Cheap Router?

I recently went to the local office max and got a router for 50$. It worked fine until recently. We have 3 computers in the house. And every once in a while I will lose connection for about 10 seconds. (Enough to kick me out of my game). And the other computer will lose connection too. Then they start to work again. And it seems to happen at very odd moments. For instance. It does it when I load different areas in games. While it's loading it loses connection (sometimes). Is there some setting that I need to mess with to get rid of this for good?

 

Is this a wireless router? And if it is, exactly what type of wireless router is it?

 

Have you checked your ISP's homepage to see if they are reporting any problems?

And have you checked your DSL or Cable settings?

I doubt it would be a wireless router for $50, but I don't know the USA market.