Shared Internet Router Problem

I've seen this problem writen a couple of times on here, but I haven't seen any answer to fix my problem. I have a Linksys DSL/Cable 8-port Router. There are 7 computers hooked up currently. I have a fast cable internet provider. All of the computers are running windows XP.

Now it seems that when browsing the internet the web pages can only load one at a time. For example, say two computers('A' and 'B') are loading up web pages, well computer 'A' will have to wait for computer 'B' to completely finish the page before computer 'A' can load up a web page. Also, one computer can't load up two web pages at the same time. It's like every computer is taking turns when to use the router.

I know that doesn't seem like a big problem, but when 7 computers are constantly on the internet, it gets a little frustrating waiting. So I don't know if this could be a hardware problem, or a problem on the router setup page. If anyone has any solutions or help, that would be great. Thanks.

What model is the router? More importantly is the unit a router with an 8 port hub or a router with an 8 port switch?

It's a linksys 8-port Dsl/Cable Router BEFSR81-CA. It's with a switch not a hub.

I can't think of anything that could cause the symptoms you describe.
What are the exact TCP/IP configurations for the PCs and the router?