Take a look at this similar thread

http://www.javaprogrammingforums.com/java-networking/5302-web-crawling-too-slow.html

Can you post your code for us to look at? There are different factors...