I am making a web crawler for extracting all the information event based information. It happens like I might make more than 1000 connections in 5-7 mins. Some times I get this exception java.net.SocketTimeoutException: Read timed and sometimes it works fine. Now I know this exception occurs when there is no response from the server(url). Is there a solution to it.