Printable View
Hello everyone,
I am trying to develop a crawler for a website (nextag.com), the idea is to take the search query and pass it on to nextag and then get the results of the website in an array.
I am not sure even on how to get started, I tried reading tutorials but they were not much of a help for this particular problem. Any help will be greatly appreciated.
Thanks
Basically are you want to develop a search engine for your web site, is it?
In a manner, yes.
The website has its own search feature, however, I want that the user should pass the query through the program I have developed. I should be able to get total number of results and page-wise results in an array.
So suppose user passes the parameter "mobile phone, 2" then I should be able to list the results given by NexTag.com for "mobile phone" on page number #2 of the results page.
Is anybody coming to my rescue?
How about the following resources. I've customize few of them used several times. May those things not exactly what you want, but it's possible to modified them.
Open Source Search Engines in Java