[SOLVED] Parallel/Asynchronous Faster indexing way on lucene

[priyanka.dandekar]

Hi, we are trying to create a huge index using lucene apis and looking for some way to do faster indexing.

Are there any frameworks or tools available which can leverage lucene and do faster index writing.

We are looking for something which can do parallel threading based indexing from database, any help would be appreciated.

____________________________________________
Priya,
Cooking is Fun | Eat Healthy Stay Fit | Sweets | Raita | Bread | Dal

[kzvi.kzvi.1]

A thread based implementation of Lucene IndexWriter can be found at

Lucene Asynchronous IndexWriter

This utilizes the Java 1.5 ArrayBlockingQueue for storing the documents.

A multithreaded data reader can add documents to this queue and a single writing thread can keep writing into index in a separate thread.

____________________________________________
Software Wiki | Interview FAQs | Lucene Search | Oracle | ORM | Struts2 | Job Seeker

[priyanka.dandekar]

Thanks, this is what we were looking for. We will do some more changes to it and use.

____________________________________________
Priya,
Cooking is Fun | Eat Healthy Stay Fit | Sweets | Raita | Bread | Dal