Results 1 to 3 of 3
  1. #1
    Join Date
    Oct 2008
    Posts
    68
    Rep Power
    0

    Thumbs up [SOLVED] Parallel/Asynchronous Faster indexing way on lucene

    Hi, we are trying to create a huge index using lucene apis and looking for some way to do faster indexing.

    Are there any frameworks or tools available which can leverage lucene and do faster index writing.

    We are looking for something which can do parallel threading based indexing from database, any help would be appreciated.

    ____________________________________________
    Priya,
    Cooking is Fun | Eat Healthy Stay Fit | Sweets | Raita | Bread | Dal

  2. #2
    kzvi.kzvi.1 is offline Member
    Join Date
    Oct 2008
    Location
    US
    Posts
    58
    Rep Power
    0

    Default

    A thread based implementation of Lucene IndexWriter can be found at

    Lucene Asynchronous IndexWriter

    This utilizes the Java 1.5 ArrayBlockingQueue for storing the documents.

    A multithreaded data reader can add documents to this queue and a single writing thread can keep writing into index in a separate thread.

    ____________________________________________
    Software Wiki | Interview FAQs | Lucene Search | Oracle | ORM | Struts2 | Job Seeker
    Have fun....
    JAVA FAQs

  3. #3
    Join Date
    Oct 2008
    Posts
    68
    Rep Power
    0

    Default

    Thanks, this is what we were looking for. We will do some more changes to it and use.

    ____________________________________________
    Priya,
    Cooking is Fun | Eat Healthy Stay Fit | Sweets | Raita | Bread | Dal

Similar Threads

  1. Lucene indexing ans searching code needed
    By vgarg80 in forum JavaServer Pages (JSP) and JSTL
    Replies: 0
    Last Post: 06-07-2008, 11:31 AM
  2. Lucene Re-Indexing
    By connect2srinath in forum Lucene
    Replies: 1
    Last Post: 05-11-2008, 05:35 PM
  3. Indexing starting with 1
    By ravian in forum New To Java
    Replies: 4
    Last Post: 01-04-2008, 12:03 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •