Results 1 to 3 of 3
  1. #1
    sadronmeldir is offline Member
    Join Date
    Oct 2009
    Posts
    2
    Rep Power
    0

    Default Large Scale Search

    Hello,

    I'm currently working on a program in an effort to expand my skill set, but I'm having a bit of a trouble getting pointed in the right direction.

    I have about ten million sets of information, each representing a single line of conversation and storing such information as the user, the message text, a timestamp and so on. I am trying to find an efficient way to search through this data efficiently without exceeding the available memory.

    The process has to be portable, so that I can easily wrap the whole program up in an installer and send it to others with relative ease.

    I'm not looking for people to provide the code, but some clues would be appreciates. How best do I store millions of objects in a single collection or database? Which approaches or libraries should I use for applying efficient, complex searches to the entire 10 million sets?

    I've posted this question on a few other sites because I'm new to the Java forums and I don't know which ones are more helpful, but if my question is answered elsewhere, I'll be sure to link it here.

    Any advice at all would be appreciated. Thanks!
    Last edited by sadronmeldir; 10-06-2009 at 08:49 AM.

  2. #2
    pbrockway2 is offline Moderator
    Join Date
    Feb 2009
    Location
    New Zealand
    Posts
    4,573
    Rep Power
    12

    Default

    Also posted at Sun forums.

  3. #3
    sadronmeldir is offline Member
    Join Date
    Oct 2009
    Posts
    2
    Rep Power
    0

    Default

    Apologies! I'm new and didn't know that was taboo.

    As you can plainly see, I'm someone with little forum experience. I posted on multiple sites because I did not know it was frowned upon, and since I genuinely need I wanted to reach a helpful, understanding audience who'd be patient with new forum members as they learn the ropes.

    I really do need help with this problem, and I hope the community can offer advice with the same devotion they have to forum etiquette.

    To simplify things, please post responses on the Sun Forums
    Last edited by sadronmeldir; 10-06-2009 at 09:15 AM.

Similar Threads

  1. The scale() method
    By IamKira in forum Java 2D
    Replies: 0
    Last Post: 07-15-2009, 04:49 PM
  2. Replies: 5
    Last Post: 08-26-2008, 04:43 PM
  3. How to use Scale in SWT
    By Java Tip in forum SWT Tips
    Replies: 0
    Last Post: 07-07-2008, 05:49 PM
  4. Transform Scale
    By Java Tip in forum java.awt
    Replies: 0
    Last Post: 06-21-2008, 09:53 PM
  5. Scale 2 or more pictures using a JSlider
    By Panchitopro in forum AWT / Swing
    Replies: 4
    Last Post: 05-20-2008, 05:44 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •