Hi Guys,
I am searching for an implementation of StringTokenizer like thing in Lucene. The problem is I am storing a string in index which has multiple values sperated by a seperator. For e.g "@@@Hello@@@World@@@....". The seperator here is @@@.
Now I want Lucene to Search the words like Hello or World within this String. With the standard analyzer, I guess its not possible. So i need a Custom Analyzer or Tokenizer like StringTokenizer of java which will split the String into tokens using the given seperator. This will effectively allow Lucene to match the tokens "Hello" or "World" when we search for them.
Please let me know any approach for the same.

Thanks
JP