Lucene highlighter returns null fragments always

[zee]

Hey folks,
I was trying to implement highlighter in my search results on my search engine. I was able to create the index and successfully search the index but i was not able to implement highlighting chunks in the search result. Im using lucene version 2.92 and highlighter package version 2.92.
The code below returns null fragments always..not able to figure out y

IndexSearcher is = new IndexSearcher("luceneIndex");
Analyzer analyzer = new StandardAnalyzer();
QueryParser parser = new QueryParser("content", analyzer);
Query query = parser.parse("audit");
Hits hits = is.search(query);
IndexReader indexReader=IndexReader.open("luceneIndex");

QueryScorer scorer=new QueryScorer(query,indexReader,"storage");
Highlighter highlighter=new Highlighter(scorer);


for (int i=0; i<hits.length(); i++) {
Document doc = hits.doc(i);

int id = hits.id(i);

String text=doc.get("storage");


TokenStream tokenStream = analyzer.tokenStream("storage", new StringReader(text));


String fragments = highlighter.getBestFragment(tokenStream, text);



System.out.println((i + 1) + ". " + doc.get("path"));
}
is.close();

Thanks in advance

[looserdgr8]

I have used lucene-highlighter-3.01.jar file.

The code is

//here text is the search result text where the highlighter will be implemented
public String highlightText(String text, Query luceneQuery){
        String fragments;
        fragments= "";
        try {
             //here simpleHTMLFormatter highlights the query words in bold and italic
            SimpleHTMLFormatter formatter = new SimpleHTMLFormatter("<b><i>", "</i></b>");
            
            QueryScorer scorer = new QueryScorer(luceneQuery);
            Highlighter lighter = new Highlighter(formatter, scorer);
            Fragmenter fragmenter = new SimpleFragmenter(40);  //40 means every fragments length will be 40
            lighter.setTextFragmenter(fragmenter);
            TokenStream stream = new WhitespaceAnalyzer().tokenStream(null, new StringReader(text));
            fragments = lighter.getBestFragments(stream, text, 6, ".....");  //maximum 6 fragments....can be less then 6
            System.out.println("Fragments= " + fragments);   //we should display the fragments
        } catch (IOException ex) {
            ex.printStackTrace();
        } catch (InvalidTokenOffsetsException ex) {
            ex.printStackTrace();
        }
        return fragments;
    }