I can not understand where I was wrong. My code, where "/ home/test/03m8894---20070213134234.txt" - file with the English text, and "/ home/test/01---20061121103506.txt" - file with the Russian text. Both files are encoded in UTF-8. The result of the execution of the program: 1 0 Ie the program finds only text in English and Russian text ignored. Although if you do
Java Code:
 for (int m = 0; m <totalDocs; m + +) {               
Document thisDoc = reader.document (m);              
System.out.print (thisDoc.get ("partnum"));
the text field partnum correctly, no errors in the output encoding on the screen.
Java Code:
RAMDirectory directory = new RAMDirectory();
IndexWriter writer =                 
//new IndexWriter(directory, new SimpleAnalyzer(), true, IndexWriter.MaxFieldLength.UNLIMITED);                 
new IndexWriter(directory, new RussianAnalyzer(Version.LUCENE_30), true, IndexWriter.MaxFieldLength.UNLIMITED);         
File f1[] = {new File("/home/test/03m8894---20070213134234.txt"), new File("/home/test/01---20061121103506.txt")};          
String strLine1 = "";         
for (int x = 0; x < f1.length; x++) {             
Document doc = new Document();             
int length = (int) f1[x].length();             
if (length != 0) {                 
char[] cbuf = new char[length];                 
InputStreamReader isr = new InputStreamReader(new FileInputStream(f1[x]));                 
final int read = isr.read(cbuf);                 
strLine1 = new String(cbuf, 0, read);                 
doc.add(new Field("partnum", strLine1, Field.Store.YES, Field.Index.NOT_ANALYZED));                 
//doc.add(new Field("description", "Illidium Space Modulator", Field.Store.YES, Field.Index.ANALYZED));                 
IndexSearcher searcher = new IndexSearcher(directory);
IndexReader reader = searcher.getIndexReader();         
int totalDocs = reader.numDocs();            
for (int m = 0; m < totalDocs; m++) {             
 Document thisDoc = reader.document(m);       
String tmp_str=thisDoc.get("partnum");       
Query query = new TermQuery(new Term("partnum", tmp_str));       

TopDocs rs = searcher.search(query, null, 10);