 Dan: Use this to regenerate the HyphenAwareStandardTokenizerImpl which is in fact a StandardTokenizer, but deals with words with hyphens.
 Example for Lucene 4.7.2
 
 1. Get the lucene-4.7.2-src.tgz from http://archive.apache.org/dist/lucene/java/4.7.2/
 2. Get the contents of the StandardTokenizer.jflex from one of the following locations: 
 
======================
Location 1
====================== 
 
             lucene-4.7.2-src.tgz.gz\lucene-4.7.2-src.tgz\lucene-4.7.2\analysis\common\src\java\org\apache\lucene\analysis\standard\
    
======================
Location 2
====================== 

If the jflex file is not present in the source archive, try on github:

https://github.com/apache/lucene-solr/blob/master/lucene/core/src/java/org/apache/lucene/analysis/standard/StandardTokenizerImpl.jflex

   make sure you take the branch corresponding to the version you are integrating.
   
   
  2.1 paste its content in HyphenAwareStandardTokenizerImpl.jflex. 
      Rename the compilation unit.
      and copy it in the same package.
    
 3. Get the contents of the UnicodeEmojiProperties.jflex file from one of the following locations
 
======================
Location 1
======================
 
 The source archive, same as on step 1
 
======================
Location 2
======================
 
 From github:
 
 		 https://github.com/apache/lucene-solr/tree/master/lucene/core/src/data/jflex/UnicodeEmojiProperties.jflex
 		 
 3.1 Rename it in UnicodeEmojiProperties.jflex-macro
 3.2 Search for  "UnicodeEmojiProperties" inside HyphenAwareStandardTokenizerImpl.jflex and rename the include to:
 
 				%include UnicodeEmojiProperties.jflex-macro
 				
 				
 4.Get lucene-8.4.1-src\lucene-8.4.1\core\src\data\jflex\skeleton.disable.buffer.expansion.txt
   and replace the one from package ro\sync\textsearch\analyzer

 5. Apply the patches: EXM-26847, in the HyphenAwareStandardTokenizerImpl.jflex
    Line: 
    
    MidLetterEx         = [\p{WB:MidLetter}\p{WB:MidNumLet}\p{WB:SingleQuote}]      {ExtFmtZwj}
    
    Gets modified into:
    
    MidLetterEx         = [\u002D\p{WB:MidLetter}\p{WB:MidNumLet}\p{WB:SingleQuote}]      {ExtFmtZwj}
    
    
 6. Check \lucene-8.4.1-src\lucene-8.4.1\core\build.xml and lucene-8.4.1-src\lucene-8.4.1\common-build.xml
    to see how they invoke JFLEx, what parameters, options they use.
 
 7. Make sure you update in the POM xml the jflex plugin to the version used also by the Lucene team to generate the file:
 		org.apache.lucene.analysis.standard.StandardTokenizerImpl, from the standard Lucene distribution - it is the first line from the file. 		
 8. Regenerate the Java files, you can use "maven generate-sources", and commit it. This phase is also run when you invoke "maven install". 
    
