JFlex / Wiki / Home

Home

JFlex is a flex-like lexer generator for Java with emphasis on speed and full Unicode support. It has some not so usual features like negation in regexps and nested input streams. Also reads JLex specifications unchanged.

Project Members:

Sub-pages:

[ExternalJFlexGrammars]

Discussion

Bhushan - 2014-06-06

Hi,

I am trying to regenerate the tokenizer by modifying the attached ClassicTokenizerImpl.jflex file using the command mentioned below. I am using JFlex 1.5 SNAPSHOT version, command used:
Command: java -jar d:\jflex-1.5.0\lib\jflex-1.5.0.jar ClassicTokenizerImpl.jflex

I observed a noticeable difference between the generated java file and the original java file available in lucene-core-3.6.0-sources.jar file. Please find the attached file for reference.

Am I missing some command line attributes while generating the java file.

Thanks,
Bhushan

Last edit: Bhushan 2014-06-06

ClassicTokenizerImpl.java

ClassicTokenizerImpl.jflex

NewlyGeneratedClassicTokenizerImpl.java

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

Steve Rowe - 2014-06-11

Bhushan, please repost your question on the jflex-users mailing list. See http://jflex.de/mailing.html for more information.

If you would like to refer to this comment somewhere else in this project, copy and paste the following link:

JFlex Wiki

The fast lexer generator for Java

Home

Project Members:

Discussion