RegexPatternRecognizer
A TokenRecognizer for Patterns.
Patterns work as for usual regular expressions in Java with the following additional rules:
Look-behind and look-ahead can go beyond the bounds of the string that needs to be recognized. Specifically, the pattern's look-behind will correctly go "through" the previously already recognized tokens.
The bounds symbols
^
and$
match the start and end of the original string.