Package-level declarations
Types
A token recognizer made for recognizing a ClosedRange of characters.
Indicates that the state should be changed to the default state
Indicates that the state should be changed to the state with stateLabel as its label.
Indicates that the match was successful, but no token should be created for this match.
Indicates that the match was successful and a token was created.
Subclasses of this class represent the different possible outputs for matchers.
Subclasses of this class represent a kind of behavior that can be followed when deciding whether to change state or not, usually after a successful match.
Indicates that the match was not successful, that there was no match.
Indicates that the state should not be changed
A TokenRecognizer for Patterns.
A recognizer that, using another "base" recognizer, will recognize a repetition of the other recognizer.
Implementation of a TokenRecognizer that attempts to recognize a given string exactly. It will return a pair with the matched string and the ending index (exclusive) if recognized.
A StringSetTokenRecognizer is a TokenRecognizer specifically built to be able to recognize whether a substring of the input matches at a relatively high speed. The speed improvements are mostly noticeable when the input consists of strings of characters of the same length.
A token matcher is an object that can determine whether a string at a given offset matches some pattern. The matcher then returns a corresponding token or null if no match is found.
A token recognizer has the ability to detect a pattern within a string (the exact pattern being entirely up to the recognizer) and then returns the matched pattern as well as the ending index (that is, the index of the last matched character + 1, this is considered to be an exclusive index).
A type of matcher that ignores anything that matches the recognizer and provides no result otherwise.
This class can be used to associate a TokenRecognizer with a token type, forming a complete TokenMatcher
Properties
Functions
Create a recognizer that recognizes any of the strings provided as parameters.
Create a recognizer that recognizes the given regular expression. Use this before isToken to create a matcher that matches against a regular expression.
Universal function to turn an object into a recognizer. This function returns a token recognizer.