StringSetTokenRecognizer
A StringSetTokenRecognizer is a TokenRecognizer specifically built to be able to recognize whether a substring of the input matches at a relatively high speed. The speed improvements are mostly noticeable when the input consists of strings of characters of the same length.
Internally, this recognizer uses a map from integers (length of strings to detect) to a set of strings (the strings of said length). This allows for a fairly efficient recognizer.
These recognizers should be created using the anyOf
DSL function.