Adds the token specified to the current linked list of tokens.
Enters a new lexical state
Returns the length of the matched text region.
Resumes scanning until the next regular expression is matched, the end of input
is encountered or an
Resets the scanner to read from a new input stream. Does not close the old
reader. All internal vari
Refills the input buffer.
Reports an error that occured while scanning. In a wellformed scanner (no or
only correct usage of y