More on Tokens and Finite State Automata

A finite state automaton:

A tokenizer corresponding to this FSA:

• https://github.com/UCSB-CS56-F16/lectureNotes_10.26