lex

Function lex 

Source
pub fn lex(input: &str) -> Result<Vec<Token>, LexerError>
Expand description

Create a vec of Terminals from a string. Can fail, and will return an error if it does.