Implement a new lexer (and split Token and related code out of experimental/ast)

Implement a new lexer (and split Token and related code out of experimental/ast) #1794