class Rouge::Lexer

@abstract A lexer transforms text into a stream of ‘[token, chunk]` pairs.