Common Lisp Package: LEXER

README:

FUNCTION

Private

Undocumented

COMBINE-PATTERNS (PATS)

EXPAND-TOKENIZE (STR POS RULES &AUX (STRVAR (GENSYM)) (MATCHEDP (GENSYM)))

EXPAND-TOKENIZE-RULES (STR POS MATCHEDP RULES)

EXTRACT-PATTERNS-AND-ACTIONS (RULES &AUX PATTERNS ACTIONS)

MAKE-LEXER-ACTIONS (ACTIONS)

MACRO

Public

DEFLEXER (NAME &REST RULES)

Create a lexical analyser. This analyser function takes a string :position, :end, :end-token and :end-value keyword parameters, and returns a function of no arguments that returns the next token and value each time it is called, or (values end-token end-value) when the input string is exhausted. By default, position = 0, end = length of str, and end-token and end-value = nil.

Undocumented

TOKENIZE (STR POS-VAR &REST RULES)

GENERIC-FUNCTION

Public

Undocumented

INT (X)

NUM (X)