TokenType:
| "EOF"
| "TEXT"
| "IDENTIFIER"
| "NEWLINE"
| "WHITESPACE"
| "BLOCK_OPEN"
| "BLOCK_CLOSE"
| "BLOCK_END_OPEN"
| "BOLD_MARKER"
| "ITALIC_MARKER"
| "UNDERLINE_MARKER"
| "STRIKE_MARKER"
| "SUPER_MARKER"
| "SUB_MARKER"
| "MONO_MARKER"
| "MONO_CLOSE"
| "HEADING_MARKER"
| "HR_MARKER"
| "LIST_BULLET"
| "LIST_NUMBER"
| "BLOCKQUOTE_MARKER"
| "TABLE_MARKER"
| "TABLE_HEADER"
| "TABLE_LEFT"
| "TABLE_CENTER"
| "TABLE_RIGHT"
| "CODE_OPEN"
| "CODE_CLOSE"
| "LINK_OPEN"
| "LINK_CLOSE"
| "BRACKET_OPEN"
| "BRACKET_CLOSE"
| "BRACKET_ANCHOR"
| "BRACKET_STAR"
| "PIPE"
| "EQUALS"
| "COLON"
| "SLASH"
| "STAR"
| "HASH"
| "AT"
| "AMPERSAND"
| "BACKSLASH"
| "QUOTED_STRING"
| "RAW_OPEN"
| "RAW_CLOSE"
| "RAW_BLOCK_OPEN"
| "RAW_BLOCK_CLOSE"
| "COLOR_MARKER"
| "UNDERSCORE"
| "BACKSLASH_BREAK"
| "COMMENT_OPEN"
| "COMMENT_CLOSE"
| "CLEAR_FLOAT"
| "CLEAR_FLOAT_LEFT"
| "CLEAR_FLOAT_RIGHT"
| "LEFT_DOUBLE_ANGLE"
| "RIGHT_DOUBLE_ANGLE"
Every distinct lexeme the Wikidot lexer can produce.
Each value corresponds to a fixed character sequence (or class of sequences) in Wikidot markup. The inline comments show the literal text that produces each token type.