tok.h file | source file

This header defines some macros for the standard tokenizer class.

Summary of Classes

(none)

Summary of Global Functions

(none)

Summary of Macros

`getTokOrig getTokType getTokVal tokRuleName tokRulePat tokRuleTest tokRuleType tokRuleVal`

Summary of Enums

(none)

Summary of Templates

(none)

Global Functions

(none)

Macros

`getTokOrig (tok)` | `tok.h[40]`

`((tok)[3])`
Get the token's original text. This is the original text matched from the tokenized string.

`getTokType (tok)` | `tok.h[34]`

`((tok)[2])`
Get the token type. This is a token enum value describing the type of the token.

`getTokVal (tok)` | `tok.h[28]`

`((tok)[1])`
Get the token value. This is the parsed representation of the token; in most cases, this is simply the text of the original token, although it might be converted in some way (words are usually converted to lower-case, for example).

`tokRuleName (rule)` | `tok.h[48]`

`(rule[1])`
Some internal convenience macros. (These are meant for internal use within the tokenizer class, rather than for client code, but we define them here because they're also useful for subclasses of the standard tokenizer.)

`tokRulePat (rule)` | `tok.h[49]`

`(rule[2])`
no description available

`tokRuleTest (rule)` | `tok.h[52]`

`(rule[5])`
no description available

`tokRuleType (rule)` | `tok.h[50]`

`(rule[3])`
no description available

`tokRuleVal (rule)` | `tok.h[51]`

`(rule[4])`
no description available

Enums

(none)

Templates

(none)

Adv3Lite Library Reference Manual
Generated on 08/12/2025 from adv3Lite version 2.2.2