idl2d v1.0.0 (2021-10-04T13:13:33Z)
Dub
Repo
Tokenizer.contNextChar
c2d
tokenizer
Tokenizer
Undocumented in source. Be warned that the author may not have intended to support it.
class
Tokenizer
int
contNextChar
(
int
iftype
charTypes
...
)
(
Token
tok
)
Meta
Source
See Implementation
c2d
tokenizer
Tokenizer
constructors
this
functions
checkChar
checkNextChar
contNextChar
eof
handleBackSlash
incPos
isNewline
next
nextChar
popText
pushText
reinit
skipAlnum
skipComment
skipIdent
skipLine
skipNumber
skipSpace
skipString
static functions
identifierToKeyword
static variables
ppOnly
variables
countTokens
curText
enableASMComment
keepBackSlashAtEOL
lastCharWasNewline
lastIndent
lineno
pos
posstack
skipNewline
text
txtstack