Tokenizer

////////////////////////////////////////////////////////////////////

Constructors

this this(string txt): Undocumented in source.

Members

Functions

checkChar int checkChar(): Undocumented in source. Be warned that the author may not have intended to support it.
checkNextChar int checkNextChar(): Undocumented in source. Be warned that the author may not have intended to support it.
contNextChar int contNextChar(Token tok): Undocumented in source. Be warned that the author may not have intended to support it.
eof bool eof(): Undocumented in source. Be warned that the author may not have intended to support it.
eof bool eof(int n): Undocumented in source. Be warned that the author may not have intended to support it.
handleBackSlash bool handleBackSlash(): Undocumented in source. Be warned that the author may not have intended to support it.
incPos void incPos(): Undocumented in source. Be warned that the author may not have intended to support it.
isNewline bool isNewline(): Undocumented in source. Be warned that the author may not have intended to support it.
next bool next(Token tok): Undocumented in source. Be warned that the author may not have intended to support it.
nextChar bool nextChar(): Undocumented in source. Be warned that the author may not have intended to support it.
popText bool popText(): Undocumented in source. Be warned that the author may not have intended to support it.
pushText void pushText(string txt): Undocumented in source. Be warned that the author may not have intended to support it.
reinit void reinit(): Undocumented in source. Be warned that the author may not have intended to support it.
skipAlnum bool skipAlnum(): Undocumented in source. Be warned that the author may not have intended to support it.
skipComment void skipComment(): Undocumented in source. Be warned that the author may not have intended to support it.
skipIdent bool skipIdent(): Undocumented in source. Be warned that the author may not have intended to support it.
skipLine void skipLine(): Undocumented in source. Be warned that the author may not have intended to support it.
skipNumber bool skipNumber(): Undocumented in source. Be warned that the author may not have intended to support it.
skipSpace int skipSpace(): Undocumented in source. Be warned that the author may not have intended to support it.
skipString bool skipString(): Undocumented in source. Be warned that the author may not have intended to support it.

Static functions

identifierToKeyword int identifierToKeyword(string ident): Undocumented in source. Be warned that the author may not have intended to support it.

Static variables

ppOnly bool ppOnly;: Undocumented in source.

Variables

countTokens int countTokens;: Undocumented in source.
curText string curText;: Undocumented in source.
enableASMComment bool enableASMComment;: Undocumented in source.
keepBackSlashAtEOL bool keepBackSlashAtEOL;: Undocumented in source.
lastCharWasNewline bool lastCharWasNewline;: Undocumented in source.
lastIndent string lastIndent;: Undocumented in source.
lineno int lineno;: Undocumented in source.
pos uint pos;: Undocumented in source.
posstack int[] posstack;: Undocumented in source.
skipNewline bool skipNewline;: Undocumented in source.
text string text;: Undocumented in source.
txtstack string[] txtstack;: Undocumented in source.

Tokenizer

Constructors

Members

Functions

Static functions

Static variables

Variables

Meta

Source