dmd.lexer

class Lexer;

this(const(char)* filename, const(char)* base, size_t begoffset, size_t endoffset, bool doDocComment, bool commentToken, DiagnosticReporter diagnosticReporter);

Creates a Lexer for the source code base[begoffset..endoffset+1]. The last character, base[endoffset], must be null (0) or EOF (0x1A).

Parameters:

const(char)* filename	used for error messages
const(char)* base	source code, must be terminated by a null (0) or EOF (0x1A) character
size_t begoffset	starting offset into base[]
size_t endoffset	the last offset to read into base[]
bool doDocComment	handle documentation comments
bool commentToken	comments become TOK.comment's
DiagnosticReporter diagnosticReporter	the diagnostic reporter to use

final bool errors();

Returns:

true if any errors occurred during lexing or parsing.

pure nothrow @safe Token* allocateToken();

Returns:

a newly allocated Token.

final TOK peekNext();

Look ahead at next token's value.

final TOK peekNext2();

Look 2 tokens ahead at value.

final void scan(Token* t);

Turn next token in buffer into a token.

final Token* peekPastParen(Token* tk);

tk is on the opening (. Look ahead and return token that is past the closing ).

static const(char)* combineComments(const(char)* c1, const(char)* c2, bool newParagraph);

Combine two document comments into one, separated by an extra newline if newParagraph is true.