Interface TokenBuilder

interface TokenBuilder {
    buildTokens(
        grammar: Grammar,
        options?: TokenBuilderOptions,
    ): TokenVocabulary;
    flushLexingReport(text: string): LexingReport;
}

Implemented by

DefaultTokenBuilder

Index

Methods

buildTokens flushLexingReport?

Methods

buildTokens

buildTokens(grammar: Grammar, options?: TokenBuilderOptions): TokenVocabulary
Parameters
- grammar: Grammar
- Optionaloptions: TokenBuilderOptions
Returns TokenVocabulary
- Defined in packages/langium/src/parser/token-builder.ts:22

`Optional`flushLexingReport

flushLexingReport(text: string): LexingReport
Produces a lexing report for the given text that was just tokenized using the tokens provided by this builder.
Parameters
- text: string
  The text that was tokenized.
Returns LexingReport
- Defined in packages/langium/src/parser/token-builder.ts:28