Interface TokenBuilder

interface TokenBuilder {
buildTokens(grammar: Grammar, options?: TokenBuilderOptions): TokenVocabulary;
flushLexingReport?(text: string): LexingReport;
}

Implemented by

DefaultTokenBuilder

Index

Methods

buildTokens flushLexingReport?

Methods

buildTokens

buildTokens(grammar, options?): TokenVocabulary
Parameters
- grammar: Grammar
- Optionaloptions: TokenBuilderOptions
Returns TokenVocabulary
- Defined in packages/langium/src/parser/token-builder.ts:22

`Optional`flushLexingReport

flushLexingReport(text): LexingReport
Produces a lexing report for the given text that was just tokenized using the tokens provided by this builder.
Parameters
- text: string
  The text that was tokenized.
Returns LexingReport
- Defined in packages/langium/src/parser/token-builder.ts:28