@wdprlib/render
Preparing search index...
libs/highlighter/engine/tokenizer
tokenize
Function tokenize
tokenize
(
def
:
LanguageDefinition
,
input
:
string
)
:
HighlightToken
[]
Tokenize source code using a language definition's state machine.
Parameters
def
:
LanguageDefinition
input
:
string
Returns
HighlightToken
[]
Package
Version
Settings
Member Visibility
Protected
Inherited
External
Theme
OS
Light
Dark
@wdprlib/render
Loading...
Tokenize source code using a language definition's state machine.