lexical token (Q5881): Difference between revisions
Jump to navigation
Jump to search
Created a new Item: lexical token, in lexical analysis, atomic string with an assigned and thus identified meaning; can be either word, bi-gram or sentence |
(No difference)
|
Revision as of 17:44, 26 March 2023
in lexical analysis, atomic string with an assigned and thus identified meaning; can be either word, bi-gram or sentence
- token
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | lexical token |
in lexical analysis, atomic string with an assigned and thus identified meaning; can be either word, bi-gram or sentence |
|