lexical token (Q5881): Difference between revisions
Jump to navigation
Jump to search
Created a new Item: lexical token, in lexical analysis, atomic string with an assigned and thus identified meaning; can be either word, bi-gram or sentence |
Created claim: subclass of (P1): symbol (Q538) |
||
| (One intermediate revision by the same user not shown) | |||
| Property / subclass of | |||
| Property / subclass of: string / rank | |||
Normal rank | |||
| Property / subclass of | |||
| Property / subclass of: symbol / rank | |||
Normal rank | |||
Latest revision as of 17:44, 26 March 2023
in lexical analysis, atomic string with an assigned and thus identified meaning; can be either word, bi-gram or sentence
- token
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | lexical token |
in lexical analysis, atomic string with an assigned and thus identified meaning; can be either word, bi-gram or sentence |
|