Update pages
This commit is contained in:
+2
-2
@@ -61,7 +61,7 @@ Due to some limitations of the parser, some parsing functions take `this_arg` an
|
||||
|
||||
The lexer splits input string on set of tokens. The token structure (`./jerry-core/parser/js/lexer.h`) consists of three elements: token type, location of the token and optional data:
|
||||
|
||||
```cpp
|
||||
{% highlight cpp %}
|
||||
typedef struct
|
||||
{
|
||||
locus loc;
|
||||
@@ -69,7 +69,7 @@ typedef struct
|
||||
literal_index_t uid;
|
||||
}
|
||||
token;
|
||||
```
|
||||
{% endhighlight %}
|
||||
|
||||
Location of token (`locus`). It is just an index of first token's character at a string that represents the program. Token types are are listed in lexer.h header file (`token_type` enum). Depending on token type, token specific data (`uid` field) has the different meaning.
|
||||
|
||||
|
||||
Reference in New Issue
Block a user