Skip to content

Stop creating tokens in parser - #828

Merged
yui-knk merged 1 commit into
ruby:masterfrom
yui-knk:codex/keep-string-token-from-lexer
Oct 26, 2026
Merged

yui-knk merged 1 commit into
ruby:masterfrom
yui-knk:codex/keep-string-token-from-lexer

Conversation

@yui-knk

@yui-knk yui-knk commented Oct 26, 2026

Copy link
Copy Markdown
Collaborator

Keep STRING tokens emitted by the lexer instead of converting them to Ident tokens in the parser.

Racc propagates the STRING value by default, and downstream grammar handling only requires the common token interface.

Keep STRING tokens emitted by the lexer instead of converting them to
Ident tokens in the parser.

Racc propagates the STRING value by default, and downstream grammar
handling only requires the common token interface.
@yui-knk
yui-knk merged commit 639b440 into ruby:master Oct 26, 2026
23 checks passed
@yui-knk
yui-knk deleted the codex/keep-string-token-from-lexer branch October 26, 2026 02:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant