- Introduction
- The description
- 1. Overview
- 2. Definitions
- 3. Grammars
- 4. Before tokenising
- 5. Tokenising
- 5.1. Fine-grained tokens
- 5.2. Token nonterminals
- 5.3. Whitespace and comment tokens
- 5.4. String and byte literal tokens
- 5.4.1. Escape processing
- 5.5. Numeric literal tokens
- 5.6. Identifier-like tokens
- 5.7. Punctuation tokens
- 6. Lowering doc-comments
- Appendices
- 7. Frontmatter grammar
- 8. Complete tokenisation grammar
- 9. Parsing Expression Grammars
- 10. Reimplementation CLI
- Discussion
- 11. Rationale for this model
- 12. Grammar for raw string literals
- 13. Open questions
- 14. Rustc oddities