1. Introduction
3. The description
4. 1. Overview
5. 2. Definitions
6. 3. Before tokenising
7. 4. Tokenising
8. 1. 4.1. Pretokens
   2. 4.2. Pretokenising
   3. 1. 4.2.1. Common definitions
      2. 4.2.2. Whitespace and comment pretokens
      3. 4.2.3. String and byte literal pretokens
      4. 4.2.4. Numeric literal pretokens
      5. 4.2.5. Identifier pretokens
      6. 4.2.6. Punctuation pretokens
   4. 4.3. Fine-grained tokens
   5. 4.4. Reprocessing
   6. 1. 4.4.1. Escape processing
      2. 4.4.2. List of reprocessing cases
9. 5. Lowering doc-comments
11. Appendices
12. 6. Parsing Expression Grammar notation
13. 7. Complete pretokenisation grammar
15. Discussion
16. 8. Rationale for this model
17. 9. Grammar for raw string literals
18. 10. Open questions
19. 11. Rustc oddities