1. Introduction
3. The description
4. 1. Overview
5. 2. Definitions
6. 3. Before tokenising
7. 4. Tokenising
8. 1. 4.1. Pretokens
   2. 4.2. Pretokenising
   3. 1. 4.2.1. Common definitions
      2. 4.2.2. Whitespace and comment pretokens
      3. 4.2.3. String and byte literal pretokens
      4. 4.2.4. Numeric literal pretokens
      5. 4.2.5. Identifier pretokens
      6. 4.2.6. Punctuation pretokens
   4. 4.3. Fine-grained tokens
   5. 4.4. Reprocessing
   6. 1. 4.4.1. Escape processing
      2. 4.4.2. List of reprocessing cases
10. Appendices
11. 5. Parsing Expression Grammar notation
12. 6. Complete pretokenisation grammar
14. Discussion
15. 7. Rationale for this model
16. 8. Grammar for raw string literals
17. 9. Open questions
18. 10. Rustc oddities