Andrew Kelley 24c432608f stage2: improve compile errors from tokenizer
In order to not regress the quality of compile errors, some improvements
had to be made.

 * std.zig.parseCharLiteral is improved to return more detailed parse
   failure information.
 * tokenizer is improved to handle null bytes in the middle of strings,
   character literals, and line comments.
 * validating how many unicode escape digits in string literals is moved
   to std.zig.parseStringLiteral rather than handled in the tokenizer.
 * when a tokenizer error occurs, if the reported token is the 'invalid'
   tag, an error note is added to point to the invalid byte location.
   Further improvements would be:
   - Mention the expected set of allowed bytes at this location.
   - Display the invalid byte (if printable, print it, otherwise
     escape-print it).
2021-07-02 13:27:35 -07:00
..
2021-06-21 17:03:03 -07:00
2021-06-21 17:03:03 -07:00
2021-06-21 17:03:03 -07:00
2021-06-21 17:03:03 -07:00
2021-06-21 17:03:03 -07:00
2021-05-08 15:15:30 +03:00
2021-06-17 16:37:38 -04:00
2020-12-31 15:45:24 -08:00
2020-12-31 15:45:24 -08:00
2021-06-21 17:03:03 -07:00
2021-06-16 14:46:25 -04:00
2021-05-08 15:15:30 +03:00
2020-12-31 15:45:24 -08:00
2021-06-21 17:03:03 -07:00
2021-06-21 17:03:03 -07:00
2020-12-31 15:45:24 -08:00
2021-05-08 15:15:30 +03:00
2021-06-27 12:54:31 +03:00
2020-12-31 15:45:24 -08:00
2021-06-21 17:03:03 -07:00
2021-06-21 17:03:03 -07:00
2021-06-10 20:13:43 -07:00
2021-06-21 17:03:03 -07:00
2021-06-21 17:03:03 -07:00
2021-06-21 17:03:03 -07:00
2021-06-21 17:03:03 -07:00
2021-06-21 17:03:03 -07:00
2021-06-21 17:03:03 -07:00
2021-06-30 18:39:04 -07:00
2021-05-08 15:15:30 +03:00
2021-05-08 15:15:30 +03:00