Staging
v0.5.1
v0.5.1
https://github.com/python/cpython
Revision e57e50c8e77bc64e1ebab7a9ddf6f13fc3440c48 authored by Ezio Melotti on 05 June 2010, 17:51:07 UTC, committed by Ezio Melotti on 05 June 2010, 17:51:07 UTC
1) #8271: when a byte sequence is invalid, only the start byte and all the valid continuation bytes are now replaced by U+FFFD, instead of replacing the number of bytes specified by the start byte. See http://www.unicode.org/versions/Unicode5.2.0/ch03.pdf (pages 94-95); 2) 5- and 6-bytes-long UTF-8 sequences are now considered invalid (no changes in behavior); 3) Add code and tests to reject surrogates (U+D800-U+DFFF) as defined in RFC 3629, but leave it commented out since it's not backward compatible; 4) Change the error messages "unexpected code byte" to "invalid start byte" and "invalid data" to "invalid continuation byte"; 5) Add an extensive set of tests in test_unicode; 6) Fix test_codeccallbacks because it was failing after this change.
1 parent 3b818bf
Tip revision: e57e50c8e77bc64e1ebab7a9ddf6f13fc3440c48 authored by Ezio Melotti on 05 June 2010, 17:51:07 UTC
Update PyUnicode_DecodeUTF8 from RFC 2279 to RFC 3629.
Update PyUnicode_DecodeUTF8 from RFC 2279 to RFC 3629.
Tip revision: e57e50c
File | Mode | Size |
---|---|---|
Demo | ||
Doc | ||
Grammar | ||
Include | ||
Lib | ||
Mac | ||
Misc | ||
Modules | ||
Objects | ||
PC | ||
PCbuild | ||
Parser | ||
Python | ||
RISCOS | ||
Tools | ||
.bzrignore | -rw-r--r-- | 493 bytes |
.hgignore | -rw-r--r-- | 705 bytes |
.hgtags | -rw-r--r-- | 4.0 KB |
LICENSE | -rw-r--r-- | 13.8 KB |
Makefile.pre.in | -rw-r--r-- | 39.7 KB |
README | -rw-r--r-- | 52.8 KB |
configure | -rwxr-xr-x | 393.3 KB |
configure.in | -rw-r--r-- | 122.0 KB |
install-sh | -rwxr-xr-x | 7.0 KB |
pyconfig.h.in | -rw-r--r-- | 33.2 KB |
setup.py | -rw-r--r-- | 86.5 KB |
![swh spinner](/static/img/swh-spinner.gif)
Computing file changes ...