Staging
v0.5.1
v0.5.1
https://github.com/python/cpython
Revision e57e50c8e77bc64e1ebab7a9ddf6f13fc3440c48 authored by Ezio Melotti on 05 June 2010, 17:51:07 UTC, committed by Ezio Melotti on 05 June 2010, 17:51:07 UTC
1) #8271: when a byte sequence is invalid, only the start byte and all the valid continuation bytes are now replaced by U+FFFD, instead of replacing the number of bytes specified by the start byte. See http://www.unicode.org/versions/Unicode5.2.0/ch03.pdf (pages 94-95); 2) 5- and 6-bytes-long UTF-8 sequences are now considered invalid (no changes in behavior); 3) Add code and tests to reject surrogates (U+D800-U+DFFF) as defined in RFC 3629, but leave it commented out since it's not backward compatible; 4) Change the error messages "unexpected code byte" to "invalid start byte" and "invalid data" to "invalid continuation byte"; 5) Add an extensive set of tests in test_unicode; 6) Fix test_codeccallbacks because it was failing after this change.
1 parent 3b818bf
Tip revision: e57e50c8e77bc64e1ebab7a9ddf6f13fc3440c48 authored by Ezio Melotti on 05 June 2010, 17:51:07 UTC
Update PyUnicode_DecodeUTF8 from RFC 2279 to RFC 3629.
Update PyUnicode_DecodeUTF8 from RFC 2279 to RFC 3629.
Tip revision: e57e50c
| File | Mode | Size |
|---|---|---|
| RPM | ||
| TextMate | ||
| Vim | ||
| ACKS | -rw-r--r-- | 12.4 KB |
| AIX-NOTES | -rw-r--r-- | 8.0 KB |
| BeOS-NOTES | -rw-r--r-- | 1.4 KB |
| BeOS-setup.py | -rw-r--r-- | 23.1 KB |
| HISTORY | -rw-r--r-- | 669.3 KB |
| NEWS | -rw-r--r-- | 225.1 KB |
| NEWS.help | -rw-r--r-- | 2.5 KB |
| PURIFY.README | -rw-r--r-- | 4.4 KB |
| Porting | -rw-r--r-- | 1.9 KB |
| README | -rw-r--r-- | 1.9 KB |
| README.OpenBSD | -rw-r--r-- | 1.5 KB |
| README.coverity | -rw-r--r-- | 845 bytes |
| README.klocwork | -rw-r--r-- | 1.2 KB |
| README.valgrind | -rw-r--r-- | 4.3 KB |
| RFD | -rw-r--r-- | 3.9 KB |
| SpecialBuilds.txt | -rw-r--r-- | 11.9 KB |
| build.sh | -rwxr-xr-x | 9.4 KB |
| cheatsheet | -rw-r--r-- | 103.6 KB |
| developers.txt | -rw-r--r-- | 10.8 KB |
| gdbinit | -rw-r--r-- | 4.5 KB |
| indent.pro | -rw-r--r-- | 66 bytes |
| pymemcompat.h | -rw-r--r-- | 3.1 KB |
| python-config.in | -rw-r--r-- | 1.6 KB |
| python-mode.el | -rw-r--r-- | 143.5 KB |
| python-wing.wpr | -rw-r--r-- | 537 bytes |
| python.man | -rw-r--r-- | 12.7 KB |
| python.pc.in | -rw-r--r-- | 253 bytes |
| setuid-prog.c | -rw-r--r-- | 5.6 KB |
| valgrind-python.supp | -rw-r--r-- | 6.7 KB |
| vgrindefs | -rw-r--r-- | 505 bytes |
Computing file changes ...
