bpo-34523: Py_DecodeLocale() use UTF-8 on Windows (GH-8998)
Py_DecodeLocale() and Py_EncodeLocale() now use the UTF-8 encoding on
Windows if Py_LegacyWindowsFSEncodingFlag is zero.
pymain_read_conf() now sets Py_LegacyWindowsFSEncodingFlag in its
loop, but restore its value at exit.
diff --git a/Doc/c-api/sys.rst b/Doc/c-api/sys.rst
index 994509a..0eee35a 100644
--- a/Doc/c-api/sys.rst
+++ b/Doc/c-api/sys.rst
@@ -109,6 +109,7 @@
Encoding, highest priority to lowest priority:
* ``UTF-8`` on macOS and Android;
+ * ``UTF-8`` on Windows if :c:data:`Py_LegacyWindowsFSEncodingFlag` is zero;
* ``UTF-8`` if the Python UTF-8 mode is enabled;
* ``ASCII`` if the ``LC_CTYPE`` locale is ``"C"``,
``nl_langinfo(CODESET)`` returns the ``ASCII`` encoding (or an alias),
@@ -140,6 +141,10 @@
.. versionchanged:: 3.7
The function now uses the UTF-8 encoding in the UTF-8 mode.
+ .. versionchanged:: 3.8
+ The function now uses the UTF-8 encoding on Windows if
+ :c:data:`Py_LegacyWindowsFSEncodingFlag` is zero;
+
.. c:function:: char* Py_EncodeLocale(const wchar_t *text, size_t *error_pos)
@@ -150,6 +155,7 @@
Encoding, highest priority to lowest priority:
* ``UTF-8`` on macOS and Android;
+ * ``UTF-8`` on Windows if :c:data:`Py_LegacyWindowsFSEncodingFlag` is zero;
* ``UTF-8`` if the Python UTF-8 mode is enabled;
* ``ASCII`` if the ``LC_CTYPE`` locale is ``"C"``,
``nl_langinfo(CODESET)`` returns the ``ASCII`` encoding (or an alias),
@@ -169,9 +175,6 @@
Use the :c:func:`Py_DecodeLocale` function to decode the bytes string back
to a wide character string.
- .. versionchanged:: 3.7
- The function now uses the UTF-8 encoding in the UTF-8 mode.
-
.. seealso::
The :c:func:`PyUnicode_EncodeFSDefault` and
@@ -180,7 +183,11 @@
.. versionadded:: 3.5
.. versionchanged:: 3.7
- The function now supports the UTF-8 mode.
+ The function now uses the UTF-8 encoding in the UTF-8 mode.
+
+ .. versionchanged:: 3.8
+ The function now uses the UTF-8 encoding on Windows if
+ :c:data:`Py_LegacyWindowsFSEncodingFlag` is zero;
.. _systemfunctions: