PyPy v7.3.8: release of python 2.7, 3.7, 3.8, and 3.9-beta¶
The PyPy team is proud to release version 7.3.8 of PyPy. It has been only a few months since our last release, but we have some nice speedups and bugfixes we wish to share. The release includes four different interpreters:
- PyPy2.7, which is an interpreter supporting the syntax and the features of Python 2.7 including the stdlib for CPython 2.7.18+ (the
+
is for backported security updates)- PyPy3.7, which is an interpreter supporting the syntax and the features of Python 3.7, including the stdlib for CPython 3.7.12. This will be the last release of PyPy3.7.
- PyPy3.8, which is an interpreter supporting the syntax and the features of Python 3.8, including the stdlib for CPython 3.8.12. This is our third release of this interpreter, and we are removing the “beta” tag.
- PyPy3.9, which is an interpreter supporting the syntax and the features of Python 3.9, including the stdlib for CPython 3.9.10. As this is our first release of this interpreter, we relate to this as “beta” quality. We welcome testing of this version, if you discover incompatibilities, please report them so we can gain confidence in the version.
The interpreters are based on much the same codebase, thus the multiple release. This is a micro release, all APIs are compatible with the other 7.3 releases. Highlights of the release, since the release of 7.3.7 in late October 2021, include:
- PyPy3.9 uses an RPython version of the PEG parser which brought with it a cleanup of the lexer and parser in general
- Fixed a regression in PyPy3.8 when JITting empty list comprehensions
- Tweaked some issues around changing the file layout after packaging to make the on-disk layout of PyPy3.8 more compatible with CPython. This requires
setuptools>=58.1.0
- RPython now allows the target executable to have a
.
in its name, so PyPy3.9 will produce apypy3.9-c
andlibpypy3.9-c.so
. Changing the name of the shared object to be version-specific (it used to belibpypy3-c.so
) will allow it to live alongside other versions.- Building PyPy3.9+ accepts a
--platlibdir
argument like CPython.- Improvement in ssl’s use of CFFI buffers to speed up
recv
andrecvinto
- Update the packaged OpenSSL to 1.1.1m
We recommend updating. You can find links to download the v7.3.8 releases here:
We would like to thank our donors for the continued support of the PyPy project. If PyPy is not quite good enough for your needs, we are available for direct consulting work. If PyPy is helping you out, we would love to hear about it and encourage submissions to our blog via a pull request to https://github.com/pypy/pypy.org
We would also like to thank our contributors and encourage new people to join the project. PyPy has many layers and we need help with all of them: PyPy and RPython documentation improvements, tweaking popular modules to run on PyPy, or general help with making RPython’s JIT even better. Since the previous release, we have accepted contributions from 6 new contributors, thanks for pitching in, and welcome to the project!
If you are a python library maintainer and use C-extensions, please consider making a HPy / CFFI / cppyy version of your library that would be performant on PyPy. In any case both cibuildwheel and the multibuild system support building wheels for PyPy.
What is PyPy?¶
PyPy is a Python interpreter, a drop-in replacement for CPython 2.7, 3.7, 3.8 and 3.9. It’s fast (PyPy and CPython 3.7.4 performance comparison) due to its integrated tracing JIT compiler.
We also welcome developers of other dynamic languages to see what RPython can do for them.
This PyPy release supports:
- x86 machines on most common operating systems (Linux 32/64 bits, Mac OS X 64 bits, Windows 64 bits, OpenBSD, FreeBSD)
- 64-bit ARM machines running Linux. A shoutout to Huawei for sponsoring the VM running the tests.
- s390x running Linux
- big- and little-endian variants of PPC64 running Linux,
PyPy support Windows 32-bit, PPC64 big- and little-endian, and ARM 32 bit, but does not release binaries. Please reach out to us if you wish to sponsor releases for those platforms.
Known Issues with PyPy3.9¶
- There is still a known speed regression around
**kwargs
handling - We slightly modified the concurrent future’s
ProcessExcecutorPool
to start all the worker processes when the first task is received (like on Python3.8) to avoid an apparent race condition when usingfork
and threads (issue 3650).
Changelog¶
Python 3.7+ bugfixes¶
- Fix various problems with the Windows
_overlapped
module (issue 3589, ) - Fix error generation on
_ssl
in Windows - Properly handle
_PYTHON_SYSCONFIGDATA_NAME
when importing_sysconfigdata
- Restore broken revdb GC support
- Fix
sys.path[0]
to be''
(not the actual full path) when run interactively - Add
_socket.socket.timeout
getter - Fix overflow detection on
array.array
on windows (issue 3604) - Add a typedef for
AsyncGenValueWrapper
since you can reach it with a trace hook, leading to a segfault - Add an
index
value toiter(range()).__reduce__
for compatibility - Fix position of syntax errors raised while parsing f-string subexpressions
- Fix stack effect of
EXTENDED_ARG
- Fix incrementality in the unicode escape handler
- Like CPython, limit
pwd.getpwnam
tostr
(issue 3624) - Only use
run_fork_hooks
in_posixprocess.fork_exec
ifpreexec_fn
is used (issue 3630) - Remove redundant call to
threading._after_fork
(issue 3623) - Fix filename in exception raised sometimes when running code with
-c
- Fixes for the
signal
module on windows so thatraise_signal
will not segfault - Detail about
PYTHONIOENCODING
: if the encoding or the error is omitted, always useutf-8/strict
(instead of asking the locale) - Disallow overriding the
__context__
descriptor fromBaseException
when chaining exceptions (issue 3644) - Replace
raise ImportError
withraise ModuleNotFoundError
where appropriate in pure-python equivalents of CPython builtin modules - Add missing
rewinddir()
at the end ofos.scandir
os.dup2
now returnsfd2
- Make
__fspath__
errors compatible with CPython - Fix handling of backslash in raw unicode escape decoders that don’t start valid escape sequences (issue 3652)
- Add missing equivalent of
_Py_RestoreSignals()
call infork_exec
- Catch exceptions in
atexit
functions to avoid crashing the interpreter at shutdown - Update
fast2locals
to deal with the fact that it’s now possible to delete cell vars (was forbidden in Python2) (issue 3656) - Allow hashing memoryviews (issue 2756)
Python 3.7+ speedups and enhancements¶
- Use buffer pinning to improve CFFI-based
_ssl
performance - Add a fast path in the parser for unicode literals with no
\\
escapes - In glibc
mbstowcs()
can return values above 0x10ffff (bpo35883) - Speed up
new_interned_str
by using better caching detection - When building a class, make sure to use a specialized
moduledict
, not a regular empty dict - Implement
_opcode.stack_effect
- Share more
W_UnicodeObject
prebuilt instances, shrink the binary by over 1MB - Fix the ctypes errcheck protocol
- Various fixes in the windows-only
_overlapped
module (issue 3625) - Implement
-X utf8
- Add
WITH_DYLD
tosysconfig
for darwin
Python 3.7 C-API¶
- Added
PyDescr_NewGetSet
,PyModule_NewObject
,PyModule_ExecDef
,PyCodec_Decode
,PyCodec_Encode
,PyErr_WarnExplicit
,PyDateTime_TimeZone_UTC
,PyUnicode_DecodeLocaleAndSize
- Fix segfault when using format strings in
PyUnicode_FromFormat
andPyErr_Format
(issue 3593) _PyObject_LookupAttrId
does not raiseAttributeError
- Fix cpyext implementation of
contextvars.get
- Deprecate
PyPy.h
, mention the contents in the embedding docs (issue 3608) - Remove duplicate definition of
Py_hash_t
, document diff to CPython (issue 3612) - Fix overflow error message when converting Python
int
to Cint
- Alias
PyDateTime_DATE_GET_FOLD
, which CPython uses instead of the documentedPyDateTime_GET_FOLD
(issue 3627) - Add some
_PyHASH*
macros (issue 3590) - Fix signature of
PyUnicode_DecodeLocale
(issue 3661)
Python 3.8+ bugfixes¶
- Unwrapping an unsigned short raises
ValueError
on negative numbers - Make properties unpicklable
- When packaging, fix finding dependencies of shared objects for portable
builds and fix location of tcl/tk runtimes (issue 3616). Also ignore
__pycache__
directories. - Match CPython errors in
_io.open
andsocket.socket(fileno=fileno)
- Add
LDFLAGS
tosysconfig
values - PyPy reports the IPv6 scope ID in
getaddrinfo
where CPython does not. Fix stdlib tests to allow PyPy’s__repr__
. bpo35545 touches on this. (issue 3628) - Fix small bugs when raising errors in various stdlib modules that caused stdlib test failures
- Update bundled
setuptools
to58.1.0
to get the fix for the new PyPy layout - Fix
multiprocessing.sharedmemory
on windows (issue 3678).
Python 3.8+ speedups and enhancements¶
- Implement reversed items and values iterator pickling, fix reversed keys iterator pickling
- Add more auditing events, while skipping CPython-specific tracing and attribute-modification tracing
- Fixed a speed regression when JITting empty list comprehensions (issue 3598)
- Make sure that all bytecodes that can close a loop go via
jump_absolute
, so the JIT can trace them
Python 3.8 C-API¶
- Add
exports.h
and refactor headers to more closely follow CPython PyLong_AsLong
tries__index__
first (issue 3585)- Redo
PyTypeObject
to be able to use thetp_vectorcall
slot without changing ABI compatibility (issue 3618) by appropriating the PyPy-onlytp_pypy_flags
slot. Users should upgrade Cython to 0.2.26 to avoid a compiler warning. - Add
PyCompilerFlags.cf_feature_version
(bpo35766) - Distinguish between a C-API
CMethod
and an app-levelMethod
, which is important for obscure reasons