3 ms·

Specialist – visual representations of CPython 3.11's new adaptive interpreter

106 points by gjvc 4y ago

gjvc 4y ago
full title limited by HN form. Specialist uses fine-grained location information to create visual representations of exactly where and how CPython 3.11's new specializing, adaptive interpreter optimizes your code.
- deleted 4y ago
  [deleted]
ModernMech 4y ago
Per the benchmarks thread from yesterday, I tried running the n-body simulation on 3.10 and 3.11 on Windows, with no noticeable speedup: Python 3.10 5.323s Python 3.11 5.305s Does anyone else get results like these or are you seeing a speedup? fwiw, I got these numbers under Ubuntu running on WSL: Python 3.8 4.251s Python 3.11 3.158s This is on a 11th gen Intel Core i7-11370H w/ 32GB RAM.
- __lambda__ 4y ago
  i think there won't be any speed changes for numpy operation and other few operation which were already implemented in C function.
Titan2189 4y ago
I don't understand what it does. It shows me where hot code is, but where is it being optimized? Is it changing my source file? Does it create a 'compiled/optimized' copy of my source file? Is it an alternative interpreter? I haven't tried running / using it, I've just read the pypi documentation.
- jsjohnst 4y ago
  > I don't understand what it does. It shows me where hot code is, but where is it being optimized? Is it changing my source file? Does it create a 'compiled/optimized' copy of my source file? Is it an alternative interpreter? I haven't tried running / using it, I've just read the pypi documentation. From the very first sentence of the docs: > Specialist uses fine-grained location information to create visual representations of exactly where and how CPython 3.11's new specializing, adaptive interpreter optimizes your code. Which links to https://peps.python.org/pep-0659/ https://peps.python.org/pep-0659/ with a lot more details.
- tekknolagi 4y ago
  The source has always been compiled to bytecode. Now after running your code for a bit, the interpreter makes a copy in memory to optimize as it notices patterns. Like more complicated automatic caches.
RayVR 4y ago
hmmmmmmmm Why now? what has changed that Python now needs to be fast in pure python? I can still recall when the python core dev team constantly argued against advanced or complicated changes to the virtual machine. Discussions around the GIL and especially JIT (this was around the time pypy was beginning to take shape) were brushed aside as they would introduce too much complexity. What has changed in the core team to make this PEP acceptable?
- pjmlp 4y ago
  Microsoft has hired Guido out of retirement with the purpose of making Python faster. https://m.slashdot.org/story/385526 https://m.slashdot.org/story/385526
- mjburgess 4y ago
  Python 2 was an educational language adopted by academics and some minor parts of the software industry. Python 3 is a software engineering and data science language, widely used by professionals. The goals of pre3-python ("import this") have basically been abandoned for the sake of making a more usable seng. language.

106 points by gjvc 4y ago

gjvc 4y ago

full title limited by HN form. Specialist uses fine-grained location information to create visual representations of exactly where and how CPython 3.11's new specializing, adaptive interpreter optimizes your code.

deleted 4y ago
[deleted]

ModernMech 4y ago

Per the benchmarks thread from yesterday, I tried running the n-body simulation on 3.10 and 3.11 on Windows, with no noticeable speedup: Python 3.10 5.323s Python 3.11 5.305s Does anyone else get results like these or are you seeing a speedup? fwiw, I got these numbers under Ubuntu running on WSL: Python 3.8 4.251s Python 3.11 3.158s This is on a 11th gen Intel Core i7-11370H w/ 32GB RAM.

__lambda__ 4y ago
i think there won't be any speed changes for numpy operation and other few operation which were already implemented in C function.

Titan2189 4y ago

I don't understand what it does. It shows me where hot code is, but where is it being optimized? Is it changing my source file? Does it create a 'compiled/optimized' copy of my source file? Is it an alternative interpreter? I haven't tried running / using it, I've just read the pypi documentation.

jsjohnst 4y ago
> I don't understand what it does. It shows me where hot code is, but where is it being optimized? Is it changing my source file? Does it create a 'compiled/optimized' copy of my source file? Is it an alternative interpreter? I haven't tried running / using it, I've just read the pypi documentation. From the very first sentence of the docs: > Specialist uses fine-grained location information to create visual representations of exactly where and how CPython 3.11's new specializing, adaptive interpreter optimizes your code. Which links to https://peps.python.org/pep-0659/ https://peps.python.org/pep-0659/ with a lot more details.
tekknolagi 4y ago
The source has always been compiled to bytecode. Now after running your code for a bit, the interpreter makes a copy in memory to optimize as it notices patterns. Like more complicated automatic caches.

RayVR 4y ago

hmmmmmmmm Why now? what has changed that Python now needs to be fast in pure python? I can still recall when the python core dev team constantly argued against advanced or complicated changes to the virtual machine. Discussions around the GIL and especially JIT (this was around the time pypy was beginning to take shape) were brushed aside as they would introduce too much complexity. What has changed in the core team to make this PEP acceptable?

pjmlp 4y ago
Microsoft has hired Guido out of retirement with the purpose of making Python faster. https://m.slashdot.org/story/385526 https://m.slashdot.org/story/385526
mjburgess 4y ago
Python 2 was an educational language adopted by academics and some minor parts of the software industry. Python 3 is a software engineering and data science language, widely used by professionals. The goals of pre3-python ("import this") have basically been abandoned for the sake of making a more usable seng. language.