{"id":329450,"date":"2023-05-29T16:34:00","date_gmt":"2023-05-29T16:34:00","guid":{"rendered":"http:\/\/itteacheritfreelance.hk\/wordpress\/?guid=d8aa21b0196913fadf422b8332c04181"},"modified":"2023-05-29T16:34:00","modified_gmt":"2023-05-29T16:34:00","slug":"the-python-language-summit-2023-towards-native-profiling-for-python","status":"publish","type":"post","link":"https:\/\/itteacheritfreelance.hk\/wordpress\/index.php\/2023\/05\/29\/the-python-language-summit-2023-towards-native-profiling-for-python\/","title":{"rendered":"The Python Language Summit 2023: Towards Native Profiling for Python"},"content":{"rendered":"

<\/p>\n

Joannah Nanjekye came to the Python Language Summit 2023<\/a> to discuss innovations by Scalene<\/a>, a sampling-based Python profiler that can distinguish between native code and Python code in its reports. After its initial release in late 2019, Scalene has become one of the most popular Python profiling tools. It has now been downloaded 500,000 times from PyPI.<\/div>\n
<\/div>\n
<\/div>\n
<\/div>\n\n\n\n\n
<\/a><\/td>\n<\/tr>\n
The Scalene project logo<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n
<\/p>\n

A profiler is a tool that can monitor a program as it is running. Once the program has run, the profiler can provide a report analysing which lines of code were visited most often, which were the most expensive in terms of time spent, and which were the most expensive in terms of memory usage. Profilers can therefore be hugely useful tools for addressing performance issues in code. If you\u2019re unsure where your program is spending most of its time, it can be hard to optimise it.<\/span><\/p>\n

Profilers can be split into two broad categories: trace-based profilers and sampling-based profilers. Trace-based profilers work by intercepting each function call as your program is running and logging information about the time spent, memory usage, etc. Sampling-based profilers, meanwhile, take snapshots of your program at periodic intervals to monitor these things. A trace-based profiler has the advantage that it can provide a granular and precise level of detail about which lines of code were executed and when each function call finishes; this makes it ideal for use as a tool to monitor test coverage, for example. However, injecting tracing hooks into each function call can sometimes slow down a program and distort the analysis of where most time was spent. As a result, sampling-based profilers are sometimes preferred for profiling performance.<\/span><\/p>\n

Scalene is a sampling-based profiler, and aims to address the shortcomings of previous sampling-based profilers for Python. One of the key challenges sampling-based profilers have faced in the past has been accurately measuring the time Python programs spend in \u201cnative code\u201d.<\/span><\/p>\n


<\/span><\/p>\n\n\n\n\n
<\/a><\/td>\n<\/tr>\n
Slide from Nanjekye\u2019s talk, illustrating sampling-based profiling<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

<\/p>\n

Handling the problem of native code<\/h2>\n

\u201cNative code\u201d, also sometimes referred to as \u201cmachine code\u201d, refers to code consisting of low-level instructions that can be interpreted directly by the hardware processor. Using extensions to Python written in <\/span>C<\/span><\/a>, <\/span>C++<\/span><\/a> or <\/span>Rust<\/span><\/a> that will compile to native code \u2013 such as <\/span>NumPy<\/span><\/a>, <\/span>scikit-learn<\/span><\/a>, and <\/span>TensorFlow<\/span><\/a> \u2013 can lead to dramatic speedups for a program written in Python.<\/span><\/p>\n

It also, however, makes life difficult for sampling-based profilers. Samplers often use Python\u2019s <\/span>signal<\/code><\/a> module as a way of knowing when to take a periodic snapshot of a program as it is running. However, due to the way the <\/span>signal<\/code> module works, no signalling events will be delivered while a Python program is spending time in a function that has been compiled to native code via an extension module. The upshot of this is that sample-based profilers are often \u201cflying blind\u201d for Python code that makes extensive use of C extensions, and will sometimes erroneously report that no time at all was spent executing native code, even if the program in fact spent the majority of its time there.<\/span><\/p>\n

Scalene\u2019s solution to this problem is to monitor delays in signal delivery. It uses this information to deduce the amount of time that the program spent outside CPython\u2019s main interpreter loop (due to the use of native, compiled code from an extension module). Further details on Scalene\u2019s methods, and comparisons with other leading Python profilers, can be found in a recent paper by Emery D. Berger, Sam Stern and Juan Altmayer Pizzorno, <\/span>\u201cTriangulating Python Performance Issues with Scalene\u201d<\/span><\/a>.<\/span><\/p>\n

Nanjekye also detailed Scalene\u2019s sophisticated approach to measuring performance in child threads. Signal-based profilers often struggle with multi-threaded code, as signals can only be delivered and received from the main thread in Python. Scalene\u2019s solution is to monkey-patch functions that might block the main thread, and add timeouts to these functions. This allows signals to be delivered even in multithreaded code.<\/span><\/p>\n

Discussion<\/span><\/h2>\n

Nanjekye asked attendees at the Language Summit if they would be interested in integrating Scalene’s ideas into the standard library’s cProfile<\/a><\/code> module, which was met with a somewhat muted response.<\/span><\/p>\n

Pablo Galindo Salgado, a leading contributor to the <\/span>Memray<\/span><\/a> profiler, criticised Scalene\u2019s signal-based appr<\/span>oach, arguing it relied on inherently brittle monkey-patching of the standard library. It also reported unreliable timings, Salgado said: for example, if code in a C extension checks for signals to support CTRL-C, the resulting delays measured by Scalene will be distorted.<\/p>\n

Salgado argued that integration with <\/span>the <\/span>perf<\/code> profiler<\/span><\/a>, which Python is introducing support for in Python 3.12, would be a better option for users. Mark Shannon, however, argued that <\/span>perf<\/code> distorted the execution time of Python programs; Salgado responded that Scalene did as well, as the use of signals came with its own overhead.<\/span><\/p>\n

Nanjekye argued that the huge popularity of Scalene in the Python ecosystem was evidence that it had proved its worth. Carol Willing concurred, noting that Scalene was an especially useful tool with code that made heavy use of libraries such as NumPy, Scikit-Learn and PyTorch.<\/span><\/p>\n<\/div>\n\n

\\\"IT\u96fb\u8166\u88dc\u7fd2
\u7acb\u523b\u8a3b\u518a\u53ca\u5831\u540d\u96fb\u8166\u88dc\u7fd2\u8ab2\u7a0b\u5427!<\/figcaption><\/figure>\r\n<\/br>Find A Teacher Form:\r\n<\/br>https:\/\/docs.google.com\/forms\/d\/1vREBnX5n262umf4wU5U2pyTwvk9O-JrAgblA-wH9GFQ\/viewform?edit_requested=true#responses\r\n<\/br><\/br>Email:\r\n<\/br>public1989two@gmail.com






\r\nwww.itsec.hk<\/a>
\r\nwww.itsec.vip<\/a>
\r\nwww.itseceu.uk<\/a>
<\/p>","protected":false},"excerpt":{"rendered":"

Joannah Nanjekye came to the Python Language Summit 2023 to discuss innovations by Scalene, a sampling-based Python profiler that can distinguish between native code and Python code in its reports. After its initial release in late 2019, Scalene has b…<\/p>\n<\/div>","protected":false},"author":2053,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"slim_seo":{"title":"The Python Language Summit 2023: Towards Native Profiling for Python - ITTeacherITFreelance.hk","description":"Joannah Nanjekye came to the Python Language Summit 2023 to discuss innovations by Scalene, a sampling-based Python profiler that can distinguish between native"},"footnotes":""},"categories":[10700],"tags":[10798],"_links":{"self":[{"href":"https:\/\/itteacheritfreelance.hk\/wordpress\/index.php\/wp-json\/wp\/v2\/posts\/329450"}],"collection":[{"href":"https:\/\/itteacheritfreelance.hk\/wordpress\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/itteacheritfreelance.hk\/wordpress\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/itteacheritfreelance.hk\/wordpress\/index.php\/wp-json\/wp\/v2\/users\/2053"}],"replies":[{"embeddable":true,"href":"https:\/\/itteacheritfreelance.hk\/wordpress\/index.php\/wp-json\/wp\/v2\/comments?post=329450"}],"version-history":[{"count":1,"href":"https:\/\/itteacheritfreelance.hk\/wordpress\/index.php\/wp-json\/wp\/v2\/posts\/329450\/revisions"}],"predecessor-version":[{"id":329451,"href":"https:\/\/itteacheritfreelance.hk\/wordpress\/index.php\/wp-json\/wp\/v2\/posts\/329450\/revisions\/329451"}],"wp:attachment":[{"href":"https:\/\/itteacheritfreelance.hk\/wordpress\/index.php\/wp-json\/wp\/v2\/media?parent=329450"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/itteacheritfreelance.hk\/wordpress\/index.php\/wp-json\/wp\/v2\/categories?post=329450"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/itteacheritfreelance.hk\/wordpress\/index.php\/wp-json\/wp\/v2\/tags?post=329450"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}