Parallel file uploads in Collectfast 0.4.0 using Python’s multiprocessing module

0.4.0 introduces parallel file uploads using Python’s multiprocessing module. This enables huge speed-ups for first time uploads. Using testdata with 50 files at 500kb each upload finished in 1m9s using 0.3.1 and in just 10s using 0.4.0.

Similar

An Unexpected Python ABI Change

Earlier this year, a Pyflame user filed a GitHub issue reporting that Pyflame didn’t work reliably with Python 3.6. Sometimes Pyflame would just print garbage output (e.g. bogus line numbers), and other times it would actually crash. Although multiple use... (more…)

Read more »

Zen of Python

The Zen of Python is a collection of 19 "guiding principles" for writing computer programs that influence the design of the Python programming language.[1] Software engineer Tim Peters wrote this set of principles and posted it on the Python mailing list ... (more…)

Read more »