Parallel file uploads in Collectfast 0.4.0 using Python’s multiprocessing module

0.4.0 introduces parallel file uploads using Python’s multiprocessing module. This enables huge speed-ups for first time uploads. Using testdata with 50 files at 500kb each upload finished in 1m9s using 0.3.1 and in just 10s using 0.4.0.

Similar

Is Python popular *because* it is slow?

I’ve been using Python with numeric/numarray/numpy and SWIG since the spring of 2002 for data analysis. The first application I used it for is the OOF holography software. The transition to Python was from tcl with hand-written bindings to C/C++ code. (more…)

Read more »

I Created a Python Meme Bot for Instagram

The Story behind Most of my time is spent on Instagram and I use it mostly for the memes. So, some of my friends told me that most of the memes are uploaded to Reddit and later spread to Instagram, and Reddit was the best place to go for funny conten... (more…)

Read more »