Book Mastering Large Datasets with Python : Parallelize and Distribute Your Python Code by John T. Wolohan... (more…)

In this post we are going to scrape data from Linkedin using Python. We'll scrape company name, address, company size, website, etc and save it in a csv file using pandas. (more…)

This post is an attempt to catalog some of my practices around testing Python projects. It's not meant to be treated as dogma- I anticipate I'll update this significantly over time. (more…)

How to use entry points as a modular plug-in architecture, to let other Python packages interact or add abilities at runtime. (more…)

Build your own distributed crawler with custom parsers per domain. Discover new pages and store the exact content you need — all in less than 300 LOC. (more…)