The scraping series will not get completed without discussing Scrapy. In this post I am going to write a web crawler that will scrape data from OLX's Electronics & Appliances' items. Before I get into the code, how about having a brief intro of Scrap...
Read more »
If you are like me, every once in a while you write a useful python utility and want to share it with your colleagues. The best way to do this is to make a package: it easy to install and saves from copy-pasting. (more…)
Read more »
There have been many Python libraries developed for interactive with the Hadoop File System, HDFS, via its WebHDFS gateway as well as its native Protocol Buffers-based RPC interface. I'll give you an overview of what's out there and show some engineering ...
Read more »
What does it take to become a software engineer for a hedge fund? Is there any point in teaching yourself how to code? Do you need to go to university?
Read more »