Some fun with Python / Scrapy & Java / Selenium WebDriver

I recently wrapped up a project with Liferay in Chicago, and wanted some fun downtime work. I decided to do some work with Python / Scrapy for web scraping to get some data. But turns out Scrapy, which is great for basic web scraping, doesn’t work for some sites...