Category

Development

Category

In this article, I’ll teach you how to build a web scraper using Python & BeautifulSoup. This idea was born of my efforts to scrape data from competitor sites for a new web-application that I’m building. A few months ago I started building a web application. A data-driven web application that collates and ranks products in an intuitive manner, with Search Engine optimization built-in. However, there are competitors that already exist that have ten of…

Scraping ASIN codes from Amazon is easier than you think. Okay, you can manually grab the ASIN codes from product pages URLs, but you can also get them from the search results. This can be done with an Amazon page, and a little XPath query. Fortunately, you can run XPath queries in Chrome, so you don’t have to install anything out of the ordinary. Don’t worry if you’re not the most technically gifted, it’s easy…