Note: The code for this project can be found in this github repo.
I have been building a new project that requires the prices of flights. I looked for APIs but couldn’t find any that were free. However, I had a great experience using BeautifulSoup when scraping baseball data for my Fantasy Baseball auto-roster algorithm project, so I decided to try to get my own data that way. To start, I chose a single airline: southwest. In this post I’ll step you through a couple basics, including how to scrape when you need to submit form data.