AWS: The 1st Cut is Getting the Data

A brief introduction to building an automated, simple web scraper in AWS

There are many technical articles on this subject that have provided comprehensive step-by-step instructions to building technical workflows. In order limit redundant information, I will focus the specific tasks I needed to do to make my solution work, and I will link the sources\starter code I used to get started.

This project collects data from a limited set of sources. In order to scale this project to hundreds of sources, further development would be needed. This…