September 11, 2021

• Hadoop: these are stored in DigitalOcean Droplets.

  • We might look at Azure instead now that we have nonprofit status

  • We still have some portion of the $1000 in credit from DigitalOcean.

• Licenses: Alec is looking at gsuite, google cloud, AWS.

• We need a data pipeline map / something like that.

• We need instructions for how to dump scraped data into Hadoop

  • I'm a scraper, and I wrote a scraper. What's next?