September 11, 2021
- Hadoop: these are stored in DigitalOcean Droplets.
- We might look at Azure instead now that we have nonprofit status
- We still have some portion of the $1000 in credit from DigitalOcean.
- Licenses: Alec is looking at gsuite, google cloud, AWS.
- We need a data pipeline map / something like that.
- We need instructions for how to dump scraped data into Hadoop
- I'm a scraper, and I wrote a scraper. What's next?