September 11, 2021

  • Hadoop: these are stored in DigitalOcean Droplets.

    • We might look at Azure instead now that we have nonprofit status

    • We still have some portion of the $1000 in credit from DigitalOcean.

  • Licenses: Alec is looking at gsuite, google cloud, AWS.

  • We need a data pipeline map / something like that.

  • We need instructions for how to dump scraped data into Hadoop

    • I'm a scraper, and I wrote a scraper. What's next?

Last updated