September 11, 2021

  • Hadoop: these are stored in DigitalOcean Droplets.
    • We might look at Azure instead now that we have nonprofit status
    • We still have some portion of the $1000 in credit from DigitalOcean.
  • Licenses: Alec is looking at gsuite, google cloud, AWS.
  • We need a data pipeline map / something like that.
  • We need instructions for how to dump scraped data into Hadoop
    • I'm a scraper, and I wrote a scraper. What's next?