Data Extractions
Running Scrapers and using the generated Extractions.

Current status

We're still in the iteration and case study phase. To submit data:
  1. 1.
    Run a Scraper you wrote, or an approved Scraper from the Scrapers Repo, to get an Extraction.
  2. 2.
    Share your Extraction in Discord. We'll work with you to write and publish a case study.
  3. 3.
    We'll all learn from the experience, and brainstorm ways our tools could better facilitate your work.
  4. 4.

Requirements for published Extractions

  • We always need to know when Extractions were collected.
  • We need to know which code was used to Scrape the Extraction.
  • We need to know from which Data Source the data was Extracted.
Since we have git version control on our scrapers, we can audit any Extraction to understand how it was gathered.