Data Intake

Requirements
1.
We know when data was submitted.
2.
We know which scraper was used to generate the data.
3.
Nice-to-have: we know who submitted the data.
Since we have git version control on our scrapers, we can audit any piece of submitted data to understand how it was gathered.
Current Process
This is a work in progress. Here's the GitHub issue.

PostgreSQL Datasets mirror

Next - Components

Data Storage

Last modified 26d ago

Copy link

Contents

Requirements

Current Process