Code automated scrapers or follow processes to manually collect data.
Automated data scrapers regularly consolidate public police information.
Humans operate semi-automated processes to gather public information
Facilitate data sharing by good-faith police organizations.
We always need to know when data was submitted.
For Datasets, we need to know who submitted the data.
For Collected Data, we need to know which code was used to scrape the data.
We use Python to scrape data into a Hadoop server, long enough that it can be translated to the submission format.
Scrapers in the PDAP-Scrapers repo are run on a schedule dictated by how often they're refreshed. People could also donate time and computing power to run them locally.