Search…
Terms & Definitions
Term
Definition
Agency
A police department or organization, like "Aurora Police Department". Agencies often have parent-child relationships to one another.
Data Source
A URL pointing to a place on a police website where public records may be scraped, like "police-agency.com/arrest-reports".
Data Source archive
A raw, unprocessed HTML archive of a Data Source at a specific time.
scraper / data scraper
A bit of code responsible for collecting an Extraction from a Data Source or Archive. Check out the GitHub repo.
​
Colloquially, "scraper" may refer to a person writing a Scraper.
extraction
The result of running a Scraper is an extraction, usually intended to further parse or process an HTML page into more usable data.
extraction metadata
Packaged with each extraction, metadata is information about when the extraction was made, from which Data Source, and using which scraper.
​
Copy link
Edit on GitHub