Links

Data Sources data dictionary

To see which options are available for select fields, consult the submission form.

Required properties for submission

submitted_name, submitter_contact_info, record_type, agency_supplied (+ other "provenance" properties, if "no")

What is it?

Property
Type
Description
name
string
Uses submitted_name if present or concatenates record_type + " for " + agency_described; can get weird when one or both are not present
submitted_name
string
Required for individual Data Source submissions for clarity.
record_type
string
What kind of data is accessible from this source?
description
string (textarea)
Information to give clarity and confidence about what this source is, how it was processed, and whether the person reading the description might want to use it. Especially important if the source is difficult to preview or categorize.

Agency

Property
Type
Description
agency_described
array (foreignkey based on an agency's ID within Airtable)
To which criminal justice agency or agencies does this Data Source refer?
state
string
2-character ISO code, related to the associated Agency object, if present
county
string
Related to the associated Agency object, if present
municipality
string
Related to the associated Agency object, if present
agency_type
string
Related to the associated Agency object, if present
jurisdiction_type
array
Related to the associated Agency object, if present. Some agencies, such as the Pennsylvania State Police, can perform local law-enforcement functions as well as state-level.

Provenance

Where did it come from?
Property
Type
Description
agency_supplied
boolean
Is the relevant Agency also the entity supplying the data? This may be "no" if the Agency or local government contracted with a third party to publish this data, or if a third party was the original record-keeper.
supplying_entity
string
If the Agency didn't publish this, who did?
agency_originated
boolean
Is the relevant Agency also the original record-keeper? This is usually "yes", unless a third party collected data about a police Agency.
originating_entity
string
If the Agency was not the original record-keeper, who was?
community_data_source
boolean
Checked when a source of public records is supplied directly by a member of our community via this form.

Access & Format

Property
Type
Description
source_url
string
A url where these records can be found or are referenced.
access_type
array
Array items can have values such as Web page or API
record_format
array
What format(s) are the records in natively? Array items can have values such as CSV, JSON, XML, RDF, RSS, HTML table and others
record_download_option_provided
boolean
There is a function available to download or export records.
aggregation_type
string
Are there individual records, or does the data include aggregated totals?
size
string
The file size on disk of all the data at this source, if downloaded.
data_portal_type
string
Some data is published via a standard third-party portal, typically named somewhere on the page.
access_restrictions
string
Is anything special required to access the data?
access_restrictions_notes
string (textarea)
Additional information about any access restrictions.
records_not_online
boolean
Someone has checked for these records on the internet, and has not located them.

Coverage & Retention

Property
Type
Description
coverage_start
date
The earliest date covered by this source, if known, in the format YYYY-DD-MM.
coverage_end
date
The date at which updates stop, in the format YYYY-DD-MM.
source_last_updated
date
The date this source was last updated, in the format YYYY-DD-MM.
update_frequency
string
How often is this data source updated?
update_method
string
How are new records added to this Data Source?
sort_method
string
When new records are added, how are they sorted?
retention_schedule
string
How long are records kept? Are there published guidelines regarding how long important information must remain accessible for future use?
number_of_records_available
integer
How many similar pieces of information are available at this source?

Meta & Utility

Property
Type
Description
scraper_url
string
The url of any web scraping efforts associated with this Data Source.
data_source_created
datetime
The date this source was first created in our database.
agency_described_linked_uid
string
The Airtable-generated UID of an associated Agency
airtable_uid
string
The Airtable-generated UID of this particular data source