Searchβ¦
β¬
back to pdap.io
π
Welcome to PDAP!
β‘
Volunteer Activities
Process overview
Maintain Datasets
Write Scrapers
π€
Mission components
Key Principles
Data Intake
Data Storage
Data Access
π
Tools & Resources
Terms & Definitions
Internal tools
DoltHub
Splunk
Third-Party Resources
π£
Updates
Blog
Working sessions
Join an Open Working Session
October 2, 2021
September 25, 2021
September 11, 2021
September 4, 2021
August 7, 2021
July 27 Dolt Bounty retro
July 17, 2021
July 10, 2021
June 26, 2021
June 19, 2021
June 12, 2021
June 5, 2021
May 1, 2021
April 24, 2021
Current Progress
π
Meta
About
Policy
Legal
β
Elsewhere
Discord
GitHub org
DoltHub org
Patreon
Powered By
GitBook
May 1, 2021
Attendees
Josh
Mitch
Jeff
Eddie
Topics
Topic
Notes
Downloadable scrapers package
Proof of concept:
https://github.com/EricTurner3/pdap-intake-ui/tree/overhaul
β
Chain of custody
Where
When
Who
With what scraper code
What granularity do we want for audit history? Cellwise
We need authβanything else is too easy to spoof
Data collision
Treat each timestamp as its own piece of data
Datasets
Maintain source info / keep it up to date
Auth
Keybase (infra)
Django built-in
GitHub for scraping (pub/privkey)
Medium-term SSO
Incentives
Dolt bounties
Paid scrapersβpay for a quick project (fiverr, freelancer)
Someone paid has ~guaranteed expertise. Collect feedback from professional consumers
$
We're covering a few licenses, but need more donations. Considering Patreon
Support
β
EFF
, ACLU,
NFOIC
β
1.
volunteer time
2.
volunteer money
3.
introduce us
4.
use the data
Scraper utilities
β
https://pdap.ericturner.it/datamap/
β
β
https://pdap.ericturner.it/datamap/schema
β
Data centers
We have NY and SF data centers in DigitalOcean, but they don't talk to each other
Security
β
https://pdap.atlassian.net/browse/PDAP-162
β
1.
perimeter
2.
secrets manager
Who can make data PR approvals?
Front end
β
https://github.com/Police-Data-Accessibility-Project/gatsby-pdap-frontpage/pull/17
β
β
Previous
June 5, 2021
Next
April 24, 2021
Last modified
1yr ago
Copy link
Edit on GitHub
Contents
Attendees
Topics