πŸ“–
Police Data Access Point Docs
pdap.ioGitHub
  • πŸ‘‹Welcome
  • ⚑Activities
    • Label new Data Sources
      • Labeling events
    • Volunteer for Data Requests
    • Search for Data Sources
    • Publish data
    • Web scraping
    • FOIA requests
    • Advocate for open data
  • πŸ”¬About
    • Search the PDAP database
    • Terms & definitions
      • What is a Data Source?
      • Terminology
    • Database details
      • Data Sources data dictionary
      • Agencies data dictionary
      • Requests data dictionary
      • Record Types taxonomy
      • Hidden properties
    • GitHub
    • Hugging Face
  • πŸ“‘API
    • Introduction/Getting Started
  • πŸ› οΈTools & Resources
    • Related projects
    • Resources for using data
    • Using LLMs like ChatGPT
  • πŸ”Meta
    • Internal Tools (Retool)
    • Internal dev resources
      • GitHub issue template
      • GitHub pull request template
      • Product changes checklist
      • β˜‘οΈProduction QA Checklist
      • Retool
    • Operations
      • Staff resources
        • Meeting Minutes
          • 2021-07-14
          • 2021-06-16
          • 2021-03-14
          • 2020 11-21 Tech Stack discussion
          • 2020-09-30 Leadership Cadence
          • 2020-10-14 Leadership Cadence
          • 2020-10-21 Leadership Cadence
          • 2020-10-28 Leadership Cadence
          • 2020-11-04 Leadership Cadence
          • 2020-11-12 Leadership Cadence
          • 2020-11-18 Leadership Cadence
          • 2020-11-25 Leadership Cadence Notes
          • 2020-12-02 Leadership Cadence Notes
          • 2020-12-09 Leadership Cadence Notes
          • 2020-12-12 Working Session
          • 2020-12-16 Leadership Cadence
          • 2020-12-30 Leadership Cadence Notes
          • 2021-01-06 Leadership Cadence Notes
          • 2021-01-13 Leadership Cadence Notes
          • 2021-01-20 Leadership Cadence Notes
          • 2021-01-27 Leadership Cadence Notes
          • 2021-02-03 Leadership Cadence Notes
          • 2021-02-10 Leadership Cadence Notes
          • 2021-02-17 Leadership Cadence Notes
          • 2021-02-24 Leadership Cadence Notes
          • 2021-03-03 Leadership Cadence Notes
          • 2021-03-10 Leadership Cadence Notes
          • 2021-03-16 Leadership Cadence Notes
          • 2021-03-27 database working session
          • 2021-03-31
          • 2020-12-1
          • 2021-01-23
          • 2021-04-10 Meeting notes
          • 2021-04-17 Meeting notes
          • 2021-04-21 Leadership Cadence
          • 2021-04-28 Leadership Cadence
          • 2021-05-05 Leadership Cadence
          • 2021-05-12 Leadership Cadence
          • 2021-05-19 Leadership Cadence
          • 2021-05-26 Leadership Cadence
          • 2021-06-02 Leadership Cadence
          • Decision log
        • Brand assets
      • Legal
        • Public records access laws & precedent
        • Legal Data Scraping
        • State Computer Crimes laws
      • Policy
        • Impartiality resolution
        • PDAP Access
        • PDAP Privacy Policy
        • Password Management
        • Personally Identifiable Information
    • Community calls
      • October 17, 2023
      • February 22, 2023
      • February 1, 2023
      • January 20, 2023
      • January 5, 2023
      • October 25, 2022
      • September 22, 2022
      • August 23, 2022
      • October 2, 2021
      • September 25, 2021
      • September 11, 2021
      • September 4, 2021
      • August 7, 2021
      • July 27 Dolt Bounty retro
      • July 17, 2021
      • July 10, 2021
      • June 26, 2021
      • June 19, 2021
      • June 12, 2021
      • June 5, 2021
      • May 1, 2021
      • April 24, 2021
    • Newsletter
    • Join our Discord
Powered by GitBook
On this page
  • Date
  • Participants
  • Goals
  • Discussion topics
  • Action items
  • Decisions

Was this helpful?

Edit on GitHub
  1. Meta
  2. Operations
  3. Staff resources
  4. Meeting Minutes

2020-11-18 Leadership Cadence

Previous2020-11-12 Leadership CadenceNext2020-11-25 Leadership Cadence Notes

Was this helpful?

Date

18 Nov 2020

Participants

Goals

  • Compare/contrast alternatives to splunk

  • High level picture conversation of how splunk/alternative fits in actual MVP

Discussion topics

Item

Presenter

Notes

Splunk alternative - ELK stack

ELK (Elasticsearch, Logstash, Kibana)

  • Open source, free

  • Wealth of information for reference

Neither ELK nor splunk do particularly well with long term data storage; will still need some form of data lake solution

We’ve been considering splunk as a springboard in order to transition into something more flexible and maintainable.

Splunk resolves:

  • Immediacy

  • Security

  • Outsource maintenance and high availability for the most part

Planning

  • Still working with A&P to continue process

  • Once we’re unblocked, where does the money need to go?

    • Splunk

    • ???

Interim work

  • Alec has a small, personal Splunk instance we can work off of as we wait for incorp/501c3

  • Could be a good time to spike out some learnings for outstanding problems whether we use splunk or not (long term data storage, exposing API for public use, determine how to validate data integrity, serving up data back to the public for free)

Accuracy of PDAP data arch diagram and data ingestion diagram

Action items

Decisions

Still fairly accurate

Working session for white boarding architecture for splunk/alternative with MVP

Working session for some splunking learning

Reach out to folks for documenting emails

πŸ”
Eddie Brown (Unlicensed)
Richard Ji
Will Beaumont
Former user (Deleted)
Alec Akin (Unlicensed)
Josh Lintag
Alec Akin (Unlicensed)
Alec Akin (Unlicensed)
Former user (Deleted)
Alec Akin (Unlicensed)
Richard Ji
Eddie Brown (Unlicensed)