Missing Evidence Links & Data Sources
Primary Data Sources (To Acquire)
| Domain | Metric | Source | URL / Location |
|---|---|---|---|
| Society | Trust in Government | Pew Research | pewresearch.org |
| Society | Social Trust | GSS Data Explorer | gssdataexplorer.norc.org |
| Society | Crime Rate | FBI UCR / DisasterCenter | cde.ucr.cjis.gov |
| Society | Income Gini | FRED | fred.stlouisfed.org |
| Society | Unmarried Birth % | NVSS / WA OFM | ofm.wa.gov |
| Society | Voter Turnout | US Elections Project | electproject.org |
| Logos | Trust in Media | Gallup | news.gallup.com |
| Logos | Media Fragmentation | Nielsen / EBSCO | (Requires Academic Access or Manual Search) |
| Logos | Polarization | Voteview | voteview.com |
| Logos | EPU Index | Policy Uncertainty | policyuncertainty.com |
| Logos | VIX Index | FRED | fred.stlouisfed.org |
| Individual | Suicide Rate | CDC WISQARS | cdc.gov/injury/wisqars |
| Individual | Life Expectancy | FRED | fred.stlouisfed.org |
| Individual | Overdose Deaths | CDC Wonder | wonder.cdc.gov |
| Individual | Religious Attendance | GSS / Gallup | gssdataexplorer.norc.org |
GitHub Helper Repositories (For Pipeline)
These repositories were identified as critical for the data ingestion pipeline.
HTML → Markdown
- html-to-markdown (Golang): github.com/JohannesKaufmann/html-to-markdown
- turndown (JS): github.com/mixmark-io/turndown
- python-readability: github.com/buriy/python-readability
Table Extraction
- BeautifulSoup4: github.com/wention/BeautifulSoup4
- tabula-py (PDF): github.com/chezou/tabula-py
- camelot-py (PDF): github.com/camelot-dev/camelot
- csvkit: github.com/wireservice/csvkit
Obsidian Integration
- obsidian-html: github.com/obsidian-html/obsidian-html
- mdformat: github.com/executablebooks/mdformat
- python-frontmatter: github.com/eyeseast/python-frontmatter