ED-2018-OCR-0064 — Title IX Nondiscrimination (2018)
Department of Education rulemaking on Title IX procedures for handling sexual harassment complaints. 124,162 public comments on record. 200-row demo slice covers civil-rights policy area.
Discovered Campaigns
Showing 9 campaignsMethodology & Ingestion Disclosures
Data Sourcing
Comments are fetched directly from official federal APIs (regulations.gov v4 API or the FCC ECFS public portal). Raw comments are ingested into our Delta Lake Bronze schema, stripping HTML noise and validating submitter fields without discarding critical metadata.
Clustering Limits & Caveats
Semantic clustering groups comments based on high-dimensional text vectors. It uses a similarity threshold (0.92 cosine proximity) to guarantee that only text sharing core structural, political, and semantic boilerplate is linked. False positives are audited against strict quality benchmarks.