Analysis request

ED-2018-OCR-0064 — Title IX Nondiscrimination (2018)

demo-ed-titleix-200 / created 5/31/2026, 3:49:32 PM

Databricks Jobs modesucceeded

Rulemaking Metadata

Docket IDED-2018-OCR-0064

Agency IDED

Topiccivil_rights_education

Data Sourceregulations_gov

Expected Scale~200 comments

Date WindowFull Historical Ingestion

Notes / Reviewer Context

"Department of Education rulemaking on Title IX procedures for handling sexual harassment complaints. 124,162 public comments on record. 200-row demo slice covers civil-rights policy area."

Status & Control Plane

Pipeline run successfully completed! Campaign data is fully exported.

View Docket Analysis

Databricks Workspace Integration

Active Databricks Run ID: 944697375016165

Command-Generation Mode

If you want to run this pipeline locally on your system instead of hosted Databricks, run the following sequence in your terminal:

.uv-test-venv\Scripts\python.exe scripts\run_ingestion.py --docket-id ED-2018-OCR-0064
.uv-test-venv\Scripts\python.exe scripts\run_embedding.py --docket-id ED-2018-OCR-0064 --backend databricks
.uv-test-venv\Scripts\python.exe scripts\run_clustering.py --docket-id ED-2018-OCR-0064 --clustering-mode vector_search

Command-generation mode allows running comment ingestion and clustering locally via python scripts, writing directly to your local delta lakehouse.