Analysis request

EPA-HQ-OAR-2021-0317 — Oil and Gas Methane Emissions Standards

demo-epa-methane-200 / created 5/31/2026, 1:22:29 AM

Databricks Jobs modesucceeded

Rulemaking Metadata

Docket IDEPA-HQ-OAR-2021-0317

Agency IDEPA

Topicclimate_energy

Data Sourceregulations_gov

Expected Scale~200 comments

Date WindowFull Historical Ingestion

Notes / Reviewer Context

"Demo run: regulations.gov, 200-row slice of EPA climate rulemaking. Diversity sample showing pipeline works across non-FCC, non-CFPB topics."

Status & Control Plane

Pipeline run successfully completed! Campaign data is fully exported.

View Docket Analysis

Databricks Workspace Integration

Active Databricks Run ID: 1112989247009224

Command-Generation Mode

If you want to run this pipeline locally on your system instead of hosted Databricks, run the following sequence in your terminal:

.uv-test-venv\Scripts\python.exe scripts\run_ingestion.py --docket-id EPA-HQ-OAR-2021-0317
.uv-test-venv\Scripts\python.exe scripts\run_embedding.py --docket-id EPA-HQ-OAR-2021-0317 --backend databricks
.uv-test-venv\Scripts\python.exe scripts\run_clustering.py --docket-id EPA-HQ-OAR-2021-0317 --clustering-mode vector_search

Command-generation mode allows running comment ingestion and clustering locally via python scripts, writing directly to your local delta lakehouse.