▸ ScholarDash — Research Funding Intelligence
2026End-to-end data pipeline for 1,000+ federal research grants. Star schema, 25+ tests, daily Airflow DAG.
Ingests 1,000+ federal research grants from NSF and NIH APIs into a DuckDB warehouse with dual persistence (database + JSON archive), rate limiting, and per-record quality scoring. Modeled the warehouse as a star schema with 14 dbt models (2 staging, 5 dimensions, 1 fact, 5 marts) and 25+ automated tests covering uniqueness, referential integrity, and value ranges. Orchestrated via Apache Airflow on Docker Compose (4 services) with an 8-task daily DAG, retry logic, and DuckDB single-writer concurrency management.