Data Observability

Real-time monitoring of data quality, pipeline health, and source freshness across 637,000+ funds

ETL Pipeline

Sources
--
Processing
--
Database
--
API Layer
--
Live Data Pipeline
SOURCES SEC / AMFI / Yahoo IMF / ECB / FRED EXTRACT API Fetch / Scrape PDF Parse / FTP TRANSFORM Normalize / Validate Deduplicate / Enrich LOAD Cloud SQL / GCS 639K+ Fund Records SERVE Flask APIs + Cache Cloud Run (max 2) 44 GitHub Actions workflows • Daily/Weekly/Monthly cadence • 28 countries • 77K+ macro observations
--
Total Funds
--
Countries
--
Active Pipelines
--
Quality Score
--
Data Freshness
--
Macro Observations

Fund Data Sources

Loading fund data sources...

Macro Economic Sources

Loading macro data sources...
Source Freshness
Source Region Last Updated Status
SEC EDGAR (N-PORT) USA Weekly Live
AMFI (India NAV) India Daily Live
IMF Data API Global Weekly Live
FRED (US Macro) USA Weekly Live
ECB Data Portal Eurozone Weekly Live
Yahoo Finance (NAV) Global Daily Live
World Bank API Global Weekly Live
CVM Brazil LatAm Manual (GCS warm) Manual
Morningstar MCP Global On-demand Limited

Country Coverage

Country Funds Managers Holdings AUM (USD) Name Coverage
Loading country data...
Data Quality Dimensions
—
Completeness
—
Accuracy
—
Freshness
—
Consistency
—
Coverage

Quality Dimensions

Loading quality dimensions...