Dashboard

Energy Atlas
⌘K
AK

Data Pipeline Hub

Manage data sources, connectors, and ingestion pipelines across your Energy Atlas deployment.

↑ 8%
8
Connected Sources
21
Active Tables
7 schemas
↑ 12%
24,456
Rows Ingested Today
7
Active Sources
1 failed

Quick Actions

Jump into any integration workflow

New API Source→
Connect Database→
Import File→
Provision Infra→

Recent Sync Activity

Live data ingestion status across all sources

SourceStatusRowsDurationStarted
IEX Market Datacompleted1,4408s08:15 AM
Vidyut Pravahcompleted9614s08:30 AM
IBM Weather Companyrunning5,840—08:00 AM
PXIL Exchangefailed0 (96 err)3s06:00 AM
MERIT Indiacompleted12,48045s07:45 AM
Karnataka SLDCcompleted38422s08:45 AM

API Connector

Connect to third-party REST APIs for automated data ingestion.

IEX Market Data active
https://api.iexindia.com/v2
1,440
rows today
120ms
avg latency
api keyincremental
Target
raw_iex.day_ahead_prices
Last Sync
8:15 AM
Auth
API Key
Vidyut Pravah active
https://vidyutpravah.in/api
288
rows today
450ms
avg latency
bearerincremental
Target
raw_demand.state_demand
Last Sync
8:30 AM
Auth
Bearer Token
IBM Weather Company active
https://api.weather.com/v3
8,760
rows today
200ms
avg latency
api keyfull refresh
Target
raw_weather.hourly_forecast
Last Sync
8:00 AM
Auth
API Key
PXIL Exchange error
https://api.pxil.com/v1
0
rows today
-
avg latency
api keyincremental
Target
raw_pxil.market_prices
Last Sync
Failed 6:00 AM
Auth
API Key
MERIT India active
https://meritindia.in/api
12,480
rows today
340ms
avg latency
bearerincremental
Target
raw_merit.generator_data
Last Sync
7:45 AM
Auth
Bearer Token

DB Connector

Connect to PostgreSQL, MySQL, BigQuery, and other databases.

Connectivity Mode

Existing Connections

AION Cloud SQL (Primary) connected
postgresql · 10.0.1.5:5432 · same vpc
12
schemas
47
tables
KPTCL Analytics DB connected
postgresql · 172.16.2.10:5432 · cross vpc
4
schemas
18
tables
HPSEBL Data Warehouse pending
bigquery · project-hpsebl.dataset · public
0
schemas
0
tables

Import Wizard

Upload CSV, Excel, Parquet, or JSON files to import into the database.

kptcl_demand_schedule.csv
8,640 rows · 1.2 MB · 6 columns
ColumnInferred TypeSample
timestampTIMESTAMP2026-02-19 08:00:00
stateVARCHAR(50)Karnataka
demand_mwFLOAT8542.3
frequency_hzFLOAT49.98
drawal_mwFLOAT8123.7
schedule_mwFLOAT8200.0

Infra Provisioner

Provision managed databases across cloud providers with Terraform.

Google Cloud
Cloud SQL, BigQuery, AlloyDB
Amazon Web Services
RDS, Aurora, Redshift
Microsoft Azure
Azure SQL, Azure PostgreSQL

Terraform Plan Preview

+ google_sql_database_instance.energy_atlas
    name                 = "aion-energy-atlas-prod"
    database_version     = "POSTGRES_16"
    region               = "asia-south1"
    tier                 = "db-n1-standard-2"
    disk_size            = 100
    availability_type    = "REGIONAL"
    deletion_protection  = true

+ google_sql_database.energy_atlas_db
    name     = "energy_atlas"
    instance = google_sql_database_instance.energy_atlas.name

+ google_sql_user.flux_service
    name     = "flux_service"
    type     = "BUILT_IN"

Plan: 3 to add, 0 to change, 0 to destroy.
This will provision billable cloud resources. Estimated cost: ~$120/month.

Schema Registry

Central metadata catalog of all schemas, tables, and data lineage.

raw_iex
IEX market exchange data
2.1M
total rows
4
tables
day_ahead_prices8 cols1.4M rows2 min ago
rtm_prices8 cols580K rows5 min ago
tam_contracts12 cols12K rows1 hr ago
green_certificates10 cols3.2K rows6 hr ago
raw_weather
Weather forecast and actuals
5.8M
total rows
3
tables
hourly_forecast14 cols4.2M rows15 min ago
daily_actuals10 cols1.2M rows1 hr ago
station_metadata8 cols842 rows30 days ago
raw_demand
State-level demand and SLDC data
1.8M
total rows
3
tables
state_demand6 cols960K rows30 sec ago
block_schedule8 cols720K rows2 min ago
frequency_profile5 cols120K rows1 min ago
energy_atlas_market
Market data — IEX, PXIL, NSE derivatives
340K
total rows
4
tables
futures_daily12 cols180K rows15 min ago
spot_reference_rate6 cols96K rows30 min ago
futures_contract8 cols48 rows1 hr ago
futures_product10 cols3 rows7 days ago
tenant_kptcl
KPTCL-specific isolated data
450K
total rows
3
tables
demand_schedule8 cols240K rows1 hr ago
dsm_penalties12 cols180K rows2 hr ago
revision_history15 cols30K rows1 hr ago

Settings

Configure FLUX pipeline hub preferences.

API Configuration
Backend service connection
Notifications
Alert preferences
Sync failures
Alert when a sync operation fails
Schema changes
Detect upstream schema drift
Row count anomalies
Alert on unusual ingestion volumes
Latency spikes
Alert when source latency exceeds threshold