Data Integration Agent & Deployment Hub

FLUX

The backbone data layer powering every Quenext product. FLUX manages data sources, API connectors, database integrations, schema registries, file imports, and cloud infrastructure provisioning — a complete data pipeline hub and deployment agent.

play_arrow Launch Interactive Demo
15+
Live Sources
24K+
Rows/Day
<200ms
Avg Latency
99.97%
Uptime
Exploreexpand_more
Pipeline Hub

Unified Data Operations Dashboard

A single pane of glass for all data pipeline operations. Monitor connected sources, active tables, rows ingested, sync status, and failure alerts — with quick actions to jump into any integration workflow instantly.

  • hub 8 connected sources with 21 active tables across 7 schemas
  • bolt 24,456 rows ingested today with real-time sync activity feed
  • speed Quick Actions: New API Source, Connect Database, Import File, Provision Infra
  • notifications_active Live sync status: completed, running, failed — with instant retry
FLUX Data Pipeline Hub dashboard showing connected sources, active tables, and sync activity
API Connector

Third-Party REST API Integration

Connect to any REST API with configurable authentication (API Key, Bearer Token, OAuth). Each source shows real-time row counts, average latency, sync status, and target table mapping. Built-in connectors for India's critical energy data sources.

  • electric_bolt IEX Market Data — 1,440 rows/day, 120ms latency, DAM/TAM/RTM prices
  • grid_on Vidyut Pravah — State-level demand, frequency, drawal data (288 rows/day)
  • cloud IBM Weather Company — 8,760 hourly forecasts/day with weather station metadata
  • swap_horiz PXIL Exchange — Market prices with auto-retry on failure
  • factory MERIT India — Generator dispatch data, 12,480 rows/day, 340ms latency
  • cell_tower State SLDC Feeds — Real-time frequency profiles, block schedules
FLUX API Connector showing IEX, Vidyut Pravah, IBM Weather, PXIL, and MERIT India sources
Database Connector

Multi-Database Integration

Connect to PostgreSQL, MySQL, BigQuery, and other databases with four connectivity modes — Public IP, Same VPC, Cross-VPC/Client VPC (via peering or PSC), and On-Premise (tunnel agent). Each connection manages schemas, tables, and real-time sync status.

  • dns Public IP — Direct SSL connection, allowlist AION IP, fully autonomous
  • lan Same VPC — Private IP via VPC connector (Cloud Run → Cloud SQL)
  • vpn_lock Cross-VPC — Client VPC access via VPC peering or Private Service Connect
  • router On-Premise — DB inside client network via tunnel agent or VPN
  • storage Live connections: AION Cloud SQL (12 schemas, 47 tables), KPTCL Analytics DB, HPSEBL Data Warehouse
CONNECTIVITY MODES
Public IP
Direct SSL endpoint
Same VPC
Private IP, VPC connector
Cross-VPC
VPC peering / PSC
On-Premise
Tunnel / VPN agent
Schema Registry

Central Metadata Catalog

A complete metadata catalog of all schemas, tables, columns, and data lineage. Track row counts, column schemas, last sync times, and data freshness across your entire data estate. Detect schema drift and upstream changes automatically.

  • schema raw_iex — 4 tables, 2.1M rows (DAM prices, RTM prices, TAM contracts, green certificates)
  • cloud raw_weather — 3 tables, 5.8M rows (hourly forecast, daily actuals, station metadata)
  • electric_meter raw_demand — 3 tables, 1.8M rows (state demand, block schedule, frequency profile)
  • trending_up energy_atlas_market — 4 tables, 340K rows (futures, spot rates, contracts)
  • apartment tenant_kptcl — 3 tables, 450K rows (demand schedule, DSM penalties, revision history)
  • sync Schema drift detection and upstream change alerts
SCHEMA REGISTRY — 7 SCHEMAS · 21 TABLES
raw_iexIEX market exchange data
2.1M rows · 4 tables
raw_weatherWeather forecast & actuals
5.8M rows · 3 tables
raw_demandState demand & SLDC data
1.8M rows · 3 tables
raw_meritGenerator dispatch data
3.4M rows · 4 tables
Import Wizard

File Import & Schema Inference

Upload CSV, Excel, Parquet, or JSON files and FLUX automatically infers column types, previews data, and maps to target tables. One-click import with intelligent type detection — TIMESTAMP, VARCHAR, FLOAT — all handled automatically.

  • upload_file Drag-and-drop file upload with instant schema inference
  • data_object Supported formats: CSV, Excel (.xlsx), Parquet, JSON, NDJSON
  • auto_fix Automatic type detection: TIMESTAMP, VARCHAR, FLOAT, INTEGER, BOOLEAN
  • preview Column preview with sample data before import confirmation
  • check_circle Example: kptcl_demand_schedule.csv — 8,640 rows, 6 columns, 1.2 MB, one-click import
IMPORT PREVIEW — kptcl_demand_schedule.csv
ColumnTypeSample
timestampTIMESTAMP2026-02-19 08:00:00
stateVARCHAR(50)Karnataka
demand_mwFLOAT8542.3
frequency_hzFLOAT49.98
8,640 rows · 1.2 MB · 6 columns
Infrastructure Provisioner

Cloud Deployment with Terraform

Provision managed databases across Google Cloud, AWS, and Azure with auto-generated Terraform plans. FLUX acts as a deployment agent — generating IaC, previewing resource changes, estimating costs, and applying infrastructure with one click.

  • cloud Google Cloud — Cloud SQL, BigQuery, AlloyDB provisioning
  • cloud Amazon Web Services — RDS, Aurora, Redshift provisioning
  • cloud Microsoft Azure — Azure SQL, Azure PostgreSQL provisioning
  • code Auto-generated Terraform plans with cost estimation (~$120/month)
  • verified Plan preview: "3 to add, 0 to change, 0 to destroy" before apply
  • security Deletion protection, regional availability, and service account management
TERRAFORM PLAN PREVIEW
+ google_sql_database_instance.energy_atlas
    name                = "aion-energy-atlas-prod"
    database_version    = "POSTGRES_16"
    region              = "asia-south1"
    tier                = "db-n1-standard-2"
    availability_type   = "REGIONAL"
    deletion_protection = true

+ google_sql_database.energy_atlas_db
+ google_sql_user.flux_service

Plan: 3 to add, 0 to change, 0 to destroy.
Observability

Data Lineage & Pipeline Monitoring

End-to-end visibility into your data pipelines. Track every row from source to destination, monitor sync latency, detect anomalies in ingestion volumes, and get instant alerts on failures, schema drift, and latency spikes.

  • timeline Data lineage tracking from raw source to transformed output
  • error Sync failure alerts with automatic retry and error categorization
  • schema Schema drift detection — upstream changes flagged before they break pipelines
  • monitoring Row count anomaly detection — alerts on unusual ingestion volumes
  • speed Latency monitoring — alerts when source latency exceeds configured thresholds
  • notifications Configurable alerts: Email, SMS, push notifications for sync failures and anomalies
RECENT SYNC ACTIVITY
IEX Market Data completed · 1,440 rows · 8s
Vidyut Pravah completed · 96 rows · 14s
IBM Weather Company running · 5,840 rows
PXIL Exchange failed · 0 rows · 7% error rate
MERIT India completed · 12,480 rows · 3s

FLUX Modules

Six integrated modules for complete data pipeline and deployment management

api

API Connector

Connect to any REST API with configurable auth (API Key, Bearer, OAuth). Built-in connectors for IEX, Vidyut Pravah, IBM Weather, PXIL, MERIT India, SLDC feeds.

storage

DB Connector

PostgreSQL, MySQL, BigQuery, AlloyDB integration with four connectivity modes — Public IP, Same VPC, Cross-VPC, and On-Premise tunnel.

upload_file

Import Wizard

Upload CSV, Excel, Parquet, or JSON with automatic schema inference, column type detection, and one-click import to target tables.

cloud_done

Infra Provisioner

Terraform-based cloud infrastructure deployment. Provision managed databases on GCP, AWS, or Azure with auto-generated IaC and cost estimation.

schema

Schema Registry

Central metadata catalog with full schema browsing, data lineage tracking, row counts, column definitions, and schema drift detection.

monitoring

Pipeline Monitoring

Real-time sync status, failure alerts, latency monitoring, row count anomaly detection, and configurable notifications across all data sources.

Power Your Data Pipeline

The backbone layer that makes every Quenext product work. See FLUX in action.

play_arrow Launch Interactive Demo calendar_today Schedule a Demo arrow_back Back to Home