Data Engineering · Full-stack
Enterprise system
Corporate Reporting
A secure web application that automated daily report delivery between PetroKazakhstan and KazMunayGas.
API
Source
08:00
Airflow
MySQL
Storage
REST
Node.js
WEB
React
XLSX
Export
Confidential project.Company names are disclosed with permission. Logos, source code, real data and application screens are not published.
Overview
I designed and built the complete system: daily API ingestion, MySQL storage and a secure interface where employees access reports and export them to Excel.
Problem
KazMunayGas employees spent time coordinating with PetroKazakhstan to obtain recurring reports. The data was needed every morning but depended on manual communication.
Solution
At 08:00 Airflow retrieves the PetroKazakhstan API data and stores it in MySQL. A Node.js REST API serves the React application. Staff connect through VPN, authenticate with AD and export the report to Excel.
How the system works
- 01PetroKazakhstan API
- 02Airflow · daily at 08:00
- 03MySQL storage and history
- 04Node.js / Express REST API
- 05React web application
- 06VPN + Active Directory + Excel export
My role
- End-to-end system architecture
- Airflow ETL orchestration
- MySQL schema and Sequelize migrations
- Backend API and React interface
- AD authentication and Excel export
Technology
Impact
08:00
automatic daily ingestion
1
single report access point
End-to-end
complete system ownership
Lessons learned
In enterprise software, value comes from the whole chain: scheduling, data integrity, access control and a practical delivery format.