Hi, I'm Shiva Darshan
Data Engineer & Data Analyst
I specialize in designing robust ETL pipelines, optimizing SQL databases, and building interactive dashboards that turn raw data logs into high-impact business intelligence.
import pandas as pd
from sqlalchemy import create_engine
# Extract data from sources
df = pd.read_csv("flight_delays_raw.csv")
# Clean and transform flights data
df['delay_minutes'] = df['delay_minutes'].fillna(0)
summary = df.groupby('airline').agg({
'delay_minutes': 'mean',
'flight_id': 'count'
}).rename(columns={'flight_id': 'total_flights'})
# Load into PostgreSQL warehouse
engine = create_engine('postgresql://admin@db/wh')
summary.to_sql('airline_kpis', engine, if_exists='replace')
print("ETL pipeline executed successfully! ✅")
// About Me
profile_card.json$ cat summary.txt
Koukuntla Shiva Darshan
Data Engineer & Analyst
// Skill Tree
system_capabilities.confData Engineering & ETL
Designing data extraction, cleaning workflows, schema design, and load operations.
-
ETL Pipelines75%
-
Data Cleaning & Pandas80%
-
Database Schema Design70%
Databases & Queries
Writing highly performant queries, analytics aggregates, CTEs, window functions, and stored procedures.
-
SQL (MySQL, PostgreSQL)85%
-
Complex Joins & Aggregates80%
-
CTEs & Subqueries80%
Analytics & BI
Translating complex datasets into beautiful, interactive, and actionable dashboards for stakeholders.
-
Power BI (Basic DAX, Reports)75%
-
Matplotlib & Seaborn70%
-
Excel (Pivots, Formulas)85%
Cloud & Frameworks
Studying and deploying solutions on cloud platforms, version control, and automation scheduling.
-
Git & GitHub75%
-
Cloud Fundamentals (AWS/Azure)50%
-
Apache Spark & Airflow40%
// Live Pipeline & SQL Playground
realtime_etl_monitor.exeAs a Data Engineer, I build pipelines that run silently in the background. Here is a live simulation of a mock pipeline processing airline delays and transactions, alongside a sandbox to run SQL queries on the output.
// Work Experience & Education
career_history.dbData Analyst (Intern)
Labmentix 📍 Bengaluru, Karnataka (Remote)
- Built comprehensive Power BI dashboards to track airline operational metrics, delay patterns, and compliance rules.
- Cleaned, imputed, and verified datasets using Python (Pandas) and SQL queries, ensuring production data quality.
- Maintained and updated documentation of key data pipelines, supporting data lineage logs.
- Mapped business analytics requests into structured SQL queries and data validation scripts.
Data Science & Analytics Intern
Zidio Developers 📍 Bengaluru, Karnataka (Remote)
- Designed analytical SQL queries to evaluate demand-supply balances in ride-share request datasets.
- Built automated Python scripts using Pandas for data staging, cleaning, and simple ETL file loading.
- Visualized key patterns (e.g. peak hours, high-density areas) using Matplotlib and Seaborn for business teams.
- Gained hands-on knowledge of end-to-end data pipelines from CSV files to database staging.
B.Tech in Computer Science & Engineering (Data Science)
KG Reddy College of Engineering & Technology, JNTUH 📍 Hyderabad, India
- Specialized in data engineering, cloud concepts, structures & algorithms, and databases.
- Acquired foundation in database structures, SQL, data structures, and python scripting.
- Captain of the College Kabaddi Team, leading the squad to tournament victories (honing leadership and collaboration under pressure).
// Featured Projects
data_repositories.logE-Commerce SQL Analytics
Designed a fully normalized MySQL database schema featuring 15+ tables. Developed 30+ complex queries incorporating windows, CTEs, and aggregation rules, alongside stored procedures for RFM user segmentation.
Banking Credit Risk Analytics
Cleaned and analyzed massive loan applicant portfolios using Python (Pandas/NumPy) to identify drivers of default. Built responsive Power BI dashboards to display risk indicators, KPIs, and demographic insights.
ETL File Processing Automation
Designed lightweight Python automated systems that clean CSV input feeds daily, perform schema checking, and use SQLALchemy to ingest records into an analytics database, triggering HTML alerts on validation failures.
// Connect
socket_connections.infoLet's Collaborate
I'm currently looking for full-time Data Engineer, Associate Data Engineer, or Data Analyst roles. If you have a role available, or simply want to chat about SQL optimization, ETL setups, or Kabaddi strategies — reach out!