Data Engineer Β· 5 Years

PhaniKumar S

Building pipelines at scale

Senior Data Engineer specializing in scalable data pipelines, real-time ingestion, and cloud-native architectures on Azure & AWS. Currently at Amegy Bank, Houston.

5+
Years Experience
99.9%
SLA Adherence
60%
Processing Reduced
$80M
Revenue Impact
Houston, Texas, US
AVAILABLE FOR OPPORTUNITIES

Technical Stack

⚑ Stream Processing
Apache Kafka Azure Event Hubs Spark Streaming Delta Live Tables
☁️ Cloud Platforms
Azure Databricks Azure Data Factory AWS S3 AWS Glue AWS IAM
πŸ”§ Data Engineering
Apache Spark Delta Lake dbt Airflow Apache Avro
πŸ—„οΈ Storage & Warehouses
Snowflake Azure Synapse ADLS Gen2 Parquet
πŸ’» Languages
Python SQL Spark SQL PySpark
πŸ€– AI / Infra
Docker LLMs Vector Databases Embeddings Gen AI

Experience

Amegy Bank
Sep 2025 – Present
Data Engineer Β· Houston, TX
  • Built ingestion pipelines handling semi-structured data (JSON, Parquet, CSV) from APIs and core banking systems, supporting 10+ upstream systems with ≀15 min latency.
  • Orchestrated 25+ Airflow DAGs with dependency handling, retries and alerting β€” achieving 99.9% SLA adherence.
  • Implemented CDC incremental pipelines, reducing data processing volume by 60% and pipeline runtimes from 2 hours to 45 minutes.
  • Built data validation & reconciliation frameworks improving data accuracy to 99% for financial reporting.
  • Implemented secure access using AWS IAM role-based policies for sensitive banking datasets in S3.
Wipro
Mar 2021 – Dec 2023
Data Engineer Β· Hyderabad
  • Designed automated ADF pipelines with real-time triggers, enhancing operational reliability by 30%.
  • Optimized Spark jobs via partition pruning, caching, and Z-ordering on NestlΓ© sales data β€” improving query performance by 20%.
  • Developed automated pipeline failure detection using Azure Monitor + Teams alerts, achieving 50% faster incident response.
  • Implemented Delta Lake upserts with watermarking, reducing ETL processing time by 40%.
  • Supported NestlΓ©'s $80M YoY revenue growth in 2022 through optimized reporting pipelines.
Deloitte
Feb 2020 – Jan 2021
Analytical Engineer Β· Telangana
  • Designed 30+ unit test cases for claims, membership eligibility, and provider data β€” improving data accuracy to 98%.
  • Developed complex transformation logic using Spark SQL, multi-level joins and window functions for advanced analytics.
  • Conducted peer code reviews to enforce development best practices across the analytics engineering team.
25+
Airflow DAGs Built
10+
Upstream Systems
40%
ETL Time Saved
3
Top-Tier Companies

Education

πŸŽ“
Avila University
Master of Science Β· Computer Science
Jan 2024 – Aug 2025
Kansas City, Missouri
Graduate Degree Computer Science MS
πŸ›οΈ
Kallam Haranadhareddy Institute of Technology
Bachelor of Technology Β· Computer Science
2016 – 2020
Andhra Pradesh, India
B.Tech Computer Science Engineering
πŸ… Certifications
Deloitte
AI Certified
Infosys
InfyTQ Certification

Get In Touch

Open to senior data engineering roles, consulting, and interesting pipeline challenges.

Available for Opportunities

Based in Houston, TX. Open to on-site, hybrid, or remote positions. Specializing in Azure-native data platforms, real-time streaming pipelines, and medallion architecture.

Full-time Contract Consulting Remote OK
Send a Message β†’