β‘ Software Engineer | π Data Engineer | π» Cloud Enthusiast
- π Designing scalable data pipelines with Azure Data Factory, Synapse, and Databricks
- π§ͺ Automating data quality validation through reusable PySpark test suites
- π§ Experimenting with AI services in Azure for intelligent data workflows
- ποΈ Azure architecture patterns for enterprise-scale systems
- β‘ Advanced Spark performance tuning & job optimization
- π€ Best practices in open-source collaboration & DevOps for data teams
Iβd love to team up on:
- βοΈ Cloud-native data platforms and automation tools
- π Real-time data streaming and observability pipelines
- π οΈ Open-source utilities for MLOps and data testing
- π Azure Data Services: ADF, ADLS Gen2, Synapse
- π PySpark: Transformations, performance tuning, Spark SQL
- βοΈ Workflow automation using Databricks notebooks & pipelines
- βοΈ Email: [v-kumashiva@microsoft.com]
- πΌ LinkedIn: linkedin.com/in/kumarshivam2s
I debug data issues like Sherlock β logs, clues, and all.
But nothing beats a perfectly visualized Power BI dashboard at the end of the chase! π΅οΈββοΈπ