Senior Data Engineering Lead

Experian · Hyderabad, in

onsitefull-time6-10 years

posted 19h

We are looking for a senior engineering leader to define and deliver a modern, cloud-based data platform that powers analytics, AI, and business decision-making across the organization. This role is responsible for building scalable batch and real-time data pipelines, establishing data governance and reliability standards, and driving platform modernization on AWS. The successful candidate will lead multidisciplinary engineering teams, shape the data platform strategy, and deliver secure, high-performing solutions that improve data accessibility, operational efficiency, and business outcomes while enabling future AI-driven capabilities What You'll Be Doing This role is Hyderabad based and reporting to Director Engineering You will lead the design and delivery of scalable batch and streaming data platforms that support analytics, reporting, and AI use cases. Manage and mentor teams across Data Engineering, Platform Engineering, and DevOps while establishing engineering standards, reusable frameworks, and delivery roadmaps. You will build reliable data pipelines with strong governance, observability, security, and data quality practices to ensure trusted and compliant data products. Drive cloud platform modernization using AWS services, infrastructure automation, CI/CD practices, and event-driven architectures. Partner with Product, Architecture, Governance, and Business teams to prioritize initiatives, manage delivery risks, and align platform investments with business goals.   What We're Looking For 10+ years of experience in Data Engineering, Software Engineering, or Platform Engineering, including leadership responsibility for engineering teams. Proven experience designing and operating large-scale batch and streaming data platforms using technologies such as Apache Spark, Kafka, Kinesis, Flink, or equivalent. Strong expertise in AWS cloud services, including data, compute, orchestration, and infrastructure components. Experience building modern data lake, warehouse, or lakehouse solutions using technologies such as Snowflake, Databricks, Redshift, Athena, Iceberg, Delta Lake, or similar platforms. Hands-on experience with CI/CD, Infrastructure as Code, containerized platforms, and engineering automation practices. Experience implementing data governance, observability, security, and compliance controls, including data quality frameworks and regulated data management.