Senior AI Data Engineer

Mastercard · Pune, India

onsitefull-time6-10 years

posted 22h

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Senior AI Data Engineer Overview As a Senior AI Data Engineer within Mastercard's AI Center of Excellence, you will lead the design, development, and optimization of enterprise data platforms and pipelines that enable scalable AI, machine learning, and Generative AI solutions. You will be responsible for building production-grade data infrastructure that supports the complete AI lifecycle, including data ingestion, feature engineering, model training, inference, and continuous improvement Working closely with AI Engineers, Data Scientists, Platform Engineers, and Solution Architects, you will deliver secure, reliable, and high-performance data solutions while driving engineering best practices, data governance, and operational excellence across AI initiatives Key Responsibilities - Design, build, and maintain scalable, cloud-native data platforms that support enterprise AI and Agentic AI applications - Lead the development of robust batch and real-time data pipelines for AI model training, feature engineering, inference, and analytics - Build and optimize data architectures supporting LLMs, RAG, embeddings, vector databases, and AI knowledge repositories - Develop reusable data products, feature stores, metadata services, and data APIs that accelerate AI solution development across the enterprise - Ensure high standards of data quality through automated validation, profiling, lineage, observability, and monitoring - Optimize data processing performance, scalability, reliability, and cost across distributed cloud environments - Collaborate with AI Engineers and Data Scientists to prepare production-ready datasets and support model deployment, monitoring, and continuous improvement - Implement data governance, security, privacy, and compliance controls that align with Mastercard's enterprise standards and regulatory requirements - Design resilient, fault-tolerant data pipelines using modern orchestration, workflow automation, and event-driven architectures - Contribute to the implementation of MLOps and AgenticOps capabilities by delivering trusted data pipelines that support automated AI workflows Required Qualifications - Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field - Significant experience designing and implementing enterprise-scale data engineering solutions supporting AI and machine learning workloads - Strong proficiency in Python, SQL, Spark, and distributed data processing frameworks - Experience building cloud-native data platforms using AWS, Azure, or Google Cloud Platform - Hands-on experience with data lakes, Lakehouse architectures, data warehouses, and object storage technologies - Experience with streaming technologies such as Kafka, Kinesis, or Azure Event Hubs. - Strong knowledge of workflow orchestration tools such as Apache Airflow, Azure Data Factory, or similar platforms - Experience supporting AI and Generative AI solutions through feature engineering, vector databases, semantic search, embeddings, and RAG - Solid understanding of data modeling, metadata management, data lineage, and enterprise data governance - Experience implementing monitoring, observability, and operational support for production data pipelines - Strong software engineering practices, including version control, automated testing, CI/CD, and Infrastructure as Code - Excellent analytical, communication, and stakeholder management skills What You'll Deliver