Data Engineer

NielsenIQ · Pune, MH, in

onsitefull-time3-6 years

posted 15h

The ability to understand at least one data pipeline from a functional and technical perspective end to end, including an in-depth understanding of the data flows involved. Develop, test and deploy (big) data applications. Ensure that all development work in data pipelines follows best practices for ensuring validity, efficiency and maintainability. Collaborate in a distributed, cross-functional agile team to reach shared goals. Take ownership of technical implementations and architecture together with your team and in alignment with communities of practices. Communicate with data producers to align on data exchange formats and interfaces. Communicate with data consumers and other stakeholders in order to help them fulfill their needs to drive the business. Provide suggestions to business in the Media Measurement context on how existing and new data sources can be utilized to enhance our existing product portfolio. Recommend different ways to constantly improve data reliability and quality. Ability to document requirements and implemented solutions. Feeling comfortable as team member of a support team and finding solutions that fulfill our customers' requirements. Strong troubleshooting and problem-solving skills. Excellent English communication skills, with the ability to effectively interface across cross-functional technology teams and the business. 3+ years of working experience as a Data Engineer. You have a bachelor's degree in computer science, software/computer engineering, or applied mathematics. You are curious about finding new and unusual ways of how to solve data management issues. You already have experience with AWS services. You know how to design data structures and manage data access. You know how to monitor data quality. You have solid hands-on experience with Python. You are comfortable writing SQL queries to wrangle data from relational databases and Athena. Intermediate level of Database (SQL) skills to develop SQL queries, function and stored procedures. You have the ability to read code written by others and understand what the code does. You know how to orchestrate data pipelines with Airflow or any other similar data scheduling and orchestration tool. You have experience with CI/CD and ideally also with IaC using Terraform. You are following best practices in software engineering, like pair programming, testing, clean code and agile software development frameworks. You are able to give and take open, constructive feedback.