Associate Software Engineer

NielsenIQ · Chennai, TN, in

onsitefull-time1-3 years

posted 20h

About Job We are looking for a Spark Scala Developer with around 2 years of hands-on experience in building scalable data processing solutions. The ideal candidate will work on big data platforms, designing and developing batch and real-time processing pipelines using Apache Spark and Scala. Key Responsibilities Develop and maintain data processing pipelines using Apache Spark (Core, SQL) Write efficient, scalable, and reusable code in Scala Work with large-scale distributed datasets (ETL/ELT processing) Optimize Spark jobs for performance and resource utilization Implement data transformations, cleansing, and aggregations Collaborate with data engineers, analysts, and stakeholders to understand data requirements Monitor and troubleshoot data workflows and production issues Ensure code quality with proper unit testing and version control (GitHub)   Bachelor’s degree in Computer Science, IT, or related field 1-2 years of experience in Big Data technologies Relevant certifications in Spark/Big Data (optional)