Job Description

Engineer - DataREFID354668\xc2\xb7 Responsible to assemble large, complex sets of data that meet non-functional and functional business requirements.\xc2\xb7 Responsible to identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.\xc2\xb7 Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using Azure, Databricks and SQL technologies\xc2\xb7 Working with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues\xc2\xb7 Responsible for the transformation of conceptual algorithms from R&D into efficient, production ready code. The data developer must have a strong mathematical background in order to be able to document and maintain the code\xc2\xb7 Responsible for integrating finished models into larger data processes using UNIX scripting languages such as ksh, Python, Spark, Scala, etc.\xc2\xb7 Produce and maintain documentation for released data sets, new programs, shared utilities, or static data. This must be done within department standards\xc2\xb7 Ensure quality deliverables to clients by following existing quality processes, manually calculating comparison data, developing statistical pass/fail testing, and visually inspecting data for reasonableness: the requirement is on-time with zero defectsEducation/Training\xc2\xb7 B.E./B.Tech. with a major in Computer Science, BIS, CIS, Electrical Engineering, Operations Research or some other technical field.\xc2\xb7 Course work or experience in Numerical Analysis, Mathematics or StatisticsHard Skills\xc2\xb7 Proven experience working as a data engineer\xc2\xb7 Highly proficient in using the spark framework (python and/or Scala)\xc2\xb7 Extensive knowledge of Data Warehousing concepts, strategies, methodologies.\xc2\xb7 Programming experience in Python, SQL, Scala\xc2\xb7 Direct experience of building data pipelines using Azure Data Factory and Apache Spark (preferably in Databricks), Airflow.\xc2\xb7 Hands on experience designing and delivering solutions using Azure including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake\xc2\xb7 Experience with big data technologies (Hadoop)\xc2\xb7 Databricks & Azure Big Data Architecture Certification would be plus\xc2\xb7 Must be team oriented with strong collaboration, prioritization, and adaptability skills required\xc2\xb7 Ability to write highly efficient code in terms of performance / memory utilization\xc2\xb7 Ability to understand and document mathematical concepts to ensure proper application\xc2\xb7 Basic knowledge of SQL; capable of handling common functionsSoft Skills\xc2\xb7 Strong oral and written communication skills\xc2\xb7 Organized, strategic thinker\xc2\xb7 Logical approach to problem solving\xc2\xb7 \xe2\x80\x9cData minded\xe2\x80\x9d- feel a level of discomfort using or delivering data until personally:\xc3\xbc validating row and column counts\xc3\xbc validating data ranges for each field are within specification\xc3\xbc accounting for extremes\xc3\xbc manually calculating comparison data where possible\xc3\xbc verifying that atomic data is consistent with aggregate dataQualificationsExperience\xc2\xb7 Minimum 3-7 year of experience as Data engineer\xc2\xb7 Experience modeling or manipulating large amounts of data is a plus\xc2\xb7 Experience with Demographic, Retail business is a plusAdditional InformationAbout NIQNIQ is the world\'s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights-delivered with advanced analytics through state-of-the-art platforms-NIQ delivers the Full View\xe2\x84\xa2.NIQ, is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world\'s population. For more information, visit NIQ.com.Want to keep up with our latest updates?Follow us on: | | |Our commitment to Diversity, Equity, and InclusionNIQ is committed to reflecting the diversity of the clients, communities, and markets we measure within our own workforce. We exist to count everyone and are on a mission to systematically embed inclusion and diversity into all aspects of our workforce, measurement, and products. We enthusiastically invite candidates who share that mission to join us.We are proud to be an Equal Opportunity/Affirmative Action-Employer, making decisions without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability status, age, marital status, protected veteran status or any other protected class. Our global non-discrimination policy covers these protected classes in every market in which we do business worldwide.Learn more about how we are driving diversity and inclusion in everything we do by visiting the NielsenIQ News Center:NIQ or any of our subsidiaries will never ask you for money at any point of the recruitment or onboarding process.

NielsenIQ