Job Description

:

Title: Lead Data Quality & Testing Engineer

Experience: 6+ years

Location: Gurgaon, India (Hybrid)

About the job: Data Quality & ETL Testing

Job Summary:

EXL is seeking a detail-oriented and experienced Data Quality Assurance professional to join our team. The Data Quality assurance engineer would be responsible to write testing plans and routines, manage continuous integration and regression testing processes, and be the point of contact for clearing data for release according to delivery specifications. The engineer must be able to function effectively in a high-volume, rapid delivery environment. The person will be also involved in building out data quality assurance capabilities. This role is critical in maintaining the accuracy, completeness, and consistency of our data assets ensuring that our data meets the highest quality standards.

Responsibilities:

• ETL Testing:

• Help create and implement quality processes and requirements
• Develop and maintain a comprehensive suite of test cases to validate data quality across our data pipelines, databases, and reporting systems
• Collaborate closely with data architects, stewards, data engineers and data analysts to understand data pipelines and workflows to create effective testing strategies, scenarios.
• Design and build test automation framework for data pipelines to streamline data pipeline testing processes.
• Design, monitor and maintain QA reports, KPIs & quality trends for data systems
• Automate test case using various automation tools & integrate with CI/CD pipelines
• Data Quality Testing:

• Data Profiling: Conduct data profiling and analysis to understand data patterns, anomalies, and outliers.
• Data Validation & Quality Improvement: Develop and implement data validation procedures to identify and rectify inconsistencies, errors, and inaccuracies in datasets. Identify areas for data quality improvement and propose solutions for enhancement.
• Data Quality Monitoring & Reporting: Continuously monitor data quality using automated tools and manual inspections to detect and address issues promptly. Generate regular reports on data quality status and improvements
• Documentation: Maintain detailed records of data quality assessments, issues, and resolutions.
• Standards: Establish and enforce data quality standards, guidelines, and best practices across the data assets.
• Collaboration: Collaborate with data owners, data stewards, and other relevant stakeholders to address data quality issues, design DQ rules & test cases and ensure that test cases cover a wide range of data quality checks
• Integrate DQ modules with data pipelines to automate DQ testing
• Utilize industry-standard test automation tools and frameworks to streamline the execution of test cases.
• Stay up-to-date with the latest test automation tools and techniques, recommending and implementing best practices to continuously improve the automation process.
• Provide leadership through all phases of project life cycle including scope definition and gathering business requirements
• Work with multiple clients, identify data management opportunities in the form of gaps or new scope, work on solution design for the same.
• Setting up ETL & DQ Testing frameworks, processes & teams from scratch
• Research on new tools, tech & trends in the market, create PoVs on where they fit in the Data Management scope and how they support the client architectures.
• Business Development in the form of RFP responses, building accelerators, data products etc.

• 7+ years of relevant experience in QA and testing (data, regression, automation, defects).
• Bachelor\'s or Master\'s degree in Computer Science, Mathematics, Engineering, Statistics, or related field of study.
• Strong SQL skills to carry out data validations from Source to Destination.
• Hands-on experience on ETL Testing and experience in Python to develop the Framework that can introduce automation and efficiency in test execution.
• Hands-on experience of testing in system, integration testing phases.
• Should be able to handle the incremental data testing and improve the test execution time
• Creation of Test Plan/ completion documents, project timelines, and execution of multiple projects.
• Conduct consumers regression testing to identify the mismatches PRE and POST deployment
• Proven experience in unit testing tools/modules \xe2\x80\x93 pytest, pyunit, Junit, TestNG
• Proven experience in API testing and tools/modules like SoapUI, Postman, Requests etc
• Understanding on CI/CD and how to integrate Unit & Integration test cases with CI/CD tools like Jenkins/Concourse and use Git, SVN, Bitbucket etc for versioning
• Good understanding of SDLC and agile methodologies such as Scrum and KanBan and tools like Jira, Confluence etc.
• Problem Solving: uses an organized and logical approach to find solutions to complex problems. Looks beyond the obvious to understand the root cause of problems
• Attention to detail and high accuracy standards.
• Excellent communication and collaboration skills.
• Strong analytical and problem-solving skills.

• Any experience in security & penetration testing is good to have
• Good Understanding of NoSQL databases, distributed processing frameworks like Spark, Hadoop is good to have
• Good understanding of one of the cloud platform (GCP, AWS, Azure) and respective tools associated with analytics and data is good to have
• Experience in tools like Collibra, Alation, Montecarlo, Datadog etc. from observability perpective is good to have
• Understanding of Orchestration tools like Airflow is good to have
• Familiarity with data governance and data management principles.

EXL Service