Job Description

Job Overview:


We are seeking a highly skilled and experienced ETL Tester to join our dynamic team. The ideal candidate will have strong expertise in SQL, Python, and PySpark and be proficient in testing ETL processes in a Snowflake and Postgres database environment. As an ETL Tester, you will be responsible for testing data pipelines, ensuring data integrity, and optimizing performance using tools such as Databricks and Tidal. In addition, you will play a key role in creating comprehensive test strategies, plans, and cases while leveraging defect management tools like Azure DevOps.


Key Responsibilities:


Perform end-to-end testing for ETL processes using Databricks, ensuring data integrity and accuracy across Snowflake and Postgres databases.


Write complex SQL queries for data validation, transformation, and reporting, ensuring that data flows correctly through various systems.


Develop and execute automated tests using Python and PySpark to validate ETL scripts and data pipelines.


Create Test Plans, and Test Cases for ETL processes, including functional and performance testing.


Conduct performance testing to ensure that data transformations and loading operations meet scalability and speed requirements.


Track and manage defects using Azure DevOps, ensuring that all identified issues are promptly addressed and resolved.


Work closely with Data Engineers, Business Analysts, and other stakeholders to understand ETL requirements and deliver high-quality testing.


Contribute to the improvement of testing processes and automation frameworks to increase testing efficiency and reduce manual testing efforts.


Required Skills & Qualifications:


ETL Testing Expertise: Proven experience in testing ETL processes, with a strong focus on data validation, transformation, and loading.


SQL: Strong proficiency in writing and optimizing SQL queries for data validation and analysis.


Python & PySpark: Experience in using Python and PySpark for test automation and data processing tasks.


Databricks: Familiarity with Databricks for managing and testing data pipelines.


Databases: Expertise with Snowflake and Postgres databases.


Scheduling Tool: Experience with Tidal or similar scheduling tools to automate ETL workflows and test execution.


Defect Management: Hands-on experience with defect management using Azure DevOps for tracking, reporting, and resolving issues.


Testing Documentation: Strong experience in creating Test Plan, and Test Case documents for both functional and performance testing.


Functional & Performance Testing: Experience in both functional testing (data validation) and performance testing (load, stress, and scalability testing) of ETL processes.


Preferred Qualifications:


Certification: ISTQB or equivalent testing certification is a plus.


Automation Testing: Experience with python-based automation frameworks and tools for ETL testing is a plus.


Cloud & Big Data Tools: Familiarity with cloud-based platforms like AWS, Azure, or GCP is a plus.


Soft Skills:


Strong analytical and problem-solving skills.


Excellent communication and collaboration skills to work with cross-functional teams.


Ability to work independently with minimal supervision and manage multiple priorities.



About Virtusa



Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 30,000 people globally that cares about your growth -- one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.



Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.



Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.