Job Description

Key Responsibilities:

• Design, develop, and execute test cases to validate ETL pipelines and data processing workflows.
• Perform data validation, integrity checks, and reconciliation between source and target systems.
• Write and optimize SQL queries to test data transformation and ensure correctness.
• Develop automated test scripts using Python to streamline data quality assurance.
• Identify, document, and track data issues, inconsistencies, and performance bottlenecks.
• Implement data quality frameworks and ensure compliance with governance policies.
• Work closely with data engineers to define and improve data validation strategies.
• Automate test execution for batch and real-time data processing pipelines.
• Generate test reports and communicate findings to relevant stakeholders.
• Utilize Jira for defect tracking, test case management, and agile collaboration.

Required Skills & Qualifications:

• Strong proficiency in SQL , SQL Server Procs for data validation, reconciliation, and performance testing.
• Experience with Python for test automation and scripting.
• Hands-on experience with Databricks, Apache Spark or Data Lake.
• Strong understanding of ETL processes, data warehousing, and data governance.
• Experience working with cloud platforms like Azure, AWS, or GCP (preferably Azure Databricks).
• Knowledge of test automation frameworks for data testing.
• Strong problem-solving skills and attention to detail.

Job Tags

Similar Jobs