ecosystem. What Your Day Will Look Like Build scalable and robust frameworks for validating complex data systems, pipelines, and APIs using tools like Pandas, GreatExpectations, and Java modules. Collaborate with development teams to design and implement automated tests for microservices, emphasizing Spring Boot and Java-based architectures. … seamless build and deployment cycles. Strong programming skills in Python, with additional experience in SQL and scripting for data manipulation and validation. Familiarity with GreatExpectations (or similar), Postman, and synthetic data generation frameworks. Expertise in identifying testing gaps, proposing enhancements, and fostering a culture of data quality More ❯
ecosystem. What Your Day Will Look Like Build scalable and robust frameworks for validating complex data systems, pipelines, and APIs using tools like Pandas, GreatExpectations, and Java modules. Collaborate with development teams to design and implement automated tests for microservices, emphasizing Spring Boot and Java-based architectures. … seamless build and deployment cycles. Strong programming skills in Python, with additional experience in SQL and scripting for data manipulation and validation. Familiarity with GreatExpectations (or similar), Postman, and synthetic data generation frameworks. Expertise in identifying testing gaps, proposing enhancements, and fostering a culture of data quality More ❯
data and analytic solutions. Developing data processing pipelines in python for Databricks including many of the following technologies: Spark, Delta, Delta Live Tables, PyTest, GreatExpectations (or similar). Building and orchestrating data and analytical processing for streaming data with technologies such as Kafka, AWS Kinesis or Azure More ❯
for AI/ML models using tools like Mosaic ML. Working with semantic layers and advanced data modelling techniques. Implementing automated testing frameworks like GreatExpectations or PyTest . Ready to lead the charge in a company that values innovation, autonomy and real impact? Let’s chat. Apply More ❯
for AI/ML models using tools like Mosaic ML. Working with semantic layers and advanced data modelling techniques. Implementing automated testing frameworks like GreatExpectations or PyTest . Ready to lead the charge in a company that values innovation, autonomy and real impact? Let’s chat. Apply More ❯
Experience with cloud-based data platforms , preferably Azure Databricks, Azure Data Factory, or Synapse Analytics . Basic experience with test automation frameworks (e.g., PyTest, GreatExpectations, DBT tests, or similar). Proficiency in SQL and scripting languages (e.g., Python, Scala) for test automation. Understanding of CI/CD More ❯
with cloud-based data platforms , particularly Azure Databricks, Azure Data Factory, and Synapse Analytics . Hands-on experience with test automation frameworks (e.g., PyTest, GreatExpectations, DBT tests, or similar). Proficiency in SQL and scripting languages (e.g., Python, Scala) for test automation. Experience in CI/CD More ❯
communication skills with both technical and business customers • Experience with CI/CD pipelines for data transformations • Experience with data quality and testing tools (GreatExpectations, dbt tests) What will help you on the job • Experience working within an agile team and familiarity with JIRA • Degree in a More ❯
Azure tools including ADF, Synapse, Data Lake, and Key Vault - Databricks or Microsoft Fabric Notebooks using PySpark * Experience building automation frameworks (e.g., Pytest, Nutter, GreatExpectations). * Familiarity with Medallion Architecture and Delta Lake. * Skilled in CI/CD integration (Azure DevOps or GitHub Actions) and Git version More ❯
and problem-solving skills Excellent communication and interpersonal skills Education and Experience: Proficiency in SQL and Python Experience with modern data testing frameworks (dbt, GreatExpectations) Proficiency in writing and maintaining dbt tests for data transformations Experience in CI/CD practices for data pipelines aPriori Offers Competitive More ❯
Document test results, defects, and quality metrics. Preferred qualifications: Experience with PySpark or notebooks in Databricks. Exposure to Azure DevOps, Unit Testing frameworks, or GreatExpectations for data testing. Knowledge of data warehousing or medallion architecture (bronze, silver, gold layers). Experience with data visualization tools (e.g., Power More ❯
Document test results, defects, and quality metrics. Preferred qualifications: Experience with PySpark or notebooks in Databricks. Exposure to Azure DevOps, Unit Testing frameworks, or GreatExpectations for data testing. Knowledge of data warehousing or medallion architecture (bronze, silver, gold layers). Experience with data visualization tools (e.g., Power More ❯
Cardiff, South Glamorgan, United Kingdom Hybrid / WFH Options
ENGINEERINGUK
to do so, you are welcome to. Flexible working will be part of the discussion at offer stage. Excellent career progression - the BBC offers great opportunities for employees to seek new challenges and work in different areas of the organisation. Unrivalled training and development opportunities - our in-house Academy … and scheduling SQL queries to discover and track Data Quality issues and measure improvement over time. Experience with Python including packages such as Python Great Expectations. • Experience using analytics and dashboarding tools such as Tableau to create and manage appropriate Data Quality dashboards • The ability to work with large More ❯