Edinburgh, York Place, City of Edinburgh, United Kingdom
Bright Purple
data pipelines Automating and orchestrating workflows (AWS Glue, Azure Data Factory, GCP Dataflow) Working across leading cloud platforms (AWS, Azure, or GCP) Implementing and optimising modern data architectures (e.g. Databricks, Snowflake) Collaborating with multidisciplinary teams to deliver real business value What we’re looking for Strong experience with Python, SQL , and pipeline tools such as dbt or Airflow Proven background More ❯
testing frameworks integrated with CI/CD pipelines. Design and execute test cases across data ingestion, transformation, storage, and presentation layers. Validate data accuracy, performance, and usability within Azure Databricks, Azure Data Factory, Azure Data Lake Storage, and Power BI. Establish and monitor data quality checks, reconciliation, and compliance processes. Collaborate closely with data engineers, BI developers, architects, and product … owners to embed testing best practices across delivery. Essential Skills & Experience Proven experience as a Test Engineer within data engineering or analytics environments. Strong knowledge of Azure data services – Databricks, ADF, ADLS, Power BI. Proficiency in SQL and data profiling for test design and validation. Hands-on experience with test automation frameworks such as Python/PySpark, Great Expectations, Pytest More ❯
Data Engineer - HealthTech - UK Remote (AWS/Databricks/Python/SQL) Job Title: Data Engineer Location: 1-2x/week on-site in Leeds Duration: Until March 2026 Day Rate: £500/day Inside IR35 NHS or Central Gov experience is ESSENTIAL Brio Digital are supporting a HealthTech consultancy who require a Data Engineer to support an ongoing … transformation project across NHS data platforms. What You'll Do Design and maintain end-to-end data pipelines within the AWS ecosystem Build reliable data solutions using Databricks, Python, and SQL Integrate and optimise data from diverse sources, including MongoDB Develop and maintain ETL processes for analytical and operational use Implement data quality, governance, and testing frameworks Collaborate with data … on experience with Python for ETL and data engineering Advanced SQL skills across data modelling, optimisation, and stored procedures Experience with AWS Data Services (eg, Glue, Redshift, S3, Lambda, Databricks ) Familiarity with MongoDB or other NoSQL databases Understanding of modern data architecture and data governance principles Experience with CI/CD , version control, and agile project delivery Strong problem-solving More ❯
