data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure Databricks Implementation: Work extensively More ❯
london (city of london), south east england, united kingdom
Mastek
data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure Databricks Implementation: Work extensively More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Billigence
Data architecture and solution design experience Hands-on experience with modern data tools such as dbt, Fivetran, Matillion, or similar data integration platforms Programming skills in Python, Java, or Scala Relevant cloud certifications (SnowPro, Databricks Certified, AWS/Azure/GCP Data Engineering certifications) Experience with DataOps, CI/CD practices, and infrastructure-as-code Knowledge of data governance, data More ❯
london (city of london), south east england, united kingdom Hybrid / WFH Options
Billigence
Data architecture and solution design experience Hands-on experience with modern data tools such as dbt, Fivetran, Matillion, or similar data integration platforms Programming skills in Python, Java, or Scala Relevant cloud certifications (SnowPro, Databricks Certified, AWS/Azure/GCP Data Engineering certifications) Experience with DataOps, CI/CD practices, and infrastructure-as-code Knowledge of data governance, data More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Az-Tec Talent
and collaboratively within client teams. Desirable: Consulting experience or client-facing delivery background. Familiarity with tools such as dbt, Fivetran, Matillion , or similar. Programming skills in Python, Java, or Scala . Cloud certifications (SnowPro, Databricks Certified, AWS/Azure/GCP). Knowledge of DataOps, CI/CD , and infrastructure-as-code concepts. What’s on Offer Hybrid working model More ❯
london (city of london), south east england, united kingdom Hybrid / WFH Options
Az-Tec Talent
and collaboratively within client teams. Desirable: Consulting experience or client-facing delivery background. Familiarity with tools such as dbt, Fivetran, Matillion , or similar. Programming skills in Python, Java, or Scala . Cloud certifications (SnowPro, Databricks Certified, AWS/Azure/GCP). Knowledge of DataOps, CI/CD , and infrastructure-as-code concepts. What’s on Offer Hybrid working model More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Tenth Revolution Group
in consultancy or client-facing roles is highly desirable. Familiarity with CI/CD pipelines and version control tools (e.g., Git, Azure DevOps). Desirable Exposure to Python or Scala for data engineering tasks. Knowledge of Power BI or other visualisation tools. Experience with data governance frameworks and metadata management. If you’re interested, get in touch ASAP with a More ❯
london (city of london), south east england, united kingdom Hybrid / WFH Options
Tenth Revolution Group
in consultancy or client-facing roles is highly desirable. Familiarity with CI/CD pipelines and version control tools (e.g., Git, Azure DevOps). Desirable Exposure to Python or Scala for data engineering tasks. Knowledge of Power BI or other visualisation tools. Experience with data governance frameworks and metadata management. If you’re interested, get in touch ASAP with a More ❯
DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD More ❯
london (city of london), south east england, united kingdom
Infosys
DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Metropolitan Police
like Power BI, Power Query or Tableau. You’ve worked in a SharePoint environment and know how to make the most of it. You’ve written code in Java, Scala or other programming languages and enjoy exploring new tech. We view diversity as fundamental to our success. To tackle today’s complex policing challenges, we welcome applications from all of More ❯
london (city of london), south east england, united kingdom Hybrid / WFH Options
Metropolitan Police
like Power BI, Power Query or Tableau. You’ve worked in a SharePoint environment and know how to make the most of it. You’ve written code in Java, Scala or other programming languages and enjoy exploring new tech. We view diversity as fundamental to our success. To tackle today’s complex policing challenges, we welcome applications from all of More ❯
More.. LEAD DATA ENGINEER – ESSTENTIAL SKILLS Proven experience as a Senior or Lead Data Engineer in a fast-scaling tech or data-driven environment Strong proficiency in Python (or Scala/Java) and SQL Deep experience with data pipeline orchestration tools (Airflow, dbt, Dagster, Prefect) Strong knowledge of cloud data platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery More ❯
london (city of london), south east england, united kingdom
Searchability®
More.. LEAD DATA ENGINEER – ESSTENTIAL SKILLS Proven experience as a Senior or Lead Data Engineer in a fast-scaling tech or data-driven environment Strong proficiency in Python (or Scala/Java) and SQL Deep experience with data pipeline orchestration tools (Airflow, dbt, Dagster, Prefect) Strong knowledge of cloud data platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery More ❯
in technology consulting, enterprise and solutions architecture and architectural frameworks, Data Modelling, Experience on ERWIN Modelling. • Hands on experience in ADF, Azure Databricks, Azure Synapse, Spark, PySpark, Python/Scala, SQL. • Hands on Experience in Designing and building Data Lake from Multiple Source systems/Data Providers. • Experience on Data Modelling, architecture, implementation & Testing. • Experienced in designing & implementation of End More ❯
City of London, London, United Kingdom Hybrid / WFH Options
KPMG UK
is required. Demonstrable experience in leading client data engineering and integration projects for major clients Hands-on experience of designing and implementing Quantexa solutions for clients. Technical excellence in Scala, Python and Databricks Skills we’d love to see/Amazing Extras: Experience delivering Quantexa in Financial Services, Fraud Detection, AML, or KYC domains. Exposure to DevOps and CI/ More ❯
london (city of london), south east england, united kingdom
Infosys
in technology consulting, enterprise and solutions architecture and architectural frameworks, Data Modelling, Experience on ERWIN Modelling. • Hands on experience in ADF, Azure Databricks, Azure Synapse, Spark, PySpark, Python/Scala, SQL. • Hands on Experience in Designing and building Data Lake from Multiple Source systems/Data Providers. • Experience on Data Modelling, architecture, implementation & Testing. • Experienced in designing & implementation of End More ❯
london (city of london), south east england, united kingdom Hybrid / WFH Options
KPMG UK
is required. Demonstrable experience in leading client data engineering and integration projects for major clients Hands-on experience of designing and implementing Quantexa solutions for clients. Technical excellence in Scala, Python and Databricks Skills we’d love to see/Amazing Extras: Experience delivering Quantexa in Financial Services, Fraud Detection, AML, or KYC domains. Exposure to DevOps and CI/ More ❯
enterprise and solutions architecture and architectural frameworks, Data Modelling, Experience on ERWIN Modelling. 7+ years of hands-on experience in ADF, Azure Databricks, Azure Synapse, Spark, PySpark, Python/Scala, SQL. Hands on Experience in Designing and building Data Lake from Multiple Source systems/Data Providers. Experience on Data Modelling, architecture, implementation & Testing. Experienced in designing & implementation of End More ❯
london (city of london), south east england, united kingdom
Infosys
enterprise and solutions architecture and architectural frameworks, Data Modelling, Experience on ERWIN Modelling. 7+ years of hands-on experience in ADF, Azure Databricks, Azure Synapse, Spark, PySpark, Python/Scala, SQL. Hands on Experience in Designing and building Data Lake from Multiple Source systems/Data Providers. Experience on Data Modelling, architecture, implementation & Testing. Experienced in designing & implementation of End More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Syntax Consultancy Limited
+ data integration patterns. Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design. Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL databases. Experience with data quality, data governance processes, Git version control + Agile development environments. Azure Data Engineer certification preferred -eg- Azure Data Engineer More ❯
performance testing activities Provide production support by troubleshooting issues and tuning environments Follow and enforce technical best practices throughout all project phases Required Skills: Strong Application development experience in Scala/Python Strong Database SQL experience, preferably Redshift Experience in Snowflake is an added advantage Experience with ETL/ELT process and frameworks is a must What is in it More ❯
london (city of london), south east england, united kingdom
Quantiphi
performance testing activities Provide production support by troubleshooting issues and tuning environments Follow and enforce technical best practices throughout all project phases Required Skills: Strong Application development experience in Scala/Python Strong Database SQL experience, preferably Redshift Experience in Snowflake is an added advantage Experience with ETL/ELT process and frameworks is a must What is in it More ❯
SR2 | Socially Responsible Recruitment | Certified B Corporation™
using Docker, Kubernetes, Terraform, or dbt Champion data reliability, scalability, and performance across the platform 🧩 The Tech Environment You’ll likely be working with some combination of: Languages: Python, Scala, Go Streaming: Kafka/Flink/Spark Structured Streaming Workflow orchestration: Airflow/Prefect/Dagster Data storage & processing: Snowflake/Detabricks/BigQuery/Redshift Infrastructure: Docker/Kubernetes More ❯
Experience with Confluent Cloud, Stream Governance, Data Lineage, and RBAC • Expertise in stream processing (Apache Flink, Kafka Streams, ksqlDB) and event-driven architecture • Strong proficiency in Java, Python, or Scala • Proven ability to integrate Kafka with enterprise systems (databases, APIs, microservices) • Hands-on experience with cloud platforms (AWS, GCP, Azure) and Kubernetes • Familiarity with CI/CD pipelines and infrastructure More ❯
