data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure Databricks Implementation: Work extensively More ❯
data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure Databricks Implementation: Work extensively More ❯
london (city of london), south east england, united kingdom
Mastek
data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure Databricks Implementation: Work extensively More ❯
flow issues, optimize performance, and implement error-handling strategies. Optional scripting skills for creating custom NiFi processors. Programming & Data Technologies: Proficiency in Java and SQL. Experience with C# and Scala is a plus. Experience with ETL tools and big data platforms. Knowledge of data modeling, replication, and query optimization. Hands-on experience with SQL and NoSQL databases is desirable. Familiarity More ❯
flow issues, optimize performance, and implement error-handling strategies. Optional scripting skills for creating custom NiFi processors. Programming & Data Technologies: Proficiency in Java and SQL. Experience with C# and Scala is a plus. Experience with ETL tools and big data platforms. Knowledge of data modeling, replication, and query optimization. Hands-on experience with SQL and NoSQL databases is desirable. Familiarity More ❯
these requirements. In order to secure one of these Senior Data Engineer roles you must be able to demonstrate the following experience: Experience in prominent languages such as Python, Scala, Spark, SQL. Experience working with any database technologies from an application programming perspective - Oracle, MySQL, Mongo DB etc. Experience with the design, build and maintenance of data pipelines and infrastructure More ❯
london, south east england, united kingdom Hybrid / WFH Options
Client Server
a week with flexibility to work from home once a week. About you: You have experience as a Data Engineer, working on scalable systems You have Python, Java or Scala coding skills You have experience with Kafka for data streaming including Kafka Streams and KTables You have strong SQL skills (e.g. PostgreSQL, MySQL) You have strong AWS knowledge, ideally including More ❯
slough, south east england, united kingdom Hybrid / WFH Options
Client Server
a week with flexibility to work from home once a week. About you: You have experience as a Data Engineer, working on scalable systems You have Python, Java or Scala coding skills You have experience with Kafka for data streaming including Kafka Streams and KTables You have strong SQL skills (e.g. PostgreSQL, MySQL) You have strong AWS knowledge, ideally including More ❯
Edinburgh, Midlothian, United Kingdom Hybrid / WFH Options
Onyx-Conseil
web/mobile applications or platform with either Java/J2EE or .NET tech stack and database technologies such as Oracle, MySQL, etc. Exposure to polyglot programming languages like Scala, Python and Golang will be a plus. Ability to read/write code and expertise with various design patterns. Have used NoSQL databases such as MongoDB, Cassandra, etc. Work on More ❯
Belfast, County Antrim, Northern Ireland, United Kingdom Hybrid / WFH Options
Aspire Personnel Ltd
multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data using APIs, writing SQL queries etc. Experience in processing large amounts of structured and unstructured data, including integrating data More ❯
Bristol, Avon, England, United Kingdom Hybrid / WFH Options
Aspire Personnel Ltd
multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data using APIs, writing SQL queries etc. Experience in processing large amounts of structured and unstructured data, including integrating data More ❯
and provide technical guidance. Troubleshoot and resolve complex issues related to Databricks infrastructure. Essential Skills & Experience: Proven experience working with Databricks in a similar role. Strong knowledge of Spark, Scala, Python, and SQL. Experience with cloud platforms such as AWS or Azure. Ability to work collaboratively in a fast-paced environment. Excellent problem-solving and communication skills. Desirable Skills & Experience More ❯
warrington, cheshire, north west england, united kingdom
iO Associates
and provide technical guidance. Troubleshoot and resolve complex issues related to Databricks infrastructure. Essential Skills & Experience: Proven experience working with Databricks in a similar role. Strong knowledge of Spark, Scala, Python, and SQL. Experience with cloud platforms such as AWS or Azure. Ability to work collaboratively in a fast-paced environment. Excellent problem-solving and communication skills. Desirable Skills & Experience More ❯
bolton, greater manchester, north west england, united kingdom
iO Associates
and provide technical guidance. Troubleshoot and resolve complex issues related to Databricks infrastructure. Essential Skills & Experience: Proven experience working with Databricks in a similar role. Strong knowledge of Spark, Scala, Python, and SQL. Experience with cloud platforms such as AWS or Azure. Ability to work collaboratively in a fast-paced environment. Excellent problem-solving and communication skills. Desirable Skills & Experience More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Avanti
For Active DV clearance (essential) Strong background in data engineering, ETL, and data pipeline development Experience with AWS or Azure cloud technologies Excellent coding skills in Python, SQL, or Scala Understanding of data warehousing, modelling, and streaming technologies Confident working in agile, fast-paced technical teams Locations London - (Hybrid model – typically 3 days per week on site) Salary range More ❯
Manchester, Lancashire, England, United Kingdom Hybrid / WFH Options
Avanti
For Active DV clearance (essential) Strong background in data engineering, ETL, and data pipeline development Experience with AWS or Azure cloud technologies Excellent coding skills in Python, SQL, or Scala Understanding of data warehousing, modelling, and streaming technologies Confident working in agile, fast-paced technical teams Locations Manchester - (Hybrid model – typically 3 days per week on site) Salary range More ❯
to demonstrate the following experience: Commercial experience gained in a Data Engineering role on any major cloud platform (Azure, AWS or GCP) Experience in prominent languages such as Python, Scala, Spark, SQL. Experience working with any database technologies from an application programming perspective - Oracle, MySQL, Mongo DB etc. Some experience with the design, build and maintenance of data pipelines and More ❯
Bristol, Avon, England, United Kingdom Hybrid / WFH Options
Avanti
For Active DV clearance (essential) Strong background in data engineering, ETL, and data pipeline development Experience with AWS or Azure cloud technologies Excellent coding skills in Python, SQL, or Scala Understanding of data warehousing, modelling, and streaming technologies Confident working in agile, fast-paced technical teams Locations Bristol - (Hybrid model – typically 3 days per week on site) Salary range More ❯
platforms (Azure) and data engineering best practices . Advanced proficiency in Power BI , including DAX, Power Query, and data modeling. Strong programming skills in Python, SQL, and/or Scala for data processing and automation. Experience with ETL/ELT, data warehousing, and event-driven architectures . Knowledge of AI/ML applications in data analytics and business intelligence. Proven More ❯
performance testing activities Provide production support by troubleshooting issues and tuning environments Follow and enforce technical best practices throughout all project phases Required Skills: Strong Application development experience in Scala/Python Strong Database SQL experience, preferably Redshift Experience in Snowflake is an added advantage Experience with ETL/ELT process and frameworks is a must What is in it More ❯
performance testing activities Provide production support by troubleshooting issues and tuning environments Follow and enforce technical best practices throughout all project phases Required Skills: Strong Application development experience in Scala/Python Strong Database SQL experience, preferably Redshift Experience in Snowflake is an added advantage Experience with ETL/ELT process and frameworks is a must What is in it More ❯
london (city of london), south east england, united kingdom
Quantiphi
performance testing activities Provide production support by troubleshooting issues and tuning environments Follow and enforce technical best practices throughout all project phases Required Skills: Strong Application development experience in Scala/Python Strong Database SQL experience, preferably Redshift Experience in Snowflake is an added advantage Experience with ETL/ELT process and frameworks is a must What is in it More ❯
support continuous delivery. Use modern cloud-native tools and CI/CD platforms to maintain secure, observable, and high-performing environments. Relevant Skills: Essential Skills: Proficiency in Python or Scala for data processing Strong SQL skills for querying and managing relational databases Experience with AWS services including S3, Glue, Redshift, Lambda, and Athena Knowledge of ETL processes and data pipeline More ❯
support continuous delivery. Use modern cloud-native tools and CI/CD platforms to maintain secure, observable, and high-performing environments. Relevant Skills: Essential Skills: Proficiency in Python or Scala for data processing Strong SQL skills for querying and managing relational databases Experience with AWS services including S3, Glue, Redshift, Lambda, and Athena Knowledge of ETL processes and data pipeline More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Client Server Ltd
Please note you must be commutable to London. About you: You have strong Data Engineering experience including design and data modelling skills You can code with Golang, Python or Scala You have advanced SQL and NoSQL database knowledge You're familiar with event-driven architectures and messaging systems (Pub/Sub, Kafka, etc.) You have experience of deploying and managing More ❯