data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure Databricks Implementation: Work extensively More ❯
data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure Databricks Implementation: Work extensively More ❯
data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure Databricks Implementation: Work extensively More ❯
london (city of london), south east england, united kingdom
Mastek
data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure Databricks Implementation: Work extensively More ❯
knowledge sharing across the team. What We're Looking For Strong hands-on experience across AWS Glue, Lambda, Step Functions, RDS, Redshift, and Boto3. Proficient in one of Python, Scala or Java, with strong experience in Big Data technologies such as: Spark, Hadoop etc. Practical knowledge of building Real Time event streaming pipelines (eg, Kafka, Spark Streaming, Kinesis). Proven More ❯
London, England, United Kingdom Hybrid / WFH Options
Client Server
a week with flexibility to work from home once a week. About you: You have experience as a Data Engineer, working on scalable systems You have Python, Java or Scala coding skills You have experience with Kafka for data streaming including Kafka Streams and KTables You have strong SQL skills (e.g. PostgreSQL, MySQL) You have strong AWS knowledge, ideally including More ❯
london, south east england, united kingdom Hybrid / WFH Options
Client Server
a week with flexibility to work from home once a week. About you: You have experience as a Data Engineer, working on scalable systems You have Python, Java or Scala coding skills You have experience with Kafka for data streaming including Kafka Streams and KTables You have strong SQL skills (e.g. PostgreSQL, MySQL) You have strong AWS knowledge, ideally including More ❯
multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data using APIs, writing SQL queries etc. Experience in processing large amounts of structured and unstructured data, including integrating data More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Avanti
For Active DV clearance (essential) Strong background in data engineering, ETL, and data pipeline development Experience with AWS or Azure cloud technologies Excellent coding skills in Python, SQL, or Scala Understanding of data warehousing, modelling, and streaming technologies Confident working in agile, fast-paced technical teams Locations London - (Hybrid model – typically 3 days per week on site) Salary range More ❯
+ data integration patterns. Experience of working with complex data pipelines, large data sets, data pipeline optimization + data architecture design. Implementing complex data transformations using Spark, PySpark or Scala + working with SQL/MySQL databases. Experience with data quality, data governance processes, Git version control + Agile development environments. Azure Data Engineer certification preferred -eg- Azure Data Engineer More ❯
platforms (Azure) and data engineering best practices . Advanced proficiency in Power BI , including DAX, Power Query, and data modeling. Strong programming skills in Python, SQL, and/or Scala for data processing and automation. Experience with ETL/ELT, data warehousing, and event-driven architectures . Knowledge of AI/ML applications in data analytics and business intelligence. Proven More ❯
performance testing activities Provide production support by troubleshooting issues and tuning environments Follow and enforce technical best practices throughout all project phases Required Skills: Strong Application development experience in Scala/Python Strong Database SQL experience, preferably Redshift Experience in Snowflake is an added advantage Experience with ETL/ELT process and frameworks is a must What is in it More ❯
performance testing activities Provide production support by troubleshooting issues and tuning environments Follow and enforce technical best practices throughout all project phases Required Skills: Strong Application development experience in Scala/Python Strong Database SQL experience, preferably Redshift Experience in Snowflake is an added advantage Experience with ETL/ELT process and frameworks is a must What is in it More ❯
performance testing activities Provide production support by troubleshooting issues and tuning environments Follow and enforce technical best practices throughout all project phases Required Skills: Strong Application development experience in Scala/Python Strong Database SQL experience, preferably Redshift Experience in Snowflake is an added advantage Experience with ETL/ELT process and frameworks is a must What is in it More ❯
london (city of london), south east england, united kingdom
Quantiphi
performance testing activities Provide production support by troubleshooting issues and tuning environments Follow and enforce technical best practices throughout all project phases Required Skills: Strong Application development experience in Scala/Python Strong Database SQL experience, preferably Redshift Experience in Snowflake is an added advantage Experience with ETL/ELT process and frameworks is a must What is in it More ❯
web/mobile applications or platform with either Java/J2EE or .NET tech stack and database technologies such as Oracle, MySQL, etc. " Exposure to polyglot programming languages like Scala, Python and Golang will be a plus " Ability to read/write code and expertise with various design patterns " Have used NoSQL database such as MongoDB, Cassandra, etc. " Work on More ❯
support continuous delivery. Use modern cloud-native tools and CI/CD platforms to maintain secure, observable, and high-performing environments. Relevant Skills: Essential Skills: Proficiency in Python or Scala for data processing Strong SQL skills for querying and managing relational databases Experience with AWS services including S3, Glue, Redshift, Lambda, and Athena Knowledge of ETL processes and data pipeline More ❯
support continuous delivery. Use modern cloud-native tools and CI/CD platforms to maintain secure, observable, and high-performing environments. Relevant Skills: Essential Skills: Proficiency in Python or Scala for data processing Strong SQL skills for querying and managing relational databases Experience with AWS services including S3, Glue, Redshift, Lambda, and Athena Knowledge of ETL processes and data pipeline More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Client Server
data pipelines You have strong Data Engineering experience including design and data modelling skills You have advanced SQL and NoSQL database knowledge You can code with Golang, Python or Scala You have experience with Google BigQuery You have a good knowledge of event-driven architectures and messaging systems (Pub/Sub, Kafka) You have experience of deploying and managing services More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Client Server Ltd
Please note you must be commutable to London. About you: You have strong Data Engineering experience including design and data modelling skills You can code with Golang, Python or Scala You have advanced SQL and NoSQL database knowledge You're familiar with event-driven architectures and messaging systems (Pub/Sub, Kafka, etc.) You have experience of deploying and managing More ❯
knowledge of all data resources within ND and prototype new data sources internally and externally Skills and Experience Essential Proficiency in technologies such as Spark (SQL and/or Scala), Kafka. Analytical and problem-solving skills, applied to data solution Proficiency with traditional database SQL technologies Experience with integration of data from multiple data sources Experience of CI/CD More ❯
South East London, London, United Kingdom Hybrid / WFH Options
TEN10 SOLUTIONS LIMITED
Azure DevOps). Excellent communication and stakeholder management skills. Bonus Points for: Previous experience in a consultancy environment . Hands-on coding experience in additional languages like Python, Ruby, Scala, PHP, or C++ . Knowledge of performance testing tools like JMeter, Gatling, K6 or Neoload. Whats in It for You? At Ten10, we believe in recognizing and rewarding great work. More ❯
South East London, London, United Kingdom Hybrid / WFH Options
TEN10 SOLUTIONS LIMITED
. Proficiency in performance testing tools like JMeter, Gatling, K6, Neoload, or Webload . Strong coding skills in at least one language such as Java, TypeScript JavaScript, Python, C#, , Scala, or PHP. Experience designing and building automation frameworks . Familiarity with Agile development environments (SCRUM, Kanban, TDD, BDD). Implementing pipelines using common tooling such as Jenkins, ADO, GitHub actions More ❯
including infrastructure (deployments, observability, CI/CD) Must-Have Qualifications 5+ years in software engineering (flexible if skills and impact are strong) Strong foundations in typed languages (e.g., C++, Scala, Rust, Java, C#, Swift) Strong understanding of core programming concepts, including variable assignments and memory allocation (stack vs. heap) Proven track record of recent impact: delivering features, improving systems, solving More ❯
including infrastructure (deployments, observability, CI/CD) Must-Have Qualifications 5+ years in software engineering (flexible if skills and impact are strong) Strong foundations in typed languages (e.g., C++, Scala, Rust, Java, C#, Swift) Strong understanding of core programming concepts, including variable assignments and memory allocation (stack vs. heap) Proven track record of recent impact: delivering features, improving systems, solving More ❯