teams Excellent problem-solving ability, especially when facing unclear or incomplete requirements 3+ years of experience designing and implementing Snowflake solutions Expert-level SQL and strong proficiency in Python, Scala, or Java Solid experience with ETL/ELT pipelines using dbt Hands-on experience with cloud platforms (AWS, Azure, or GCP) Familiarity with orchestration tools like Airflow, Dagster, or Azure More ❯
to having resided in the UK for at least the past 5 years and being a UK national or dual UK national. Experience in prominent languages such as Python, Scala, Spark, SQL. Experience working with any database technologies from an application programming perspective - Oracle, MySQL, Mongo DB etc. Experience with the design, build and maintenance of data pipelines and infrastructure More ❯
Kafka, Spark Streaming, Flink, etc.). Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage. Programming skills in Python, Java, Scala, or a similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive More ❯
Data Engineer – Investment Banking – London/Hybrid (Data Engineer, SQL Data Engineer, Java, Python, Spark, Scala, SQL, Snowflake, OO programming, Snowflake, Databricks, Data Fabric, design patterns, SOLID principles, ETL, Unit testing, NUnit, MSTest, Junit, Microservices Architecture, Continuous Integration, Azure DevOps, AWS, Jenkins, Agile, Data Engineer, SQL Data Engineer) We have several fantastic new roles including a Data Engineer position to More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Noir
Data Engineer – Investment Banking – London/Hybrid (Data Engineer, SQL Data Engineer, Java, Python, Spark, Scala, SQL, Snowflake, OO programming, Snowflake, Databricks, Data Fabric, design patterns, SOLID principles, ETL, Unit testing, NUnit, MSTest, Junit, Microservices Architecture, Continuous Integration, Azure DevOps, AWS, Jenkins, Agile, Data Engineer, SQL Data Engineer) We have several fantastic new roles including a Data Engineer position to More ❯
London, England, United Kingdom Hybrid / WFH Options
Luupli
understanding of data modelling, ETL processes, and data warehousing concepts. 5.Proficiency in statistical analysis, data mining, and machine learning techniques. 6.Proficiency in programming languages such as Python, R, or Scala for data analysis and modelling. 7.Experience with SQL and NoSQL databases, data visualisation tools, and statistical packages. Strong analytical, problem-solving, and critical thinking skills. 8.Experience with social media analytics More ❯
SQL for data manipulation (at least one of PostgreSQL, MSSQL, Google BigQuery, SparkSQL) Modelling & Statistical Analysis experience, ideally customer related Coding skills in at least one of Python, R, Scala, C, Java or JS Track record of using data manipulation and machine learning libraries in one or more programming languages. Keen interest in some of the following areas: Big Data More ❯
City Of London, England, United Kingdom Hybrid / WFH Options
CipherTek Recruitment
maintaining LLM services and solutions. Expertise in Azure DevOps and GitHub Actions. Familiarity with Databricks CLI and Databricks Job Bundle. Strong programming skills in Python and SQL; familiarity with Scala is a plus. Solid understanding of AI/ML algorithms, model training, evaluation (including hyperparameter tuning), deployment, monitoring, and governance. Experience in handling large datasets and performing data preparation and More ❯
Google Cloud Platform, Amazon Web Services, Microsoft Azure, Databricks, Snowflake. Architectural and/or feature knowledge of one or more of the following Programming Languages/Packages: Python, Java, Scala, Spark, SQL, NoSQL databases. Experience working within Agile delivery methodologies. Proven ability to be successful in a matrixed organisation, and to enlist support and commitment from peers in selling and More ❯
Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: The job you're considering The Cloud Data Platforms team is part of the Insights and Data Global Practice and has seen More ❯
AWS, GCP, or Azure for real-time data ingestion and storage. Ability to optimise and refactor existing data pipelines for greater performance and reliability. Programming skills in Python, Java, Scala, or a similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive More ❯
Leeds, England, United Kingdom Hybrid / WFH Options
KPMG UK
it? Expertise in data engineering/analytics/architecture/security using native technologies of least one cloud platform (AWS, Azure, GCP) Expertise in prominent languages such as Python, Scala, Spark, SQL. Experience working with any database technologies from an application programming perspective - Oracle, MySQL, Mongo DB etc. Expertise in leading the design, build and maintenance of data pipelines and More ❯
control, task tracking). ·Demonstrable experience writing ETL scripts and code to make sure the ETL processes perform optimally. ·Experience in other programming languages for data manipulation (e.g., Python, Scala). ·Extensive experience of data engineering and the development of data ingest and transformation routines and services using modern, cloud-based approaches and technologies. ·Understanding of the principles of data More ❯
their favourite shows is a challenge that we relish. This means scaling, and reliability is our primary focus in everything we build. The User Services Teams: We are functional Scala enthusiasts ( Cats/Scalaz/ZIO/shapeless etc) that care about following best practice. We're responsible for things like registration, login and authentication, profiles and personalisation and compliance … experienced advocates of functional programming so you can expect to join a team that is applying principles from FP, Reactive Programming and Distributed Computing to build these services, using Scala, Akka, Kafka, Play and Cats, as well a wide range of cloud-native technologies including AWS (Kinesis, DynamoDB, Lambda), Docker and Serverless. We have a mature DevOps culture in place … where the team is responsible for the infrastructure and deployment of those applications - "You build it, you run it." What you will do: You will be using Scala , Akka , Kafka , Kinesis , and Dynamo to build and innovate our software that is distributed, reactive, and scalable. You will: Lead a product engineering team, ultimately responsible for the delivery of that product More ❯
pipeline monitoring. Develop and optimise data pipelines for integrating structured and unstructured data from various internal and external sources. Leverage big data technologies such as Apache Spark, Kafka, and Scala to build robust and scalable data processing systems. Write clean, maintainable code in Python or Scala to support data transformation, orchestration, and integration tasks. Work with cloud platforms like AWS More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Signify Technology
pipeline monitoring. Develop and optimise data pipelines for integrating structured and unstructured data from various internal and external sources. Leverage big data technologies such as Apache Spark, Kafka, and Scala to build robust and scalable data processing systems. Write clean, maintainable code in Python or Scala to support data transformation, orchestration, and integration tasks. Work with cloud platforms like AWS More ❯
South East London, England, United Kingdom Hybrid / WFH Options
Signify Technology
pipeline monitoring. Develop and optimise data pipelines for integrating structured and unstructured data from various internal and external sources. Leverage big data technologies such as Apache Spark, Kafka, and Scala to build robust and scalable data processing systems. Write clean, maintainable code in Python or Scala to support data transformation, orchestration, and integration tasks. Work with cloud platforms like AWS More ❯
Reading, Berkshire, United Kingdom Hybrid / WFH Options
Bowerford Associates
concepts to a range of audiences. Able to provide coaching and training to less experienced members of the team. Essential Skills: Programming Languages such as Spark, Java, Python, PySpark, Scala or similar (minimum of 2). Extensive Big Data hands-on experience across coding/configuration/automation/monitoring/security is necessary. Significant AWS or Azure hands-on … to Work in the UK long-term as our client is NOT offering sponsorship for this role. KEYWORDS Lead Data Engineer, Senior Lead Data Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, On-Prem, Cloud, ETL, Azure Data Fabric, ADF, Databricks, Azure Data, Delta Lake, Data Lake. Please note that due to a high level of applications, we More ❯
Employment Type: Permanent
Salary: £75000 - £80000/annum Pension, Good Holiday, Healthcare
Data Factory, or Synapse Analytics . Basic experience with test automation frameworks (e.g., PyTest, Great Expectations, DBT tests, or similar). Proficiency in SQL and scripting languages (e.g., Python, Scala) for test automation. Understanding of CI/CD and DevOps practices , with exposure to Azure DevOps, GitHub Actions, or Jenkins . Knowledge of data governance, security, and compliance best practices More ❯
data solutions 💡 What You’ll Bring Strong hands-on experience building streaming data platforms Deep understanding of tools like Kafka , Flink , Spark Streaming , etc. Proficiency in Python , Java , or Scala Cloud experience with AWS , GCP , or Azure Familiarity with orchestration tools like Airflow , Kubernetes Collaborative, solutions-focused mindset and a willingness to lead from the front 🌟 What’s on Offer More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Atarus
data solutions 💡 What You’ll Bring Strong hands-on experience building streaming data platforms Deep understanding of tools like Kafka , Flink , Spark Streaming , etc. Proficiency in Python , Java , or Scala Cloud experience with AWS , GCP , or Azure Familiarity with orchestration tools like Airflow , Kubernetes Collaborative, solutions-focused mindset and a willingness to lead from the front 🌟 What’s on Offer More ❯
South East London, England, United Kingdom Hybrid / WFH Options
Atarus
data solutions What You’ll Bring Strong hands-on experience building streaming data platforms Deep understanding of tools like Kafka , Flink , Spark Streaming , etc. Proficiency in Python , Java , or Scala Cloud experience with AWS , GCP , or Azure Familiarity with orchestration tools like Airflow , Kubernetes Collaborative, solutions-focused mindset and a willingness to lead from the front What’s on Offer More ❯
real-time data processing tools (e.g. Kafka, Flink, Spark Streaming) Solid hands-on knowledge of cloud platforms (AWS, GCP or Azure) Strong proficiency in languages like Python, Java or Scala Familiarity with orchestration tools such as Airflow or Kubernetes Strong stakeholder management and communication skills Passion for mentoring and developing engineering talent 🎁 What’s On Offer Competitive salary + quarterly More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Atarus
real-time data processing tools (e.g. Kafka, Flink, Spark Streaming) Solid hands-on knowledge of cloud platforms (AWS, GCP or Azure) Strong proficiency in languages like Python, Java or Scala Familiarity with orchestration tools such as Airflow or Kubernetes Strong stakeholder management and communication skills Passion for mentoring and developing engineering talent 🎁 What’s On Offer Competitive salary + quarterly More ❯
South East London, England, United Kingdom Hybrid / WFH Options
Atarus
real-time data processing tools (e.g. Kafka, Flink, Spark Streaming) Solid hands-on knowledge of cloud platforms (AWS, GCP or Azure) Strong proficiency in languages like Python, Java or Scala Familiarity with orchestration tools such as Airflow or Kubernetes Strong stakeholder management and communication skills Passion for mentoring and developing engineering talent What’s On Offer Competitive salary + quarterly More ❯