data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. Azure Databricks Implementation: Work extensively More ❯
Snowflake), writing complex SQL queries. · Building ETL/ELT/data pipelines. · Kubernetes and Linux containers (e.g., Docker). · Related/complementary open-source software platforms and languages (e.g., Scala, Python, Java, Linux). · Experience with both relational (RDBMS) and non-relational databases. · Analytical and problem-solving skills applied to big data datasets. · Experience working on projects with agile/ More ❯
are looking for data engineers who have a variety of different skills which include some of the below. Strong proficiency in at least one programming language (Python, Java, or Scala) Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: Data warehousing and lake architectures SQL and NoSQL databases Distributed computing frameworks (Spark, Kinesis etc) Software development best practices More ❯
platforms supporting both batch and real-time processing architectures. Deep understanding of data warehousing, ETL/ELT pipelines, and analytics engineering principles. Proficient in programming languages such as Python, Scala, or Java, and experienced with cloud platforms (AWS, GCP, or Azure). Experience working with privacy-sensitive data and implementing comprehensive observability and governance solutions. Strong technical foundation with a More ❯
with Microsoft Fabric – including Lakehouse architecture, OneLake storage design, semantic modeling, and Power BI integration best practices Hands-on experience with Microsoft Fabric and OneLake Experience with Python or Scala for data processing is preferred Exposure to CI/CD workflows and DevOps practices in a data engineering context Comfortable working in agile, collaborative environments with distributed teams Exceptional interpersonal More ❯
slough, south east england, united kingdom Hybrid / WFH Options
Osmii
Data Factory, Azure Data Lake Storage, Azure Synapse) and architecting cloud-native data platforms. Programming Proficiency: Expert-level skills in Python (PySpark) and SQL for data engineering and transformation. Scala is a strong plus. Data Modelling: Strong understanding and practical experience with data warehousing, data lake, and dimensional modelling concepts. ETL/ELT & Data Pipelines: Proven track record of designing More ❯
Social network you want to login/join with: Our client a London based Technology and Data Engineering leader have an opportunity in a high growth AI Lab for an ‘AI Engineering Researcher' A UK based 'Enterprise' Artificial Intelligence organisation More ❯
like Redshift, Athena, EMR, and QuickSight. Understanding of data modeling, ETL, and data warehousing concepts. Skills in statistical analysis, data mining, and machine learning. Proficiency in Python, R, or Scala for data analysis. Experience with SQL, NoSQL, and data visualization tools. Strong analytical and problem-solving skills. Experience with social media analytics and user behavior analysis. Knowledge of big data More ❯
Slough, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
Azure, Snowflake and Terraform is advantageous Experience of knowledge of containers such as Docker and Kubernetes is advantageous Familiarity with at least one programming language (e.g. Python, Java, or Scala) Proven experience of data warehousing concepts and ETL processes Strong analytical skills and attention to detail Excellent verbal and written communication skills in English is essential Airline experience is advantageous More ❯
GCP data processing services: Dataflow (Apache Beam), Dataproc (Apache Spark/Hadoop), or Composer (Apache Airflow). Proficiency in at least one scripting/programming language (e.g., Python, Java, Scala) for data manipulation and pipeline development. Scala is mandated in some cases. Deep understanding of data lakehouse design, event-driven architecture, and hybrid cloud data strategies. Strong proficiency in SQL More ❯
What You Bring: 2+ years in data engineering or related roles Bachelor’s in CS, Engineering, Mathematics, Finance, etc. Proficiency in Python, SQL , and one or more: R, Java, Scala Experience with relational/NoSQL databases (e.g., PostgreSQL, MongoDB) Familiarity with big data tools (Hadoop, Spark, Kafka), cloud platforms (Azure, AWS, GCP), and workflow tools (Airflow, Luigi) Bonus: experience with More ❯
in a leadership or managerial role. Strong background in financial services, particularly in market risk, counterparty credit risk, or risk analytics Proficiency in modern programming languages (e.g., Java, Python, Scala) and frameworks. Experience with cloud platforms (AWS, Azure, or GCP). Deep understanding of software development lifecycle (SDLC), agile methodologies, and devOps practices. Preferred Skills: Strong communication and stakeholder management More ❯
Slough, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
control, task tracking). Demonstrable experience writing ETL scripts and code to make sure the ETL processes perform optimally. Experience in other programming languages for data manipulation (e.g., Python, Scala). Extensive experience of data engineering and the development of data ingest and transformation routines and services using modern, cloud-based approaches and technologies. Understanding of the principles of data More ❯
slough, south east england, united kingdom Hybrid / WFH Options
Atarus
data solutions 💡 What You’ll Bring Strong hands-on experience building streaming data platforms Deep understanding of tools like Kafka , Flink , Spark Streaming , etc. Proficiency in Python , Java , or Scala Cloud experience with AWS , GCP , or Azure Familiarity with orchestration tools like Airflow , Kubernetes Collaborative, solutions-focused mindset and a willingness to lead from the front 🌟 What’s on Offer More ❯
slough, south east england, united kingdom Hybrid / WFH Options
Atarus
real-time data processing tools (e.g. Kafka, Flink, Spark Streaming) Solid hands-on knowledge of cloud platforms (AWS, GCP or Azure) Strong proficiency in languages like Python, Java or Scala Familiarity with orchestration tools such as Airflow or Kubernetes Strong stakeholder management and communication skills Passion for mentoring and developing engineering talent 🎁 What’s On Offer Competitive salary + quarterly More ❯
Key Responsibilities Design and implement real-time data pipelines using tools like Apache Kafka, Apache Flink, or Spark Streaming. Develop and maintain event schemas using Avro, Protobuf, or JSON Schema. Collaborate with backend teams to integrate event-driven microservices. Ensure More ❯
as build brand new ones. The Senior Software Engineer will have: • Strong backend or full-stack software development experience • Strong coding experience in either Java, Golang (Go), Python or Scala – multiple would be even better! • Experience with cloud platforms e.g. AWS, Azure, GCP - Google Cloud • Experience with data warehouses e.g. BigQuery, Redshift, Snowflake • Ability to work collaboratively • Open to new More ❯
software engineering to ensure the delivery of high-quality data solutions aligned with company goals. Requirements: 5+ years of hands-on experience in data engineering, including expertise in Python, Scala, or Java. Deep understanding of Apache Kafka for stream processing workflows (required) Proficiency in managing and optimizing databases such as PostgreSQL, MySQL, MSSQL. Familiarity with analytical databases. Familiarity with both More ❯
Slough, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
in Portugal, the Netherlands, and more. Qualifications Minimum 3 years of experience as a software engineer. 2+ years of experience withReact/TypeScriptand an Object-Oriented Programming Language (Java, Scala,Kotlin, C#, C++). Proven experience in building and shipping software, involving collaboration with other engineers, designers, product managers, and users to identify and implement solutions based on customer needs. More ❯
slough, south east england, united kingdom Hybrid / WFH Options
Nicoll Curtin
Senior Functional Programmer - Haskell, OCaml, Scala, Linux, F#, Financial Markets, Openshift, Kubernetes I am working with a leading financial services firm who is seeking a Senior Haskell Developer to join a specialist team developing cross-product transactional pricing systems for derivatives. This is a rare opportunity to work with a production-grade Haskell codebase, delivering high-performance backend systems that … developers and promote best practices in functional programming Apply financial domain knowledge in derivatives pricing and risk management Key Skills: Proficient in functional programming (Haskell is preferred, OCaml/Scala also considered) Experience building scalable, high-performance backend/server-side applications Strong understanding of architecture and system design principles Comfortable working in Linux environments and agile development settings Financial … up to £115k and a total comp of up to £160k. If you are interested or know someone who might be please reach out. Senior Functional Programmer - Haskell, OCaml, Scala, Linux, F#, Financial Markets, Openshift, Kubernetes More ❯
Slough, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
have the opportunity to work on exciting projects and collaborate with experienced developers. You will play a key role in designing, developing, and maintaining scalable software solutions using Java, Scala, AWS, and the Spring framework. Key Responsibilities: Develop high-quality software applications using Java, Scala, and Spring framework. Collaborate with cross-functional teams to understand requirements and translate them into … Requirements: Bachelor's degree in Computer Science, Software Engineering, or a related field. Proficiency in Java programming language and experience with JVM-based frameworks such as Spring. Familiarity with Scala programming language and its ecosystem. Basic understanding of cloud computing concepts and experience with AWS services (e.g., EC2, S3, Lambda, DynamoDB). Strong problem-solving skills and ability to learn More ❯
approaches Experience of build and Continuous Integration pipelines and tools Experience of TDD and BDD You may have: Knowledge of NestJS framework Experience working with an ORM Knowledge of Scala and functional programming Knowledge of AWS services and infrastructure monitoring Experience working with AWS Lambda functions Experience working with microservices/micro frontends Experience working with Docker/ECS Experience More ❯
Slough, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
of platform development. Preferred Skills, Qualifications, and Experience: Experience in server-side development, such as services, systems, messaging, and middleware. Familiarity with functional programming languages like Erlang, Haskell, F#, Scala, or Go. Experience working with distributed systems. Understanding of complex event processing and continuous query languages. Strong problem-solving skills. Excellent communication and teamwork skills. Bachelor’s degree in IT More ❯