Python, R, and Java. Experience in building modern data pipelines and ETL processes with tools like Apache Kafka and Apache Nifi. Proficiency in Java, Scala, or Python programming. Experience managing or testing API Gateway tools and Rest APIs. Knowledge of traditional databases like Oracle, MySQL, etc., and modern data management More ❯
and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. More ❯
london (city of london), south east england, united kingdom
Mastek
and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy throughout the data lifecycle. More ❯
warehousing, big data platforms (e.g., Hadoop, Spark), data streaming (e.g., Kafka), and cloud services (e.g., AWS, GCP, Azure) Programming skills in Python, Java, or Scala, with automation and scripting experience Experience with containerization and orchestration tools like Docker and Kubernetes is a plus Experience with data governance, security, and compliance More ❯
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
Net Talent
data modeling , distributed systems , streaming architectures , and ETL/ELT pipelines . Proficiency in SQL and at least one programming language such as Python , Scala , or Java . Demonstrated experience owning and delivering complex systems from architecture through implementation. Excellent communication skills with the ability to explain technical concepts to More ❯
recommend tools to improve data engineering workflows. Documentation: Maintain detailed technical documentation for all solutions and processes. Technical Skills Programming: Proficiency in Python, Java, Scala, or similar languages. Big Data Technologies: Hands-on experience with big data tools e.g. (Databricks, Apache Spark, Hadoop). Cloud Platforms: Familiarity with AWS, Azure More ❯
AWS or equivalent cloud technologies. Knowledge of Serverless technologies, frameworks and best practices. Experience using AWS CloudFormation or Terraform for infrastructure automation. Knowledge of Scala or OO such as Java or C#. SQL or Python development experience. High-quality coding and testing practices. Willingness to learn new technologies and methodologies. More ❯
platform, either on Azure or AWS. Good working knowledge of Databricks components: DeltaLake, Unity Catalog, ML Flow, etc. Expertise in SQL, Python and Spark (Scala or Python). Experience working with relational SQL databases either on premises or in the cloud. Experience delivering multiple solutions using key techniques such as More ❯
will too... WHAT WE NEED YOU TO HAVE EXPERIENCE IN Coding Coding/scripting experience developed in a commercial/industry setting (Python, Java, Scala or Go and SQL) Databases & frameworks Strong experience working with Kafka technologies Working experience with operational data stores , data warehouse , big data technologies and data More ❯
Understanding of data modeling, distributed systems, ETL/ELT pipelines, and streaming architectures Proficiency in SQL and at least one programming language (e.g., Python, Scala, or Java) Demonstrated experience owning complex technical systems end-to-end, from design through production Excellent communication skills with the ability to explain technical concepts More ❯
Newcastle upon Tyne, England, United Kingdom Hybrid / WFH Options
Somerset Bridge Group
Delta Lake for schema evolution, ACID transactions, and time travel in Databricks. Strong Python (PySpark) skills for big data processing and automation. Experience with Scala (optional but preferred for advanced Spark applications). Experience working with Databricks Workflows & Jobs for data orchestration. Strong knowledge of feature engineering and feature stores More ❯
data modeling , distributed systems , streaming architectures , and ETL/ELT pipelines . Proficiency in SQL and at least one programming language such as Python , Scala , or Java . Demonstrated experience owning and delivering complex systems from architecture through implementation. Excellent communication skills with the ability to explain technical concepts to More ❯
data modeling , distributed systems , streaming architectures , and ETL/ELT pipelines . Proficiency in SQL and at least one programming language such as Python , Scala , or Java . Demonstrated experience owning and delivering complex systems from architecture through implementation. Excellent communication skills with the ability to explain technical concepts to More ❯
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
JR United Kingdom
data modeling , distributed systems , streaming architectures , and ETL/ELT pipelines . Proficiency in SQL and at least one programming language such as Python , Scala , or Java . Demonstrated experience owning and delivering complex systems from architecture through implementation. Excellent communication skills with the ability to explain technical concepts to More ❯
Strong expertise in Databricks , Apache Spark , and Delta Lake . Experience with Hive Metastore and Unity Catalog for data governance. Proficiency in Python, SQL, Scala , or other relevant languages. Familiarity with structured streaming, event-driven architectures , and stateful processing . Ability to design, schedule, and optimize Databricks workflows . Knowledge More ❯
of performing architectural assessments, examining architectural alternatives, and choosing the best solution in collaboration with both IT and business stakeholders Fluent in Python, Java, Scala, or similar Object-Oriented Programming Languages Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with More ❯
grids, SCADA systems). Hands-on experience in building and managing data pipelines. Proficiency in Python, SQL, and at least one other language (e.g., Scala, Java). Experience with relational (e.g., PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra). Familiarity with cloud platforms like AWS, Azure, or GCP. Experience with More ❯
will too. WHAT WE NEED YOU TO HAVE EXPERIENCE IN Coding Coding/scripting experience developed in a commercial/industry setting (Python, Java, Scala or Go and SQL). Databases & frameworks Strong experience working with Kafka technologies. Working experience with operational data stores , data warehouse , big data technologies and More ❯
who have a variety of different skills which include some of the below. Strong proficiency in at least one programming language (Python, Java, or Scala) Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: Data warehousing and lake architectures ETL/ELT pipeline development SQL and NoSQL databases More ❯
london (city of london), south east england, united kingdom
Accenture
who have a variety of different skills which include some of the below. Strong proficiency in at least one programming language (Python, Java, or Scala) Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: Data warehousing and lake architectures ETL/ELT pipeline development SQL and NoSQL databases More ❯
who have a variety of different skills which include some of the below. Strong proficiency in at least one programming language (Python, Java, or Scala) Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: Data warehousing and lake architectures ETL/ELT pipeline development SQL and NoSQL databases More ❯
UK for at least the past 5 years and being a UK national or dual UK national. Experience in prominent languages such as Python, Scala, Spark, SQL. Experience working with any database technologies from an application programming perspective - Oracle, MySQL, Mongo DB etc. Experience with the design, build and maintenance More ❯
expertise in building and managing data pipelines. Proficiency in Python, SQL, and at least one other programming language commonly used in data engineering (e.g., Scala, Java). Experience with relational databases (e.g., PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra). Familiarity with cloud platforms like AWS, Azure, or GCP for More ❯
expertise in building and managing data pipelines. Proficiency in Python, SQL, and at least one other programming language commonly used in data engineering (e.g., Scala, Java). Experience with relational databases (e.g., PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra). Familiarity with cloud platforms like AWS, Azure, or GCP for More ❯
technology developments to identify cutting-edge innovations for potential future projects. Requirements Expertise in development languages including but not limited to: Java/J2EE, Scala/Python, XML, JSON, SQL, Spring/Spring Boot. Expertise with RESTful web services, Spark, Kafka etc. Experience with relational SQL, NoSQL databases and cloud More ❯
