25 of 25 Apache Jobs in London

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

high-performance, data-heavy environments Strong fundamentals in algorithms, distributed systems, and parallel compute Experience with large-scale data frameworks: PySpark, Ray, Dask, Apache Arrow, Numba, Cython Exposure to containerised, cloud-native environments (Docker, K8s, Terraform) Familiarity with CI/CD, observability, and diagnostics: GitLab CI, Prometheus, Grafana, OpenTelemetry ...

have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology in the stack includes: FastAPI ...

/or Azure (Data Lake, Synapse). Programming & Scripting:Proficiency in Python, SQL, PySpark etc. ETL/ELT & Streaming:Expertise in technologies like Apache Airflow, Glue, Kafka, Informatica, EventBridge etc. Industrial Data Integration:Familiarity with OT data schema originating from OSIsoft PI, SCADA, MES, and Historian systems. Information Modeling ...

NICE FOR THE SENIOR SOFTWARE ENGINEER TO HAVE. Cloud based experience Microservice architecture or server-less architecture Big Data/Messaging technologies such as Apache Nifi/MiNiFi/Kafka TO BE CONSIDERED. Please either apply by clicking online or emailing me directly to For further information please call ...

Code tools Experience with NoSQL databases (e.g., MongoDB) or SQL (e.g., Postgres) Understanding of web standards, accessibility and development best practice Experience with Apache NiFi Bonus Skills Microservices in C# Integrating LLMs (e.g., LangChain, Vercel AI) Experience using the (url removed) Design System and Nunjucks What You'll Love ...

programming languages including Java, Python, Scala or Golang. Experience with columnar, analytical cloud data warehouses (e.g., BigQuery, Snowflake, Redshift) and data processing frameworks like Apache Spark is essential. Experience with cloud platforms like AWS, Azure, or Google Cloud. Strong proficiency in designing, developing, and deploying microservices architecture, with ...

cloud data warehouses (e.g., Snowflake, Redshift). Familiarity with data orchestration tools (e.g., Airflow). Experience with data visualisation platforms (such as Preset.io/Apache Superset or other). Exposure to CI/CD pipelines, ideally using GitLab CI. Background working with media, marketing, or advertising data. The Opportunity ...

cloud data warehouses (e.g., Snowflake, Redshift). ·Familiarity with data orchestration tools (e.g., Airflow). ·Experience with data visualisation platforms (such as Preset.io/Apache Superset or other). ·Exposure to CI/CD pipelines, ideally using GitLab CI. ·Background working with media, marketing, or advertising data. The Opportunity ...

languages and technologies ;Java 8, 17, Spring, SpringBoot, Hibernate, JEE, Swing, MVC, Angular & AngularJS, JQuery, AJAX, JSON, HTML, CSS, XSLT, Webservice, JAXB, JSP, Tomcat, Apache, JBoss Enterprise Application Platform, SQL, Jira, Subversion, Azure Pipeline ADO, XML, and related technologies. Extensive experience in API development both REST and SOAP. Experience ...

pipelines and contribute to digital transformation initiatives across government departments. Key Responsibilities Design, develop and maintain robust data pipelines using PostgreSQL and Airflow or Apache Spark Collaborate with frontend/backend developers using Node.js or React Implement best practices in data modelling, ETL processes and performance optimisation Contribute ...

MLOps processes in a production environment. Cloud ML Stack: Expert proficiency with Databricks and MLflow . Big Data/Coding: Expert Apache Spark and Python engineering experience on large datasets. Core Engineering: Strong experience with GIT for version control and building CI/CD/release pipelines. Data Fundamentals ...

Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence to data governance, security ...

cloud technologies Experience with Docker and agile delivery Desirable Skills Terraform or other IaC tools NoSQL (ideally MongoDB) or relational databases (e.g., Postgres) Apache NiFi Web standards, accessibility and development best practice Bonus Experience Microservices in C#/.NET Integrating LLMs with tools like LangChain or Vercel AI Additional ...

more key data platform technologies – Databricks, GCP, and/or Snowflake and specific familiarity with modern data engineering tools such as Apache Spark, Kubernetes, or Kafka Strong understanding of the EMEA market, including data privacy laws and regulations such as GDPR, and the ability to design compliant data solutions ...

WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply by clicking online or emailing me directly to For further information please call ...

projects and delivering secure, scalable cloud solutions. Nice to have: Immediate availability Understanding of Synapse Spark Architecture Familiarity with a variety of technologies, including Apache Spark, Spark ML, Serverless Spark Pools, TSQL, ETL Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business ...

languages and technologies ;Java 8, 17, Spring, SpringBoot, Hibernate, JEE, Swing, MVC, Angular & AngularJS, JQuery, AJAX, JSON, HTML, CSS, XSLT, Webservice, JAXB, JSP, Tomcat, Apache, JBoss Enterprise Application Platform, SQL, Jira, Subversion, Azure Pipeline ADO, XML, a click apply for full job details ...

capturing reporting requirements, designing reports, and developing dashboards using an interactive and agile approach. Experience with at least one BI platform, such as Apache Superset, Looker, Metabase, SAP BI/SAC, MicroStrategy, Microsoft Power BI, Tableau, or Qlik. Familiarity with agile development methodologies. Nice to have Experience in Java ...

requirements into efficient data solutions, leveraging modern cloud-based tools and frameworks. Key Responsibilities Design and develop scalable, testable data pipelines utilizing Python and Apache Spark. Orchestrate data workflows using AWS services including Glue, EMR Serverless, Lambda, and S3. Apply industry-standard software engineering practices such as version control …/CD, modular design, and automated testing. Contribute to the development of a lakehouse architecture leveraging Apache Iceberg for efficient data storage and management. Collaborate with business teams to understand requirements and deliver insightful, data-driven solutions. Enhance data pipeline observability and implement basic data quality checks. Participate ...

such as React, Redux, TypeScript, Material UI, Storybook, Jest, and Scala.js Proven working knowledge of Backend & Databases such as Scala (v2), Play Framework, ScalaTest, Apache Pekko (including testkits), Mockito, PostgreSQL, and MongoDB. Familiarity with DevOps & Cloud tools like Docker, Kubernetes, Sysdig, OpenSearch, and AWS. Excellent communication and stakeholder management ...

such as React, Redux, TypeScript, Material UI, Storybook, Jest, and Scala.js Proven working knowledge of Backend & Databases such as Scala (v2), Play Framework, ScalaTest, Apache Pekko (including testkits), Mockito, PostgreSQL, and MongoDB. Familiarity with DevOps & Cloud tools like Docker, Kubernetes, Sysdig, OpenSearch, and AWS. Excellent communication and stakeholder management ...

your specific data industry experience to keep our curriculum cutting-edge. This involves iterating on materials to reflect modern stacks (e.g. cloud data engineering, Apache Airflow, Kafka). You will collaborate with the Curriculum team to design highly effective educational experiences that give learners the AI and Data skills … data modelling, and managing data warehouses (experience with DBT is a plus). Pipelines & Orchestration: Familiarity with building data pipelines, covering batch processing (e.g., Apache Airflow) and an understanding of stream processing (e.g., Kafka/Spark). Data Statistics & Analytics: A strong grasp of statistical concepts (distributions, regression, significance ...

your specific data industry experience to keep our curriculum cutting-edge. This involves iterating on materials to reflect modern stacks (e.g. cloud data engineering, Apache Airflow, Kafka). You will collaborate with the Curriculum team to design highly effective educational experiences that give learners the AI and Data skills … data modelling, and managing data warehouses (experience with DBT is a plus). Pipelines & Orchestration: Familiarity with building data pipelines, covering batch processing (e.g., Apache Airflow) and an understanding of stream processing (e.g., Kafka/Spark). Data Statistics & Analytics: A strong grasp of statistical concepts (distributions, regression, significance ...