1 to 25 of 27 Apache Beam Jobs in England

services for personalisation· Developing Java/Spring Boot microservices with REST/gRPC APIs· Working with Kafka and event-driven architectures· Building pipelines using Apache Flink and Apache Beam· Integrating ML models and feature stores· Working with NoSQL databases and Redis caching· Using Apache Camel … Familiarity with stream processing concepts· Knowledge of distributed systems· Strong communication and teamwork skills· Interest in data-driven personalisation systemsNice to have· Experience with Apache Flink and Apache Beam· Experience with Kafka· Familiarity with Apache Camel· Experience with NoSQL databases (Cassandra, DynamoDB) and Redis· Cloud experience ...

analysis and returning the results to various business systems.We build on a vast variety of technological stacks, from building products on top of Apache Kafka, Apache Spark, and Apache Beam to integrating Neo4j into Google Dataflow Templates and Microsoft Fabric. We also build backend components … ideally have professional experience developing software systems, either in cloud or on-premises, involving either of the following;Distributed event streaming platforms, such as Apache Kafka or similar products,Data processing and analytics platforms, such as Apache Spark, Apache Beam, or their derivatives,Data warehouses ...

services for personalisation · Developing Java/Spring Boot microservices with REST/gRPC APIs · Working with Kafka and event-driven architectures · Building pipelines using Apache Flink and Apache Beam · Integrating ML models and feature stores · Working with NoSQL databases and Redis caching · Using Apache Camel … with stream processing concepts · Knowledge of distributed systems · Strong communication and teamwork skills · Interest in data-driven personalisation systems Nice to have · Experience with Apache Flink and Apache Beam · Experience with Kafka · Familiarity with Apache Camel · Experience with NoSQL databases (Cassandra, DynamoDB) and Redis · Cloud experience ...

platform at scale, ideally in a consumer or marketplace environment. Deep understanding of distributed systems and modern data ecosystems — including extensive experience with Databricks, Apache Spark, Apache Kafka, Apache Flink, Apache Beam and DBT. Demonstrated success in designing, building, and operating data platforms at scale ...

Data Engineer within GCP environments Hands-on experience with BigQuery, Dataflow and Spanner Strong programming capability in Python, Java or Scala Experience with Apache Beam/Dataflow and distributed processing frameworks Experience designing and managing ETL/ELT pipelines Solid understanding of data modelling and database design Experience … with workflow orchestration tools such as Apache Airflow Strong understanding of data governance, security and scalability Desirable Skills for the GCP Data Engineer: Experience with Pub/Sub, Cloud Composer or Cloud Data Fusion Exposure to CI/CD, DevOps and Infrastructure as Code Experience with real-time streaming ...

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code ...

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and "infrastructure as a code ...

optimisation and administration Strong programming experience with Python, Go and/or SQL Experience using dbt for data modelling and transformation Experience working with Apache Airflow or similar orchestration tooling Proven experience designing and building production systems on GCP and/or AWS Strong understanding of event-driven architectures … distributed systems Experience deploying and supporting batch and real-time machine learning workloads Experience working with distributed processing technologies such as Spark or Apache Beam Strong understanding of data quality principles and engineering best practices Experience optimising database performance, troubleshooting issues and maintaining production data systems Ability ...

optimisation and administration Strong programming experience with Python, Go and/or SQL Experience using dbt for data modelling and transformation Experience working with Apache Airflow or similar orchestration tooling Proven experience designing and building production systems on GCP and/or AWS Strong understanding of event-driven architectures … distributed systems Experience deploying and supporting batch and real-time machine learning workloads Experience working with distributed processing technologies such as Spark or Apache Beam Strong understanding of data quality principles and engineering best practices Experience optimising database performance, troubleshooting issues and maintaining production data systems Ability ...

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code ...

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code ...

variety of data sources using data modelling techniques Experience in Building Extract Transform and Load (ETL) pipeline (streaming/batch) using MPP frameworks (Spark, Beam, or other) Experience in orchestrating complex pipelines using Airflow, Dagster or other Proficiency in one or more programming languages: Python, Java, GO or other ...

data ingestion, transformation, orchestration, and processing across batch and real-time workloads. Own the integration strategy across tools such as dbt, Spark and Beam Lead the implementation and adoption of data quality, observability, security, testing and deployment including creating and sharing standards Partner closely with Analytics Engineers, Data Scientists ...

capabilities for data ingestion, transformation, orchestration, and processing across batch and real-time workloads. Own the integration strategy across tools such asdbt, Spark and Beam Lead the implementation and adoption of data quality, observability, security, testing and deployment including creating and sharing standards Partner closely with Analytics Engineers, Data ...

Extensive experience working with operational data stores, data warehouse, large‐scale data technologies and data lakes Experience using distributed frameworks (Spark, Flink, Beam, Hadoop) Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS Strong experience working with Kafka technologies Clear ...

backend systems and data-intensive applications. You are experienced with Scala or Java and at least one distributed data processing framework such as Scio, Apache Beam, Spark, or Flink. You know how to design and build reliable backend services and scalable data pipelines that support business-critical workflows. ...

driven user experience. Hybrid role with three on-site days in City of London. Responsibilities include building scalable data pipelines (BigQuery, Dataflow/Apache Beam, Airflow), ensuring data quality and observability (Looker, Monte Carlo), and collaborating with product engineering and data science teams to plan data tracking ...

Experience with domain-specific workflow systems (e.g., Nextflow) for scaling high-throughput pipeline execution.Familiarity with general-purpose data orchestration and processing frameworks (e.g., Dagster, Apache Beam) for integrating research pipelines into a production platformFamiliarity with building and maintaining bioinformatics infrastructure on Google Cloud Platform (GCP).Familiarity with modern ...

Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you’ve held any of these roles or used these technologies/skills, this role could be a great fit: Data Scientist ...

Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these roles or used these technologies/skills, this role could be a great fit: Data Scientist ...

technical program manager. Data Engineering Proficiency : Expertise in SQL, Python, Pandas, Matlab, or R. Bonus if familiarity with Influx, Grafana, Spark, Polars, Arrow, Kafka, Beam, and Flink. [Bonus] In-Field Hardware Mastery : Proficiency with hardware engineering tools such as DAQs, DDS, Nix, RTOS, MCAP, H5, TDMS, LabVIEW, Simulink ...

talks or threads about building with AI MLOps and model serving experience (BentoML, MLflow, Vertex AI, SageMaker) Streaming or batch pipeline experience (Spark, Airflow, Beam, Glue) Healthcare or life sciences exposure AWS Professional or other relevant certifications What We Offer At Newpage, we’re building a company that works ...

data processing solutions using BigQuery, Pub/Sub, Dataflow and Dataproc Experience developing end‐to‐end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam. Expert understanding of when to use a range of data storage technologies including relational/non‐relational, document ...

data pipelines and event-driven systems Kafka, Pulsar, NATS, RabbitMQ, or similar messaging platforms Designing distributed schedulers, queues, and asynchronous processing systems Spark, Flink, Beam, or MapReduce Ad tech, social networks, search engines, or other large-scale content platforms We conduct coding interviews as part of the process. Benefits ...

ready data processing solutions using BigQuery, Pub/Sub, Dataflow and DataprocExperience developing end-to-end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam.Expert understanding of when to use a range of data storage technologies including relational/non-relational, document, row-based ...