21 of 21 Apache Beam Jobs in England

analysis and returning the results to various business systems. We build on a vast variety of technological stacks, from building products on top of Apache Kafka, Apache Spark, and Apache Beam to integrating Neo4j into Google Dataflow Templates and Microsoft Fabric. We also build backend components … ideally have professional experience developing software systems, either in cloud or on-premises, involving either of the following; Distributed event streaming platforms, such as Apache Kafka or similar products, Data processing and analytics platforms, such as Apache Spark, Apache Beam, or their derivatives, Data warehouses ...

services for personalisation · Developing Java/Spring Boot microservices with REST/gRPC APIs · Working with Kafka and event-driven architectures · Building pipelines using Apache Flink and Apache Beam · Integrating ML models and feature stores · Working with NoSQL databases and Redis caching · Using Apache Camel … with stream processing concepts · Knowledge of distributed systems · Strong communication and teamwork skills · Interest in data-driven personalisation systems Nice to have · Experience with Apache Flink and Apache Beam · Experience with Kafka · Familiarity with Apache Camel · Experience with NoSQL databases (Cassandra, DynamoDB) and Redis · Cloud experience ...

platform at scale, ideally in a consumer or marketplace environment. Deep understanding of distributed systems and modern data ecosystems — including extensive experience with Databricks, Apache Spark, Apache Kafka, Apache Flink, Apache Beam and DBT. Demonstrated success in designing, building, and operating data platforms at scale ...

integration, and production support. Good understanding of ETL/ELT, data warehousing, data lakes, dimensional modelling, batch processing, and stream processing. Experience with Apache Beam, Kafka, REST APIs, Docker, Kubernetes, or GKE. Experience with data formats such as JSON, CSV, Avro, and Parquet. Working knowledge of Git, automated … observability, and release management. Ability to design solutions for scalability, resilience, security, performance, operability, and cost efficiency. Preferred Skills Experience with Cloud Composer or Apache Airflow, Dataproc or Spark, Dataform or dbt, and metadata-driven pipeline frameworks. Exposure to Terraform or another infrastructure-as-code tool. Knowledge of Dataplex ...

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code ...

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and "infrastructure as a code ...

Learning, or AI workloads. Experience with MLOps tooling such as MLflow, Kubeflow, Vertex AI, or similar technologies. Knowledge of workflow orchestration platforms such as Apache Airflow. Experience with data processing technologies such as Pandas, Apache Beam, Spark, or similar frameworks. Strong SQL skills and experience with analytical ...

variety of data sources using data modelling techniques Experience in Building Extract Transform and Load (ETL) pipeline (streaming/batch) using MPP frameworks (Spark, Beam, or other) Experience in orchestrating complex pipelines using Airflow, Dagster or other Proficiency in one or more programming languages: Python, Java, GO or other ...

capabilities for data ingestion, transformation, orchestration, and processing across batch and real-time workloads. Own the integration strategy across tools such asdbt, Spark and Beam Lead the implementation and adoption of data quality, observability, security, testing and deployment including creating and sharing standards Partner closely with Analytics Engineers, Data ...

Extensive experience working with operational data stores, data warehouse, large‐scale data technologies and data lakes Experience using distributed frameworks (Spark, Flink, Beam, Hadoop) Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS Strong experience working with Kafka technologies Clear ...

driven user experience. Hybrid role with three on-site days in City of London. Responsibilities include building scalable data pipelines (BigQuery, Dataflow/Apache Beam, Airflow), ensuring data quality and observability (Looker, Monte Carlo), and collaborating with product engineering and data science teams to plan data tracking ...

Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you’ve held any of these roles or used these technologies/skills, this role could be a great fit: Data Scientist ...

Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these roles or used these technologies/skills, this role could be a great fit: Data Scientist ...

more of the following Agentic & Gen AI Platforms: such as Microsoft Copilot Studio, Adept AI, UiPath, OpenAI GPT-5 Agents, Orby AI, and Beam AI.Eligibility:Due to security clearance requirements, there is a strong preference for candidates who have resided in the UK for more than 5 years.WHAT ...

that process large-scale batch and real-time workloads. Today, those workloads span two ecosystems. Our streaming stack includes XStream and a growing managed Apache Flink footprint. Our batch stack includes Spark and Presto over Hive and Iceberg tables, Velox as a shared execution layer, and an internal workflow … 12+ years of experience in Product Management or equivalent relevant experience Experience with or direct product ownership of at least one of Google Dataflow, Apache Beam, Flink, Kafka, Spark Structured Streaming, Iceberg or comparable systems Demonstrated expertise in large-scale distributed data systems Critical thinking and analytical leadership ...

data pipelines and event-driven systems Kafka, Pulsar, NATS, RabbitMQ, or similar messaging platforms Designing distributed schedulers, queues, and asynchronous processing systems Spark, Flink, Beam, or MapReduce Ad tech, social networks, search engines, or other large-scale content platforms We conduct coding interviews as part of the process. Benefits ...

technical program manager. Data Engineering Proficiency : Expertise in SQL, Python, Pandas, Matlab, or R. Bonus if familiarity with Influx, Grafana, Spark, Polars, Arrow, Kafka, Beam, and Flink. [Bonus] In-Field Hardware Mastery : Proficiency with hardware engineering tools such as DAQs, DDS, Nix, RTOS, MCAP, H5, TDMS, LabVIEW, Simulink ...

data processing solutions using BigQuery, Pub/Sub, Dataflow and Dataproc Experience developing end‐to‐end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam. Expert understanding of when to use a range of data storage technologies including relational/non‐relational, document ...

experiences for Tesco customers across web, mobile, and in-store channels. You will develop Java/Spring Boot microservices, work with Kafka, Flink/Beam pipelines, feature stores, NoSQL datastores, and contribute to CI/CD, testing, and monitoring in a large-scale distributed system. #J-18808-Ljbffr ...

ready data processing solutions using BigQuery, Pub/Sub, Dataflow and DataprocExperience developing end-to-end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam.Expert understanding of when to use a range of data storage technologies including relational/non-relational, document, row-based ...

role requires 5+ years of production-grade software experience, proficiency in Kotlin/Java/Go, and hands-on work with Kafka, Spark/Beam, and cloud warehouses. #J-18808-Ljbffr ...