17 of 17 Apache Beam Jobs in the UK

analysis and returning the results to various business systems. We build on a vast variety of technological stacks, from building products on top of Apache Kafka, Apache Spark, and Apache Beam to integrating Neo4j into Google Dataflow Templates and Microsoft Fabric. We also build backend components … ideally have professional experience developing software systems, either in cloud or on-premises, involving either of the following; Distributed event streaming platforms, such as Apache Kafka or similar products, Data processing and analytics platforms, such as Apache Spark, Apache Beam, or their derivatives, Data warehouses ...

platform at scale, ideally in a consumer or marketplace environment. Deep understanding of distributed systems and modern data ecosystems — including extensive experience with Databricks, Apache Spark, Apache Kafka, Apache Flink, Apache Beam and DBT. Demonstrated success in designing, building, and operating data platforms at scale ...

integration, and production support. Good understanding of ETL/ELT, data warehousing, data lakes, dimensional modelling, batch processing, and stream processing. Experience with Apache Beam, Kafka, REST APIs, Docker, Kubernetes, or GKE. Experience with data formats such as JSON, CSV, Avro, and Parquet. Working knowledge of Git, automated … observability, and release management. Ability to design solutions for scalability, resilience, security, performance, operability, and cost efficiency. Preferred Skills Experience with Cloud Composer or Apache Airflow, Dataproc or Spark, Dataform or dbt, and metadata-driven pipeline frameworks. Exposure to Terraform or another infrastructure-as-code tool. Knowledge of Dataplex ...

Dataflow, Dataproc, Cloud Composer (Airflow), Pub/Sub, Cloud Storage, Bigtable, and Cloud SQL. Proficiency in Python and SQL, with experience in Spark or Apache Beam. Experience designing data warehouse and data lake architectures, including data modeling. Working experience with Terraform and CI/CD tooling such as Jenkins ...

schemas and storage for relational databases, warehouses or lakehouses, and understanding when each fits. Distributed processing: working with systems such as Spark, Flink or Beam, including how partitioning, parallelism, skew, memory, failures and ordering affect results. Platform experience Cloud and infrastructure as code: building infrastructure with tools such ...

schemas and storage for relational databases, warehouses or lakehouses, and understanding when each fits. Distributed processing: working with systems such as Spark, Flink or Beam, including how partitioning, parallelism, skew, memory, failures and ordering affect results. Platform experience Cloud and infrastructure as code: building infrastructure with tools such ...

achieve meaningful results. You have worked with large-scale data pipelines, data platforms, or backend services. Experience with technologies such as Google Cloud, BigQuery, Apache Beam, Dataflow, dbt, Flyte, Airflow, Scala, or Java is valuable. You can navigate changing priorities, make informed decisions, and help your team move ...

capabilities for data ingestion, transformation, orchestration, and processing across batch and real-time workloads. Own the integration strategy across tools such asdbt, Spark and Beam Lead the implementation and adoption of data quality, observability, security, testing and deployment including creating and sharing standards Partner closely with Analytics Engineers, Data ...

Extensive experience working with operational data stores, data warehouse, large‐scale data technologies and data lakes Experience using distributed frameworks (Spark, Flink, Beam, Hadoop) Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS Strong experience working with Kafka technologies Clear ...

working with large-scale datasets using SQL and platforms such as BigQuery. You have experience with JVM-based data processing frameworks such as Flink, Beam, Dataflow, or Spark. You are familiar with DevOps practices, cloud infrastructure, containerized applications, and Kubernetes fundamentals. You have experience with data modeling and schema ...

similar environments. Knowledge, entity, search or feed systems where correctness under continuous update was the hard part. Stateful stream processing (Flink, Kafka Streams, Beam or similar): event time, watermarks, exactly-once. APIs for data ingestion and consumption with FastAPI, gRPC or GraphQL. Graph stores and entity resolution or curation ...

talks, or threads about building with AI. MLOpsand model serving experience (BentoML,MLflow, Vertex AI, SageMaker). Streaming and batch ingestion pipelines (Spark, Airflow, Beam, Glue). Healthcare or life sciences domain exposure. AWS Professional certification or other relevant industry certifications. What We Offer At Newpage, we’re building ...

Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these roles or used these technologies/skills, this role could be a great fit: Data Scientist ...

similar. Solid beats polished. You have 5+ years of experience building and running production data-intensive pipelines with distributed processing (for example Spark, Ray, Beam, or Dask) and orchestration tools (for example Airflow, Dagster, or Prefect) with structured and unstructured data. You have experience with retrieval-augmented generation, agentic ...

data pipelines and event-driven systems Kafka, Pulsar, NATS, RabbitMQ, or similar messaging platforms Designing distributed schedulers, queues, and asynchronous processing systems Spark, Flink, Beam, or MapReduce Ad tech, social networks, search engines, or other large-scale content platforms We conduct coding interviews as part of the process. Benefits ...

data processing solutions using BigQuery, Pub/Sub, Dataflow and Dataproc Experience developing end‐to‐end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam. Expert understanding of when to use a range of data storage technologies including relational/non‐relational, document ...

role requires 5+ years of production-grade software experience, proficiency in Kotlin/Java/Go, and hands-on work with Kafka, Spark/Beam, and cloud warehouses. #J-18808-Ljbffr ...