23 of 23 Permanent Apache Beam Jobs

analysis and returning the results to various business systems. We build on a vast variety of technological stacks, from building products on top of Apache Kafka, Apache Spark, and Apache Beam to integrating Neo4j into Google Dataflow Templates and Microsoft Fabric. We also build backend components … ideally have professional experience developing software systems, either in cloud or on-premises, involving either of the following; Distributed event streaming platforms, such as Apache Kafka or similar products, Data processing and analytics platforms, such as Apache Spark, Apache Beam, or their derivatives, Data warehouses ...

services for personalisation Developing Java/Spring Boot microservices with REST/gRPC APIs Working with Kafka and event-driven architectures Building pipelines using Apache Flink and Apache Beam Integrating ML models and feature stores Working with NoSQL databases and Redis caching Using Apache Camel … with stream processing concepts Knowledge of distributed systems Strong communication and teamwork skills Interest in data-driven personalisation systems Nice to have Experience with Apache Flink and Apache Beam Experience with Kafka Familiarity with Apache Camel Experience with NoSQL databases (Cassandra, DynamoDB) and Redis Cloud experience ...

services for personalisation · Developing Java/Spring Boot microservices with REST/gRPC APIs · Working with Kafka and event-driven architectures · Building pipelines using Apache Flink and Apache Beam · Integrating ML models and feature stores · Working with NoSQL databases and Redis caching · Using Apache Camel … with stream processing concepts · Knowledge of distributed systems · Strong communication and teamwork skills · Interest in data-driven personalisation systems Nice to have · Experience with Apache Flink and Apache Beam · Experience with Kafka · Familiarity with Apache Camel · Experience with NoSQL databases (Cassandra, DynamoDB) and Redis · Cloud experience ...

platform at scale, ideally in a consumer or marketplace environment. Deep understanding of distributed systems and modern data ecosystems — including extensive experience with Databricks, Apache Spark, Apache Kafka, Apache Flink, Apache Beam and DBT. Demonstrated success in designing, building, and operating data platforms at scale ...

Dataflow, Dataproc, Cloud Composer (Airflow), Pub/Sub, Cloud Storage, Bigtable, and Cloud SQL. Proficiency in Python and SQL, with experience in Spark or Apache Beam. Experience designing data warehouse and data lake architectures, including data modeling. Working experience with Terraform and CI/CD tooling such as Jenkins ...

/Java and/or Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and "infrastructure as a code ...

Learning, or AI workloads. Experience with MLOps tooling such as MLflow, Kubeflow, Vertex AI, or similar technologies. Knowledge of workflow orchestration platforms such as Apache Airflow. Experience with data processing technologies such as Pandas, Apache Beam, Spark, or similar frameworks. Strong SQL skills and experience with analytical ...

data ingestion, transformation, orchestration, and processing across batch and real-time workloads. Own the integration strategy across tools such as dbt, Spark and Beam Lead the implementation and adoption of data quality, observability, security, testing and deployment including creating and sharing standards Partner closely with Analytics Engineers, Data Scientists ...

capabilities for data ingestion, transformation, orchestration, and processing across batch and real-time workloads. Own the integration strategy across tools such asdbt, Spark and Beam Lead the implementation and adoption of data quality, observability, security, testing and deployment including creating and sharing standards Partner closely with Analytics Engineers, Data ...

Python and Java development skills.Experience with GCP and cloud-native AI/data platforms.Hands-on experience with Vertex AI and BigQuery.Experience with Dataflow/Apache Beam, Pub/Sub, Cloud Run/GKE, and Cloud Storage.Experience with graph data modeling and querying, including GQL, Neo4j, Spanner Graph ...

Extensive experience working with operational data stores, data warehouse, large‐scale data technologies and data lakes Experience using distributed frameworks (Spark, Flink, Beam, Hadoop) Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS Strong experience working with Kafka technologies Clear ...

working with large-scale datasets using SQL and platforms such as BigQuery. You have experience with JVM-based data processing frameworks such as Flink, Beam, Dataflow, or Spark. You are familiar with DevOps practices, cloud infrastructure, containerized applications, and Kubernetes fundamentals. You have experience with data modeling and schema ...

similar environments. Knowledge, entity, search or feed systems where correctness under continuous update was the hard part. Stateful stream processing (Flink, Kafka Streams, Beam or similar): event time, watermarks, exactly-once. APIs for data ingestion and consumption with FastAPI, gRPC or GraphQL. Graph stores and entity resolution or curation ...

talks, or threads about building with AI. MLOpsand model serving experience (BentoML,MLflow, Vertex AI, SageMaker). Streaming and batch ingestion pipelines (Spark, Airflow, Beam, Glue). Healthcare or life sciences domain exposure. AWS Professional certification or other relevant industry certifications. What We Offer At Newpage, we’re building ...

driven user experience. Hybrid role with three on-site days in City of London. Responsibilities include building scalable data pipelines (BigQuery, Dataflow/Apache Beam, Airflow), ensuring data quality and observability (Looker, Monte Carlo), and collaborating with product engineering and data science teams to plan data tracking ...

Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these roles or used these technologies/skills, this role could be a great fit: Data Scientist ...

Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these roles or used these technologies/skills, this role could be a great fit: Data Scientist ...

more of the following Agentic & Gen AI Platforms: such as Microsoft Copilot Studio, Adept AI, UiPath, OpenAI GPT-5 Agents, Orby AI, and Beam AI. Eligibility: Due to security clearance requirements, there is a strong preference for candidates who have resided in the UK for more than 5 years. ...

data processing solutions using BigQuery, Pub/Sub, Dataflow and Dataproc Experience developing end‐to‐end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam. Expert understanding of when to use a range of data storage technologies including relational/non‐relational, document ...

experiences for Tesco customers across web, mobile, and in-store channels. You will develop Java/Spring Boot microservices, work with Kafka, Flink/Beam pipelines, feature stores, NoSQL datastores, and contribute to CI/CD, testing, and monitoring in a large-scale distributed system. #J-18808-Ljbffr ...

role requires 5+ years of production-grade software experience, proficiency in Kotlin/Java/Go, and hands-on work with Kafka, Spark/Beam, and cloud warehouses. #J-18808-Ljbffr ...

LilEngine is leading the Lakehouse, a company-strategic effort to make Apache Iceberg a first-class citizen in Spotify's data ecosystem. We're building it in close collaboration with Google, on open standards, so that different kinds of data are queryable the same way and teams can bring … quotas, and work with CRDs and operators. You don't need deep expertise in all of these on day one. You've worked with Apache Iceberg or JVM-based processing frameworks like Spark, Beam or Flink, or with a cloud data warehouse such as BigQuery, Snowflake or Databricks. ...

streaming workloads, managing schemas as they evolve, and guaranteeing that consumers only read complete data. We build on open standards like OpenLineage and Apache Iceberg, and define the internal standards for naming, storage and metadata that the rest of Spotify builds against. As the platform takes on new storage … worked with data pipelines or a cloud data warehouse such as BigQuery, Snowflake or Databricks. Hands-on experience with batch or streaming frameworks like Beam, Flink or Spark is a plus. You have a working understanding of data engineering concepts such as orchestration, metadata management, data quality, governance ...