1 to 25 of 81 Flink Jobs in the UK

issues. Strong commercial experience designing and implementing real‐time streaming data platforms. Hands‐on experience with technologies such as Apache Kafka, AWS Kinesis, Apache Flink, Spark Streaming, Apache Pulsar, or similar event‐driven technologies. Experience building high‐volume, low‐latency, resilient data pipelines in production environments. Strong understanding ...

Python and/or other modern programming languages. Experience developing and orchestrating data pipelines using technologies such as DBT, Apache Spark, Airflow, Dagster, Kafka, Flink, or equivalent tooling. Solid understanding of data lakehouse, warehouse, and medallion architecture patterns. Experience applying DevOps and DataOps best practices including CI/ ...

Hands-on experience building, scaling, and shipping large-scale data platforms in production. Deep practical experience with distributed data processing frameworks (e.g., Apache Spark, Flink, Hadoop). Strong expertise in message brokers and event streaming platforms (e.g., Apache Kafka, Kinesis). End-to-end exposure to data pipeline lifecycle ...

following would be beneficial but not essential: Data Warehousing (Snowflake, Redshift, Synapse, BigQuery, etc.) Relational, NoSQL, graph and vector databases Streaming technologies (Kafka, Kinesis, Flink, etc.) Containers and related services (Docker, Kubernetes, container Registries, etc) Data modelling approaches (Kimball, Imnon) Orchestration tools - Apache Airflow, Prefect or cloud-native tools ...

Experience with additional languages such as TypeScript, Go, Java or Rust. Experience with big data and real-time processing technologies, such as Apache Spark, Flink or Kafka Streams. Relevant cloud certifications, such as AWS Certified Solutions Architect – Professional, Azure Solutions Architect Expert or Google Cloud Professional Cloud Architect. Experience ...

offer visa sponsorship for this role at present Desirable (Nice to Have) Experience with streaming and big‐data tooling – Apache Kafka, Spark, or Flink Experience with MLOps platforms – MLflow, Kubeflow, Vertex AI, SageMaker, or Weights & Biases Experience evaluating and optimising RAG systems at scale (retrieval quality, chunking, re‐ranking ...

Proven experience designing and building scalable data pipelines (ETL/ELT) for batch and streaming use cases using modern technologies (e.g., Python, SQL, Spark, Flink, Airflow) and advanced knowledge on the workings of these. Hands-on experience in building and operating workloads Databricks. Hands-on experience creating data visualizations ...

that power intelligent decision-making. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Develop and support real-time streaming pipelines and event-driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using … junior engineers where needed. Core Data Engineering Strong programming proficiency in Java (preferred) or Python. Hands-on experience with at least one of: Kafka, Flink, Spark (Flink/Kafka preferred for streaming). Solid understanding of stream processing concepts (e.g., event time, state, backpressure). Understanding of software ...

Kubernetes – experience with container orchestration and distributed application deployment. Experience developing Java-based data processing or event-driven applications. Additional Advantageous Experience Apache Spark, Flink, Hadoop or other Big Data technologies. Working with high-volume or complex enterprise datasets. Experience delivering solutions within government, defence or other secure environments. ...

managing real-time data pipelines across a track record of multiple initiatives. Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.). Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage. Programming skills in Python ...

cloud strategy — contributing to cloud adoption initiatives, deploying Citi APIs on AWS and Azure Working with event streaming and messaging systems including Kafka, Flink, and Solace at enterprise scale This is a rare opportunity in financial services — a stable, well‐funded platform with the freedom to keep building ...

columnar formats, or analytics engines (e.g., ClickHouse, TimescaleDB, Druid, InfluxDB, Parquet). Experience with streaming or data processing technologies such as Kafka, Apache Arrow, Flink, or Spark. Comfort reasoning about distributed systems tradeoffs: latency vs. throughput, consistency vs. availability, abstraction vs. control. Clear technical communication and a bias toward ...

development. Proficiency in SQL and programming languages such as Python, Java, or Scala. Hands‐on experience with big data frameworks (e.g., Spark, Hadoop, Flink) and cloud platforms (AWS, GCP, or Azure). Familiarity with data warehouse technologies (e.g., Snowflake, Redshift, BigQuery) and workflow orchestration tools (e.g., Airflow, Luigi). ...

Worked with one or more cloud platforms and services (AWS, Azure, GCP) Extensive hands‐on experience with modern data technologies, ETL tools (e.g. Kafka, Flink, DBT etc.), data storage (e.g. Snowflake, Redshift, etc.) and also IaC (e.g. Terraform, CloudFormation) Software development experience with one or more languages (e.g. Python ...

modelling: designing schemas and storage for relational databases, warehouses or lakehouses, and understanding when each fits. Distributed processing: working with systems such as Spark, Flink or Beam, including how partitioning, parallelism, skew, memory, failures and ordering affect results. Platform experience Cloud and infrastructure as code: building infrastructure with tools ...

consumer or marketplace environment. Deep understanding of distributed systems and modern data ecosystems — including extensive experience with Databricks, Apache Spark, Apache Kafka, Apache Flink, Apache Beam and DBT. Demonstrated success in designing, building, and operating data platforms at scale, encompassing both batch processing and real-time streaming architectures. Expertise ...

Databricks, Snowflake, Microsoft Fabric, Azure Synapse, Google BigQuery, Amazon Redshift Data engineering and orchestration: Spark, dbt, Airflow, Azure Data Factory, AWS Glue, Dataflow, Kafka, Flink Governance, catalogue and lineage: Microsoft Purview, Collibra, Informatica, Alation, Atlan, OpenLineage Graph, ontology and semantic technologies: Neo4j, Amazon Neptune, Stardog, GraphDB, RDF, OWL, SPARQL ...

Spring components, including Spring Data JPA. Experience with containerisation technologies such as Docker and Kubernetes. Experience with stream processing frameworks such as Apache Flink is a plus but not required. Familiarity with SSO mechanisms including OpenID is a plus but not required. A basic understanding of core microservice components ...

OpenTelemetry Strong problem‐solving skills and a systematic approach to diagnosing and resolving issues Highly Desirable Skills Experience with streaming frameworks such as Flink, Kafka Streams and Kafka Connect Knowledge of modern data lake technologies including Delta Lake, Iceberg and Glue Data Catalog Exposure to DataOps practices and collaboration ...

data platforms rather than solely delivering individual components. You’ll need experience across: Batch data processing, ELT and orchestration. Modern streaming technologies such as Flink or comparable platforms. AWS data services, including S3, Lambda, Glue, Athena, Kinesis and RDS. Infrastructure as code using Terraform. CI/CD and automated ...

data platforms rather than solely delivering individual components. You'll need experience across: Batch data processing, ELT and orchestration. Modern streaming technologies such as Flink or comparable platforms. AWS data services, including S3, Lambda, Glue, Athena, Kinesis and RDS. Infrastructure as code using Terraform. CI/CD and automated ...

containerization (Docker/K8s), and CI/CD pipelines. Excellent communication skills Technical Areas Where Depth Matters (one or more) Data Engineering: Spark, Kafka, Flink, BigQuery, streaming pipelines, ETL at scale. Distributed Systems: High-volume scaling, fault tolerance, eventual consistency. AI/ML: LLMs in production, RAG, embeddings, fine ...

production Worked with one or more cloud platforms and services (AWS, Azure, GCP) Hands-on experience with modern data technologies and tools (e.g. Kafka, Flink, DBT etc.), data storage (e.g. Snowflake, Redshift, etc.) and also IaC (e.g. Terraform, CloudFormation) Pragmatic approach to solving problems Nice to haves Keen interest ...

design sessions Confidence communicating with technical and non-technical stakeholders, and challenging constructively Desirable: SQL Server or on-prem to cloud migration, Apache Flink, regulated industry experience If you'd rather shape a platform than inherit a finished one, and want a seat at the table while ...

design sessions Confidence communicating with technical and non-technical stakeholders, and challenging constructively Desirable: SQL Server or on-prem to cloud migration, Apache Flink, regulated industry experience If you'd rather shape a platform than inherit a finished one, and want a seat at the table while ...