1 to 25 of 67 Permanent Flink Jobs in England

distributed data processing and performance tuningHands-on experience with modern data warehousing/lakehouse technologies (e.g., Redshift, BigQuery, Snowflake; and engines such as Spark, Flink, or Trino; and table formats such as Iceberg, Hudi, or similar)Strong SQL skills and experience with SQL-based transformation tooling (e.g., dbt)Experience ...

including command-line administration and troubleshooting. Solid experience with SQL or data pipeline technologies, Experience with data processing frameworks such as Apache Airflow, Apache Flink or Google Dataflow, with a practical understanding of ETL pipeline design and the ability to diagnose issues across data transformation and scheduling workflows. Demonstrable ...

.Hands-on experience building, scaling, and shipping large-scale data platforms in production. Deep practical experience with distributed data processing frameworks (e.g., Apache Spark, Flink, Hadoop).Strong expertise in message brokers and event streaming platforms (e.g., Apache Kafka, Kinesis).End-to-end exposure to data pipeline lifecycle development, including ...

Linux, PowerShell, Shell Scripting, HTML and CSS.Different types of database, e.g. Google Cloud Spanner, Firestore, Bigtable and BigQuery, as well as MongoDB, MySQL, Flink, Cassandra, SQL Server, Postgres. Developing schema for supporting business logic and data. Microservices architecture, including containers and serverless implementation. E.g. Kubernetes, Docker, OpenShift, AWS Lambda ...

consumer or marketplace environment. Deep understanding of distributed systems and modern data ecosystems — including extensive experience with Databricks, Apache Spark, Apache Kafka, Apache Flink, Apache Beam and DBT. Demonstrated success in designing, building, and operating data platforms at scale, encompassing both batch processing and real-time streaming architectures. Expertise ...

covering ingestion, streaming, storage, processing, and analytics Architect and guide event-driven and streaming data solutions using Kafka (Confluent Platform/Confluent Cloud); Apache Flink experience is a plus Define and maintain infrastructure-as-code using Terraform, including cloud resources, networking, and platform services Contribute directly to platform components ...

experience with Python, SQL and modern software engineering practices. Experience building large-scale batch and streaming data solutions using technologies such as Spark, Kafka, Flink, Beam or equivalent. Deep knowledge of modern data architectures including data warehouses, data lakes and lakehouse platforms. Strong understanding of analytical data modelling, dimensional ...

request volumes, large data volumes, or both. Deep expertise in distributed data systems: streaming (Kafka or similar), batch and ELT/ETL frameworks (Spark, Flink, dbt, Airflow or Argo Workflows), and modern lakehouse or warehouse technologies. Strong production Python experience and awareness of other relevant languages (Java/Kotlin ...

Java/Scala and a scripting language like Python. Experience building large scale data pipelinesStrong familiarity with the Apache Hadoop ecosystem including : Spark, Kafka, Flink, Iceberg/Delta Lake/Hive, Apache Presto/Trino, etc. Experience with relational SQL and NoSQL databases, including Postgres/MySQL, Cassandra, DynamoDBFamiliarity ...

Looker, Tableau, or Apache Superset. Understanding of software engineering best practices and their application to data processing systems. Knowledge of Python, Java or Flink is a plus, but not a necessity. Strong attention to detail. Ability to work autonomously in a fast-paced and dynamic environment. Strong communication ...

microservices and REST APIs • AWS, including Lambda • Kafka and distributed streaming • Databricks for data processing • SQL and NoSQL databases • Docker and Kubernetes Spark/Flink, Python, CI/CD, Datadog or Prometheus experience is a strong advantage. Interested and can start ASAP, please apply. ...

ArgoCD, Prometheus, Grafana and OpenTelemetryStrong problem-solving skills and a systematic approach to diagnosing and resolving issuesHighly desirable skillsExperience with streaming frameworks such as Flink, Kafka Streams and Kafka ConnectKnowledge of modern data lake technologies including Delta Lake, Iceberg and Glue Data CatalogExposure to DataOps practices and collaboration with ...

Scala or Go) Extensive experience working with operational data stores, data warehouse, large‐scale data technologies and data lakes Experience using distributed frameworks (Spark, Flink, Beam, Hadoop) Good knowledge of containers (Docker, Kubernetes etc) and experience with cloud platforms such as GCP, Azure or AWS Strong experience working with ...

Confluent Platform Deep knowledge of Kafka internals & KRaft architecture Experience with Confluent Cloud, stream governance, RBAC, and data lineage Expertise in stream processing (Apache Flink, Kafka Streams, ksqlDB) Strong Java, Python, or Scala skills Hands-on experience with AWS/GCP/Azure & Kubernetes CI/CD & infrastructure automation ...

production, providing subject matter expertise on the .Net stack and contributing to technical design discussions. You'll use a range of technology including Apache Flink with Java for large scale data processing and will be able to assess and recommend new and emerging technologies, using the best tool ...

production-grade code Distributed Data Processing Experience building and operating: batch processing systems distributed data systems near real-time streaming pipelines Familiarity with: Kafka Flink Spark Databricks experience is a strong plus Databases & Data Warehousing Comfortable working with: RDBMS data warehousing solutions Strong understanding of data modelling aligned with ...

Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code” tools such as Terraform, Salt ...

Python. Experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code” tools such as Terraform, Salt ...

Linux, bare metal and virtual machines· Provisioning: Puppet, Kickstart, RPM· Languages: Bash, Ruby, Python, Java, Clojure· Security: Kerberos, SELinux, LDAP· Big Data: HDFS, Flink, Kafka· Containers: Docker, KVM· Schedulers: YARN, KubernetesYou will be joining a progressive and exciting company committed to excellence. They offer an excellent working environment with ...

Linux, bare metal and virtual machines· Provisioning: Puppet, Kickstart, RPM· Languages: Bash, Ruby, Python, Java, Clojure· Security: Kerberos, SELinux, LDAP· Big Data: HDFS, Flink, Kafka· Containers: Docker, KVM· Schedulers: YARN, KubernetesYou will be joining a progressive and exciting company committed to excellence. They offer an excellent working environment with ...

rather than relying on frameworks such as Spring. You have built event‐driven applications using Kafka and solutions with event‐streaming frameworks at scale (Flink/Kafka Streams/Spark) that go beyond basic ETL pipelines. You know how to orchestrate the deployment of applications on Kubernetes, including defining ...

data pipelines on cloud platforms (GCP preferred). Build scalable data ingestion, transformation, and processing workflows using distributed technologies such as Spark, Flink, Storm, or similar. Develop robust ELT/ETL processing and migration pipelines, including support for legacy Datastage decommissioning and modernisation. Work with a variety of database … data services (GCP preferred; Azure/AWS acceptable). Practical experience with distributed data processing frameworks such as Spark (Core/SQL/Streaming), Flink, or Storm. Strong knowledge of data ingestion, transformation and messaging systems : Kafka, Pulsar, Pub/Sub, etc. Understanding of designing scalable data models ...

maintaining production Python systemsStrong experience with microservices, databases, and production infrastructureExperience with streaming systems, real-time data pipelines, or event-driven architectures (Kafka, Flink, Redis etc.)Quantitative background - maths, physics, engineering or finance - you can read a model and reason about correctnessExperience with testing, monitoring, and debugging complex systems ...

home in system design and in low-level implementation detail. Experience building and deploying services on AWS or GCP. Hands-on exposure to Kafka, Flink, Redis or clustered Postgres, and an appetite for more. Comfortable with agent-based development tools. We use Claude Code; any equivalent is fine. ...

evolving platform stack — from data ingestion and event processing to REST services and internal tooling. Build and maintain streaming and batch processing systems (Flink, Spark, Kafka) that power real‐time and analytical workloads. Take responsibility for all aspects of software engineering: design, implementation, QA, and maintenance, with … difficult problems. Willingness and ability to take on new technologies as our stack evolves. Nice to Have Experience with stream processing frameworks such as Flink or Spark Streaming. Experience with task orchestration tools such as Apache Airflow or similar systems. Experience working with and designing infrastructures for large‐scale ...