26 to 37 of 37 Apache Iceberg Jobs in England

replication tool, and Waggle Dance, a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg, a high-performance open table format for large analytic datasets that underpins many modern Lakehouse architectures. We guarantee you'll learn ...

Lead Data EngineerManchester | Hybrid | Circa £85K An established organisation is looking for a hands-on Lead Data Engineer to take ownership of its existing data estate and lead the development of a modern, scalable data ...

Data Engineering Lead AWS & AI - Manchester An established financial services organisation is looking for a hands-on Data Engineering Lead to take ownership of its existing data estate and deliver a modern platform supporting Business ...

throughput, low-latency software systemsExperience with pipeline orchestration frameworks (e.g. Airflow, Dagster)Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databasesHave a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experienceFor more information about ...

face detection, quality assessment, tracking)Improve training performance across single and multi-node setups using PyTorch and RayBuild evaluation and experimentation systems (Parquet/Iceberg) for model output analysisOwn model versioning, lifecycle management, and promotion to productionOptimise inference pipelines using Triton; build model ensembles and define request protocolsRequirementsProven ...

familiar withFX or financial markets experienceTerm structure modelling, stochastic calculus or Monte Carlo methodsInterest rate curve bootstrappingAlgorithmic execution experienceData lake or warehouse experience (Snowflake, Iceberg, Spark etc.)A product mindset - you think about who uses your systems and why.Clear communicator who can work cross-functionally with other quants, analysts ...

familiar withFX or financial markets experienceTerm structure modelling, stochastic calculus or Monte Carlo methodsInterest rate curve bootstrappingAlgorithmic execution experienceData lake or warehouse experience (Snowflake, Iceberg, Spark etc.)A product mindset - you think about who uses your systems and why. Clear communicator who can work cross-functionally with other quants ...

data at scale on AWS using technologies such as Lambda, containerised services, and, where appropriate, Glue, EMR Serverless, and lakehouse table formats such as Apache IcebergEmbedding observability, automated testing, monitoring, and quality controls so that issues are identified before they affect customersTaking ownership of production outcomes and helping … value strong teams and shared ownership over individual heroics and thrive in an Agile environmentNICE TO HAVESBeneficial, but not what we're screening on: Apache Spark/PySpark and experience optimising large-scale distributed processingBig data experience — designing and operating systems for datasets and workloads well beyond single-machine ...

pipelines and streaming architectures. Establish best practices for monitoring, reliability, and scale across our data ecosystem (using Python, dbt, Airflow, Kafka, and Trino/Iceberg). Build the Unified Customer View: Productionize PoCs into scalable Airflow/dbt data workflows to lay the groundwork for our Customer Data Platform … Advanced proficiency in Python and proven experience architecting, deploying, and maintaining Big Data and streaming/batch pipelines (e.g., Kafka Streams, Event Streaming, Trino, Iceberg). dbt & Airflow Proficiency: Hands-on experience using dbt for scalable data transformations and Airflow for workflow orchestration. Data Architecture Mastery: A strong background ...

bandwidth. The goal: no software rewrites, predictable time to production, early integration, and fast iteration. You'll work with tools such as DBT, Python, Apache Airflow, Spark, Iceberg; AWS services like Lambda, Bedrock, and SageMaker, containers, and whatever adds the most value. You'll design tools that ...

Playwright, Cucumber, Junit or TestNGProficiency in programming with Python and working knowledge of JavaScript/TypeScript. Experience with database testing (Postgres, SQL Server, Athena Iceberg) and data-centric applications. Strong understanding of API, UI, integration and end-to-end testing. Experience with GitLab CI/CD and integrating automated …/ML for resolving automation problems is highly advantageousFamiliarity with performance testing, security testing, and other non-functional testing approaches using JMeter, Apache BenchmarkCertification in QA or Test Automation (e.g., ISTQB Foundation, Advanced/or Specialist certification)Soft Skills: Excellent problem-solving abilities and attention to detail. Strong communication ...

DevOps knowledge, including Linux/Unix, OpenShift/Kubernetes, and Ansible. Experience building and supporting reactive, event-sourced systems. Hands-on experience with Apache Spark and Apache Flink. Strong understanding of Apache Envoy, and REST API design. Experience working with Protobuf, Avro, and Parquet data formats. Knowledge … Iceberg, Databricks, and Hadoop ecosystems. Skills that will help: Follows TDD, ATDD and Clean Coding practices and used to setting up or working in an environment using CI/CD using tools such as Jenkins with build tools like GradleExperience of Scrum/Agile methodsExperienced in using design patterns ...