51 to 75 of 86 Apache Iceberg Jobs in England

Lead Data EngineerManchester | Hybrid | Circa £85K An established organisation is looking for a hands-on Lead Data Engineer to take ownership of its existing data estate and lead the development of a modern, scalable data ...

services, a good understanding of cloud architecture, and proficiency with Terraform for provisioning and managing cloud infrastructure Experience building streaming data pipelines using Apache Flink, Apache Kafka, Spark Structured Streaming, or similar technologies Knowledge of modern data lakehouse architectures and ecosystem such as Kafka, Flink, Spark, Databricks, Snowflake … Airflow, Debezium, Delta/Iceberg, and comfort with Python/Java and SQL Experience with networking and security concepts within AWS, including VPCs, subnets, routing, security groups, IAM, etc. Nice to have Experience: Exposure to or interest in the cryptocurrency technology ecosystem Experience working with different blockchain technologies ...

Skill Requirements:*** Strong experience in **Solution Architecture** and **Cloud-Native Architecture Design*** Hands-on expertise in **Snowflake Architecture*** Experience with **Data Lakehouse architectures**, including **Apache Iceberg*** Proficiency in designing and managing **S3-based Data Lakes*** Experience with **Apache Airflow/MWAA** for workflow orchestration* Strong knowledge … scale data processing* Ability to create **Architecture Design Documents (ADDs)*** Deep understanding of **cloud-native design patterns*** Experience in **performance tuning** across:* Snowflake* Airflow* Iceberg* Focus on **platform reliability, scalability, and observability*** Experience designing and operating **data platforms** in production environments #J-18808-Ljbffr ...

latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelor or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experience For more information ...

latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experience For more information ...

throughput, low-latency software systemsExperience with pipeline orchestration frameworks (e.g. Airflow, Dagster)Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databasesHave a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experienceFor more information about ...

cloud environments. You will enable real-time analytics and governance while promoting self-service insights for business users. Key skills include data lakehouse design (Iceberg), AWS/Azure data services, dbt, Airflow, and BI/dashboard experience. The role emphasizes automation, quality, and collaboration with architects. #J-18808-Ljbffr ...

logging tools like CloudWatch, Dynatrace, Datadog, Prometheus, Grafana, or ELK stack.Strong understanding of cloud security best practices.Proficiency in data warehousing solutions like Snowflake and Iceberg and relational databases such as RDS or Oracle.Experience in Infrastructure as code (IAC) such as Terraform or equivalentExperience working with related technical frameworks – Flyway ...

DevOps practices.Experience with monitoring and logging tools like CloudWatch, Dynatrace, Datadog, Prometheus, Grafana, or ELK stack.Proficiency in data warehousing solutions like Snowflake and Iceberg and relational databases such as RDS or Oracle.Experience in Infrastructure as code (IAC) such as Terraform or equivalentLeverages enterprise-authorized AI coding assist tools within ...

framework and services Identifyingand implementing computational improvements Making improvements and/or fixing bugs bysubmittingpatches toopen-sourceprojects in our stack, such as Spark,Iceberg,Hadoop, Airflow, and many others Acting as anexpert on Spark and Scala Mentoring engineers (including through pairing, design discussions, and knowledge-sharing sessions) and helping ...

services on Kubernetes in at least one major cloud (AWS, GCP, or Azure). Experience with data warehousing or analytics technologies such as Snowflake, Iceberg, Trino, or Postgres. Experience designing, deploying, and operating ML models in production, including familiarity with MLOps tooling such as MLflow. Demonstrated ability to work ...

designing and operating high‐availability, production ML services. Hands‐on experience designing and operating data and analytics platforms built on technologies such as Snowflake, Iceberg, Trino, and Postgres. Strong production experience with Kubernetes and at least one major cloud provider (AWS, GCP, or Azure), with working familiarity across multi ...

consumers Actively uses AI-powered tools to move faster and focus on architecture, system design, and scalability tradeoffs Nice to have: experience with Databricks, Apache Iceberg, Kafka, or similar lakehouse and streaming technologies Условия Hybrid work schedule with office attendance twice a week and flexible working hours Virtual ...

driven tooling to automate mapping, testing, and documentation. Join a Data Platform Team delivering high-throughput data warehousing and lakehouse solutions on Snowflake, Iceberg, Kafka, and AWS, driving compliance and scalable analytics for global trials. #J-18808-Ljbffr ...

Data Engineering Lead AWS & AI - Manchester An established financial services organisation is looking for a hands-on Data Engineering Lead to take ownership of its existing data estate and deliver a modern platform supporting Business ...

product and commercial teams. You Need Expert Python and SQL, with experience building production ML systems and data pipelines (PyTorch, XGBoost, Spark/PySpark, Apache Iceberg, Ray, MLflow, SageMaker, Airflow, or equivalent). Deep experimentation and statistical inference skills, and a strong grasp of optimisation under uncertainty (bandits ...

DevOps practices. Experience with monitoring and logging tools likeCloudWatch, Dynatrace, Datadog,Prometheus, Grafana, or ELK stack. Proficiency in data warehousing solutions like Snowflake and Iceberg and relational databases such as RDS or Oracle. Experience in Infrastructure as code (IAC) such as Terraform or equivalent Leverages enterprise-authorized AI coding ...

driven architectures or data pipelines. Also Welcome Kubernetes. Deploying, running or debugging workloads, including K3s, RKE2 or OpenShift. Data at scale. Spark, Trino, Parquet, Iceberg or similar columnar and distributed query tooling. GPU workloads and serving models on-premise. Open source contributions or a portfolio worth a look. Mentoring ...

driven architectures or data pipelines. Also Welcome Kubernetes. Deploying, running or debugging workloads, including K3s, RKE2 or OpenShift. Data at scale. Spark, Trino, Parquet, Iceberg or similar columnar and distributed query tooling. GPU workloads and serving models on-premise. Open source contributions or a portfolio worth a look. Mentoring ...

familiar withFX or financial markets experienceTerm structure modelling, stochastic calculus or Monte Carlo methodsInterest rate curve bootstrappingAlgorithmic execution experienceData lake or warehouse experience (Snowflake, Iceberg, Spark etc.)A product mindset - you think about who uses your systems and why.Clear communicator who can work cross-functionally with other quants, analysts ...

centric data fabric, unifying multi-stream clinical data such as EDC, telemetry, and real-world datasets. You will build a modern Data Lake using Apache Iceberg, Snowflake, and Kafka, develop backend services in Java or Scala on AWS, and apply AI-assisted tooling for schema mapping, testing ...

Kingdom. The role demands strong expertise in Solution Architecture, Cloud-Native Architecture Design, and hands-on experience with Snowflake and Data Lakehouse architectures, including Apache Iceberg. Responsibilities involve creating Architecture Design Documents, managing S3-based Data Lakes, and ensuring platform performance tuning and observability. Ideal candidates should have substantial ...

Rate: £650 - £750 Location: Hybrid – 2/3 days per week on-site Contract: 6 months | Outside IR35 Key Skills: Data Lakehouse PySpark DBT Iceberg AWS Strong data engineering and pipeline development experience You’ll be responsible for designing, building and optimising scalable data pipelines and lakehouse solutions within ...

Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka … Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching strategies, pull requests and merge processes We appreciate you may not be an expert ...

Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka … Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching strategies, pull requests and merge processes We appreciate you may not be an expert ...