26 to 41 of 41 Apache Iceberg Jobs in the UK

Hadoop ecosystem and deep understanding of components like Spark, Flink, Elasticsearch, Doris, ClickHouse, and Trino., Strong knowledge of big data architecture, including Data Lake (Iceberg, Hudi) and Serverless data concepts. Familiarity with mainstream global cloud products such as AWS EMR/Redshift, Google BigQuery, Snowflake, and Databricks., Ability ...

data quality, governance and platform delivery.Understanding of data product concepts, metadata, lineage, access control or platform operating models would be advantageous.Familiarity with Snowflake, Databricks, Apache Iceberg or similar modern data platform technologies is beneficial.Formal training in Product Management, Product Ownership or Agile delivery is helpful but not essential.Risk ...

decisions that matter: architecture, system design, and the tradeoffs that determine whether a platform scales gracefullyNice-to-haveLakehouse and streaming technologies — experience with Databricks, Apache Iceberg, Kafka, or similar is a strong advantageWhat we offerDiverse and internationally distributed team: joining our team means becoming part of a large ...

DevOps practices.Experience with monitoring and logging tools like CloudWatch, Dynatrace, Datadog, Prometheus, Grafana, or ELK stack.Proficiency in data warehousing solutions like Snowflake and Iceberg and relational databases such as RDS or Oracle.Experience in Infrastructure as code (IAC) such as Terraform or equivalentLeverages enterprise-authorized AI coding assist tools within ...

Applications DevelopmentDemonstrated knowledge of client core business functionsDemonstrated leadership, project management, and development skillsRelationship and consensus building skillsPreferredKafka/Event-Driven ArchitectureApache Iceberg/Delta LakePythonAI/ML & LLM integrationFinancial Services/Capital MarketsEducation:Bachelor’s degree/University degree or equivalent experienceMaster’s degree preferredWhat we’ll provide ...

Databases: PostgreSQL, Graph Databases ( Neo4j , Kuzu ), and data mesh/metadata management platforms. Modern Tech Stack: Next.js 14, FastAPI (Python), Casbin RBAC, Pipeline Orchestration, Apache Iceberg, MCP AI Server Integration, and ODCS v2 Data Contracts layer. DevOps & Integration: Azure DevOps, CI/CD, Data Transformation/Quality frameworks ...

logging tools like CloudWatch, Dynatrace, Datadog, Prometheus, Grafana, or ELK stack.Strong understanding of cloud security best practices.Proficiency in data warehousing solutions like Snowflake and Iceberg and relational databases such as RDS or Oracle.Experience in Infrastructure as code (IAC) such as Terraform or equivalentExperience working with related technical frameworks – Flyway ...

compliance colleaguesWhat will set you apartExperience in financial services, payments or another regulated industryHands-on familiarity with the modern data stack, for example Iceberg or Delta, Snowflake or Databricks, and dbtFamiliarity with AI governance frameworks such as the EU AI Act, DORA or MAS FEATAdditional InformationFind out moreHow ...

familiar withFX or financial markets experienceTerm structure modelling, stochastic calculus or Monte Carlo methodsInterest rate curve bootstrappingAlgorithmic execution experienceData lake or warehouse experience (Snowflake, Iceberg, Spark etc.)We’re people without borders — without judgement or prejudice, too. We want to work with the best people, no matter their background. ...

languages (e.g., SQL, Python, Spark, cloud platforms).Preferred Qualifications, Capabilities, and Skills:Hands-on experience with Databricks and proficiency in managing large datasets using Apache Iceberg.Experience architecting and implementing enterprise-scale data warehouses on cloud platforms (e.g., AWS, Azure, GCP).Advanced proficiency in designing and optimizing data models … intelligence.Ability to automate data pipeline deployment and monitoring using CI/CD tools and infrastructure-as-code practices.Expertise with distributed data processing frameworks (e.g., Apache Spark, Hadoop) and real-time data streaming technologies (e.g., Kafka, Kinesis, Spark).Experience collaborating with cross-functional teams to deliver impactful data solutions.Ability ...

commonly used for data manipulation, building data pipelines, and developing algorithms for data processing. A strong understanding of data formats such as Delta and Iceberg is vital, in addition to both SQL and NoSQL databases. Data engineers should be skilled in designing, querying, and optimising data to ensure efficient … engineers should be adept at Extract, Transform, Load (ETL) processes. This includes using frameworks such as the Medallion Architecture, as well as tools like Apache Airflow, Fivetran, Azure Data Factory, and Amazon Glue to automate data workflows and ensure data quality. Familiarity with cloud computing services, such ...

pipelines and streaming architectures. Establish best practices for monitoring, reliability, and scale across our data ecosystem (using Python, dbt, Airflow, Kafka, and Trino/Iceberg).Build the Unified Customer View: Productionize PoCs into scalable Airflow/dbt data workflows to lay the groundwork for our Customer Data Platform … Advanced proficiency in Python and proven experience architecting, deploying, and maintaining Big Data and streaming/batch pipelines (e.g., Kafka Streams, Event Streaming, Trino, Iceberg).dbt & Airflow Proficiency: Hands-on experience using dbt for scalable data transformations and Airflow for workflow orchestration.Data Architecture Mastery: A strong background in designing ...

Data Engineer IIAre you passionate about building scalable, high-performance data-driven applications Do you enjoy turning complex datasets into robust, reliable systems that deliver real business impact About the team:The Search and AI ...

ability to help refine problem statements and propose solutions taking effort-impact-scalability tradeoff into account.Some skills that will make you stand out: Apache Spark, Iceberg, Kafka, dbtScikit-Learn, XGBoost, PyTorch, MLFlow,, GraphFrames, RayAWS (S3, EMR, SageMaker, Lakeformation), Terraform, Docker, GitHub CI/CDKnowledge Graphs (+ RAG), graph ...

software development lifecycleSolid background in Java/Scala and a scripting language like Python.Experience building large scale data pipelinesStrong familiarity with the Apache Hadoop ecosystem including : Spark, Kafka, Flink, Iceberg/Delta Lake/Hive, Apache Presto/Trino, etc.Experience with relational SQL and NoSQL databases, including ...

microservices, Spark/Scala data processing (also some Flink), Kubernetes and AWS native tooling.What You'll Do: Write highly fault-tolerant Java code within Apache Spark to produce platform products used by our customers to query our event pipelines/ingestion for insight into active threat trends and related … combined between backend/cloud development and data platform engineering roles5+ years of experience building data platform product(s) or features with (one of) Apache Spark, Flink or Iceberg, or with comparable tools in GCP5+ years of experience programming with Java, Scala or Kotlin.Proven experience utilizing AI technologies ...