help craft innovative solutions. To be successful as a Data Engineer, you should have experience with: CICD Pipelines - GitLab Cloud Technologies such as AWS, Iceberg, Snowflake, Databricks Containerization/Orchestration: Docker/Kubernetes Framework Components- Spark/Scala/Kafka Unix: Scripting and Config Other highly valued skills include … Automation - Python/Bash Scripting DataBase - Teradata, Oracle Workflow Management: Apache Airflow You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen strategic thinking and digital and technology, as well as job-specific technical skills. More ❯
Join to apply for the Data Platform Engineering Lead role at LSEG 3 days ago Be among the first 25 applicants Join to apply for the Data Platform Engineering Lead role at LSEG LSEG (London Stock Exchange Group) is one More ❯
Cardiff, Wales, United Kingdom Hybrid / WFH Options
Confused.com
Join to apply for the Staff Software Engineer - Data role at Confused.com 1 week ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Description Confused.com is the UK’s first comparison More ❯
Milton Keynes, England, United Kingdom Hybrid / WFH Options
Santander USA
AWS Data Engineer | S3 | Data Centre of Excellence Country: United Kingdom Interested in part-time, job-share or flexible working ? We want to talk to you! Join our community. We have an exciting opportunity to join our Data Centre of More ❯
Cardiff, Wales, United Kingdom Hybrid / WFH Options
RVU Co UK
Staff Software Engineer - Data Department: Engineering Employment Type: Full Time Location: Cardiff Description Confused.com is the UK’s first comparison platform for car insurance. We’ve been helping customers since 2002 by empowering them to make better decisions around insurance More ❯
Cardiff, South Glamorgan, United Kingdom Hybrid / WFH Options
RVU Co UK
Staff Software Engineer - Data Department: Engineering Employment Type: Full Time Location: Cardiff Description is the UK's first comparison platform for car insurance. We've been helping customers since 2002 by empowering them to make better decisions around insurance and More ❯
PySpark, Azure data technologies, Python or Scala, SQL. Experience with testing frameworks like pytest or ScalaTest. Knowledge of open table formats such as Delta, Iceberg, or Apache Hudi. Experience with CI/CD workflows using Azure DevOps, GitHub Actions, and version control systems like GIT. Understanding of cloud … have skills: Experience in retail or e-commerce. Knowledge of Big Data and Distributed Computing. Familiarity with streaming technologies like Spark Structured Streaming or Apache Flink. Additional programming skills in PowerShell or Bash. Understanding of Databricks Ecosystem components. Experience with Data Observability or Data Quality frameworks. Additional Information What More ❯
is to redefine the future of banking and craft innovative solutions. Requirements: Experience with CI/CD Pipelines - GitLab Cloud Technologies such as AWS, Iceberg, Snowflake, Databricks Containerization/Orchestration: Docker/Kubernetes Framework Components: Spark/Scala/Kafka Unix: Scripting and Configuration Highly Valued Skills: Automation with … Python/Bash Scripting Database experience: Teradata, Oracle Workflow Management: Apache Airflow This role is located in Glasgow. Purpose of the role: To build and maintain systems that collect, store, process, and analyze data, ensuring accuracy, accessibility, and security. Accountabilities: Build and maintain data architecture pipelines for data transfer More ❯
About Us : Role Description : As a Senior Lead within Engineering, you'll design and implement functionalities focusing on Data Engineering tasks. You'll work with semi-structured data to ingest and distribute it on a Microsoft Fabric-based platform, modernizing More ❯
Cardiff, Wales, United Kingdom Hybrid / WFH Options
Identify Solutions
Want to drive a top brand's Data team with 1m+ users? If you love building software in Python, implementing robust data pipelines & driving best practices, you may be interested in a Senior Engineer role I have with a highly More ❯
newport, wales, united kingdom Hybrid / WFH Options
Identify Solutions
Want to drive a top brand's Data team with 1m+ users? If you love building software in Python, implementing robust data pipelines & driving best practices, you may be interested in a Senior Engineer role I have with a highly More ❯
scale data migration efforts. (Mandatory) Demonstrated experience with database architecture, performance design methodologies, and system-tuning recommendations. Preference for familiarity with Glue, Hive, and Iceberg or similar Demonstrated experience with Python, Bash, and Terraform Demonstrated experience with DevSecOps solutions and tools Demonstrated experience implementing CI/CD pipelines using … and Data Governance concepts and experience. Demonstrated experience maintaining, supporting, and improving the ETL process through the implementation and standardization of data flows with Apache Nifi and other ETL tools. Demonstrated experience with Apache Spark More ❯
data migration efforts. 5. (Mandatory) Demonstrated experience with database architecture, performance design methodologies, and system-tuning recommendations. Preference for familiarity with Glue, Hive, and Iceberg or similar 6. (Mandatory) Demonstrated experience with Python, Bash, and Terraform 7. (Mandatory) Demonstrated experience with DevSecOps solutions and tools 8. (Mandatory) Demonstrated experience … Governance concepts and experience. 11. (Desired) Demonstrated experience maintaining, supporting, and improving the ETL process through the implementation and standardization of data flows with Apache Nifi and other ETL tools. 12. (Desired) Demonstrated experience with Apache Spark More ❯
data migration efforts. 5. (Mandatory) Demonstrated experience with database architecture, performance design methodologies, and system-tuning recommendations. Preference for familiarity with Glue, Hive, and Iceberg or similar 6. (Mandatory) Demonstrated experience with Python, Bash, and Terraform 7. (Mandatory) Demonstrated experience with DevSecOps solutions and tools 8. (Mandatory) Demonstrated experience … Governance concepts and experience. 11. (Desired) Demonstrated experience maintaining, supporting, and improving the ETL process through the implementation and standardization of data flows with Apache Nifi and other ETL tools. 12. (Desired) Demonstrated experience with Apache Spark MUST be a US Citizen with a U.S. Government clearance - Intel More ❯
data migration efforts. 5. (Mandatory) Demonstrated experience with database architecture, performance design methodologies, and system-tuning recommendations. Preference for familiarity with Glue, Hive, and Iceberg or similar 6. (Mandatory) Demonstrated experience with Python, Bash, and Terraform 7. (Mandatory) Demonstrated experience with DevSecOps solutions and tools 8. (Mandatory) Demonstrated experience … Governance concepts and experience. 11. (Desired) Demonstrated experience maintaining, supporting, and improving the ETL process through the implementation and standardization of data flows with Apache Nifi and other ETL tools. 12. (Desired) Demonstrated experience with Apache Spark B4CORP Company Information B4Corp is a small defense contracting company that More ❯
foundations for others Technical Capabilities 6+ years experience in data engineering or distributed systems Deep proficiency in Python and SQL Fluent in tools like Apache Spark , Beam , Flink , or Kafka Experience with cloud data warehouses (BigQuery, Snowflake) and orchestration tools (Airflow, Prefect, Dagster) Understanding of data lakehouse patterns (IcebergMore ❯
processing. You'll be working closely with Engineering, Product, Security, and Compliance leadership to design a cloud-native data architecture using tools like Kafka, Iceberg, ClickHouse, Tinybird, and Snowflake. If building at scale, tackling complex streaming + batch challenges, and driving long-term architecture sounds exciting to you-this … Own architecture and technical vision from end to end Work on real-time and petabyte-scale data problems Use a modern data stack (Kafka, Iceberg, ClickHouse, Snowflake, etc.) Help shape the platform that will power AI/ML and analytics across the company What You'll Be Doing: Architect … years operating at a Principal-level or equivalent Deep experience with Kafka and real-time data pipelines Solid hands-on work with ClickHouse, Iceberg, Snowflake, or similar tools Strong understanding of cloud-native architectures (AWS, GCP, or Azure) Experience building systems with compliance, governance, and scale in mind Proven More ❯
processing. You'll be working closely with Engineering, Product, Security, and Compliance leadership to design a cloud-native data architecture using tools like Kafka, Iceberg, ClickHouse, Tinybird, and Snowflake. If building at scale, tackling complex streaming + batch challenges, and driving long-term architecture sounds exciting to you-this … Own architecture and technical vision from end to end Work on real-time and petabyte-scale data problems Use a modern data stack (Kafka, Iceberg, ClickHouse, Snowflake, etc.) Help shape the platform that will power AI/ML and analytics across the company What You'll Be Doing: Architect … years operating at a Principal-level or equivalent Deep experience with Kafka and real-time data pipelines Solid hands-on work with ClickHouse, Iceberg, Snowflake, or similar tools Strong understanding of cloud-native architectures (AWS, GCP, or Azure) Experience building systems with compliance, governance, and scale in mind Proven More ❯
processing. You'll be working closely with Engineering, Product, Security, and Compliance leadership to design a cloud-native data architecture using tools like Kafka, Iceberg, ClickHouse, Tinybird, and Snowflake. If building at scale, tackling complex streaming + batch challenges, and driving long-term architecture sounds exciting to you-this … Own architecture and technical vision from end to end Work on real-time and petabyte-scale data problems Use a modern data stack (Kafka, Iceberg, ClickHouse, Snowflake, etc.) Help shape the platform that will power AI/ML and analytics across the company What You'll Be Doing: Architect … years operating at a Principal-level or equivalent Deep experience with Kafka and real-time data pipelines Solid hands-on work with ClickHouse, Iceberg, Snowflake, or similar tools Strong understanding of cloud-native architectures (AWS, GCP, or Azure) Experience building systems with compliance, governance, and scale in mind Proven More ❯
processing. You'll be working closely with Engineering, Product, Security, and Compliance leadership to design a cloud-native data architecture using tools like Kafka, Iceberg, ClickHouse, Tinybird, and Snowflake. If building at scale, tackling complex streaming + batch challenges, and driving long-term architecture sounds exciting to you-this … Own architecture and technical vision from end to end Work on real-time and petabyte-scale data problems Use a modern data stack (Kafka, Iceberg, ClickHouse, Snowflake, etc.) Help shape the platform that will power AI/ML and analytics across the company What You'll Be Doing: Architect … years operating at a Principal-level or equivalent Deep experience with Kafka and real-time data pipelines Solid hands-on work with ClickHouse, Iceberg, Snowflake, or similar tools Strong understanding of cloud-native architectures (AWS, GCP, or Azure) Experience building systems with compliance, governance, and scale in mind Proven More ❯
processing. You'll be working closely with Engineering, Product, Security, and Compliance leadership to design a cloud-native data architecture using tools like Kafka, Iceberg, ClickHouse, Tinybird, and Snowflake. If building at scale, tackling complex streaming + batch challenges, and driving long-term architecture sounds exciting to you-this … Own architecture and technical vision from end to end Work on real-time and petabyte-scale data problems Use a modern data stack (Kafka, Iceberg, ClickHouse, Snowflake, etc.) Help shape the platform that will power AI/ML and analytics across the company What You'll Be Doing: Architect … years operating at a Principal-level or equivalent Deep experience with Kafka and real-time data pipelines Solid hands-on work with ClickHouse, Iceberg, Snowflake, or similar tools Strong understanding of cloud-native architectures (AWS, GCP, or Azure) Experience building systems with compliance, governance, and scale in mind Proven More ❯
processing. You'll be working closely with Engineering, Product, Security, and Compliance leadership to design a cloud-native data architecture using tools like Kafka, Iceberg, ClickHouse, Tinybird, and Snowflake. If building at scale, tackling complex streaming + batch challenges, and driving long-term architecture sounds exciting to you-this … Own architecture and technical vision from end to end Work on real-time and petabyte-scale data problems Use a modern data stack (Kafka, Iceberg, ClickHouse, Snowflake, etc.) Help shape the platform that will power AI/ML and analytics across the company What You'll Be Doing: Architect … years operating at a Principal-level or equivalent Deep experience with Kafka and real-time data pipelines Solid hands-on work with ClickHouse, Iceberg, Snowflake, or similar tools Strong understanding of cloud-native architectures (AWS, GCP, or Azure) Experience building systems with compliance, governance, and scale in mind Proven More ❯
processing. You'll be working closely with Engineering, Product, Security, and Compliance leadership to design a cloud-native data architecture using tools like Kafka, Iceberg, ClickHouse, Tinybird, and Snowflake. If building at scale, tackling complex streaming + batch challenges, and driving long-term architecture sounds exciting to you-this … Own architecture and technical vision from end to end Work on real-time and petabyte-scale data problems Use a modern data stack (Kafka, Iceberg, ClickHouse, Snowflake, etc.) Help shape the platform that will power AI/ML and analytics across the company What You'll Be Doing: Architect … years operating at a Principal-level or equivalent Deep experience with Kafka and real-time data pipelines Solid hands-on work with ClickHouse, Iceberg, Snowflake, or similar tools Strong understanding of cloud-native architectures (AWS, GCP, or Azure) Experience building systems with compliance, governance, and scale in mind Proven More ❯
processing. You'll be working closely with Engineering, Product, Security, and Compliance leadership to design a cloud-native data architecture using tools like Kafka, Iceberg, ClickHouse, Tinybird, and Snowflake. If building at scale, tackling complex streaming + batch challenges, and driving long-term architecture sounds exciting to you-this … Own architecture and technical vision from end to end Work on real-time and petabyte-scale data problems Use a modern data stack (Kafka, Iceberg, ClickHouse, Snowflake, etc.) Help shape the platform that will power AI/ML and analytics across the company What You'll Be Doing: Architect … years operating at a Principal-level or equivalent Deep experience with Kafka and real-time data pipelines Solid hands-on work with ClickHouse, Iceberg, Snowflake, or similar tools Strong understanding of cloud-native architectures (AWS, GCP, or Azure) Experience building systems with compliance, governance, and scale in mind Proven More ❯
processing. You'll be working closely with Engineering, Product, Security, and Compliance leadership to design a cloud-native data architecture using tools like Kafka, Iceberg, ClickHouse, Tinybird, and Snowflake. If building at scale, tackling complex streaming + batch challenges, and driving long-term architecture sounds exciting to you-this … Own architecture and technical vision from end to end Work on real-time and petabyte-scale data problems Use a modern data stack (Kafka, Iceberg, ClickHouse, Snowflake, etc.) Help shape the platform that will power AI/ML and analytics across the company What You'll Be Doing: Architect … years operating at a Principal-level or equivalent Deep experience with Kafka and real-time data pipelines Solid hands-on work with ClickHouse, Iceberg, Snowflake, or similar tools Strong understanding of cloud-native architectures (AWS, GCP, or Azure) Experience building systems with compliance, governance, and scale in mind Proven More ❯