Sheffield, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
big data technologies (e.g., Spark, Databricks, Delta Lake, BigQuery) Familiarity with eventing technologies (e.g., Event Hubs, Kafka) and file formats such as Parquet, Delta, Iceberg Interested in learning more? Get in touch for an informal chat. #J-18808-Ljbffr More ❯
Your day-to-day -Wrangle and draw meaningful insights from massive amounts of unstructured textual data using the latest tools and technologies like Spark, Iceberg, Athena, AWS SageMaker -Apply unsupervised learning algorithms across billions of email interactions to identify emerging threat patterns -Work with state-of-the-art machine More ❯
the future of the AI Data Cloud. Join the Snowflake team. Snowflake is seeking an accomplished Principal Sales Specialist, Data Engineering Platform (Openflow and Iceberg/Polaris) to drive sales execution for our ingestion workloads for the EMEA markets. Reporting to the Managing Direction, Data Engineering Platform Sales, this More ❯
help craft innovative solutions. To be successful as a Data Engineer, you should have experience with: CICD Pipelines - GitLab Cloud Technologies such as AWS, Iceberg, Snowflake, Databricks Containerization/Orchestration: Docker/Kubernetes Framework Components- Spark/Scala/Kafka Unix: Scripting and Config Other Highly Valued Skills Include … Automation - Python/Bash Scripting DataBase - Teradata, Oracle Workflow Management: Apache Airflow You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen strategic thinking and digital and technology, as well as job-specific technical skills. More ❯
with Spark or DBT on Starburst Use SQL to transform data into meaningful insights Build and deploy infrastructure with Terraform Implement DDL, DML with Iceberg Do code reviews for your peers Orchestrate your pipelines with DAGs on Airflow Participate in SCRUM ceremonies (standups, backlogs, demos, retros, planning) Secure data … diagram of proposed tables to enable discussion Good communicator and comfortable with presenting ideas and outputs to technical and non-technical users Worked on Apache Airflow before to create DAGS. Ability to work within Agile, considering minimum viable products, story pointing and sprints More information: Enjoy fantastic perks like More ❯
experience include: Proven desire to expand your cloud/platform engineering capabilities Experience working with Big Data Experience of data storage technologies: Delta Lake, Iceberg, Hudi Proven knowledge and understanding of Apache Spark, Databricks or Hadoop Ability to take business requirements and translate these into tech specifications Competence More ❯
experience include: Proven desire to expand your cloud/platform engineering capabilities Experience working with Big Data Experience of data storage technologies: Delta Lake, Iceberg, Hudi Proven knowledge and understanding of Apache Spark, Databricks or Hadoop Ability to take business requirements and translate these into tech specifications Competence More ❯
using Python and pandas within a financial environment. Strong knowledge of relational databases and SQL. Familiarity with various technologies such as S3, Kafka, Airflow, Iceberg Proficiency working with large financial datasets from various vendors. A commitment to engineering excellence and pragmatic technology solutions. A desire to work in an … understanding of financial markets. Experienceworking with hierarchical referencedata models. Provenexpertise in handling high-throughput, real-time marketdata streams Familiarity with distributed computing frameworks suchas Apache Spark Operational experience supporting real time systems. Equal Opportunity Workplace We are proud to be an equal opportunity workplace. We do not discriminate based More ❯
Job Description We know that people want great value combined with an excellent experience from a bank they can trust, so we launched our digital bank, Chase UK, to revolutionise mobile banking with seamless journeys that our customers love. We More ❯
Join to apply for the Senior Lead Software Engineer role at LSEG (London Stock Exchange Group) Role Description As a Senior Lead within Software Engineering, you’ll design and implement functionalities, focusing on Data Engineering tasks. You’ll be working More ❯
modeling. Knowledge of CI/CD tools like GitHub Actions or similar. AWS certifications such as AWS Certified Data Engineer. Knowledge of Snowflake, SQL, Apache Airflow, and DBT. Familiarity with Atlan for data cataloging and metadata management. Understanding of iceberg tables. Who we are: We're a global More ❯
help craft innovative solutions. To be successful as a Data Engineer, you should have experience with: CICD Pipelines - GitLab Cloud Technologies such as AWS, Iceberg, Snowflake, Databricks Containerization/Orchestration: Docker/Kubernetes Framework Components- Spark/Scala/Kafka Unix: Scripting and Config Other highly valued skills include … Automation - Python/Bash Scripting DataBase - Teradata, Oracle Workflow Management: Apache Airflow You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen strategic thinking and digital and technology, as well as job-specific technical skills. More ❯
Milton Keynes, England, United Kingdom Hybrid / WFH Options
Santander USA
AWS Data Engineer | S3 | Data Centre of Excellence Country: United Kingdom Interested in part-time, job-share or flexible working ? We want to talk to you! Join our community. We have an exciting opportunity to join our Data Centre of More ❯
Cardiff, Wales, United Kingdom Hybrid / WFH Options
Confused.com
Join to apply for the Staff Software Engineer - Data role at Confused.com 1 week ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Description Confused.com is the UK’s first comparison More ❯
Cardiff, Wales, United Kingdom Hybrid / WFH Options
RVU Co UK
Staff Software Engineer - Data Department: Engineering Employment Type: Full Time Location: Cardiff Description Confused.com is the UK’s first comparison platform for car insurance. We’ve been helping customers since 2002 by empowering them to make better decisions around insurance More ❯
Join to apply for the Data Platform Engineering Lead role at LSEG 3 days ago Be among the first 25 applicants Join to apply for the Data Platform Engineering Lead role at LSEG LSEG (London Stock Exchange Group) is one More ❯
Cardiff, South Glamorgan, United Kingdom Hybrid / WFH Options
RVU Co UK
Staff Software Engineer - Data Department: Engineering Employment Type: Full Time Location: Cardiff Description is the UK's first comparison platform for car insurance. We've been helping customers since 2002 by empowering them to make better decisions around insurance and More ❯
PySpark, Azure data technologies, Python or Scala, SQL. Experience with testing frameworks like pytest or ScalaTest. Knowledge of open table formats such as Delta, Iceberg, or Apache Hudi. Experience with CI/CD workflows using Azure DevOps, GitHub Actions, and version control systems like GIT. Understanding of cloud … have skills: Experience in retail or e-commerce. Knowledge of Big Data and Distributed Computing. Familiarity with streaming technologies like Spark Structured Streaming or Apache Flink. Additional programming skills in PowerShell or Bash. Understanding of Databricks Ecosystem components. Experience with Data Observability or Data Quality frameworks. Additional Information What More ❯
About Us : LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a commitment to excellence in delivering the services our customers expect from us. With More ❯
About Us : Role Description : As a Senior Lead within Engineering, you'll design and implement functionalities focusing on Data Engineering tasks. You'll work with semi-structured data to ingest and distribute it on a Microsoft Fabric-based platform, modernizing More ❯
Cardiff, Wales, United Kingdom Hybrid / WFH Options
Identify Solutions
Want to drive a top brand's Data team with 1m+ users? If you love building software in Python, implementing robust data pipelines & driving best practices, you may be interested in a Senior Engineer role I have with a highly More ❯
newport, wales, united kingdom Hybrid / WFH Options
Identify Solutions
Want to drive a top brand's Data team with 1m+ users? If you love building software in Python, implementing robust data pipelines & driving best practices, you may be interested in a Senior Engineer role I have with a highly More ❯
Derby, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
Social network you want to login/join with: Want to drive a top brand's Data team with 1m+ users? If you love building software in Python, implementing robust data pipelines & driving best practices, you may be interested in More ❯
Social network you want to login/join with: Want to drive a top brand's Data team with 1m+ users? If you love building software in Python, implementing robust data pipelines, and driving best practices, you may be interested More ❯
Bath, England, United Kingdom Hybrid / WFH Options
JR United Kingdom
Want to drive a top brand's Data team with 1m+ users? If you love building software in Python, implementing robust data pipelines & driving best practices, you may be interested in a Senior Engineer role I have with a highly More ❯