1 to 25 of 389 Data Engineering Jobs in the UK

a hybrid role 80% homeworking available and 20% in Stratford Upon Avon About the role We are seeking a skilled Developer to join our Data Engineering team. In this role, you will play a pivotal part inmaintainingand enhancing our technical ser... APCT1_UKTJ more »

against these. The key practices and capabilities this role is responsible for are: MAdTech - involving the connection of Marketing & Advertising technologies (MAdTech), plus associated data tech & data engineering to deliver against Marketing use cases. Orchestration – Focuses on bringing to life and enabling the marketing strategies and experiences … we design. Using technology, data & operations to connect onsite experiences to offsite marketing that deliver improved customer experience through consistent and frictionless experiences. Furthermore, helping clients to define, deliver and operate robust optimisation programmes that scale and grow as our clients require. This role, due to its nature of … provide the knowledge and experience as per the client’s requirements. This may include, but not limited to Media, Customer Engagement, Experience Design, Product, Data and more. Develop our MAdTech & Orchestration capabilities based on solving client problems in a variety of ways, not simply through technological challenges but user more »

Data Engineer – Salary National up to £35,000/London up to £45,000 Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity to join our highly skilled Data Engineer community. Within one of our Data Engineering teams, we are looking for an individual who is passionate about data to work within our multi cloud environment to h elp shape the future of insurance through cutting-edge predictive analytics and Data Science. A bit about the job: Data is the life … blood of any modern organisation and Aviva is no different. Our Data Engineering teams sits within Aviva’s Quantum Data Science Practise (covering areas including Machine Learning, Analytics, Data Engineering, AI, etc) but also services Claims, Pricing, Financial Crimes, Fraud and Underwriting with the data more »

Be the first hire of this brand-new data engineering team and build it from the ground up. First up, you’re going to need to have done something similar before within finance, ideally algorithmic or systematic trading, with ETFs. You’re going to be given total autonomy … to build the team in the way you want. You’ll work closely with the quant teams to understand their requirements, but data strategy will be down to you. Using the right technologies will be down to you. It’s a hands-on engineering role to begin with … with engineering leadership responsibilities in future. The focus is on collecting and processing data that’s critical to the business, so you’re not going to be building data ingestion strategies for every piece of data you can find. There’ll be specific data types more »

maintaining business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … it can improve business performance. The role: Data Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on business requirements … and priorities As part of the BI team you will be responsible for the day to day maintenance and enhancement of the data quality, security and performance of the Data Lake/Warehouse Assisting your Data Analyst colleagues to generate impactful business insights and analysis Support the more »

Data Engineering Lead Do you enjoy leading a team that develops high-quality code? Are you A highly visible champion with a ‘can do’ attitude and enthusiasm that inspires others? About the Business LexisNexis Risk Solutions provides customers with solutions and decision tools that combine public and industry … specific content with advanced technology and analytics to assist them in evaluating and predicting risk and enhancing operational efficiency. We use the power of data and advanced analytics to help our customers make better, timelier decisions. By bringing clarity to information, we ultimately help make communities safer, insurance rates … You can learn more about LexisNexis Risk solutions at the link below, https://risk.lexisnexis.com/. About our Team As a Lead Data Engineer you will be leading and liaising with dynamic, passionate across functional teams, where collaboration as a team is key. About the Role As more »

Xpertise is seeking a series of Data Engineers with cloud experience to join a fledgling team in Newcastle. As part of our client's growing engineering division, you will play a pivotal role in leading the data engineering capabilities, working closely with Platform Engineers, Developers, and … Architect, and even venture into the world of MLOps/AIOps. Key experience desired/what you will learn: Design, develop, and maintain scalable data pipelines and ETL processes leveraging GCP services such as BigQuery, Dataflow, and Cloud Storage. If you have experience across AWS and Azure, we can … train you up on Google Cloud. Architect data models and schemas in BigQuery to support analytics, reporting, and business intelligence initiatives. Python development Implement data governance and security best practices to ensure compliance and data integrity. Monitor and troubleshoot data pipelines, ensuring high availability and reliability. more »

Xpertise is seeking a series of Data Engineers with cloud experience to join a fledgling team in Birmingham. As part of our client's growing engineering division, you will play a pivotal role in leading the data engineering capabilities, working closely with Platform Engineers, Developers, and … Architect, and even venture into the world of MLOps/AIOps. Key experience desired/what you will learn: Design, develop, and maintain scalable data pipelines and ETL processes leveraging GCP services such as BigQuery, Dataflow, and Cloud Storage. Architect data models and schemas in BigQuery to support … analytics, reporting, and business intelligence initiatives. Python development Implement data governance and security best practices to ensure compliance and data integrity. Monitor and troubleshoot data pipelines, ensuring high availability and reliability. CI/CD pipeline automation utilising GitLab DevOps: GKE (Kubernetes), Terraform, Ansible Leadership capabilities: mentorship, management more »

Engineering Delivery Lead (AWS/Snowflake/Python/Scala) - UK based - 6 Month contract + extensions - £450-550/day + negotiable Our client are looking for 2 Engineering Delivery Leads for workstreams on Platform Builds. The suitable individual needs to have an understanding of Data modelling Principles & best practices and also needs prior experience leading a data engineering team. Key Tech: - AWS (S3, Glue, EMR, Athena, Lambda) - Snowflake, Redshift - DBT (Data Build Tool) - Programming: Python, Scala, Spark, PySpark or Ab Initio - Data pipeline orchestration (Apache Airflow) - Knowledge of SQL This more »

The role As a Data Engineer at Storm you will work alongside other software and cloud infrastructure engineers to design, build and maintain data pipelines, data management solutions and analytics components for our client’s projects across the healthcare, justice and local government sectors. About you We … know that many Data Engineer's will come from a variety of backgrounds, and we encourage and value people who bring unique perspectives and knowledge to our team. Your previous experience will include working daily with disparate data sources, ingesting, transforming and processing data streams into actionable … use or for onward processing. You will have a proven track record of delivery and a passion for adherence to best practices in the data engineering discipline. You will be passionate about data in all its forms and see the value in transforming data into insights. more »

profitable since early 2022. FullCircl was formed in 2021 following the merger of Artesian Solutions and DueDil. In September 2023 FullCircl acquired W2 Global Data Solutions. FullCircl is backed by top-tier investors which include Octopus Investments, Notion Capital, Augmentum Fintech and notable angel investors which include Dr Steve … provide competitive compensation and benefits and believe employee ownership is a key part of cultivating the mindset we want from everyone. The Role Lead Data Engineer We realise at FullCircl that it takes a dedicated team of brilliant people to continually innovate, push boundaries and exceed expectations. We pride … do amazing things. Still led by our three original founders, we’re constantly on the lookout for rising stars. We are seeking a lead data engineer to join our team and to work on a variety of assignments alongside our product and commercial management teams. The role will require more »

with options for remote or hybrid working. Our client, a global leader in IT solutions for buses and trains, is seeking a highly skilled Data Engineer with a focus on ETL processes to join their expanding team. This role offers the opportunity to contribute significantly to making public transport … By joining this team, you will be at the forefront of enhancing mobility for millions of system users and passengers globally. The Role: The Data Engineer will be responsible for designing, building, and maintaining sophisticated ETL pipelines and data integrations that support crucial analytics and business intelligence efforts. … a dynamic environment where your work directly impacts the effectiveness and efficiency of public transport systems. Responsibilities Include: Develop and manage ETL processes, integrating data from diverse sources into a unified data warehouse. Utilise Python and other advanced tools to script and automate data processes. Create and more »

This innovative Multi-Strategy Hedge Fund, seek an experienced Software Engineer with expertise in Python to work within a dynamic Data Engineering Group building greenfield pipelines, frameworks, APIs and core Data store (Data warehouse and Data Lake) to enable the ingestion and provision (upstream and … Trading teams firmwide (X-Asset - Equities, Rates, Commodities, FX and Crypto). Key Skills required 3+ years of exp. as a Software Developer/Data Engineer with Python as your core language Extensive API and Microservices development experience 3+ years SQL Strong DB skills ideally in both SQL and more »

a FTSE 250 client who are looking for a BI Analyst to join their team. The ideal candidate will be responsible for analyzing complex data sets, generating insights, and providing actionable recommendations to drive business growth and efficiency. The BI Analyst will collaborate closely with various stakeholders across departments … to understand business needs, develop data models, and create visually compelling reports and dashboards. This role requires a strong analytical mindset, proficiency in data visualization tools, and the ability to communicate effectively with technical and non-technical audiences. Responsibilities Analyze large, complex data sets to identify trends … patterns, and insights that will drive business decisions. Develop and maintain BI solutions, including reports, dashboards, and data models, using tools such as Power BI, Tableau, or similar. Work closely with stakeholders to understand their reporting and analytics requirements and translate them into actionable deliverables. Collaborate with IT and more »

Lead Data Engineer - Azure/Spark/Databricks Role: Lead Data Engineer Location: London (3 days a week) Salary: £85k - £90k A leading technology firm, renowned for connecting people globally, is looking for a skilled Lead Data Engineer to join their expanding team. In this role, you … will lead a team of talented engineers, leveraging your expertise in the Azure data engineering stack. Key Responsibilities: Lead the design, development, and implementation of data solutions using Azure services such as Spark, Data Lake, Synapse, and Databricks. Code in Spark and oversee the technical design … aspects of projects, ensuring adherence to engineering best practices. Lead and mentor a team of data engineers, providing guidance and support to foster their professional growth and development. Collaborate effectively with remote teams, leveraging your experience in leading distributed teams to drive success. Requirements: Extensive experience with Azure more »

We help brands across the globe design and build innovative products, platforms, and digital experiences for the modern world. By integrating experience design, complex engineering, and data expertise – we help our clients imagine what’s possible and accelerate their transition into tomorrow’s digital businesses. At GlobalLogic, we … region (Edinburgh, London, Manchester, Glasgow) About the role: Responsible for architecting and developing software and pipelines to shorten the algorithm development life cycle from data curation to integration and deployment to support AI technologies that will help improve our users’ experience. Develop continuous integration and deployment (CI/CD … pipelines on top of ML model infrastructure for multiple ML development teams. Design and develop data engineering tools to store, manage, query and visualize big datasets. Create data and metric visualization tools, web UI dashboards for model performance and data drift monitoring. AWS Sagemaker, Terraform About more »

AI Relevant Networking and Security knowledge, for both private and public networks, along with expertise in RESTful API development and integration. Solid foundation in Data Engineering, including understanding of databases, data retrieval via query languages like SQL or Kusto, and experience with data management, data more »

Senior Azure Data Engineering Consultant Home-based with occasional customer travel £65,000 - £85,000 + bonus and benefits I'm working with a leading Microsoft Gold Partner who specialise in data. They are true experts when it comes to data strategy, data platforming, analytics, artificial … intelligence and data managed service. This means they are working on the most interesting and cutting-edge data centric projects in the market today. I’m looking for a Senior Data Engineering Consultant to join the team. This is an excellent opportunity for a Data Engineer, with experience in consulting and customer-facing roles to join a data-centric organisation at an exciting time of change. You will be well supported with the opportunity to gain numerous Microsoft certifications and accreditations to enhance your profile whilst working alongside experienced professionals to boost your more »

Data Engineer - Azure Databricks CONTRACT - London (Hybrid) Data warehousing - Trading - Credit/Market Risk Harrington Starr is working with a leading Energy trading firm in London on an initial 6-month contract for a market-leading project. The project is signed off and they are looking to start … interviewing ASAP. Responsibilities: Azure Cloud Data Engineering using Azure Databricks Data Warehousing Data Engineering Very strong with the Microsoft Stack ESSENTIAL knowledge of PySpark clusters Python & C# Scripting experience Experience of message queues (Kafka) Experience of containerization (Docker) FINANCIAL SERVICES EXPERIENCE (Energy/commodities trading more »

Head of Data Engineering Microsoft Hybrid/Inside IR35 I am excited to partner with a client who has set their project plan for the future where they are looking to re-architect their entire data ecosystem through better utilising cloud technologies and implementing best practices moving … advantage of their flexible working (3 days WFH) The Project The client is partnered with Microsoft, they are looking to increase headcount with the data cohort across all teams (Data analysis, Engineering, Science). They need someone who has experience of understanding the data architecture, looking … through better using current tools and possible using new tools on the market. The Person You must have experience working as a head of data engineering, the client wants someone who delivers positive change. If you have worked in very senior data positions within financial services and more »

Xpertise is seeking a series of Data Engineers with cloud experience to join a fledgling team in Milton Keynes. As part of our client's growing engineering division, you will play a pivotal role in leading the data engineering capabilities, working closely with Platform Engineers, Developers … Architect, and even venture into the world of MLOps/AIOps. Key experience desired/what you will learn: Design, develop, and maintain scalable data pipelines and ETL processes leveraging GCP services such as BigQuery, Dataflow, and Cloud Storage. If you have experience across AWS and Azure, we can … train you up on Google Cloud. Architect data models and schemas in BigQuery to support analytics, reporting, and business intelligence initiatives. Python development Implement data governance and security best practices to ensure compliance and data integrity. Monitor and troubleshoot data pipelines, ensuring high availability and reliability. more »

My leading Energy and Commodities conglomerate are currently seeking a skilled individual with experience in Python-based data pipeline, data lake house development and an appreciation for Object orientated languages such as C# or Java, using leading orchestration tools. In this role, you'll lead the development of … robust, fully tested data pipelines in Python using cutting-edge platforms like Dagster/Airflow and apply your expertise in real-time data streaming solutions using Kafka. You'll play a key role in expanding their on prem data lake infrastructure to help enhance support for new … lines of businesses they have including Systematic trading, Trading and Shipping commodities, ensuring strong data lineage. The successful candidate will have: A strong background in data engineering using Python Strong understanding of Test Driven Development Experience building Star Schemer Databases Strong experience with SQL design patterns Experience more »

responsible for it end to end to deliver outstanding outcomes. Our clients are large enterprise Fortune 500/Global 2000 companies and need complex engineering design to meet their expectations. The Role We are looking for an enthusiastic hands-on technologist to join an exciting opportunity for building a … sophisticated data/analytics/reporting platform. As the director of data engineering/analytics/reporting, you will build and evolve the next gen data platform to process and report huge datasets across our client ecosystem. You will own end to end projects to plan … candidate will have strong experience in heterogeneous technologies in DW space (map/reduce, columnar DBs etc.,). You should be an expert with Data warehouse architectures, data modeling, and data processing using distributed compute solutions. The role will involve leading the core global engineering team more »

Operations, and Information Security. We are now building a new Informa with the Growth Acceleration Plan II (GAP II) where customer centricity, Digital and Data is the beating heart. As we embark on an ambitious journey with our Growth Acceleration Plan II (GAP II), focusing on customer centricity and … leveraging the power of Digital and Data, Informa is excited to announce the formation of our new AI initative. This groundbreaking initiative is designed to be the cornerstone of our strategy, roadmap, and delivery of key AI-driven priorities. This will not just be a hub of innovation; it … crucially, developing new capabilities and services for our valued customers. We are looking for a AI Engineer to help to outline, deliver and extend Data & AI use cases across Group Job Description The AI Engineer position will be responsible to shape, create and integrate AI solutions with particular focus more »

requests. Lead discovery and design workshops with clients and internal stakeholders to gather business requirements. Lead creation of overall solution roadmap in terms of data engineering, data visualisation, reporting, and analytics capabilities based on the client needs. Analyse and translate business and functional requirements into solutioning system … has proven ability to engage with clients on briefs and consultative solution development. Who has a proven ability to manage and deliver enterprise level data and analytics projects successfully and at the same time create and maintain positive working relations both with our clients and internally across teams. Who more »