1 to 25 of 445 Permanent Data Engineer Jobs

Unfortunately, my client is not able to sponsor, so candidates must have the right to work in the UK. I'm seeking a Principal Data Engineer to join a public and Private sector-focused consultancy. People are at the heart of everything this organisation does, from utilising a … bottom-up approach internally to ensure all services they deliver are evidence-based and human-centred. A Principal Data Engineer to spearhead our collaborative efforts. As a Principal Data Engineer, you'll be instrumental in crafting and maintaining cutting-edge digital solutions that resonate with users … relationships with your team and stakeholders, you'll foster a supportive environment where challenges are tackled head-on and successes are celebrated. As a data and engineering community champion, you'll help shape the strategic direction and seize new business opportunities through technical bids and proposals. To thrive in more »

Data Engineer – Salary National up to £35,000/London up to £45,000 Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity to join our highly skilled Data Engineer community. Within one of … our Data Engineering teams, we are looking for an individual who is passionate about data to work within our multi cloud environment to h elp shape the future of insurance through cutting-edge predictive analytics and Data Science. A bit about the job: Data is the … life blood of any modern organisation and Aviva is no different. Our Data Engineering teams sits within Aviva’s Quantum Data Science Practise (covering areas including Machine Learning, Analytics, Data Engineering, AI, etc) but also services Claims, Pricing, Financial Crimes, Fraud and Underwriting with the data more »

Data Engineer (Snowflake) - Up to £80K + Benefits – Flexible Working - London Overview: We are working with one of the market leaders and most exciting organisations within the retail sector. We’re seeking an experienced Data Engineer who is analytically focused with expertise and proven experience with … and efficient databases to support internal enterprise applications. Collaborate closely with development and infrastructure teams to ensure seamless integration and optimal database performance. Lead data strategy aligned with organizational objectives, including data governance, architecture, quality management, and integration initiatives. Develop and support data warehouse, customer data platform (CDP), and associated data pipelines using Matillion and Snowflake. Gather requirements from the Business Intelligence team and translate them into technical specifications for implementation by the software development team. Define software requirements for data maintenance and dashboard requirements for displaying insights to relevant users. Essential Skills more »

Data Engineering Lead Do you enjoy leading a team that develops high-quality code? Are you A highly visible champion with a ‘can do’ attitude and enthusiasm that inspires others? About the Business LexisNexis Risk Solutions provides customers with solutions and decision tools that combine public and industry specific … content with advanced technology and analytics to assist them in evaluating and predicting risk and enhancing operational efficiency. We use the power of data and advanced analytics to help our customers make better, timelier decisions. By bringing clarity to information, we ultimately help make communities safer, insurance rates more … You can learn more about LexisNexis Risk solutions at the link below, https://risk.lexisnexis.com/. About our Team As a Lead Data Engineer you will be leading and liaising with dynamic, passionate across functional teams, where collaboration as a team is key. About the Role more »

maintaining business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how it … can improve business performance. The role: Data Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on business requirements … and priorities As part of the BI team you will be responsible for the day to day maintenance and enhancement of the data quality, security and performance of the Data Lake/Warehouse Assisting your Data Analyst colleagues to generate impactful business insights and analysis Support the more »

Xpertise is seeking a series of Data Engineers with cloud experience to join a fledgling team in Newcastle. As part of our client's growing engineering division, you will play a pivotal role in leading the data engineering capabilities, working closely with Platform Engineers, Developers, and Analysts. Key … Architect, and even venture into the world of MLOps/AIOps. Key experience desired/what you will learn: Design, develop, and maintain scalable data pipelines and ETL processes leveraging GCP services such as BigQuery, Dataflow, and Cloud Storage. If you have experience across AWS and Azure, we can … train you up on Google Cloud. Architect data models and schemas in BigQuery to support analytics, reporting, and business intelligence initiatives. Python development Implement data governance and security best practices to ensure compliance and data integrity. Monitor and troubleshoot data pipelines, ensuring high availability and reliability. more »

Xpertise is seeking a series of Data Engineers with cloud experience to join a fledgling team in Birmingham. As part of our client's growing engineering division, you will play a pivotal role in leading the data engineering capabilities, working closely with Platform Engineers, Developers, and Analysts. Key … Architect, and even venture into the world of MLOps/AIOps. Key experience desired/what you will learn: Design, develop, and maintain scalable data pipelines and ETL processes leveraging GCP services such as BigQuery, Dataflow, and Cloud Storage. Architect data models and schemas in BigQuery to support … analytics, reporting, and business intelligence initiatives. Python development Implement data governance and security best practices to ensure compliance and data integrity. Monitor and troubleshoot data pipelines, ensuring high availability and reliability. CI/CD pipeline automation utilising GitLab DevOps: GKE (Kubernetes), Terraform, Ansible Leadership capabilities: mentorship, management more »

Be the first hire of this brand-new data engineering team and build it from the ground up. First up, you’re going to need to have done something similar before within finance, ideally algorithmic or systematic trading, with ETFs. You’re going to be given total autonomy to … build the team in the way you want. You’ll work closely with the quant teams to understand their requirements, but data strategy will be down to you. Using the right technologies will be down to you. It’s a hands-on engineering role to begin with, with engineering … leadership responsibilities in future. The focus is on collecting and processing data that’s critical to the business, so you’re not going to be building data ingestion strategies for every piece of data you can find. There’ll be specific data types, looking at things more »

The role As a Data Engineer at Storm you will work alongside other software and cloud infrastructure engineers to design, build and maintain data pipelines, data management solutions and analytics components for our client’s projects across the healthcare, justice and local government sectors. About you … We know that many Data Engineer's will come from a variety of backgrounds, and we encourage and value people who bring unique perspectives and knowledge to our team. Your previous experience will include working daily with disparate data sources, ingesting, transforming and processing data streams … use or for onward processing. You will have a proven track record of delivery and a passion for adherence to best practices in the data engineering discipline. You will be passionate about data in all its forms and see the value in transforming data into insights. You more »

profitable since early 2022. FullCircl was formed in 2021 following the merger of Artesian Solutions and DueDil. In September 2023 FullCircl acquired W2 Global Data Solutions. FullCircl is backed by top-tier investors which include Octopus Investments, Notion Capital, Augmentum Fintech and notable angel investors which include Dr Steve … provide competitive compensation and benefits and believe employee ownership is a key part of cultivating the mindset we want from everyone. The Role Lead Data Engineer We realise at FullCircl that it takes a dedicated team of brilliant people to continually innovate, push boundaries and exceed expectations. We … do amazing things. Still led by our three original founders, we’re constantly on the lookout for rising stars. We are seeking a lead data engineer to join our team and to work on a variety of assignments alongside our product and commercial management teams. The role will more »

Lead Data Engineer Want to help drive the Data function with one of the most reputable employers in Belfast? This company is known for it’s innovation, delivery, and culture. Their Belfast hub is at the centre of the tech community, promoting learning and diversity at all … levels. They have a new opportunity for a Lead Data Engineer – this function is still relatively young in this region, and they’re looking for a thought leader in the industry to come in to this blank page and help write a new story. The person Experienced in … designing and deploying production data pipelines within a big data architecture Strong technical skills in Python, SQL and AWS (though they’re very open to any cloud experience) Experience processing large volumes of structured and unstructured data Experience of leading teams, mentoring junior team members and promoting more »

with options for remote or hybrid working. Our client, a global leader in IT solutions for buses and trains, is seeking a highly skilled Data Engineer with a focus on ETL processes to join their expanding team. This role offers the opportunity to contribute significantly to making public … By joining this team, you will be at the forefront of enhancing mobility for millions of system users and passengers globally. The Role: The Data Engineer will be responsible for designing, building, and maintaining sophisticated ETL pipelines and data integrations that support crucial analytics and business intelligence … a dynamic environment where your work directly impacts the effectiveness and efficiency of public transport systems. Responsibilities Include: Develop and manage ETL processes, integrating data from diverse sources into a unified data warehouse. Utilise Python and other advanced tools to script and automate data processes. Create and more »

Data Engineer -SQL, Power BI, Analytics - Permanent Data Engineer SQL, Power BI, Data Analytics Insurance City, London/Hybrid (3 in the office) Permanent Competitive Salary A fantastic opportunity has arisen for an experienced Data Engineer ideally with previous Insurance background … years of work experience with Analytical users and a good exposure to Cloud based data/analytics to join a well respected Specialist Insurer in their London office. Reporting to the Head of Data & Cloud, you will be an integral part of building out Cloud solutions and supporting … management information dashboards through the automation and streamlining of data processes. KEY RESPONSIBILITIES The primary role is to provide data and management information expertise, specifically: Build and maintain data warehouses on the Azure Cloud and create one source of truth data sets to drive consistency and more »

Lead Data Engineer - Azure/Spark/Databricks Role: Lead Data Engineer Location: London (3 days a week) Salary: £85k - £90k A leading technology firm, renowned for connecting people globally, is looking for a skilled Lead Data Engineer to join their expanding team. In … this role, you will lead a team of talented engineers, leveraging your expertise in the Azure data engineering stack. Key Responsibilities: Lead the design, development, and implementation of data solutions using Azure services such as Spark, Data Lake, Synapse, and Databricks. Code in Spark and oversee the … technical design aspects of projects, ensuring adherence to engineering best practices. Lead and mentor a team of data engineers, providing guidance and support to foster their professional growth and development. Collaborate effectively with remote teams, leveraging your experience in leading distributed teams to drive success. Requirements: Extensive experience with more »

This innovative Multi-Strategy Hedge Fund, seek an experienced Software Engineer with expertise in Python to work within a dynamic Data Engineering Group building greenfield pipelines, frameworks, APIs and core Data store (Data warehouse and Data Lake) to enable the ingestion and provision (upstream and … Trading teams firmwide (X-Asset - Equities, Rates, Commodities, FX and Crypto). Key Skills required 3+ years of exp. as a Software Developer/Data Engineer with Python as your core language Extensive API and Microservices development experience 3+ years SQL Strong DB skills ideally in both SQL more »

applying - Informatica Cloud, IICS/IDMC is essential and the role is 2-3 days a week in the Liverpool office - rest remote**** Senior Data Engineer, Data, Data Modelling, Migration, ETL, ETL Tooling (Informatica IICS & IDMC ) SQL, Python or Pyspark, Agile, migrating data from on … prem to cloud. **** Informatica Cloud (IICS & IDMC ) is essential - NOT PowerCenter**** A top insurance firm are looking for a Senior Data Engineer (Informatica Cloud IICS/IDMC) to work with the end to end support for acquisition, organization, integration, transformation and secure storage of mission-critical data. Essential …/core experience required: 10+ years of experience and in-depth knowledge of data delivery and associated architecture principles, data modelling concepts, ETL procedures, and all steps of data production process Prior experience in insurance and/or reinsurance in support of specialty lines is a plus. more »

Data Engineer - Azure Databricks CONTRACT - London (Hybrid) Data warehousing - Trading - Credit/Market Risk Harrington Starr is working with a leading Energy trading firm in London on an initial 6-month contract for a market-leading project. The project is signed off and they are looking to … start interviewing ASAP. Responsibilities: Azure Cloud Data Engineering using Azure Databricks Data Warehousing Data Engineering Very strong with the Microsoft Stack ESSENTIAL knowledge of PySpark clusters Python & C# Scripting experience Experience of message queues (Kafka) Experience of containerization (Docker) FINANCIAL SERVICES EXPERIENCE (Energy/commodities trading) If more »

Senior Azure Data Engineering Consultant Home-based with occasional customer travel £65,000 - £85,000 + bonus and benefits I'm working with a leading Microsoft Gold Partner who specialise in data. They are true experts when it comes to data strategy, data platforming, analytics, artificial intelligence … and data managed service. This means they are working on the most interesting and cutting-edge data centric projects in the market today. I’m looking for a Senior Data Engineering Consultant to join the team. This is an excellent opportunity for a Data Engineer, with experience in consulting and customer-facing roles to join a data-centric organisation at an exciting time of change. You will be well supported with the opportunity to gain numerous Microsoft certifications and accreditations to enhance your profile whilst working alongside experienced professionals to boost your learning more »

Intelligence technologies and leading and educating a technical team across two global territories. The client is in the initial stages of deploying the Collibra Data Catalog tool to assist in accurate reporting of IT Asset Management. Collaborate with key stakeholders to understand business requirements and translate them into Collibra … solutions. Lead the implementation of Collibra Data Catalog, including configuration, customisation, and integration with other systems. Design and implement data governance workflows, data dictionaries, and data lineage within Collibra. Develop and maintain Collibra data governance policies, standards, and rules. Provide technical guidance and support to … users on Collibra platform usage and best practices. Develop custom reports and dashboards to monitor data governance metrics and KPIs. Conduct training sessions and workshops for end-users to promote adoption and usage of Collibra. Work closely with the Collibra vendor and internal IT teams to resolve technical issues more »

Principal Configuration & Data Management Engineer Location: Preston Job type: Permanent Salary: Competitive Delkia is a specialist Systems Integrator operating throughout the UK and Internationally for safety-related and mission-critical systems in highly regulated sectors, including Aerospace, Maritime, Defence and Clean Energy. Our offering includes system integration, engineering … are harnessed specifically for each project’s needs, maturity and technology requirements. We have an exciting opportunity to appoint an experienced Principal Safety Capability Engineer to join our dynamic team at Delkia. Overview of the role We are seeking an experienced engineer in configuration and data management … across sectors and products through life. This includes core CM functions of planning, identification, change, status accounting & verification and audit as well the associated data management experience in supplier data requirements, data stewardship, data modelling & data exchange. Knowledge of CDM Management Systems with a strong more »

Data Science & ML Consultant Location : London – Hybrid Employment : Full Time All applicants must hold a DV (Developed Vetting) clearance to apply. The Opportunity : For the Ministry of Defence (MOD), maintaining national security is a 24-hour-a-day, 365-day-a-year mission. For this reason, it partners with … this Big 4 Firm to support its multidisciplinary Data Science and Machine Learning team within DSSV (Data Science, Simulation and Visualisation). The Teams work together to drive innovation and insight from data, using cutting-edge Data Science and Machine Learning techniques alongside Digital Transformation to … solve complex problems through AI and Data. The Role : Working closely with senior data scientists, the Consultant's responsibilities span the entire data science lifecycle, from Proof of Concept to fully tested production solutions. Additional duties include preparing technical documentation, participating in client proposal responses, and pitching data more »

My leading Energy and Commodities conglomerate are currently seeking a skilled individual with experience in Python-based data pipeline, data lake house development and an appreciation for Object orientated languages such as C# or Java, using leading orchestration tools. In this role, you'll lead the development of … robust, fully tested data pipelines in Python using cutting-edge platforms like Dagster/Airflow and apply your expertise in real-time data streaming solutions using Kafka. You'll play a key role in expanding their on prem data lake infrastructure to help enhance support for new … lines of businesses they have including Systematic trading, Trading and Shipping commodities, ensuring strong data lineage. The successful candidate will have: A strong background in data engineering using Python Strong understanding of Test Driven Development Experience building Star Schemer Databases Strong experience with SQL design patterns Experience in more »

Xpertise is seeking a series of Data Engineers with cloud experience to join a fledgling team in Milton Keynes. As part of our client's growing engineering division, you will play a pivotal role in leading the data engineering capabilities, working closely with Platform Engineers, Developers, and Analysts. … Architect, and even venture into the world of MLOps/AIOps. Key experience desired/what you will learn: Design, develop, and maintain scalable data pipelines and ETL processes leveraging GCP services such as BigQuery, Dataflow, and Cloud Storage. If you have experience across AWS and Azure, we can … train you up on Google Cloud. Architect data models and schemas in BigQuery to support analytics, reporting, and business intelligence initiatives. Python development Implement data governance and security best practices to ensure compliance and data integrity. Monitor and troubleshoot data pipelines, ensuring high availability and reliability. more »

Lead AWS Data Engineer - London (Hybrid) - Permanent - £90,000-£100,000 Start-up, AWS, DBT, Redshift, PostgreSQL, Python, MongoDB, ELT *You must be based in London, and have full permanent right to work in the UK to apply for this role* I'm currently working with an exciting … start-up who provide real-time insights and emerging trends in private markets . They partner with investment firms and corporations to provide actionable data and intelligence on private companies. They are massively successful and growing steadily, and are on the look-out for a Lead Data Engineer to join the team! Specifically, they're looking for: Extensive experience as a Data Engineer using AWS Very strong ability in DBT and Redshift Proven experience working in an autonomous, start-up environment . Expert ability with PostgreSQL , ELT , unstructured data , and MongoDB . Experience with more »

Data Engineer Azure/Snowflake/Power Bi/Airflow London (Contract) Role: Our client is looking to expand their data engineering team and add in the utilisation of Snowflake which is currently being used by a select few members of the team, and upskilling taking place … alongside. They want to add in an additional team member who has multiple years of experience using Snowflake as a data tool and can hit the ground running Experience Snowflake Financial services Cloud (Ideally azure) Airflow would be an advantage more »