301 to 325 of 1,157 Permanent Data Engineer Jobs

Our client, a leader in the renewable energy industry, is looking for a Data Engineer to join their growing data team. They are committed to digital transformation and innovation, and they need an experienced professional to maintain and improve their in-house data systems. This role … will focus on ensuring smooth data flow, security, and automation across the business. The Role As a Senior Data Engineer , you will: Maintain and improve internal data systems and AWS infrastructure. Develop user interfaces and APIs to enhance data accessibility. Manage data integrity and … optimize ETL pipelines. Work closely with technical and asset management teams to improve the platform. Identify automation and integration opportunities to drive efficiency. Ensure data security and compliance with GDPR and industry regulations. What We’re Looking For 4+ years of experience in Python development (Flask, Django). Strong More ❯

Data Engineer | Bristol | Up to 70,000 depending on experience We are partnering with a growing energy company in their search for a Data Engineer to join their team. They are a leading energy trading company with a global presence, and they are making waves across … the market, so you won't want to miss out! Responsibilities: Acquire and store UK and EU energy market data efficiently. Develop and enhance batch and real-time data pipelines. Collaborate with frontend and data science teams to optimize data processes. Audit databases and enhance data … for modelling and analysis. Experience required: Proficiency in Python and SQL. Degree in a quantitative/computational discipline. 2+ years of relevant experience in data engineering. Experience in data modelling and end-to-end data pipelines. Knowledge of AWS core services (EC2, ECS, RDS, S3). Strong More ❯

The Data Engineer will play a lead role in a high-profile technology programme which is delivering leading-edge AI solutions for a global organisation. You will deliver data solutions, including the design and implementation of data pipelines, transforming raw data into usable formats, ensuring … data quality and maintaining the data infrastructure. The programme presents an opportunity to work with data scientists, software teams, and business professionals to collaboratively deliver truly innovative AI solutions. Responsibilities include: Data Pipeline Development Data Modelling Data Transformation Data Quality & Governance Data More ❯

SMX is seeking a talented Data Engineer (Python) with expertise in ETL (Extract, Transform, Load) processes and Apache Airflow. The candidate will be responsible for designing and implementing robust and efficient data pipelines, ensuring high data quality, and contributing to the continuous improvement of our data … remote position supporting a Washington, DC based team. Essential Duties & Responsibilities: Design, develop, and maintain ETL processes using Python and Apache Airflow. Collaborate with data analysts and other stakeholders to understand and meet their data requirements. Develop and implement data validation processes to ensure high data quality. Troubleshoot and resolve issues related to data pipelines. Optimize data extraction, transformation, and loading (ETL) processes to improve efficiency and performance. Document and maintain the design and details of data processes and schemas. Stay updated with the latest industry trends and technologies to ensure data More ❯

REQUIRED: DATA ENGINEER - SC CLEARED Location: Fully remote with occasional travel to Central London IR35 Status: Inside Duration: 6-month initial contract Job Description: Seeking a Data Engineer with a strong understanding of data concepts, including data types, data structures, schemas (JSON and … Spark), and schema management. Key Skills and Experience: Strong understanding of complex JSON manipulation Experience with Data Pipelines using custom Python/PySpark frameworks Knowledge of the 4 core Data categories (Reference, Master, Transactional, Freeform) and handling Reference Data Understanding of Data Security principles, access controls … advanced proficiency, Pydantic bonus) SQL PySpark Delta Lake Bash Git Markdown Scala (bonus) Azure SQL Server (bonus) Technologies: Azure Databricks Apache Spark Delta Tables Data processing with Python PowerBI (Data ingestion and integration) JIRA Additional Notes: Candidates with current or past high-level security clearance are encouraged to More ❯

Our client, a leader in the renewable energy industry, is looking for a Data Engineer to join their growing data team. They are committed to digital transformation and innovation, and they need an experienced professional to maintain and improve their in-house data systems. This role … will focus on ensuring smooth data flow, security, and automation across the business. Location: Bristol | Hybrid Salary: £55,000 - £75,000 (experience dependant) + Benefits The Role As a Senior Data Engineer , you will: Maintain and improve internal data systems and AWS infrastructure. Develop user interfaces … and APIs to enhance data accessibility. Manage data integrity and optimize ETL pipelines. Work closely with technical and asset management teams to improve the platform. Identify automation and integration opportunities to drive efficiency. Ensure data security and compliance with GDPR and industry regulations. What We’re Looking More ❯

Role: Principal Data Engineer Type: Permanent Location: Hampshire, London (Hybrid Working) Salary: £80,000 - £90,000 + Benefits Are you an experienced Data Engineer ready to take the next step into a strategic, hands-on leadership role? This is a fantastic opportunity to join a well … name in general insurance and part of a larger European group, with a UK presence that continues to grow. With significant investment in their data and technology function, theyre now looking to bring on a Principal Data Engineer to help shape and evolve their data infrastructure … and engineering capability. The Opportunity: This is a pivotal role where youll lead on the design, delivery, and optimisation of scalable, secure data systems that support the wider business strategy. Youll be part of a collaborative tech environment, working closely with cross-functional teams and mentoring fellow engineers. Its More ❯

Job Title: Azure Data Engineer Lead - Outside IR35 Location: Remote Salary/Rate: £450 per day - Outside IR35 Start Date: 28/04/2025 Duration: 3 months We have an exciting opportunity with a major retail company. They are looking for a Lead Azure Data Engineer … working outside IR35 and fully remote. Job Responsibilities/Objectives: Lead the design and execution of the end-to-end migration from on-premise data systems to Azure, ensuring scalability, reliability, and performance. Develop and optimise data pipelines using Azure Data Factory, Synapse Analytics, and related services … to support data ingestion, transformation, and integration. Architect and implement Azure-based data solutions, including Data Lake, SQL Database, and Databricks, aligning with business and technical requirements. Establish cloud data engineering best practices, including governance, security, monitoring, and cost optimisation. Collaborate cross-functionally with cloud architects More ❯

Data Engineer Salary: Up to £57,000 Location: London (hybrid 2 days a week) Join a team that helps governments, national security agencies, and commercial organisations unlock the value of their data in the most demanding and complex environments. We are looking for a Data Engineer … join our digital intelligence practice in London . You'll be part of a team transforming a proof-of-concept into a fully operational data warehouse and business intelligence platform for a key public sector client. This is a fantastic opportunity to work on a high-impact programme using … the latest in Microsoft Azure technologies. What You’ll Be Doing: Supporting the transformation of a data platform from PoC to a fully productionised, scalable, and secure system. Collaborating in agile teams to deliver iterative enhancements and support long-term data strategy. Designing, implementing, and optimising data More ❯

D.C. (On-Site) Clearance Requirement: Active TS/SCI with CI Polygraph Position Type: Full-Time Position Overview: Constellation West is seeking a skilled Data Engineer to support the Defense Intelligence Agency (DIA) on the Machine-Assisted Analytic Rapid-Repository System (MARS) program. The Data Engineer will lead critical data integration and interoperability initiatives across the Defense Intelligence Enterprise, the broader DoD, and international partner networks. This role is central to advancing the MARS mission through data orchestration, advanced analytics support, and infrastructure development across classified and unclassified environments. Key Responsibilities: Lead cross … agency data interoperability efforts in collaboration with the DIA's Technology Center (TC), DoD organizations, and foreign mission partners. Manage, analyze, and transform large and complex datasets to support mission-critical analytic and operational requirements. Evaluate and recommend data integration opportunities across MARS and associated capability development initiatives. More ❯

with multidisciplinary backgrounds. This team is challenged daily to provide cutting edge technology solutions to our clients. SRC is searching for a well-rounded Data Engineer with experience to support the developmentof advanced analytic techniques for Big Data engineering, Machine Learning, AI/ML, and security trend … as a project lead on advanced specialized projects or in resolution of technical problems that would critically impact performance, schedule, or cost Focusing on Data wrangling, ingestion, and processing- ability to prepare data for ingestion from various data types into various data stores using Python and … SQL within our AWS Marine Corps GovCloud Providing functional and technical guidance to Data Analyst, Data Scientists, Data Engineers, and management Representing the company as a prime technical customer contact on engineering contracts or programs Consulting and advising senior management and/or the customer regarding feasibility More ❯

Senior Data Engineer Location: Washington, DC (Hybrid) Work Type: Full-Time GridIron IT is seeking a Senior Data Engineer with an Active Top Secret (SCI Eligible) Clearance. As a Senior Data Engineer, you will be required to interpret business needs and select appropriate technologies … and have experience in implementing data governance of shared and/or master sets of data. You will work with key business stakeholders, IT experts, and subject-matter experts to plan and deliver optimal data solutions. You will create, maintain, and optimize data pipelines as workloads move … from development to production for specific use cases to ensure seamless data flow for the use case. You will perform technical and non-technical analyses on project issues and help to ensure technical implementations follow quality assurance metrics. You will analyze data and systems architecture, create designs, and More ❯

Software is an artisanal software engineering firm built on the values of trust, respect, curiosity, and craftsmanship, and delivering purpose-built solutions to drive data-led transformation for organisations. Our emphasis is on craft as we create purpose-built solution, leveraging Data Engineering, Platform Engineering and Data Science with a razor-sharp focus to solve complex business and technology challenges, and provide customers with a competitive edge. As a Senior Data Engineer, you’ll feel at home if you are hands on, grounded, opinionated and passionate about delivering comprehensive data solutions that align … with modern data architecture approaches. Your work will range from building a full data platform to building data pipelines or helping with data architecture and strategy. This role is ideal for those looking to have a large impact and huge scope for growth, while still being More ❯

We're currently seeking a Data Engineer to join one of the leading organisations responsible for coordinating the financing activities for one of the largest car manufacturer groups in the world! Ready to fuel your career? Drive your ambition with incredible car scheme perks, a fantastic bonus, and … state-of-the-art workspace. Apply now and accelerate your future! What You’ll Bring To The Table Lead the design and development of data pipelines, transforming data from various sources and loading it into appropriate data storage systems to ensure seamless data flow. Define and … support the creation and maintenance of optimal data pipeline architecture, enabling faster and safer solution delivery. Consolidate and optimise large, complex data sets from diverse sources that meet both functional and non-functional business requirements, ensuring data quality and accessibility. Lead the identification, design, and implementation of More ❯

Data Engineer - Salisbury - £55,000-£65,000 - Hybrid My client is looking for a highly skilled Data Engineer to join our growing data team. This role is ideal for someone with strong experience in Azure data services and a passion for building scalable, secure … and cost-effective data pipelines that support analytics and BI initiatives. You’ll work closely with data scientists, analysts, and business stakeholders to ensure our data infrastructure is reliable, performant, and compliant. Key Responsibilities Design, build, and maintain robust ETL/ELT pipelines using Azure Data Factory, Synapse Analytics, and Data Lake Storage. Model data for analytical and BI consumption, including normalized and denormalized schemas. Collaborate with stakeholders to gather data requirements and translate them into efficient engineering solutions. Monitor and optimize cloud costs, query performance, and storage efficiency. Ensure data More ❯

Role Overview Data Engineer & Analyst to join our ambitious data team delivering data engineering and innovative data solutions. Projects we work on include Microsoft Fabric data pipeline implementation, advanced analytics, location analytics, LLM agent management and many other projects spanning data engineering, data science and data analytics. GAIL’s delivers craft baking at scale, striving for sustainable ways of delivering fresh, tasty food every day. We use data and technology to help our teams make better decisions so that they can focus on producing quality food and delivering a great … customer experience. We are looking for someone who has a passion for data, learning and self-development. You will have 0-1 year experience in data engineering and analytics. We do not expect you to know everything, but we do expect you to be inquisitive, innovative and fast More ❯

Role Overview Data Engineer & Analyst to join our ambitious data team delivering data engineering and innovative data solutions. Projects we work on include Microsoft Fabric data pipeline implementation, advanced analytics, location analytics, LLM agent management and many other projects spanning data engineering, data science and data analytics. GAIL’s delivers craft baking at scale, striving for sustainable ways of delivering fresh, tasty food every day. We use data and technology to help our teams make better decisions so that they can focus on producing quality food and delivering a great … customer experience. We are looking for someone who has a passion for data, learning and self-development. You will have 0-1 year experience in data engineering and analytics. We do not expect you to know everything, but we do expect you to be inquisitive, innovative and fast More ❯

AWS Data Engineer (Must hold current SC) The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all … delivery times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff. Overview: We are looking for a highly skilled AWS Data Engineer to join our team. The ideal candidate will have expertise in designing, building, and managing scalable data pipelines on AWS. You … will work closely with data scientists, analysts, and software engineers to implement efficient data solutions that support business intelligence and analytics needs. Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines using AWS services such as AWS Glue, Lambda, Step Functions, and Kinesis. Work with structured and More ❯

Senior Data Engineer £55,000 + 5% annual bonus Remote Are you a skilled Data Engineer ready to shape the future of data systems? We're looking for someone to drive the transformation of our architecture—building high-performance, resilient pipelines that enable advanced analytics … and real business value from diverse data sources. You’ll be part of a dynamic, agile environment, collaborating closely with analysts, architects, and product teams across the business. This is a hands-on role with real impact—designing and implementing automated, scalable data flows, and enabling powerful insights … across the organization. What You’ll Be Doing Build and support modern cloud data warehouse architecture (Kimball, Data Vault, Data Mesh). Design dimensional models and develop robust ETL/ELT pipelines. Implement seamless data integrations between cloud and on-prem systems. Optimize data lifecycle More ❯

Marathon TS is looking for a Data Engineer to support our end client. The ideal candidate will provide Data integration and senior level engineering and design services related to data integration in support of an enterprise-level ICAM solutions using Radiant Logic, SailPoint and other appropriate … implementation efforts. Domain knowledge and technical decision-making will have a critical impact on overall project implementation and execution. This position requires an innovative engineer who is passionate about data & data quality The ideal candidate will possess data warehousing experience and the ability to develop scalable … data pipelines that make data ingestion into an enterprise Identity management solution faster, and more efficient Capacity to understand specific needs or requirements to apply skills/knowledge Architect, engineer, and lead data integration efforts to deploy a single ICAM solution/Identity management platform (SailPoint More ❯

Hybrid/Remote from within the UK or Greece Preferred start date: ASAP LIFE AT SATALIA As an organisation, we push the boundaries of data science, optimisation and artificial intelligence to solve the hardest problems in industry. Satalia is a community of individuals devoted to working on diverse and … shape cutting-edge AI products and services that make a tangible impact for FTSE 100 clients. We are hiring across all experience levels in data science, from entry-level to seasoned professionals, and offer competitive salaries commensurate with experience and skills. It is a great time to be joining … as the industry transforms itself in what we believe is a generational moment for technology and AI. YOUR RESPONSIBILITIES Collaborate closely with data scientists, architects, and other stakeholders to understand and implement business requirements. Provide data engineering support for AI model development and deployment, ensuring data scientists More ❯

Data Engineer Location: Central London (2 days a week in office) Salary: £60,000 - £62,000 We're working with our client , a leading UK rail operator, to recruit a Data Engineer . This role is key in transforming operational data into accessible insights, supporting … open data initiatives and better decision-making across the business. Role Overview: You'll develop and maintain scalable cloud-based data infrastructure and pipelines, ensuring clean, secure, and well-modelled datasets are available across teams. The role suits someone confident with cloud tools, large data sets, and … real-time processing. Key Responsibilities: Build and manage cloud data infrastructure (AWS/Azure) Design data models and ETL pipelines Maintain data warehouses, lakes, and reporting-ready datasets Ensure data accuracy, security, and GDPR compliance Collaborate with internal and external stakeholders Optimise performance of pipelines and More ❯

Job Highlights Do you thrive in a fast-paced, multi-disciplinary team in an ever-changing work environment? As a Big Data Engineer, you will have the opportunity to work on a variety of challenging and rewarding projects. You will work directly with stakeholders and Data Analysts … and add core tools to an analytical suite. You will support the National Geospatial-Intelligence Agency (NGA) to process ETL on new and varied data sets, and work with Big Data at scale, using Spark/PySpark to handle petabytes of data. As an immediate liaison with the … you will have a deep understanding of their current and upcoming mission needs, generating requirements based on their input. Working with a variety of data types, including Technical Telemetry Data, Computer Network Cyber data, and other forms of telecommunication protocol data types, such as cellular, wi More ❯

Senior Data Engineer Malaga - Relocation Package Available 2 days a week in the office €60,000 - €100,000 English & Russian Speaking This company are one of the biggest and most successful businesses within their niche FinTech market space and have massive plans to build brand new Tech, Data … countries and picked up numerous awards within the industry. They partner with some of the biggest global FinTech companies and process lots of different data variants which is where this role comes in. They are looking for a Senior Data Engineer to contribute to their growing data platform, where they develop infrastructure for their data finance product suite. You will ideally have come from a FinTech background, have good previous experience working as a Data Engineer and have worked with the majority of skills listed below. This role is based in Malaga, Spain More ❯

be part of something greater, you are in the right place. Northrop Grumman Aeronautics Systems has an opening for a Principal or Sr. Principal Data Engineer to join our team of qualified, diverse individuals located onsite in Rancho Bernardo, CA. Join our team and build scalable pipelines from … the ground up. You will play a key role in designing, developing, and maintaining modern, optimized, and high-performance data storage solutions. If you enjoy collaborating with data scientists, analysts, and software engineers to integrate and process data efficiently, we'd love to hear from you! Accomplish … In this role you will design, build, and maintain scalable ETL (Extract, Transform, Load) pipelines using Python, while developing and optimizing data storage solutions, and ensure data integrity, security and best practices are followed. The ideal candidate should have a background in Software Engineering, with a particular focus More ❯