251 to 275 of 1,038 Permanent Data Engineer Jobs

Databricks Data Engineer | London | £50,000 - £65,000 🧱 Peaple Talent have partnered with a specialist data consultancy delivering services across data engineering, data strategy, data migration, BI & analytics. As a trusted Microsoft Partner, my client are leaders in the industry, with a diverse portfolio … of clients and projects. Due to exciting growth plans we are now looking for a Data Engineer, specialising in Databricks. We are looking for: Demonstratable data engineering/BI skills, with a focus on having delivered in Microsoft Azure or AWS Strong experience designing and delivering data solutions in Databricks Proficient with SQL and Python Experience using Big Data technologies such as Apache Spark or PySpark Great communication skills, effectively participating with Senior Stakeholders Nice to haves: Azure/AWS Data Engineering certifications Databricks certifications What's in it for you: 📍Location: London (Hybrid More ❯

Our client, a leader in the renewable energy industry, is looking for a Data Engineer to join their growing data team. They are committed to digital transformation and innovation, and they need an experienced professional to maintain and improve their in-house data systems. This role … will focus on ensuring smooth data flow, security, and automation across the business. The Role As a Senior Data Engineer , you will: Maintain and improve internal data systems and AWS infrastructure. Develop user interfaces and APIs to enhance data accessibility. Manage data integrity and … optimize ETL pipelines. Work closely with technical and asset management teams to improve the platform. Identify automation and integration opportunities to drive efficiency. Ensure data security and compliance with GDPR and industry regulations. What We’re Looking For 4+ years of experience in Python development (Flask, Django). Strong More ❯

Data Engineer | Bristol | Up to 70,000 depending on experience We are partnering with a growing energy company in their search for a Data Engineer to join their team. They are a leading energy trading company with a global presence, and they are making waves across … the market, so you won't want to miss out! Responsibilities: Acquire and store UK and EU energy market data efficiently. Develop and enhance batch and real-time data pipelines. Collaborate with frontend and data science teams to optimize data processes. Audit databases and enhance data … for modelling and analysis. Experience required: Proficiency in Python and SQL. Degree in a quantitative/computational discipline. 2+ years of relevant experience in data engineering. Experience in data modelling and end-to-end data pipelines. Knowledge of AWS core services (EC2, ECS, RDS, S3). Strong More ❯

The Data Engineer will play a lead role in a high-profile technology programme which is delivering leading-edge AI solutions for a global organisation. You will deliver data solutions, including the design and implementation of data pipelines, transforming raw data into usable formats, ensuring … data quality and maintaining the data infrastructure. The programme presents an opportunity to work with data scientists, software teams, and business professionals to collaboratively deliver truly innovative AI solutions. Responsibilities include: Data Pipeline Development Data Modelling Data Transformation Data Quality & Governance Data More ❯

SMX is seeking a talented Data Engineer (Python) with expertise in ETL (Extract, Transform, Load) processes and Apache Airflow. The candidate will be responsible for designing and implementing robust and efficient data pipelines, ensuring high data quality, and contributing to the continuous improvement of our data … remote position supporting a Washington, DC based team. Essential Duties & Responsibilities: Design, develop, and maintain ETL processes using Python and Apache Airflow. Collaborate with data analysts and other stakeholders to understand and meet their data requirements. Develop and implement data validation processes to ensure high data quality. Troubleshoot and resolve issues related to data pipelines. Optimize data extraction, transformation, and loading (ETL) processes to improve efficiency and performance. Document and maintain the design and details of data processes and schemas. Stay updated with the latest industry trends and technologies to ensure data More ❯

REQUIRED: DATA ENGINEER - SC CLEARED Location: Fully remote with occasional travel to Central London IR35 Status: Inside Duration: 6-month initial contract Job Description: Seeking a Data Engineer with a strong understanding of data concepts, including data types, data structures, schemas (JSON and … Spark), and schema management. Key Skills and Experience: Strong understanding of complex JSON manipulation Experience with Data Pipelines using custom Python/PySpark frameworks Knowledge of the 4 core Data categories (Reference, Master, Transactional, Freeform) and handling Reference Data Understanding of Data Security principles, access controls … advanced proficiency, Pydantic bonus) SQL PySpark Delta Lake Bash Git Markdown Scala (bonus) Azure SQL Server (bonus) Technologies: Azure Databricks Apache Spark Delta Tables Data processing with Python PowerBI (Data ingestion and integration) JIRA Additional Notes: Candidates with current or past high-level security clearance are encouraged to More ❯

Our client, a leader in the renewable energy industry, is looking for a Data Engineer to join their growing data team. They are committed to digital transformation and innovation, and they need an experienced professional to maintain and improve their in-house data systems. This role … will focus on ensuring smooth data flow, security, and automation across the business. Location: Bristol | Hybrid Salary: £55,000 - £75,000 (experience dependant) + Benefits The Role As a Senior Data Engineer , you will: Maintain and improve internal data systems and AWS infrastructure. Develop user interfaces … and APIs to enhance data accessibility. Manage data integrity and optimize ETL pipelines. Work closely with technical and asset management teams to improve the platform. Identify automation and integration opportunities to drive efficiency. Ensure data security and compliance with GDPR and industry regulations. What We’re Looking More ❯

Role: Principal Data Engineer Type: Permanent Location: Hampshire, London (Hybrid Working) Salary: £80,000 - £90,000 + Benefits Are you an experienced Data Engineer ready to take the next step into a strategic, hands-on leadership role? This is a fantastic opportunity to join a well … name in general insurance and part of a larger European group, with a UK presence that continues to grow. With significant investment in their data and technology function, theyre now looking to bring on a Principal Data Engineer to help shape and evolve their data infrastructure … and engineering capability. The Opportunity: This is a pivotal role where youll lead on the design, delivery, and optimisation of scalable, secure data systems that support the wider business strategy. Youll be part of a collaborative tech environment, working closely with cross-functional teams and mentoring fellow engineers. Its More ❯

Job Title: Azure Data Engineer Lead - Outside IR35 Location: Remote Salary/Rate: £450 per day - Outside IR35 Start Date: 28/04/2025 Duration: 3 months We have an exciting opportunity with a major retail company. They are looking for a Lead Azure Data Engineer … working outside IR35 and fully remote. Job Responsibilities/Objectives: Lead the design and execution of the end-to-end migration from on-premise data systems to Azure, ensuring scalability, reliability, and performance. Develop and optimise data pipelines using Azure Data Factory, Synapse Analytics, and related services … to support data ingestion, transformation, and integration. Architect and implement Azure-based data solutions, including Data Lake, SQL Database, and Databricks, aligning with business and technical requirements. Establish cloud data engineering best practices, including governance, security, monitoring, and cost optimisation. Collaborate cross-functionally with cloud architects More ❯

D.C. (On-Site) Clearance Requirement: Active TS/SCI with CI Polygraph Position Type: Full-Time Position Overview: Constellation West is seeking a skilled Data Engineer to support the Defense Intelligence Agency (DIA) on the Machine-Assisted Analytic Rapid-Repository System (MARS) program. The Data Engineer will lead critical data integration and interoperability initiatives across the Defense Intelligence Enterprise, the broader DoD, and international partner networks. This role is central to advancing the MARS mission through data orchestration, advanced analytics support, and infrastructure development across classified and unclassified environments. Key Responsibilities: Lead cross … agency data interoperability efforts in collaboration with the DIA's Technology Center (TC), DoD organizations, and foreign mission partners. Manage, analyze, and transform large and complex datasets to support mission-critical analytic and operational requirements. Evaluate and recommend data integration opportunities across MARS and associated capability development initiatives. More ❯

with multidisciplinary backgrounds. This team is challenged daily to provide cutting edge technology solutions to our clients. SRC is searching for a well-rounded Data Engineer with experience to support the developmentof advanced analytic techniques for Big Data engineering, Machine Learning, AI/ML, and security trend … as a project lead on advanced specialized projects or in resolution of technical problems that would critically impact performance, schedule, or cost Focusing on Data wrangling, ingestion, and processing- ability to prepare data for ingestion from various data types into various data stores using Python and … SQL within our AWS Marine Corps GovCloud Providing functional and technical guidance to Data Analyst, Data Scientists, Data Engineers, and management Representing the company as a prime technical customer contact on engineering contracts or programs Consulting and advising senior management and/or the customer regarding feasibility More ❯

Senior Data Engineer Location: Washington, DC (Hybrid) Work Type: Full-Time GridIron IT is seeking a Senior Data Engineer with an Active Top Secret (SCI Eligible) Clearance. As a Senior Data Engineer, you will be required to interpret business needs and select appropriate technologies … and have experience in implementing data governance of shared and/or master sets of data. You will work with key business stakeholders, IT experts, and subject-matter experts to plan and deliver optimal data solutions. You will create, maintain, and optimize data pipelines as workloads move … from development to production for specific use cases to ensure seamless data flow for the use case. You will perform technical and non-technical analyses on project issues and help to ensure technical implementations follow quality assurance metrics. You will analyze data and systems architecture, create designs, and More ❯

We're currently seeking a Data Engineer to join one of the leading organisations responsible for coordinating the financing activities for one of the largest car manufacturer groups in the world! Ready to fuel your career? Drive your ambition with incredible car scheme perks, a fantastic bonus, and … state-of-the-art workspace. Apply now and accelerate your future! What You’ll Bring To The Table Lead the design and development of data pipelines, transforming data from various sources and loading it into appropriate data storage systems to ensure seamless data flow. Define and … support the creation and maintenance of optimal data pipeline architecture, enabling faster and safer solution delivery. Consolidate and optimise large, complex data sets from diverse sources that meet both functional and non-functional business requirements, ensuring data quality and accessibility. Lead the identification, design, and implementation of More ❯

Data Management Engineer Cornerstone: As an automation company we are faced every day with solving our customers' most challenging manufacturing problems. Those customers are increasingly turning to digital solutions to leverage their current investments for improving efficiency, throughput, and ROI. Our Data Integration Engineering team is at … customers and backing each other up in times of high demand. Come join our exciting team and develop your career with us as a Data Management Engineer at Cornerstone! Job Description: We are looking for a Data Management Engineer who can be a customer facing individual … enterprise level. This individual will be responsible for coordinating with customer site contacts and implementing solutions in a challenging real-time process environment. The Data Management Engineer must be able to understand, troubleshoot, and resolve issues. The Data Management Engineer, as a use case developer, will More ❯

ManTech seeks a motivated, career and customer-oriented Data Engineer to join our team in Herndon, Virginia. As a Data Engineer on our team, you will work with of a team of cyber experts protecting our national security, while working on innovative projects that offer opportunities … and expertise while creating robust and state-of-the-art solutions. Responsibilities include but are not limited to: Design, build, and optimize systems for data collection, storage, access, and analytics at enterprise scale, which may involve security-sensitive actions like illicit network access or data transfer Make data available, accessible, and secure to all stakeholders Create robust and resilient data pipelines to connect data sources to analytics tools Analyze data sources for accuracy, data prioritization, and apply appropriate logic to developed solutions. Work with various analysts to craft requirements Enumerate the necessary datasets More ❯

Description SAIC is seeking an experienced and dynamic Senior Data Engineer will oversee data integration efforts including developing and maintaining data models, supporting cleaning and transformation of data prior to data persistence, and writing scripts for data analysis. This role will work as … a member of the Data Modeling team and work collaboratively with members of the Data Operations and Data Metrics and Assessment teams to interpret operational requirements, perform data modeling and integrate data from a variety of sources and implement secure data pipelines for near … real-time ingest from a myriad of tactical and intelligence community data sources. A major responsibility is implementing and enforcing data modeling best practices and version controlling of software and configuration among development, integration, and production environments. Qualifications U.S. Citizenship and an active TS clearance. TYPICAL EDUCATION AND More ❯

join an innovative project where technology is used to make a positive impact by combating misinformation and fake news? We're seeking a Principal Data Engineer to join our Data team. Step into a thrilling challenge where you'll collaborate with a passionate team exploring the cutting … edge of generative AI and multimodal models to tackle fake news. Working closely with AI&Data engineers to design the next generation of intelligent systems that can automatically verify information and make a meaningful impact in the fight against misinformation. Do you thrive on solving the unsolvable? Are you … driven by the desire to make a real difference in society? If so, keep reading What you will do As a Principal Engineer , your mission will be to design and implement the data pipelines, microservices, and information architecture that power the intelligent agents we're building to fight More ❯

Role Overview Data Engineer & Analyst to join our ambitious data team delivering data engineering and innovative data solutions. Projects we work on include Microsoft Fabric data pipeline implementation, advanced analytics, location analytics, LLM agent management and many other projects spanning data engineering, data science and data analytics. GAIL’s delivers craft baking at scale, striving for sustainable ways of delivering fresh, tasty food every day. We use data and technology to help our teams make better decisions so that they can focus on producing quality food and delivering a great … customer experience. We are looking for someone who has a passion for data, learning and self-development. You will have 0-1 year experience in data engineering and analytics. We do not expect you to know everything, but we do expect you to be inquisitive, innovative and fast More ❯

AWS Data Engineer (Must hold current SC) The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all … delivery times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff. Overview: We are looking for a highly skilled AWS Data Engineer to join our team. The ideal candidate will have expertise in designing, building, and managing scalable data pipelines on AWS. You … will work closely with data scientists, analysts, and software engineers to implement efficient data solutions that support business intelligence and analytics needs. Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines using AWS services such as AWS Glue, Lambda, Step Functions, and Kinesis. Work with structured and More ❯

Senior Data Engineer £55,000 + 5% annual bonus Remote Are you a skilled Data Engineer ready to shape the future of data systems? We're looking for someone to drive the transformation of our architecture—building high-performance, resilient pipelines that enable advanced analytics … and real business value from diverse data sources. You’ll be part of a dynamic, agile environment, collaborating closely with analysts, architects, and product teams across the business. This is a hands-on role with real impact—designing and implementing automated, scalable data flows, and enabling powerful insights … across the organization. What You’ll Be Doing Build and support modern cloud data warehouse architecture (Kimball, Data Vault, Data Mesh). Design dimensional models and develop robust ETL/ELT pipelines. Implement seamless data integrations between cloud and on-prem systems. Optimize data lifecycle More ❯

Hybrid/Remote from within the UK or Greece Preferred start date: ASAP LIFE AT SATALIA As an organisation, we push the boundaries of data science, optimisation and artificial intelligence to solve the hardest problems in industry. Satalia is a community of individuals devoted to working on diverse and … shape cutting-edge AI products and services that make a tangible impact for FTSE 100 clients. We are hiring across all experience levels in data science, from entry-level to seasoned professionals, and offer competitive salaries commensurate with experience and skills. It is a great time to be joining … as the industry transforms itself in what we believe is a generational moment for technology and AI. YOUR RESPONSIBILITIES Collaborate closely with data scientists, architects, and other stakeholders to understand and implement business requirements. Provide data engineering support for AI model development and deployment, ensuring data scientists More ❯

Job Highlights Do you thrive in a fast-paced, multi-disciplinary team in an ever-changing work environment? As a Big Data Engineer, you will have the opportunity to work on a variety of challenging and rewarding projects. You will work directly with stakeholders and Data Analysts … and add core tools to an analytical suite. You will support the National Geospatial-Intelligence Agency (NGA) to process ETL on new and varied data sets, and work with Big Data at scale, using Spark/PySpark to handle petabytes of data. As an immediate liaison with the … you will have a deep understanding of their current and upcoming mission needs, generating requirements based on their input. Working with a variety of data types, including Technical Telemetry Data, Computer Network Cyber data, and other forms of telecommunication protocol data types, such as cellular, wi More ❯

Senior Data Engineer Malaga - Relocation Package Available 2 days a week in the office €60,000 - €100,000 English & Russian Speaking This company are one of the biggest and most successful businesses within their niche FinTech market space and have massive plans to build brand new Tech, Data … countries and picked up numerous awards within the industry. They partner with some of the biggest global FinTech companies and process lots of different data variants which is where this role comes in. They are looking for a Senior Data Engineer to contribute to their growing data platform, where they develop infrastructure for their data finance product suite. You will ideally have come from a FinTech background, have good previous experience working as a Data Engineer and have worked with the majority of skills listed below. This role is based in Malaga, Spain More ❯

be part of something greater, you are in the right place. Northrop Grumman Aeronautics Systems has an opening for a Principal or Sr. Principal Data Engineer to join our team of qualified, diverse individuals located onsite in Rancho Bernardo, CA. Join our team and build scalable pipelines from … the ground up. You will play a key role in designing, developing, and maintaining modern, optimized, and high-performance data storage solutions. If you enjoy collaborating with data scientists, analysts, and software engineers to integrate and process data efficiently, we'd love to hear from you! Accomplish … In this role you will design, build, and maintain scalable ETL (Extract, Transform, Load) pipelines using Python, while developing and optimizing data storage solutions, and ensure data integrity, security and best practices are followed. The ideal candidate should have a background in Software Engineering, with a particular focus More ❯

send your CV and application. Do you thrive in a fast-paced, multi-disciplinary team in an ever-changing work environment? As a Big Data Engineer, you will have the opportunity to work on a variety of challenging and rewarding projects. You will work directly with stakeholders and … Data Analysts to develop new and enhanced capabilities that help analysts achieve mission success and add core tools to an analytical suite. You will support the National Geospatial-Intelligence Agency (NGA) to process ETL on new and varied data sets, and work with Big Data at scale … you will have a deep understanding of their current and upcoming mission needs, generating requirements based on their input. Working with a variety of data types, including Technical Telemetry Data, Computer Network Cyber data, and other forms of telecommunication protocol data types, such as cellular, wi More ❯