326 to 350 of 1,157 Permanent Data Engineer Jobs

Job Highlights Do you thrive in a fast-paced, multi-disciplinary team in an ever-changing work environment? As a Big Data Engineer, you will have the opportunity to work on a variety of challenging and rewarding projects. You will work directly with stakeholders and Data Analysts … and add core tools to an analytical suite. You will support the National Geospatial-Intelligence Agency (NGA) to process ETL on new and varied data sets, and work with Big Data at scale, using Spark/PySpark to handle petabytes of data. As an immediate liaison with the … you will have a deep understanding of their current and upcoming mission needs, generating requirements based on their input. Working with a variety of data types, including Technical Telemetry Data, Computer Network Cyber data, and other forms of telecommunication protocol data types, such as cellular, wi More ❯

Senior Data Engineer Malaga - Relocation Package Available 2 days a week in the office €60,000 - €100,000 English & Russian Speaking This company are one of the biggest and most successful businesses within their niche FinTech market space and have massive plans to build brand new Tech, Data … countries and picked up numerous awards within the industry. They partner with some of the biggest global FinTech companies and process lots of different data variants which is where this role comes in. They are looking for a Senior Data Engineer to contribute to their growing data platform, where they develop infrastructure for their data finance product suite. You will ideally have come from a FinTech background, have good previous experience working as a Data Engineer and have worked with the majority of skills listed below. This role is based in Malaga, Spain More ❯

be part of something greater, you are in the right place. Northrop Grumman Aeronautics Systems has an opening for a Principal or Sr. Principal Data Engineer to join our team of qualified, diverse individuals located onsite in Rancho Bernardo, CA. Join our team and build scalable pipelines from … the ground up. You will play a key role in designing, developing, and maintaining modern, optimized, and high-performance data storage solutions. If you enjoy collaborating with data scientists, analysts, and software engineers to integrate and process data efficiently, we'd love to hear from you! Accomplish … In this role you will design, build, and maintain scalable ETL (Extract, Transform, Load) pipelines using Python, while developing and optimizing data storage solutions, and ensure data integrity, security and best practices are followed. The ideal candidate should have a background in Software Engineering, with a particular focus More ❯

Data Engineer Ongoing contract (Client maintains right to hire after 3 months though rarely exercises this right) Location: Alpharetta, GA C2C Pay Rate: $65.00 Responsibilities: Design, build, and optimize scalable data pipelines for batch and real-time processing. Work extensively with Hadoop ecosystem components including HDFS, MapReduce … Hive, and Spark. Implement and manage cloud-based data warehousing solutions, with a focus on Snowflake, including architecture, data manipulation, and performance tuning. Apply best practices for data ingestion, transformation, data quality validation, and secure data handling. Develop robust data models that support efficient … storage, access, and analytics in a warehousing environment. Requirements: Strong proficiency in Python, Java, and SQL. In-depth knowledge of Big Data frameworks: HDFS, MapReduce, Hive, and Spark. Expertise in Snowflake: architecture design, data manipulation, and query optimization. Hands-on experience in core data engineering concepts: ingestion More ❯

Lead AWS Data Engineer 📍 City of London (Hybrid: Around 2-3 office days per week) 💰 Salary: Up to £120,000 🏦 Industry: FinTech/RegTech A 200-employee data and technology company specialising in Regulatory Technology (RegTech) are looking for a Lead AWS Data Engineer. They develop … products that enhance data quality and help financial institutions navigate regulatory compliance. The Role The Lead Data Engineer will provide technical leadership to a small team of Data Engineers (onshore & offshore), driving the design, implementation, and optimisation of scalable data solutions in AWS. Key Responsibilities … Lead and mentor a team of onshore and offshore Data Engineers, driving technical growth and ensuring effective collaboration. Design, develop, and optimise scalable data pipelines and infrastructure using AWS (Glue, Athena, Redshift, Kinesis, Step Functions, Lake Formation). Utilise PySpark for distributed data processing, ETL, SQL querying More ❯

Lead AWS Data Engineer 📍 City of London (Hybrid: Around 2-3 office days per week) 💰 Salary: Up to £120,000 🏦 Industry: FinTech/RegTech A 200-employee data and technology company specialising in Regulatory Technology (RegTech) are looking for a Lead AWS Data Engineer. They develop … products that enhance data quality and help financial institutions navigate regulatory compliance. The Role The Lead Data Engineer will provide technical leadership to a small team of Data Engineers (onshore & offshore), driving the design, implementation, and optimisation of scalable data solutions in AWS. Key Responsibilities … Lead and mentor a team of onshore and offshore Data Engineers, driving technical growth and ensuring effective collaboration. Design, develop, and optimise scalable data pipelines and infrastructure using AWS (Glue, Athena, Redshift, Kinesis, Step Functions, Lake Formation). Utilise PySpark for distributed data processing, ETL, SQL querying More ❯

Data Engineer An exciting opportunity has arisen for a skilled Data Engineer to support a government department in transitioning a successful proof-of-concept (PoC) business intelligence and data warehousing solution into a fully operational, production-ready platform. Over a four-year period, a PoC … technology options aligned with the departments long-term digital strategy. Through agile delivery and close collaboration, the organisation significantly improved its understanding of internal data assets and the Microsoft technology ecosystem, enhancing its reporting capabilities and data-driven decision-making. The next phase of this programme will involve … more specialist teams contributing to key technical milestones along the roadmap. Key Responsibilities: The successful candidate will be responsible for designing and implementing robust data engineering solutions within a Microsoft Azure environment. Key tasks will include optimising data pipelines, enhancing security configurations, and contributing to the overall architecture More ❯

Data Engineer An exciting opportunity has arisen for a skilled Data Engineer to support a government department in transitioning a successful proof-of-concept (PoC) business intelligence and data warehousing solution into a fully operational, production-ready platform. Over a four-year period, a PoC … options aligned with the department’s long-term digital strategy. Through agile delivery and close collaboration, the organisation significantly improved its understanding of internal data assets and the Microsoft technology ecosystem, enhancing its reporting capabilities and data-driven decision-making. The next phase of this programme will involve … more specialist teams contributing to key technical milestones along the roadmap. Key Responsibilities: The successful candidate will be responsible for designing and implementing robust data engineering solutions within a Microsoft Azure environment. Key tasks will include optimising data pipelines, enhancing security configurations, and contributing to the overall architecture More ❯

Role: Senior SQL Data Engineer Location: Wolverhampton, West Midlands Hybrid working: go into office 3 days a week Salary: £55,000 - £70,000 (dependent on experience) Insight into the Company: This organisation is a large, well-established bank who are looking to expand their existing Data Engineering … team. You would be coming into a team of 10 Data Engineers as a Senior Data Engineer, and be responsible for maintaining the SQL Server, using T-SQL and building ETL pipelines. The ideal candidate will have experience working in the financial sector and working with end … SSRS Skills and Experience: Essential to have experience with: Expert level SQL and T-SQL ETL pipelines SSRS Stakeholder skills Interview Process Interview with Data Engineering Manager Interview with Data Engineering Manager and Senior Data Engineer on the team, including T-SQL tech test and soft More ❯

Job Number: R Software and Data Engineer The Opportunity: As a Software and Data Engineer, you're excited at the prospect of unlocking the secrets held by a data set, and you're fascinated by the possibilities presented by IoT, quantum computing, machine learning, and … artifi cia l intelligence. If you care about moving a mission forward as much as advancing the fields of data science and software engineering, this is the opportunity for you. Your deep data and systems architecture expertise, coupled with an original approach to your work, will help clients … and stakeholders make sense of their data and encourage actionable results. We're looking for someone like you to lead complex data exploration and analytics projects through your experience with Python and C++, discrete event simulators, and high-performance computing architectures for the national security industry. As a More ❯

Senior Data Engineer role at a fast-growing media agency. Salary to £70,000 + benefits. You must have previous experience within a media related business to be considered for this role. We're looking for someone that is skilled in both SQL and Python (with PySpark/… with the resources of a global network. This is an agency where individuality and inclusion are championed, and bold ideas thrive. The role Senior Data Engineer Shape the Future With Data As a Senior Data Engineer , you’ll lead the way in transforming how data drives decision-making and innovation. You’ll design cutting-edge pipelines, build automation frameworks, and enable seamless collaboration between analysts and data scientists. This is your chance to work across high-profile projects, from scaling infrastructure to developing advanced analytics solutions, while mentoring a talented team of junior More ❯

Data Engineer (UKIC DV Clearance) Remote £75,000 - £90,000 + Training + Progression + Company Benefits Are you a Data Engineer with developed vetting looking to join on of the worlds most renowned multinational technology businesses where you will be working on some of the … of how quickly you progress with access to constant personal and professional development opportunities? On offer is the exciting opportunity for a Linux Infrastructure Engineer who currently has developed vetting to join one of the world's most well known, multinational, technology business who have consistently been in the … this global tech giant as well as a vital role within the UK and Global Defence industry. In this role, the successful Linux Infrastructure Engineer will be responsible for both continuous improvement and continuous deployment across many different projects and teams. The ideal Data Engineer would have More ❯

Data Engineering Vacancies - Mid to Lead Level - Leeds I am working with a brand new client, and end user based in Leeds who are building an exciting data practice, doing some highly advanced work in the data space. Salary and Benefits Highly comptetitive salary of £60k - £120k … DOE) 3-5 days per week in Leeds office Competitive annual leave package And many more Role and Responsibilities Design and manage Snowflake-based data pipelines, ensuring data flows seamlessly from multiple sources into the data platform. Collaborate with business stakeholders and data analysts to identify … data requirements and deliver the appropriate solutions. Ensure the integration of structured and unstructured data sources into Snowflake, optimizing data models for reporting. Work with data analysts to support their data needs and optimize semantic models for Snowflake-based reporting and analytics. Implement data More ❯

PRINCIPAL DATA ENGINEER LONDON BASED £90,000-100,000 PER ANNUM This retailer are searching for a new Principal Data Engineer to take responsibility for the development of the company's cloud platform in Azure. You will also build new Data Pipelines using Python and … SQL. THE COMPANY This fast-growing international company is seeking a Principal Data Engineer to join their growing Data and Analytics team. They are currently active in over 30 countries and are looking to grow even more. THE ROLE Joining a growing team, you will take responsibility … for the direction and development of the internal data platform. You will liaise with stakeholders across the business and help impact future decisions across the company. Monitor and maintain existing pipelines using Python. Work and maintain in the company's cloud database on Azure Implement best coding practices. SKILLS More ❯

Fabric Data Engineer I am working with a data driven Microsoft partnered consultancy who are looking for a Fabric Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects … on Fabric implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design to insights … creation. As part of this role, you will be responsible for some of the following areas Design, develop and maintain data pipelines that are responsible for the ingestion and transformation of data between different sources Create and develop data models Development of cloud data platforms solutions More ❯

STAFF DATA ENGINEER LONDON BASED £100,000-110,000 PER ANNUM This insurance company is searching for a new Staff Data Engineer to take responsibility for the development of the company's cloud platform in Azure. You will also build new Data Pipelines using Python … and SQL. THE COMPANY This fast-growing international company is seeking a Staff Data Engineer to join its growing Data and Analytics team. They are currently active in over 30 countries and are looking to grow even more. THE ROLE Joining a growing team, you will take … responsibility for the direction and development of the internal data platform. You will liaise with stakeholders across the business and help impact future decisions across the company. Monitor and maintain existing pipelines using Python. Work and maintain in the company's cloud database on Azure Implement best coding practices. More ❯

SHC Federal is seeking a Senior Data Engineer to join a mission critical, talented team of data engineers, scientists, and analysts within the federal space in Herndon, VA or Chantilly, VA. This person must have extensive experience designing and developing data systems within an AWS environment … Engineering, Computer Engineering or similar discipline OR the equivalent education, technical training, and/or work/military experience 3+ years of software/data engineering experience Experience coding in Python Experience working in an AWS environment as a data engineer working with enterprise ETL Responsibilities: Focus … on continual process improvement with a proactive approach to problem solving Design scalable reliable data pipelines using AWS services Build ETL workflows to process structured and unstructured data, leveraging AWS services Collaborate with other data engineers and architects implement and optimize data architectures supporting large-scale More ❯

Data Engineer We are on the lookout for a Data Engineer who will play a key role in analysing, documenting, and implementing data solutions to enable analytics across the business. You’ll play an integral part in claims and supporting management information dashboards through the … automation and streamlining of data processes. What you’ll be doing: Build and maintain data warehouses on the Azure Cloud and create one source of truth data sets to drive consistency and ease of business reporting Work with multiple business customers (Underwriting, Operations, Technical Accounts, Finance, Actuarial … Claims etc.) to collate, update and balance monthly/quarterly data by implementing repeatable automated processes Liaise with business customers and IT to produce accurate Management Information and data flow automation, including data reconciliation with Finance, Technical Accounts, and Actuarial departments Interact with IT, Underwriting, Operations, Technical More ❯

Data Engineer We are on the lookout for a Data Engineer who will play a key role in analysing, documenting, and implementing data solutions to enable analytics across the business. You’ll play an integral part in claims and supporting management information dashboards through the … automation and streamlining of data processes. What you’ll be doing: Build and maintain data warehouses on the Azure Cloud and create one source of truth data sets to drive consistency and ease of business reporting Work with multiple business customers (Underwriting, Operations, Technical Accounts, Finance, Actuarial … Claims etc.) to collate, update and balance monthly/quarterly data by implementing repeatable automated processes Liaise with business customers and IT to produce accurate Management Information and data flow automation, including data reconciliation with Finance, Technical Accounts, and Actuarial departments Interact with IT, Underwriting, Operations, Technical More ❯

10951SJR £80k - 85k per year + benefits Principal Data Engineer - REMOTE WORKING We are working with one of our biggest customers who are a leading force in the financial services sector. The company is based in Hampshire and the role is remote with occasional trips to the office … when required. As a Principal Data Engineer, this involves designing scalable solutions, optimising data systems, and collaborating with various teams to support data-driven decision-making. You will also mentor junior engineers, ensuring best practices and innovative techniques are implemented to enhance overall data infrastructure … and strategy alignment with business goals. Main Responsibilities include: Develop, design, and test data deliveries throughout the development lifecycle. Train and coach developers. Manage day-to-day data delivery tasks. Collaborate with stakeholders to align data solutions with organizational objectives. Design and implement scalable, high-performance data More ❯

Principal Data Engineer/Architect (Python) Remote UK to £120k Are you a data centric technologist? You could be progressing your career in a senior, hands-on role at a scaling, global technical services company as they look to expand their product offerings with a new SaaS … data analytics platform. As a Principal Data Engineer/Architect you will head up the engineering for the new platform, building the PoC product from the ground up and in time creating a team around you. You'll be responsible for the architecture and design, building a … highly scalable SaaS offering that is customer facing and compliant with SOC and ISO27001 standards. The application will ingest customer data from multiple sources and aggregate, manipulate, model and build calculations and transformations based on the customers' analytical requirements and make the information available on a presentation layer. This More ❯

Position Description: Looking for a self-motivated data engineer to join our team at CGI. Learn and implement new technology and advanced analytical tools in a cooperative encouraging environment. Looking for an individual who can work independently creating data flows, improving ingest times, troubleshooting ETL errors. This … position is located in Arlington, VA. Your future duties and responsibilities: Create and maintain data flows for data ingestion into data warehouse. Help migrate current data pipelines to new technology. Provide support to data modeling teams. Troubleshoot issues in different environments (Dev/Stage/… Prod) Required qualifications to be successful in this role: Strong team development and organizational skill sets. Trouble shooting skills ETL tool experience Programming experience Data Modeling Experience interacting with clients, stakeholders, and executives. Experience in using cloud platforms such as AWS, Azure, and Google Cloud. Experience in communicating both More ❯

Data Engineer – Azure Location: Birmingham, UK Amtis is delighted to recruit for an exciting opportunity for a Data Engineer to join a brilliant company based in Birmingham. Key Responsibilities Collaborating with internal customers to document requirements. Integrating and modelling data from multiple sources for analytics. … Developing and testing complex BI apps. Creating data pipelines and migrating existing solutions to Microsoft Fabric. Supporting business users in self-service app development. Enhancing BI services with advanced data science capabilities. Providing routine BI service support and incident resolution. Ensuring data quality and completeness. Adhering to … governance requirements and handling ad-hoc requests. Required Skills Extensive experience in data analytics development. Proficiency in data engineering and complex data modelling using Fabric/Azure. Expertise in app/DWH development and support with Microsoft Azure/Power BI. Experience with ETL and SSIS development. More ❯

Senior Data Engineer (Microsoft Fabric) 💼 Permanent | 📍 London (Hybrid - 2 days onsite) | 💷 £60k-£70k | ❌ No sponsorship Our client is shaping the future of data and they need a Senior Data Engineer to help lead the way! You'll design and build cutting-edge data solutions … using Microsoft Fabric and Azure, working closely with technical and business teams. You'll also mentor junior engineers and drive best practices across modern data platforms. ✅ Hands-on with Azure Data Factory, Synapse, and Fabric ✅ Strong SQL & Python skills ✅ Experience across ETL/ELT, data lakes, modelling … Fabric Analytics certification highly desirable. Important: Must have the right to work in the UK - no sponsorship offered. Ready to build the future of data? Apply now! Desired Skills and Experience Senior Data Engineer (Microsoft Fabric) 💼 Permanent | 📍 London (Hybrid - 2 days onsite) | 💷 £60k-£70k | ❌ No sponsorship More ❯

your ambition to work every day, which is why, at British Airways the sky is never the limit. We are looking for talented Principal Data Engineers with deep technical data platform engineering skills including SQL, AWS, Snowflake, Airflow, Git, and Python. As a Principal Data Engineer, you'll serve as a technical lead overseeing Senior Data Engineers, driving industry best practices to build a world-class data engineering function and providing direction for engineering a modern data platform. You'll lead end-to-end data product development in an Agile environment … contributing to British Airways' renowned service and shaping the future of our business. Your responsibilities will include: Bringing an innovative and creative mindset to data engineering challenges to develop a modern data platform with efficient reusable components Developing the BA Data Engineering community of practitioners Leading or More ❯