276 to 300 of 674 Data Engineer Jobs

Job Description Job Title: Data & AI Engineer, Associate Manager CL8 Locations: London, Bristol or Manchester Salary: Competitive salary and package (Depending on level of experience) Please Note: Any offer of employment is subject to satisfactory BPSS and SC security clearance which requires 5 years continuous UK address history (typically including no periods of 30 consecutive days or more … to all of us." - Julie Sweet, Accenture CEO Qualification Key responsibilities • Deploy machine learning models to production and implement measures to monitor their performance • Implement ETL pipelines and orchestrate data flows using batch and streaming technologies based on software engineering best practice • Define, document and iterate data mappings based on concepts and principles of data modelling • Re … engineer data pipelines to be scalable, robust, automatable, and repeatable • Navigate, explore and query large scale datasets • Build processes supporting data transformation, data structures, metadata, dependency and workload management • Identify and resolve data issues including data quality, data mapping, database and application issues • Implement data flows to connect operational systems, data More ❯

Calling for a Lead Data Engineer to join our Housing sector client in London. This is a hybrid contract role: 2 days onsite - 3 days remote. Our client is looking for an experienced Lead Data Engineer with the following skill set: Experience with Azure data services, Azure Data Factory (ADF), API development and integration … Databricks, Python programming, Unit testing, GIT version control, Data management and data governance, Data security. If this is you, get in touch ASAP and send us your CV More ❯

ClearanceJobs' client, a government contractor, is looking to hire a Data Engineer on a full-time, permanent basis. This position must be performed onsite in Tysons Corner, VA and requires an active Secret security clearance (minimum). After a probationary period, this opportunity also offers flexibility to work a hybrid schedule. About the Role: We are seeking a … motivated and detail-oriented Data Engineer to support our team. This role is ideal for candidates with a solid foundational knowledge of computer systems engineering and a passion for growing their skills in big data and cloud technologies. You will be working in a team of data engineering specialists, contributing to the development and maintenance of … advanced data pipelines and supporting various analytical initiatives. Responsibilities: • Assist in the development and maintenance of data pipelines using Spark, Scala, PySpark, and Python. • Support the deployment and management of AWS services including EC2, S3, and IAM. • Work with the team to implement and optimize big data processing frameworks such as Hadoop and Spark. • Help with the More ❯

Data Engineer - GCP | £500-£550 per day | Inside IR35 6-Month Contract | Hybrid (2 Days Onsite - Osterley) 83zero are partnered with a leading media and broadcasting organisation on the lookout for a skilled Data Engineer to join their Data & Analytics team on an initial 6-month contract . This role is perfect for someone with … strong ETL expertise , deep experience in Google Cloud Platform (GCP) , and a passion for building scalable, cloud-native data pipelines. You'll work with cutting-edge tech in a fast-paced environment, helping to deliver critical insights and analytics to the business. What You'll Be Doing: Designing and developing scalable ETL pipelines to process and deliver large volumes … Dataflow . Automating infrastructure using Terraform , Ansible , and CI/CD tooling. Writing clean, efficient code in Python , Go , and BASH . Supporting and maintaining a secure Linux-based data engineering environment. Collaborating with stakeholders to ensure data pipelines meet business needs and SLAs. What We're Looking For: Proven experience in data engineering with a strong More ❯

The Swift Group is a privately held, mission-driven and employee-focused services and solutions company headquartered in Reston, VA. Our capabilities include Software Development, Engineering & IT, Data Science, Cyber Enablement, Logistics, and Training. Founded in 2019, Swift supports Civilian, Defense, and Intelligence Community customers across the country and around the globe. We are looking for a skilled Senior … Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and managing scalable data pipelines and infrastructure, with a focus on AWS cloud services. You will collaborate with cross-functional teams to support data-driven applications and analytics, ensuring efficient data flow and accessibility. The ideal candidate will … thrive in an Agile project management setting and possess a strong background in data management and processing. The position is in Herndon, VA. Responsibilities: Design and implement robust data pipelines and ETL processes to ingest, transform, and load data from diverse sources into data warehouses Develop and maintain data models and schemas to support analytics More ❯

Data Engineer Contract to Permanent Skills: Python, Pandas Hybrid London Rate: c400/day (outside) & 70k Transform Sustainability with Smart Data Simulations. Ready to code for a cleaner future? A cutting-edge sustainability start-up based in Central London is seeking an experienced Data Engineer to help transform how businesses reduce their carbon footprint. If … you're fluent in Python, a master of Pandas, and passionate about building analytical models with customer data, this role offers you purpose and impact. What you’ll be doing Designing and implementing robust data pipelines Building simulations to model complex real-world customer behaviours Working with large and intricate data sets to uncover actionable insights Collaborating … with analysts, scientists, and product teams to turn data into sustainable solutions What we’re looking for Proven experience with Python and Pandas, especially in data analysis and simulation building A keen eye for data accuracy and insight generation Passion for sustainability and applying data to drive environmental progress Agile mindset with a start-up energy More ❯

Data Engineer, Pricing and Promotions Science Data and Insights Are you passionate about developing the next generation of data infrastructure capable of handling complex, mission-critical data pipelines and analytics workloads? Do you want to build next generation data engineering solutions that leverage the latest AWS technologies to process a broad range of business … and customer data? Join our Pricing & Promotions Science, Data and Insights team, where you'll have the opportunity to continuously improve the systems that enable Amazon's annual worldwide revenue of billions of dollars. Key job responsibilities - Design, build, and operate highly scalable, fault-tolerant data processing systems using modern AWS services like Redshift, S3, Glue, EMR … Kinesis, and Lambda, and orchestration systems using Airflow - Leverage your expertise in Python, Scala, or other modern programming languages to develop custom data processing frameworks and automation tools - Collaborate closely with data scientists, analysts, and product managers to understand business requirements and translate them into technical solutions - Continuously optimize data pipeline performance, reliability, and cost-efficiency using More ❯

This is a full-time hybrid role for a Data Engineer located in Greater London, with opportunities for remote work. The Data Engineer will be responsible for designing, implementing, and maintaining data pipelines and architectures. Daily tasks include developing data models, performing ETL processes, managing data warehouses, and conducting data analytics to … support business objectives. What we're looking for Required skills and experience Experience in Data Engineering and Data Modeling Proficiency in Extract Transform Load (ETL) processes and Data Warehousing Strong skills in Data Analytics Excellent problem-solving and analytical skills Ability to work collaboratively in a hybrid work environment Bachelor's degree in Computer Science, Information More ❯

Overview: A leading global trading firm is seeking a Data Engineer to join their London office, working closely with many of their trading teams. This role sits within a team that focuses on building and maintaining mission-critical data infrastructure that supports trading and research strategies across commodities and macro markets. What you'll be doing: You … ll play a vital role in the data lifecycle, including: Designing and maintaining robust ETL/ELT pipelines for alternative and macroeconomic datasets Collaborating directly with traders and researchers to align data with trading strategies Building scalable and reliable data architectures Who you are: A data engineer with at least 2 years of experience, preferably … in trading environments Expert in Python development and comfortable in DevOps/Linux environments Deep experience with data pipeline tools and frameworks (ETL/ELT) What's on offer: Market-leading compensation Catered breakfasts and lunches Commuter and parking benefits Opportunity to contribute to a highly dynamic and technically sophisticated environment If you're a data engineer More ❯

to help businesses effectively. You'll be encouraged to identify and draw attention to opportunities for enhancing our delivery and providing additional services to organisations we work with. The Data Engineer role is part of the Chief Data Office function and reports into our Data Engineering manager. It is a critical role to deliver on our … vision which is to empower every colleague and client of BDO with data. You will be working as part of a multi-disciplinary team of data and analytics managers, data analysts and fellow data engineers to develop and manage data products that can empower our people to make decisions from data to drive growth activities … and bring efficiencies to our processes. You will be working on a greenfield cloud platform and will play a key role in building out data products that drive value for the firm. In this busy and rewarding role you'll also: Ingest from a variety of source types Transform raw data to curated Provision curated data sets More ❯

APK Solutions is a government contractor providing professional and technical services to the intelligence community. We are currently looking for a Data Engineer to join our winning team and provide support to our McLean, VA customer. Job Details: Position: Data Engineer Location: McLean, VA Clearance: TS/SCI with Full Scope Polygraph. Salary Range … Job Description: Develop new tools, code & services to execute data engineering activities. Activities include the following tasks: Movement of structure & unstructured data using approved methods. Execute data ingestion activities for storing data in a local or enterprise level location. View data in its source format. Develop code to format data that supports exploration. Analyze … source data formats & work with Data Scientists & partners to determine the formats & transforms that best meet mission objectives. Develop code and tools to provide one-time & on-going data formatting & transformations into enterprise or boutique data models. Implement existing ETL code & best practices/standards. Develop an ETL Code Transition Plan. Develop & deliver documentation for each More ❯

Data Cable Installation Engineer (Data Communication) £35,000 - £40,000 + Van and Fuel Card + Training + Overtime + Flexible Hours Bradford, West Yorkshire Are you a Data Cable Installation Engineer or similar who wants to work for a growing company within a closeknit team who will provide tailored, on the job training, making … you an expert in setting up and installing a range of AV and data equipment across England? On offer is the opportunity to join a growing installation business who have worked all over England for over 25 years setting up and installing AV and network infrastructure equipment for a range of industries. They are looking for an AV Electrician … team and assist with technical installations in a role where no two days are the same. This role would see you travel the country setting up audio visual and data communication equipment. You will be working within a team to set up these systems, lending a hand to other works when needed to ensure that projects are completed on More ❯

Data Engineer (Databricks) - Leeds Our client is a global innovator and world leader with a highly recognizable name within technology. They are looking for Data Engineers with significant Databricks experience to join an exceptional Agile engineering team. We are seeking a Data Engineer with strong Python, PySpark, and SQL experience, a clear understanding of Databricks … and a passion for Data Science (R, Machine Learning, and AI). Database experience with SQL and NoSQL databases such as Aurora, MS SQL Server, and MySQL is expected, along with substantial Agile and Scrum exposure and adherence to SOLID principles. Experience with Continuous Integration tools, Infrastructure as Code, and strong Cloud Platform knowledge, ideally with AWS, is also … key. We are keen to hear from talented Data Engineer candidates from all backgrounds. This is a truly exciting opportunity to work for a prestigious brand that will significantly enhance your career. The company invests heavily in training and career development, offering unlimited career progression for top performers. Location: Leeds Salary: £40k - £50k + Pension + Benefits To More ❯

Data Engineer - Azure Data Factory - Remote contract for initial 6 months Outside IR35 with rate of £(Apply online only) available We are looking for a strong Data Engineer with Azure (Including ADF, Azure Data Factory) experience. A large part of the role will be to deliver the Data Pipeline Development and subsequent Performance … Tuning. Building ETL processes using Azure Data Factory. We are looking for skills in the following areas - Azure including Azure Data Factory and Azure SQL Database - ETL (Extract, Transform, Load) - Knowledge of SQL and C# - Experience with Data warehousing concepts and practices - Some exposure Azure DevOps for pipeline integration. This is a fully remote role with interviews More ❯

Software/Data Engineer Who We Are : Veson Nautical is a well-established and rapidly growing software company working to provide end-to-end logistical, operational, and analytical solutions to propel the efficiency and effectiveness of Maritime Commerce. The Opportunity: In this role, you'll contribute to the development and maintenance of our Data Lake (Snowflake) product … supporting best practices across teams. As a Software/Data Engineer, you'll help design and implement software components, working with others to balance new improvements with ongoing stability. You'll collaborate closely with team members, engineering leads, and product managers to deliver value to clients, and assist in resolving technical issues to support smooth delivery. Our Stack … two is preferred. A Closer Look at the Role This role will provide opportunities to get your hands on various tasks/technologies such as: Develop and support scalable data storage solutions using Snowflake under the guidance of senior engineers. Write and optimize SQL queries within the Snowflake environment, identifying and resolving performance issues with support when needed. Contribute More ❯

Job Title: Data Engineer Location: London Employment Type: Permanent Salary: up to £80,000 + bonus and benefits The Company Our client, a major player in the reinsurance sector is looking to hire a skilled and driven Data Engineer to support the evolution of its internal data solutions. This position offers the opportunity to own … and enhance core data flows that underpin critical business applications.You’ll play a central role in maintaining data quality, integrating systems, and ensuring data is accessible for analytics and decision-making across the business. The role involves close collaboration with stakeholders and offers the chance to contribute to both operational processes and strategic projects. Key Responsibilities: Take … ownership of a central data integration tool and lead its ongoing development and optimisation. Finalise and improve data pipelines to deliver clean, structured datasets across business functions. Design and apply monitoring processes to maintain data quality and integrity. Produce clear and well-documented code and data flows to support transparency and future maintenance. Carry out peer More ❯

Data Engineer Location: Herndon/Chantilly Schedule (FT/PT): Full Time Clearance: Full Scope Poly Salary: $200-250K or $125-$160/hr 1099 Data Engineer supports enterprise Extract, Transform, and Load (ETL) activities to deliver data to both humans and systems. Move structured and unstructured data using approved methods. Execute data ingestion activities for storing data in a local or enterprise level location. Develop code to format data that supports exploration. Analyze source data formats and work with Data Scientists and partners to determine the formats and transforms that best meet mission objectives. Develop code and tools to provide one-time and on-going data extraction from various repositories, formatting and transformations into enterprise or standalone data models. Develop new ETL and perform O&M and enhancements on existing ETL code using best practices/standards. Develop and deliver documentation for each project including ETL mappings, code use guide, code location and access instructions. Location is Herndon or Chantilly (both locations are in More ❯

it. Channeling your inner grit will accelerate your growth, help us win as a team, and create unforgettable moments for our customers. The Crown Is Yours As a Senior Data Engineer, Games, you will help lead the design and implementation of reliable, scalable systems for transforming raw data into structured, usable formats that power data products … reporting, and operational workflows. You'll operate across varied business domains and play a critical role in aligning technical solutions with business strategy. Your work will enable clean, performant data solutions that drive impact at scale. If you're excited about solving complex data challenges in a fast-paced, high-growth environment, come join us and grow your … career at DraftKings. Your work will create the next generation of immersive, data-powered gaming experiences that captivate audiences worldwide. What you'll do as a Senior Data Engineer Dive into the world of DraftKings to understand the systems and data structures that support our products Work with engineering, product, and business teams to design data More ❯

Data Engineer Join a Trailblazing Team in Clinical Research Data ManagementStep into a role that places you at the cutting edge of clinical trials, leveraging Electronic Health Record (EHR) data to revolutionise patient care and research. Based in the innovative Manchester Science Park, this position offers the chance to be part of a world-leading organisation … this is usually on Tuesdays and Thursdays but can be subject to change. Strong benefits package This role focuses on the development, performance, management, and troubleshooting of ETL processes, data pipelines, and data infrastructure. The successful candidate will ensure the effective and reliable operation of these systems, adopting new tools and technologies to stay ahead of industry best … practices. Collaboration across teams to define solutions, requirements, and testing approaches is essential, as is ensuring compliance with regulatory standards.Key Responsibilities:- Design, develop, maintain, and optimise data pipelines, ETL processes, and databases.- Drive continuous improvement by refining processes and identifying new tools and standards.- Collaborate with cross-functional teams to define solutions and testing approaches.- Ensure compliance with regulatory More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development of … scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams … to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake as a data warehouse. Proficiency in Python More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development of … scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams … to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake as a data warehouse. Proficiency in Python More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development of … scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams … to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake as a data warehouse. Proficiency in Python More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development of … scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams … to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake as a data warehouse. Proficiency in Python More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development of … scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams … to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake as a data warehouse. Proficiency in Python More ❯

Lead Data Engineer - Remote - UK About the Role: We're hiring on behalf of a fast-growing, tech-driven organisation looking for a Lead Data Engineer to take ownership of their data infrastructure. This is a fully remote role open to candidates based anywhere in the UK. You'll lead the design and development of … scalable data pipelines, mentor a small team of engineers, and work closely with cross-functional teams to deliver high-impact data solutions. Key Responsibilities: Architect and maintain robust data pipelines using AWS services (Glue, Lambda, S3, Airflow) Lead the migration and optimisation of data workflows into Snowflake. Collaborate with analysts, data scientists, and product teams … to deliver clean, reliable data. Define and enforce best practices in data engineering and governance. Mentor junior engineers and contribute to a culture of technical excellence Requirements: Proven experience in a Lead or Senior Data Engineering role Strong hands-on expertise with AWS (Glue, Lambda, S3) Deep experience with Snowflake as a data warehouse. Proficiency in Python More ❯