526 to 550 of 746 Data Engineering Jobs

Senior Data Engineer (AI & MLOps) - Software - Newcastle/Hybrid or Remote Day rate: £300 - £500 (Inside IR35) Duration: 6 months Start: ASAP My new client is looking for a Senior Data Engineer with expertise in AI, MLOps, and AWS architecture to design and deliver production-grade machine learning pipelines. The ideal candidate will be passionate about bridging the … gap between data science experimentation and scalable production systems, driving automation, and enabling faster innovation cycles. Key Responsibilities Architect, build, and maintain production-grade ML Ops pipelines to automate deployment, monitoring, and scaling of machine learning models. Collaborate with data scientists and ML engineers to reduce time-to-production for experiments and prototypes. Design and optimize data … SageMaker, RDS, DynamoDB, Redshift, etc.) to build robust, scalable, and cost-effective solutions. Apply AIOps practices to enhance monitoring, automation, and resilience of ML systems. Implement best practices in data engineering, version control, CI/CD, and infrastructure as code. Ensure the security, reliability, and compliance of data pipelines and deployed ML solutions. Mentor junior engineers and More ❯

Lead Product Analyst Department: Data & Analytics Employment Type: Full Time Location: Cardiff Description Hybrid: 2 days per week in-office. Depending on experience, the internal title could also be Staff Product Analyst. In 2002, we became the first insurance comparison site. Our purpose is to make the process of sorting your insurance, utilities or personal finances as easy as … in touch today! About the role: As a Lead/Staff Analyst at you will be crucial in driving business impact and decision-making by bridging the gap between data and insight. We are looking for an analytical thought leader who will identify opportunities for deep analytics on customer behaviour and site performance by working closely with a variety … funnels and channels? What youinden What you'll be doing: Develop robust product analytics for our insurance products, including event tracking strategy, platform insights, and user behaviour analysis Manage data from its raw format to an output of comprehensive dashboards, creating compelling, actionable and high-value bespoke analysis that allow for data storytelling and decision making Collaborate with More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams through training sessions … and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and building models from scratch Solid understanding More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams through training sessions … and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and building models from scratch Solid understanding More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams through training sessions … and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and building models from scratch Solid understanding More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams through training sessions … and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and building models from scratch Solid understanding More ❯

Location: Huntsville, AL Work Type: Onsite Remote Work: No Job Description Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a Data Engineer, you know that organizing data can yield pivotal insights when it's gathered from disparate sources. We need … an experienced data engineer like you to help our clients find answers in their data to impact important missions-from fraud detection to cancer research to national intelligence. As a Data Engineer with us, you'll help build advanced technology solutions and implement data engineering activities on some of the most mission-driven projects in … the industry. You'll deploy and develop pipelines and platforms that organize and make disparate data meaningful. Here, you'll work with and guide a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. You'll use your experience in analytical exploration and data examination while you manage More ❯

Technical Pre-Sales Lead I am working with a global data and AI consultancy that is expanding its banking-focused Data Management practice and looking to bring on a Technical Pre-Sales Lead. This is a strategic, client-facing role where you'll partner with senior stakeholders to shape large-scale data transformation programs and drive cloud … adoption across banking and financial services. You'll join a collaborative environment focused on delivering measurable business outcomes through modern data architectures, cloud strategy, and reusable data products. With increasing demand for data-driven innovation and regulatory compliance, this is a fantastic opportunity to influence C-suite decisions and lead high-impact engagements. As part of this … role, you will be responsible for: Leading technical pre-sales engagements, including RFP/RFI responses and solution presentations. Designing enterprise-scale data platforms using a variety of cloud platforms including Azure, AWS, GCP, Databricks, Snowflake, and Fabric. Advising senior stakeholders on data strategy, governance, and innovation roadmaps. Overseeing technical workshops and shaping solution blueprints that win new More ❯

Technical Pre-Sales Lead I am working with a global data and AI consultancy that is expanding its banking-focused Data Management practice and looking to bring on a Technical Pre-Sales Lead. This is a strategic, client-facing role where you'll partner with senior stakeholders to shape large-scale data transformation programs and drive cloud … adoption across banking and financial services. You'll join a collaborative environment focused on delivering measurable business outcomes through modern data architectures, cloud strategy, and reusable data products. With increasing demand for data-driven innovation and regulatory compliance, this is a fantastic opportunity to influence C-suite decisions and lead high-impact engagements. As part of this … role, you will be responsible for: Leading technical pre-sales engagements, including RFP/RFI responses and solution presentations. Designing enterprise-scale data platforms using a variety of cloud platforms including Azure, AWS, GCP, Databricks, Snowflake, and Fabric. Advising senior stakeholders on data strategy, governance, and innovation roadmaps. Overseeing technical workshops and shaping solution blueprints that win new More ❯

a job - we offer a career path filled with growth and opportunities. Join us and let's shape the future together! Who We Are: We offer advanced services in data science, data engineering, software engineering, AI solutions, cybersecurity, staff augmentation, and IT program management. Passionate Integrity, Driven by Excellence "Ardent Principles" signifies our unwavering commitment to … to senior executives Oracle Cloud Computing Researching, evaluating, and developing security policies and guidance Performing complex technical tasks with minimal direction Bachelor's degree in Computer Science, Information Systems, Engineering, or other related scientific or technical discipline. One or more of the relevant certifications: o Certified Ethical Hacker (CEH) o Offensive Security Certified Professional (OSCP) o Global Information Assurance More ❯

Job Title: Data Engineer Job Description We are seeking a skilled Data Engineer to join an existing Market Access project. You will play a key part in building scalable data solutions that empower market readiness. 3 months initial contract Remote working ( UK based) Inside IR35 Responsibilities Design, develop, and maintain data pipelines using Palantir Foundry, PySpark … and TypeScript. Collaborate with cross-functional teams to integrate data sources and ensure data quality and consistency. Implement robust integration and unit testing strategies to validate data workflows. Engage with business stakeholders to understand requirements and translate them into technical solutions. Contribute to product-oriented thinking and help shape the data engineering roadmap. Essential Skills … Strong experience with Palantir Foundry. Proficiency in TypeScript and PySpark. Understanding of data integration and unit testing practices. Excellent communication skills and ability to work with non-technical stakeholders. Additional Skills & Qualifications Experience with OpenTelemetry is desired and beneficial but not needed Location Bracknell, UK Trading as TEKsystems. Allegis Group Limited, Maxis 2, Western Road, Bracknell, RG12 1RT, United More ❯

A rapidly growing specialist manufacturing business is looking to recruit a talented Data Engineer to join their newly established product development program, based in Abingdon (OX14) . This is an exceptional opportunity to be at the forefront of aerospace innovation, working with advanced materials and additive manufacturing to revolutionize jet engine performance. Data Engineer key responsibilities: Design and … maintain robust data logging frameworks to capture real-time jet engine performance metrics Build scalable data architectures for processing and analyzing complex experimental data Create versatile sandbox environments for rapid prototyping and fast iteration Own the data acquisition platforms that enable breakthrough testing capabilities Collaborate directly with testing engineers to ensure experiments are feasible from an … infrastructure standpoint Develop automated workflows for platform-agnostic post-processing and self-service data access Implement clean code practices with strict version control across code repositories Build dashboards and control systems for real-time test monitoring Enforce data security, privacy, and compliance standards Key requirements for Data Engineer: Minimum First Class Degree (MSc preferred) in Engineering More ❯

opportunity from one of our client. Please find the detailed job Description below. If you are interested, kindly forward your updated resume to at your earliest convenience. Job Title: Data Engineer Location: Madison, WISCONSIN - Onsite Duration: Long term Contract Job Description: A seasoned Data Quality/Data Analytics Engineer Contractor that will perform the following essential activities … which include, but are not limited to: Design and implement data quality rules in Informatica Data Quality (IDQ) to validate file formats, schema consistency, completeness, and business logic compliance. Establish and manage SLA monitoring frameworks to track external file delivery timeliness, frequency, and compliance with contractual or operational expectations. Create and maintain alerting and exception workflows for missing … late, or malformed file deliveries. Profile incoming data stored in Azure Blob Storage and loaded into Snowflake for issues such as null values, duplicates, schema drift, or logic violations. Work with data engineering teams to ensure seamless integration of validation steps into ingestion pipelines. Collaborate with business and governance stakeholders to define quality thresholds, acceptance criteria, and More ❯

with a Polygraph. Introduction: The Customer's business environment is fast-paced and dynamic. The Customer maintains a network, records system, and other analytical applications to collect and analyze data on the Customer's business operations. The Customer's goal is to improve the integrity and usability of its data collected during its day to day operation. It … performs this duty through the development of software systems. The Customer requires support specializing in development and maintenance of software that extracts, transforms, and loads data from various data formats into data models. The Customer also requires expertise that will appropriately secure those capabilities. Work Requirement: Software Development The Candidate shall work within a data engineering … extraction, transformation, and loading data. The Candidate shall assess and validate system integration requirements across Customer organization. The Candidate shall provide Operations and Maintenance (O&M) for Customer's data related software systems. The Candidate shall finesse cyber data models. Details: Labor Category: Software Engineer Position Title: Software Developer Position Level: Level 1 - Subject Matter Expert Salary: Up More ❯

Role Overview - We’re looking for a Data Scientist with a strong background in agrochemicals, crop science, or agricultural R&D , and a passion for working with live, streaming, or sensor-based data . You’ll help us build robust datasets from real-time field trials, integrate diverse data sources, and develop predictive models that guide product … development and deployment. Key Responsibilities Design and implement pipelines to ingest, clean, and structure live data from field sensors, drones, and environmental monitoring systems. Build scalable datasets that integrate genotype, environment, and management (GxExM) variables. Develop models to predict crop response to biostimulants under varying conditions. Collaborate with agronomists and plant scientists to ensure data relevance and accuracy. … Support regulatory and commercial teams with data-driven insights and visualizations. Requirements Experience in data science within agrochemicals, crop science, or precision agriculture. Strong skills in Python, R, or similar tools for data engineering and modeling. Familiarity with IoT/sensor data , time-series analysis, and cloud-based data platforms. Understanding of field trial More ❯

The AA, providing both stability and structure to support growth and innovation. We are the drivers of change. This is the job Are you passionate about designing cutting-edge data platforms that drive real business impact? Do you thrive in collaborative environments and enjoy mentoring others while shaping the future of data architecture? We're looking for a … Lead Platform Architect to join our Data & Analytics team. This is a pivotal role where you'll lead the design and implementation of scalable, secure, and high-performing data solutions, primarily leveraging Azure and Databricks technologies. What will I be doing? Architect and deliver end-to-end data platform solutions using Azure and Databricks , aligned with our … strategic frameworks. Own and develop technical solution architecture documents for key work packages. Collaborate across engineering teams and technical departments to ensure robust infrastructure design. Lead technical evaluations, pilots, and proof-of-concepts to inform design decisions. Champion best practices in data engineering, governance, and agile delivery. Mentor BI Platform Architects and contribute to the growth of More ❯

The AA, providing both stability and structure to support growth and innovation. We are the drivers of change. This is the job Are you passionate about designing cutting-edge data platforms that drive real business impact? Do you thrive in collaborative environments and enjoy mentoring others while shaping the future of data architecture? We're looking for a … Lead Platform Architect to join our Data & Analytics team. This is a pivotal role where you'll lead the design and implementation of scalable, secure, and high-performing data solutions, primarily leveraging Azure and Databricks technologies. What will I be doing? Architect and deliver end-to-end data platform solutions using Azure and Databricks , aligned with our … strategic frameworks. Own and develop technical solution architecture documents for key work packages. Collaborate across engineering teams and technical departments to ensure robust infrastructure design. Lead technical evaluations, pilots, and proof-of-concepts to inform design decisions. Champion best practices in data engineering, governance, and agile delivery. Mentor BI Platform Architects and contribute to the growth of More ❯

The AA, providing both stability and structure to support growth and innovation. We are the drivers of change. This is the job Are you passionate about designing cutting-edge data platforms that drive real business impact? Do you thrive in collaborative environments and enjoy mentoring others while shaping the future of data architecture? We're looking for a … Lead Platform Architect to join our Data & Analytics team. This is a pivotal role where you'll lead the design and implementation of scalable, secure, and high-performing data solutions, primarily leveraging Azure and Databricks technologies. What will I be doing? Architect and deliver end-to-end data platform solutions using Azure and Databricks , aligned with our … strategic frameworks. Own and develop technical solution architecture documents for key work packages. Collaborate across engineering teams and technical departments to ensure robust infrastructure design. Lead technical evaluations, pilots, and proof-of-concepts to inform design decisions. Champion best practices in data engineering, governance, and agile delivery. Mentor BI Platform Architects and contribute to the growth of More ❯

Contract Data Scientist - Food Delivery | £400/day | London | 3-6 Months Join one of the UK's leading food delivery platforms as a Contract Data Scientist , where you'll play a key role in shaping data-driven decisions across logistics, customer experience, and product innovation. This is a hands-on opportunity to work with modern cloud … insights. Contribute to AI-driven initiatives, such as chatbots or recommendation engines. Communicate findings clearly to stakeholders and influence strategic decisions. What We're Looking For: Proven experience in data science or data engineering roles, ideally within consumer tech, logistics, or e-commerce. Strong proficiency in Python, SQL, and machine learning frameworks. Experience with cloud platforms (Azure More ❯

their team on an initial 6-month contract. Key skills/knowledge required: Deep knowledge of trading workflows, trade lifecycle events, and OMS integration patterns Understanding of capital markets data flows, trade settlement, reference data, and portfolio management processes Strong understanding of data modelling, data engineering workflows, and integration with front-office platforms Awareness of … regulatory and compliance considerations in capital markets delivery Understanding of modern engineering practices, including agile methodologies, DevOps, and cloud-native development Strong background in asset management or investment banking with hands-on delivery of capital markets solutions Minimum 3-5 years leading development teams in financial services environments Experience with OMS platform integration (any major platform - Aladdin, Murex, Charles … River, etc.) and understanding of trade lifecycle data flows Proven experience as a Tech Lead or Senior Engineer leading development teams in financial services Experience working directly with business and front-office stakeholders Track record of designing and delivering high-quality, scalable technical solutions Experience in SQL, Python, Snowflake, and AWS within data-intensive, cloud-based environments Desirable More ❯

Company Description At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for jobseekers and companies around the world to find a perfect match in fair and equitable way. With over 20 brands across 30+ countries, we strive for fair and unbiased hiring. … for ensuring quality throughout the whole software development cycle. You will guide and support others and lead the team by example with best testing practices. Working in the Commercial Data Solutions domain, you will work across multiple projects to identify potential issues, along with helping with refinement of requirements, and making informed judgement calls on the scope of testing … forgotten (accessibility, security, access control, etc.) Bring testing experience to the team and help other team members write good quality automated tests Help build a culture of ever-increasing data quality with a focus on all data quality dimensions and integratemetrics with centralized tools that measure data products quality and reliability in the organization Qualifications Understanding of More ❯

Data Engineer We’re looking for a Data Engineer with strong Python skills and experience in event-driven systems to join our growing data team. This isn’t your typical “pipelines-for-analysts” role -you’ll be building real-time systems that power applications, tooling, and commercial products across the business. What you’ll be doing: -Build … and maintain event-driven data pipelines that power Citywire’s Catalyst platform. -Design resilient, fault-tolerant workflows using AWS services such as Lambda, Kinesis, SQS, DynamoDB Streams, and EventBridge. -Implement processors that ensure data consistency across DynamoDB, PostgreSQL (Aurora), OpenSearch, and BigQuery. -Modernise legacy batch processes into stream-first architectures. -Build and integrate APIs to enable smooth publishing … greenfield and existing projects, balancing speed with resilience. -Take ownership of key pipelines and services, ensuring reliability, performance, and scalability. -Share best practices and mentor others in event-driven data engineering. What we’re looking for: -Technical Skills: Proven experience in data engineering or backend development, with solid Python skills and hands-on use of AWS event More ❯

Senior/Data Integration Specialist (Oracle & Azure) Department: Data & Technology Employment Type: Permanent - Full Time Location: UK (London) Description Senior/Data Integration Specialist London Hybrid, two days in office Permanent/full-time We are a fast-growing global reinsurance speciality company servicing the insurance markets of Lloyd's, Europe and North America. Due to growth … our Head of Data Management is looking for a driven Data Integration Specialist to lead on the ingestion of new deal data into our core Oracle Cloud claim system. This would suit someone with an insurance and Oracle technical background but who is keen to enhance their Azure and Databricks technical skills in the future. Responsibilities • Design … develop, and maintain Oracle ingestion packages using PLSQL Developer or similar IDE's or related tools • Design ADF/Databricks pipelines for non-Oracle data management activity • Collaborate with cross-functional teams to understand business requirements and design technical solutions • Work closely with stakeholders in claims, finance and actuarial to understand data needs and translate them into technical More ❯

Make your mark in a collaborative and purpose-driven team.** We are seeking a Senior AWS Data Engineer to join a leading organisation's AWS - Data team. This permanent, hybrid position requires you to work in the office two-three days a week in London. This is a great opportunity for candidates who are passionate about data engineering and want to contribute to impactful projects in a supportive environment. **Key Responsibilities:**- Develop and maintain AWS data pipelines and infrastructure.- Collaborate with cross-functional teams to design data solutions.- Optimise existing data processes for efficiency and performance.- Ensure data quality and security standards are met.- Stay up-to-date with AWS developments … and best practices.**Key Requirements:**- Proven experience with AWS services and tools.- Strong knowledge of data modeling and ETL processes.- Proficiency in programming languages such as Python or SQL.- Excellent problem-solving skills with a proactive approach.- Ability to communicate effectively within a team.If you are a skilled and driven AWS Data Engineer looking to make an impact More ❯

Make your mark in a collaborative and purpose-driven team.** We are seeking a Senior AWS Data Engineer to join a leading organisation's AWS - Data team. This permanent, hybrid position requires you to work in the office two-three days a week in London. This is a great opportunity for candidates who are passionate about data engineering and want to contribute to impactful projects in a supportive environment. **Key Responsibilities:** - Develop and maintain AWS data pipelines and infrastructure. - Collaborate with cross-functional teams to design data solutions. - Optimise existing data processes for efficiency and performance. - Ensure data quality and security standards are met. - Stay up-to-date with AWS developments … and best practices. **Key Requirements:** - Proven experience with AWS services and tools. - Strong knowledge of data modeling and ETL processes. - Proficiency in programming languages such as Python or SQL. - Excellent problem-solving skills with a proactive approach. - Ability to communicate effectively within a team. If you are a skilled and driven AWS Data Engineer looking to make an More ❯