1,451 to 1,475 of 1,843 Data Engineering Jobs

We’re seeking a Lead Data Engineer to design and deliver scalable data and AI solutions across internal and client projects. You’ll own the full data lifecycle — from ingestion and processing to deployment and monitoring of machine learning models — while leading a small, high-performing team. What You’ll Do Build and maintain data pipelines … cloud infrastructure (AWS/GCP). Develop AI-driven applications including LLM tools, RAG pipelines, and automation solutions. Lead on client communication , project delivery, and stakeholder alignment. Collaborate with Data Science and Analytics teams to improve data access, automation, and governance. Drive innovation through proofs-of-concept , model monitoring , and adoption of emerging AI tech. What We’re … Looking For 5+ years in data engineering, with team or project leadership experience. Advanced Python (Pandas, PyTorch, TensorFlow, Scikit-learn). Strong AWS/GCP , MySQL , and CI/CD experience; Docker/Kubernetes a plus. Excellent communication, organisation, and problem-solving skills. Passion for innovation and ethical, scalable AI. Nice to Have Experience in digital marketing or More ❯

We're seeking a Lead Data Engineer to design and deliver scalable data and AI solutions across internal and client projects. You'll own the full data life cycle - from ingestion and processing to deployment and monitoring of machine learning models - while leading a small, high-performing team. What You'll Do Build and maintain data … cloud infrastructure (AWS/GCP). Develop AI-driven applications including LLM tools, RAG pipelines, and automation solutions. Lead on client communication , project delivery, and stakeholder alignment. Collaborate with Data Science and Analytics teams to improve data access, automation, and governance. Drive innovation through proofs-of-concept , model monitoring , and adoption of emerging AI tech. What We're … Looking For 5+ years in data engineering, with team or project leadership experience. Advanced Python (Pandas, PyTorch, TensorFlow, Scikit-learn). Strong AWS/GCP , MySQL , and CI/CD experience; Docker/Kubernetes a plus. Excellent communication, organisation, and problem-solving skills. Passion for innovation and ethical, scalable AI. Nice to Have Experience in digital marketing or More ❯

learning and making predictions as defined by the business logic developed to meet customer requirements. The AI/ML Engineer should be proficient in all aspects of model architecture, data pipeline interaction, and metrics application, interpretation, and presentation. The AI/ML Engineer needs familiarity with foundational concepts of application development, infrastructure management, data engineering, and data … i.e. Python, Java, C++ decisions, meeting the evolving needs of our customers. With strong familiarity with Hadoop, we develop and deploy scalable AI/ML models that integrate with data pipelines, infrastructure, and applications. WHY JOIN US Providing ongoing training, mentorship, and development opportunities to help our cyber and intelligence professionals stay at the forefront of their field and … dental coverage. 401k retirement savings plan. Paid time off for work/life balance. And more Basic Qualifications: A Master's or Ph.D. degree in advanced math, artificial intelligence, data science, computer science or deep learning from an accredited college or university is required. Plus 5 years experience deploying machine learning algorithms is required. Or A Masters degree may More ❯

potential extension) Start: ASAP Rate: Market rate - Inside IR35 We’re looking for experienced PySpark + Fabric Developers to join a major transformation programme with a leading global financial data and infrastructure organisation. This is an exciting opportunity to work on cutting-edge data engineering solutions, driving innovation and performance at scale. Key Responsibilities Design, build, and … optimise data pipelines for both batch and streaming workloads. Develop and manage dataflows and semantic models to support analytics and reporting. Implement complex data transformations, aggregations, and joins with a focus on performance and reliability. Apply robust data validation, cleansing, and profiling techniques to maintain accuracy. Enforce role-based access, data masking, and compliance standards. Tune … Strong hands-on experience with PySpark (RDDs, DataFrames, Spark SQL). Proven ability to build and optimise ETL pipelines and dataflows. Familiar with Microsoft Fabric or similar lakehouse/data platform environments. Experience with Git, CI/CD pipelines, and automated deployment. Knowledge of market data, transactional systems, or financial datasets. Excellent communication skills and collaborative mindset. Desirable More ❯

the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. YOUR ROLE We are seeking a skilled and hands-on AWS Data Engineer with strong coding expertise and deep experience in building scalable data solutions using AWS services. The ideal candidate will have a solid background in data engineering, Python development, and cloud-native architecture. YOUR PROFILE Design, develop, and maintain robust data pipelines and ETL workflows using AWS services. Implement scalable data processing solutions using PySpark and AWS Glue. Build and manage infrastructure as code using CloudFormation. Develop and deploy serverless applications using AWS Lambda, Step Functions, and S3. Perform data querying and analysis … using Athena. Collaborate with Data Scientists to operationalize models using SageMaker. Ensure secure and compliant data handling using IAM, KMS, and VPC configurations. Containerize applications using ECS for scalable deployment. Write clean, testable code in Python, with a strong emphasis on unit testing. Use GitLab for version control, CI/CD, and collaboration. Strong coding background in Python More ❯

projects across multiple domains. Key Responsibilities Design, develop, and optimize Transformer-based architectures (GPT, LLaMA, Mistral, Claude) Fine-tune large language models for domain-specific applications Implement advanced prompt engineering strategies Leverage Retrieval-Augmented Generation (RAG) for enhanced contextual performance Build intelligent agents using frameworks like LangChain, LlamaIndex, CrewAI, AutoGen Apply reinforcement learning techniques including Q-learning , policy gradients … and RLlib Collaborate with cross-functional teams to integrate AI solutions into scalable products Ensure best practices in data engineering and contribute to architectural decisions Contribute to the mentoring and development of junior team members. Support senior team members in identifying and addressing data science opportunities. Required Skills & Experience Proven experience with Transformer models and LLMs (GPT … LLaMA, Mistral, Claude) Strong background in fine-tuning and prompt engineering Hands-on experience with RAG pipelines Familiarity with Agent Frameworks (LangChain, LlamaIndex, CrewAI, AutoGen) Solid understanding of reinforcement learning concepts and tools (Q-learning, policy gradients, RLlib) Azure AI Engineer Associate certification (or willingness to obtain) Bachelor's degree in a relevant field or equivalent combination of education More ❯

Data Science Engineer - MLOPS, Machine Learning, AI, Artificial Intelligence, Azure, PyTorch, TensorFlow, LangChain, OpenAI, Docker, Kubernetes, GenAI, ETL We are actively working with a global law firm who are actively looking to bolster their IT team as they undergo a global-scale cloud transformation. At present they are looking to take on a new Data Science Engineer (MLOPS … join a top-tier global law firm who have a long-stream of projects in the pipeline alongside a diverse and collaborative team environment. To be considered for this Data Science Engineer (MLOPS, Machine Learning, AI, Artificial Intelligence, Azure, PyTorch, TensorFlow, LangChain, OpenAI, Docker, Kubernetes, GenAI, ETL) role, it's ideal you have: Ideal but not required law firm … experience 2-4 years experience within AI/ML positions Knowledge of cloud platforms (Ideally Azure) AI/ML Frameworks Generative AI Data engineering knowledge Solution Delivery Design, build, and deploy data science and AI solutions end-to-end, from design and development through testing, release, monitoring, and support. Operationalize models with CI/CD pipelines, automated More ❯

Join the BBC as a Data Scientist apprentice and turn raw data into insights that shape audience experiences. Learn through hands-on projects and study, gaining skills in data science and earning a qualification. Be part of a creative, curious team helping drive the future of media. Role As a Data Scientist apprentice (DSD26), this is … a brilliant opportunity to learn, grow, and contribute – you will: Support the team in sourcing, cleaning, and preparing data for analysis and modelling. Learn to use data science tools (Python, Jupyter, cloud platforms) and apply them to real BBC projects. Assist in running experiments and evaluations of machine learning models, guided by senior colleagues. Contribute to simple visualisations … and reports that help communicate findings to the wider team. Stay curious about the latest developments in AI and data science and bring fresh ideas to discussions. Learn about the value of data to organisations like the BBC. Discover how the BBC uses data and increasingly AI technologies to improve its connection with audiences. Unlock the power More ❯

A leading global investment firm is seeking a Weather Data Engineer to help build proprietary weather analytics and infrastructure that directly powers alpha generation across its commodities trading strategies. This is a high-impact opportunity to work at the intersection of data engineering, meteorology, and AI-driven forecasting. Weather data is central to the firm's … edge - from raw satellite observations to climate simulations and proprietary model outputs. You'll be part of a specialist team driving innovation in how weather data is ingested, transformed, and deployed across the investment process. Responsibilities: Design and maintain scalable, cloud-native (AWS) pipelines for ingesting and processing real-time and historical weather data. Build robust APIs and data services to serve weather data and AI model outputs to researchers, quants, and traders. Support the development and deployment of proprietary forecasting models, including workflows for blending, debiasing, and fine-tuning. Collaborate with meteorologists, data scientists, and AI researchers to onboard new datasets and accelerate research. Implement automated data validation, monitoring, and alerting to ensure reliability More ❯

A leading global investment firm is seeking a Weather Data Engineer to help build proprietary weather analytics and infrastructure that directly powers alpha generation across its commodities trading strategies. This is a high-impact opportunity to work at the intersection of data engineering, meteorology, and AI-driven forecasting. Weather data is central to the firm's … edge - from raw satellite observations to climate simulations and proprietary model outputs. You'll be part of a specialist team driving innovation in how weather data is ingested, transformed, and deployed across the investment process. Responsibilities: Design and maintain scalable, cloud-native (AWS) pipelines for ingesting and processing real-time and historical weather data. Build robust APIs and data services to serve weather data and AI model outputs to researchers, quants, and traders. Support the development and deployment of proprietary forecasting models, including workflows for blending, debiasing, and fine-tuning. Collaborate with meteorologists, data scientists, and AI researchers to onboard new datasets and accelerate research. Implement automated data validation, monitoring, and alerting to ensure reliability More ❯

A leading global investment firm is seeking a Weather Data Engineer to help build proprietary weather analytics and infrastructure that directly powers alpha generation across its commodities trading strategies. This is a high-impact opportunity to work at the intersection of data engineering, meteorology, and AI-driven forecasting. Weather data is central to the firm's … edge - from raw satellite observations to climate simulations and proprietary model outputs. You'll be part of a specialist team driving innovation in how weather data is ingested, transformed, and deployed across the investment process. Responsibilities: Design and maintain scalable, cloud-native (AWS) pipelines for ingesting and processing real-time and historical weather data. Build robust APIs and data services to serve weather data and AI model outputs to researchers, quants, and traders. Support the development and deployment of proprietary forecasting models, including workflows for blending, debiasing, and fine-tuning. Collaborate with meteorologists, data scientists, and AI researchers to onboard new datasets and accelerate research. Implement automated data validation, monitoring, and alerting to ensure reliability More ❯

Data Engineer - Sought by Boutique Hedge Fund - Permanent - London Salary : £95 - 125k + Bonus About the Role : Build and operate data pipelines and analytics platforms in the cloud. Work with engineers and analysts to design, implement, and maintain reliable, observable ETL/ELT workflows using Airflow and managed cloud services. Focus on Python-first implementations, high-quality SQL … Airflow orchestration, and query engines such as Athena, Trino, or ClickHouse. Required Skills: Hands-on software development and data engineering experience. Must have strong financial or trading background. Strong Python & SQL skills: writing clean, testable code following SOLID principles. Hands-on experience using Athena, Trino, ClickHouse, or other distributed SQL engines and knowledge of cost/scan optimization. … Experience with cloud platforms (AWS/Azure/GCP): working with object storage, managed query services, and data catalogs. More ❯

Data Engineer - Sought by Boutique Hedge Fund - Permanent - London Salary : £95 - 125k + Bonus About the Role : Build and operate data pipelines and analytics platforms in the cloud. Work with engineers and analysts to design, implement, and maintain reliable, observable ETL/ELT workflows using Airflow and managed cloud services. Focus on Python-first implementations, high-quality SQL … Airflow orchestration, and query engines such as Athena, Trino, or ClickHouse. Required Skills: Hands-on software development and data engineering experience. Must have strong financial or trading background. Strong Python & SQL skills: writing clean, testable code following SOLID principles. Hands-on experience using Athena, Trino, ClickHouse, or other distributed SQL engines and knowledge of cost/scan optimization. … Experience with cloud platforms (AWS/Azure/GCP): working with object storage, managed query services, and data catalogs. More ❯

Mercator Digital is looking for a Data Specialist to be part of our growing consultancy. We're looking for a dynamic, forward-thinking Data Specialist with excellent communications that wants to learn new technologies and promote best practice. Role Expectations: Understand product owners needs to translate business requirements into analytics requirements and ensure that priorities are met. Create … visualisation of data, conduct deep-dive analysis and share insights & recommendations Ensure data collection and standardisation is met and explain methodologies to stakeholders Communicating efficiently and work together within a multi-disciplinary team, fostering the open and collaborative culture Enable data driven decision making to personalize the journeys of individuals to ensure they have the best and … most appropriate experience Produce product performance dashboards, user segmentation analysis, media agency tagging implementation Produce program dashboards and weekly analysis/information updates Experience Required : Cloud & Data Engineering: Proven experience with Google Cloud Platform (Projects, IAM, Storage, Dataprep), Azure SQL, Cosmos DB, and JSON data handling Digital & Web Analytics: Hands-on expertise with Google 360 (GA, GTM More ❯

ensuring scalability, security, and robustness. Make key decisions on infrastructure, cloud services, DevOps, and technical roadmaps. Establish and implement best practices, development standards, and technical guidelines. Contribute to software engineering through prototyping, coding, and code reviews. Develop and oversee data engineering pipelines for seamless data ingestion, transformation, and validation. Collaborate with outsourced development teams, ensuring high … quality delivery aligned with product goals. Work closely with scientists to translate innovations into scalable software components. Support customer integrations, data pipelines, and secure system configurations. Mentor junior developers, fostering a culture of collaboration and technical excellence. Key Skills and Requirements Expertise in software engineering and SaaS architecture, with experience in designing scalable cloud based platforms (e.g., Azure … AWS). Proficiency in DevOps practices, CI/CD pipelines, and system integrations. Strong knowledge of data pipeline design, security best practices, and microservice architectures. Hands on experience with Python and machine learning frameworks such as TensorFlow, PyTorch, Scikit learn, or JAX. Familiarity with tools like Apache Airflow, Snowflake, dbt, or custom ETL stacks for data pipeline implementation. More ❯

core technology crucial to Ki's success – allowing us to evolve underwriting intelligently and unlock massive scale. We're a multi-disciplined team, bringing together expertise in software and data engineering, full stack development, platform operations, algorithm research, and data science. Our squads focus on delivering high-impact features – we favour a highly iterative, analytical approach. We … re looking for a Staff Software Engineer to join our Engineering team. You will provide technical leadership for both delivery squads and the wider engineering organisation. Along with our engineering leadership, you’ll champion engineering excellence and high standards of quality through an environment of continuous improvement. You will be hands-on, directly delivering new impactful … for growth and improvement - Build mock-ups or prototypes to explore and troubleshoot new initiatives - Explore new ideas and emerging technologies, develop prototypes quickly - Uphold and advance the wider engineering team’s principles and ways of working - Promote a culture of continuous improvement, positively influence current ways of working, leading by example - Serve as a domain expert in many More ❯

core technology crucial to Ki's success – allowing us to evolve underwriting intelligently and unlock massive scale. We're a multi-disciplined team, bringing together expertise in software and data engineering, full stack development, platform operations, algorithm research, and data science. Our squads focus on delivering high-impact features – we favour a highly iterative, analytical approach. We … re looking for a Staff Software Engineer to join our Engineering team. You will provide technical leadership for both delivery squads and the wider engineering organisation. Along with our engineering leadership, you’ll champion engineering excellence and high standards of quality through an environment of continuous improvement. You will be hands-on, directly delivering new impactful … for growth and improvement - Build mock-ups or prototypes to explore and troubleshoot new initiatives - Explore new ideas and emerging technologies, develop prototypes quickly - Uphold and advance the wider engineering team’s principles and ways of working - Promote a culture of continuous improvement, positively influence current ways of working, leading by example - Serve as a domain expert in many More ❯

core technology crucial to Ki's success – allowing us to evolve underwriting intelligently and unlock massive scale. We're a multi-disciplined team, bringing together expertise in software and data engineering, full stack development, platform operations, algorithm research, and data science. Our squads focus on delivering high-impact features – we favour a highly iterative, analytical approach. We … re looking for a Staff Software Engineer to join our Engineering team. You will provide technical leadership for both delivery squads and the wider engineering organisation. Along with our engineering leadership, you’ll champion engineering excellence and high standards of quality through an environment of continuous improvement. You will be hands-on, directly delivering new impactful … for growth and improvement - Build mock-ups or prototypes to explore and troubleshoot new initiatives - Explore new ideas and emerging technologies, develop prototypes quickly - Uphold and advance the wider engineering team’s principles and ways of working - Promote a culture of continuous improvement, positively influence current ways of working, leading by example - Serve as a domain expert in many More ❯

core technology crucial to Ki's success – allowing us to evolve underwriting intelligently and unlock massive scale. We're a multi-disciplined team, bringing together expertise in software and data engineering, full stack development, platform operations, algorithm research, and data science. Our squads focus on delivering high-impact features – we favour a highly iterative, analytical approach. We … re looking for a Staff Software Engineer to join our Engineering team. You will provide technical leadership for both delivery squads and the wider engineering organisation. Along with our engineering leadership, you’ll champion engineering excellence and high standards of quality through an environment of continuous improvement. You will be hands-on, directly delivering new impactful … for growth and improvement - Build mock-ups or prototypes to explore and troubleshoot new initiatives - Explore new ideas and emerging technologies, develop prototypes quickly - Uphold and advance the wider engineering team’s principles and ways of working - Promote a culture of continuous improvement, positively influence current ways of working, leading by example - Serve as a domain expert in many More ❯

core technology crucial to Ki's success – allowing us to evolve underwriting intelligently and unlock massive scale. We're a multi-disciplined team, bringing together expertise in software and data engineering, full stack development, platform operations, algorithm research, and data science. Our squads focus on delivering high-impact features – we favour a highly iterative, analytical approach. We … re looking for a Staff Software Engineer to join our Engineering team. You will provide technical leadership for both delivery squads and the wider engineering organisation. Along with our engineering leadership, you’ll champion engineering excellence and high standards of quality through an environment of continuous improvement. You will be hands-on, directly delivering new impactful … for growth and improvement - Build mock-ups or prototypes to explore and troubleshoot new initiatives - Explore new ideas and emerging technologies, develop prototypes quickly - Uphold and advance the wider engineering team’s principles and ways of working - Promote a culture of continuous improvement, positively influence current ways of working, leading by example - Serve as a domain expert in many More ❯

of developing Snowflake-focused intellectual property, including best practices, accelerators, reusable frameworks, and reference architecturesStrengthen our Snowflake partnership by leveraging technical credibility to build trusted relationships with architecture and engineering stakeholders at SnowflakeProvide technical assurance on delivery projects, ensuring that all solutions adhere to established Snowflake implementation best practicesContribute to pre-sales activities by shaping proposals, supporting client workshops … and meetings, publishing thought leadership content, and participating in industry eventsAct as a technical advisor to clients, helping to define data strategies and solution blueprints that fully utilize Snowflake's capabilitiesInvestigate opportunities to leverage Snowflake's app development features (e.g., Snowpark, Native Apps) and integrations (e.g., Streamlit) to create new business offerings and co-developed IPPartner with colleagues across … our Core and Applied Practices to design and bring to market repeatable Snowflake-based solutionsSkills & Experience:Extensive experience designing and delivering Snowflake solutions, including Snowpipe, Streams & Tasks, Data Sharing, Native Apps, Snowpark, Data Clean Rooms, and CortexProven expertise in optimising Snowflake performance and cost efficiency, with SnowPro Core and Advanced certificationsSkilled in software engineering practices with experience More ❯

Job Title: Senior Data Manager Duration: long-term contract Location: UK Based Hybrid (x3 days from Birmingham) Overview: We’re looking for a hands-on Senior Data Manager to design, build, and optimize scalable data pipelines and infrastructure for global banking projects. You’ll lead a team, drive engineering best practices, and ensure data reliability … security, and compliance. Key Responsibilities: Lead and mentor a big team of data engineers, establishing best practices in data engineering. Design, build, and maintain scalable, secure , and reliable data pipelines and architectures. Develop and optimize ETL processes, integrating diverse data sources into unified platforms. Monitor, troubleshoot , and enhance data performance and infrastructure. Key Skills & Experience … Strong experience with SQL/NoSQL databases, data warehousing, and big data (Hadoop, Spark). Proficient in Python, Java, or Scala with solid OOP and design pattern understanding. Expertise in ETL tools and orchestration frameworks (Airflow, Apache NiFi). Hands-on experience with cloud platforms (AWS, Azure, or GCP) and their data services. More ❯

SDLC best practices. Proven expertise in cloud-native architecture, ideally within the Microsoft Azure ecosystem. Solid understanding of AI and machine learning solution patterns. Deep knowledge of API design, data integration, and security standards (OAuth2, SSO, encryption). Ability to create clear, well-structured architectural documentation, including diagrams and roadmaps. Excellent communication and stakeholder management skills, with the ability … to bridge business objectives and technical delivery. Desirable Skills Background in full-stack or backend engineering, using technologies such as Python, TypeScript, or .NET. Experience with data engineering and data architecture concepts. Familiarity with MLOps practices and AI development frameworks (e.g., Azure AI, LangChain, Hugging Face). Relevant certifications in Azure Architecture, Data, or AI More ❯

SDLC best practices. Proven expertise in cloud-native architecture, ideally within the Microsoft Azure ecosystem. Solid understanding of AI and machine learning solution patterns. Deep knowledge of API design, data integration, and security standards (OAuth2, SSO, encryption). Ability to create clear, well-structured architectural documentation, including diagrams and roadmaps. Excellent communication and stakeholder management skills, with the ability … to bridge business objectives and technical delivery. Desirable Skills Background in full-stack or backend engineering, using technologies such as Python, TypeScript, or .NET. Experience with data engineering and data architecture concepts. Familiarity with MLOps practices and AI development frameworks (e.g., Azure AI, LangChain, Hugging Face). Relevant certifications in Azure Architecture, Data, or AI More ❯

Mid & Senior Data Engineers (Databricks) | London | up to £85k + Bonus Multiple roles Are you a Databricks expert ready to make a real impact? Join our high-growth consultancy and help shape the future of data platforms for some of the UK’s most asset-intensive industries. 📍 Location: London (Hybrid – 2 days/week onsite) 📄 Role Type: Permanent … base + up to 20% bonus (based on performance & commercial impact) 🔍 What’s the Opportunity? We’re on the lookout for a Mid/Senior Data Engineer to take a leading role in our expanding Databricks practice . With two senior team members moving on and demand growing fast, this is your chance to step into a high-impact … a values-driven consultancy with a strong presence in utilities, manufacturing, and aviation . Our team thrives on collaboration, technical excellence, and clear communication. We don’t just build data platforms—we solve real business problems. 🛠️ What You’ll Be Doing Designing and building scalable data pipelines using Databricks and medallion architecture Leveraging Delta Live Tables (DLT) for More ❯