51 to 75 of 141 Data Pipeline Jobs in the South East

Azure Data Engineer - 3-Month Contract - £450-£500/day - Outside IR35 Location: Remote (UK-based) Duration: 3 months Rate: £400-£450 per day (Outside IR35) Role Overview We are looking for an experienced Azure Data Engineer to join a short-term project focused on building and optimising cloud-based data solutions. This role … requires strong technical expertise in Azure services and modern data engineering practices, with the ability to deliver high-quality solutions in a fast-paced environment. Key Responsibilities Design and implement scalable data pipelines using Azure Data Factory , Databricks , and Synapse Analytics . Develop and optimise ETL processes for structured and semi-structured data. Work … with SQL and Python for data transformation and modelling. Integrate data from multiple sources, ensuring accuracy, consistency, and performance. Collaborate with stakeholders to understand requirements and deliver actionable insights. Apply best practices for data governance , security, and performance tuning. Required Skills Proven experience as an Azure Data Engineer in enterprise environments. Strong More ❯

Data Analyst – SC Cleared - AWSWe’re looking for a Data Analyst (SFIA Level 4) to join a high-profile government data transformation programme. The role will support an existing team, working across data modelling, analytics, and performance optimisation within the AWS Athena environment.This is not a data engineering or build … role; it’s focused on understanding, analysing, and optimising existing data models and SQL scripts to improve efficiency, structure, and insight quality.Due to the nature of the role, active SC clearance is required.Key Responsibilities Analyse and interpret existing SQL/NoSQL scripts, optimising performance and accuracy. Review, document, and enhance data models in AWS Athena and … related warehousing environments. Provide insight and recommendations on data modelling standards, table structures, and query logic. Support the wider MIDAS analytical and engineering team on data validation and reporting improvements. Contribute to the delivery of a robust data warehousing and analytics environment in AWS. Produce technical documentation and maintain clear audit trails of analysis More ❯

Contract Data Engineer - Global Bank Location: Hybrid (London or Edinburgh preferred)?? Duration: 6-12 months? Day Rate: Competitive via Umbrella A leading global bank is seeking a skilled Data Engineer to join its next-generation data and AI transformation programme. This contract role offers the chance to work on high-impact initiatives, including powering … intelligent chatbots and AI-driven analytics across the organisation. Key Responsibilities: Design, build, and maintain scalable ETL data pipelines to support AI, chatbot, and analytics use cases. Collaborate with data scientists, ML engineers, and product teams to deliver clean, reliable data for model training and real-time inference. Enable chatbot platforms by integrating structured … support data storytelling and operational insights. Optimise data workflows across cloud and on-prem environments, ensuring performance and reliability. Skills & Experience: Strong experience in ETL pipeline development using tools like Apache Airflow, Informatica, or similar. Advanced SQL skills and experience with large-scale relational and cloud-based databases. Hands-on experience with Tableau for data More ❯

Data Business Analyst - MetaData, Cloud, Healthcare £Market Rate - Inside IR35 London/Hybrid - 2 days per week on site 3-6 months My client is an instantly recognisable Healthcare Insurer who urgently require a Data Business Analyst to join a business-critical programme. Key Requirements: Proven commercial experience working as a Data Business Analyst … within large, complex organisations (Healthcare/Insurance preferred). Experience working on large-scale Data programmes. The ability to analyse and document business processes to gather and define requirements. The ability to develop and maintain detailed project documentation, including business requirements, process flows, and Data models. Working knowledge of structured, unstructured and MetaData. Familiarity with Data pipelines for cloud environments (Azure, GCP, AWS, Snowflake). Awareness of medallion architecture (Gold, Silver, Bronze). Previous experience creating Data requirements for Data Engineers/Data Scientists. Proficiency in Data Analysis tools such as SQL, Python and R and the ability to write simple SQL scripts. Strong understanding of More ❯

Senior Data Engineer in Databricks - Lead the Future of Data in Financial Services Location: Hybrid | 2-3 days/week on site Offices: South East and North West Salary: Up to £80,000 + Car Allowance + Bonus + Benefits Note: Visa sponsorship is not available for this role. Be the Technical Leader in a Bold … Data Transformation Our client is entering a pivotal phase in its data journey. With a new Head of Data already in place and a Data Architect joining shortly, the business is investing in a modern, scalable data platform to turn messy, complex client data into trusted, actionable insights. … team. Finance sector experience is a bonus-but not essential. Interview Process Initial coffee chat to explore team fit and technical challenges. Technical interview covering Databricks, MDM, semantic layers, pipeline design, and governance. This is a rare opportunity to lead, build, and shape the future of data in a growing financial services business. Ready to make your More ❯

Palantir Foundry Data Engineer - DV Cleared NEW CONTRACT OPPORTUNITY FOR A PALANTIR FOUNDRY DATA ENGINEER TO WORK ON A NATIONAL SECURITY PROJECT IN LONDON WITH DV CLEARANCE - Contract role in London for a Palantir Foundry Data Engineer - Must hold DV Security Clearance - Central London based - Daily rate up to £800 - Hybrid position - To apply … email: or call Who we are... We are seeking an experienced Palantir Foundry Data Engineer with current DV clearance to join a high-profile programme. This is a contract position offering hybrid working and a daily rate of up to £800 . In this role, you will be responsible for designing, developing, and optimising data pipelines … and integrations within Palantir Foundry , ensuring data is efficiently processed, transformed, and made available for analysis and operational use. You will collaborate closely with analysts, data scientists, and business stakeholders to deliver robust, secure, and scalable data solutions. What we're looking for... Key Responsibilities: Develop and maintain data pipelines and workflows More ❯

Senior Fabric Developer Data & Analytics Consultanc **y London/Hybri** d SDG Group is a global Consulting firm specialising in Data & Analytics. We are committed to unlocking an organisations' potential and hidden value by offering in-depth analytics expertise that empowers our clients' business models to become successful data-driven enterprises. Innovation is in … will play a pivotal role in designing, developing, and deploying enterprise-grade solutions using Microsoft Fabric. You will work closely with clients and internal teams to build scalable data pipelines, semantic models, and visualizations that support advanced analytics and business intelligence initiatives. Must be a willing to learn other Technology Stacks, Data Bricks, Sn **owflake. What … You'll** Be Doing Lead the design and implementation of solutions using Microsoft Fabric, including Data Factory, Dataflows, Lakehouses, and - Power BI.Architect and optimize data pipelines for performance, scalability, and re - liability.Develop and maintain semantic models and datasets for reporting and - analytics.Collaborate with cross-functional teams including data engineers, analysts, and business sta - keholders.Ensure More ❯

Company Description At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in fair and equitable way. With over 20 brands across 30+ countries, we strive for fair and … the worlds leading job-tech platform. Job Description The role of Product Analytics Manager in our company is at the intersection of several disciplines: Product Analytics, Insights Analytics, Data Engineering and Data Science. Your teams projects will cover a broad range of topics, from working with engineers to implement event tracking on our platforms, all the … way to generating data insights and sometimes building predictive models, ultimately helping our Product organisation deliver great products, which solve meaningful user problems. You and your team are part of a larger Product Analytics group, and will be working closely with Product Directors, Heads of Product, Data Engineers, Data Scientists and many other stakeholders More ❯

Data Engineer (Azure & Databricks) Location: London (Hybrid - 2 days in office) Salary: £65,000 + Benefits Level: Mid-Level About the Role: We're looking for a talented Data Engineer to join a leading consultancy and work on cutting-edge data solutions for global clients. You'll design and build scalable data pipelines using Azure and Databricks, ensuring high-quality, reliable data delivery for advanced analytics and AI initiatives. Key Responsibilities: Develop and optimize data pipelines on Azure and Databricks Collaborate with data scientists and analysts to deliver actionable insights Implement best practices for data governance and security Work in a hybrid … setup (2 days per week in our London office) What We're Looking For: Strong experience with Azure Data Services (Data Factory, Synapse, etc.) Hands-on expertise with Databricks and Python Solid understanding of ETL processes and data modelling Excellent problem-solving and communication skills Benefits: Work on high-impact projects with top-tier More ❯

cutting-edge analytics solutions that make a real impact. This role combines hands-on technical expertise with strategic thinking. Enabling clients to unlock insights and value from their data using Microsoft’s latest analytics stack. As an expert in Power BI and Microsoft Fabric, you’ll architect scalable, modern data solutions that unlock real business value … and guide delivery teams through implementation. With your deep knowledge in Power BI, Microsoft Fabric, and Azure data services, and your passion for innovation, technical expertise with strategic thinking to support data-driven transformation. Here, you’ll partner with stakeholders, guide delivery teams, and help clients harness the full potential of Microsoft’s newest analytics ecosystem. … Key Responsibilities: Lead the design and architecture of end-to-end analytics solutions using Power BI and Microsoft Fabric Translate business requirements into scalable data models, lakehouse architectures, and reporting frameworks Develop and optimize Power BI reports, dashboards, and semantic models using DAX and Power Query Implement Fabric components including Data Factory, Lakehouse, Dataflows Gen2, and More ❯

for use within PowerBI or reporting. Maintenance of Power BI, SQL and related reporting systems, helping to ensure a useful and reliable reporting function for the business. Developing data pipelines from Microsoft Fabric and integration products to exploit and maximise a range of data systems. Understanding and interpreting user specifications and requirements gathering, user interviews, running … workshops, prototyping etc. and then document requirements in a format that is intelligible to both business partners and IT colleagues Carefully testing and accuracy checking data lists and aggregations Engaging with existing and prospective users to understand and document their information needs predicated on an understanding of both business processes and the business decisions that users need to … make Provide support to BI projects to enable them to meet their deadlines Working with DDaT colleagues to understand and document available data sources and their interrelation Collaborating with other team members to design solutions and to develop strong governance and control processes Working with quality assurance to ensure that business requirements are met Responsible for partnering with More ❯

Data Engineer (Microsoft Fabric) Please note this role is Fully remote based. We're partnering with a leading organisation that’s driving innovation through modern data engineering practices, and they’re looking for a Fabric Data Engineer to join their growing team. In this role, you'll work at the forefront of Microsoft Fabric … helping to build robust, scalable data solutions. Responsibilities Delivering high-quality data engineering solutions within the Microsoft Fabric ecosystem. Writing advanced SQL and optimising complex queries. Building and orchestrating data pipelines across modern cloud platforms. Applying expert knowledge of data integration tools and methods. Designing ELT/ETL workflows using medallion architecture … and lakehouse principles. Developing and maintaining data warehouses and data marts. Skills Needed 2+ years’ experience in data engineering, with at least 1 year on Microsoft cloud technologies. Strong hands-on experience with Microsoft Fabric, especially around data engineering and warehousing workflows. Familiarity with Azure DevOps for CI/CD and deployment. More ❯

BI Developer - London - £65,000 Are you passionate about building scalable BI solutions and working with cutting-edge data technologies? We are seeking a BI Developer to join a dynamic team and help shape the future of data analytics within a global organisation. About the role: Design and develop BI solutions using Microsoft Fabric and related … technologies. Build and manage data pipelines leveraging Data Factory. Develop semantic models in Power BI Collaborate with data architects, analysts, and stakeholders to deliver actionable insights. Optimise data models for performance and reusability. Support governance, security, and compliance best practices. Key Responsibilities Deliver scalable Azure-based data platforms, including Data Warehouses and reporting tools. Provide technical support and manage a modern technology stack (Azure Synapse, SSIS, SQL, Data Lake). Assist with migration and reconciliation of data from legacy systems or acquisitions. Act as a hands-on Data Engineer across the full stack. Requirements: Strong expertise in SQL, Power BI, and cloud More ❯

A well-established professional services business is hiring a Head of Data to play a key role in building and optimising its modern cloud data environment. This is a technical, hands-on role with team management responsibilities – ideal for someone who wants to stay close to the tech while guiding and developing a growing team. Role … Head of Data Salary: £80,000 - £110,000 Location: Guildford – 5 days per week onsite What you’ll be doing: Design, build, and optimise scalable data pipelines and architecture Work hands-on with PySpark, Databricks, Azure, and Data Lake to deliver high-performance solutions Translate business needs into technical requirements and data-driven solutions Ensure best practice in data governance, quality, and security Manage and mentor engineers, helping them grow while contributing directly to delivery Support the company’s AI roadmap by developing and scaling the data environment What you’ll need: Proven experience as a Data Engineer or Senior Data Engineer More ❯

A well-established professional services business is hiring a Data Engineering Manager to play a key role in building and optimising its modern cloud data environment. This is a technical, hands-on role with team management responsibilities – ideal for someone who wants to stay close to the tech while guiding and developing a growing team. Role … Data Engineering Manager Salary: £90,000 - £110,000 Location: Guildford – 5 days per week onsite What you’ll be doing: Design, build, and optimise scalable data pipelines and architecture Work hands-on with PySpark, Databricks, Azure, and Data Lake to deliver high-performance solutions Translate business needs into technical requirements and data-driven solutions Ensure best practice in data governance, quality, and security Manage and mentor engineers, helping them grow while contributing directly to delivery Support the company’s AI roadmap by developing and scaling the data environment What you’ll need: Proven experience as a Data Engineer or Senior Data Engineer More ❯

Data Engineer (Microsoft Fabric) Please note this role is Fully remote based. We're partnering with a leading organisation that’s driving innovation through modern data engineering practices, and they’re looking for a Fabric Data Engineer to join their growing team. In this role, you'll work at the forefront of Microsoft Fabric … helping to build robust, scalable data solutions. Responsibilities Delivering high-quality data engineering solutions within the Microsoft Fabric ecosystem. Writing advanced SQL and optimising complex queries. Building and orchestrating data pipelines across modern cloud platforms. Applying expert knowledge of data integration tools and methods. Designing ELT/ETL workflows using medallion architecture … and lakehouse principles. Developing and maintaining data warehouses and data marts. Skills Needed 2+ years’ experience in data engineering, with at least 1 year on Microsoft cloud technologies. Strong hands-on experience with Microsoft Fabric, especially around data engineering and warehousing workflows. Familiarity with Azure DevOps for CI/CD and deployment. More ❯

Fimador is currently recruiting for a Senior Data Engineer to lead a team developing cutting-edge … data-driven products. This role is helping the firm pioneer AI and ML in the global environment. This role is central to designing and maintaining scalable pipelines, data platforms, and integrations, while ensuring solutions meet regulatory standards and align with architectural best practices. Key Responsibilities: Build and optimise scalable data pipelines using Databricks and … backlog refinement. Promote engineering best practices including CI/CD, code reviews, and testing. Research and introduce new tools, technologies, and methodologies. Ideal experience: Experience with efficient, reliable data pipelines that improve time-to-insight. Knowledge of secure, auditable, and compliant data workflows. Know how on optimising performance and reducing costs through Spark and Databricks tuning. More ❯

Data Engineering Lead Salary: Up to £95,000 + Bonus I am working with a technology driven organisation who are leaders in their field that are delivering some of the world's most innovative projects in their space. With a strong focus on innovation, sustainability and data-driven decision-making, they are investing heavily in their … digital transformation journey. As part of this growth, they are looking to bring on a Data Engineering Lead to shape and optimise their hybrid Azure/Databricks data platform. This is a strategic and hands-on role where you will lead the development of scalable data solutions and mentor a team of BI Developers … a collaborative environment that values technical excellence, continuous learning and inclusive leadership. In this role, you will be responsible for: Leading a technical team to deliver dashboards and data products aligned with business needs. Designing and developing robust data pipelines using Azure Data Factory, Databricks, and SQL. Architecting a scalable, high-performance data More ❯

Stevenage As a data engineer specialising in generative AI ; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. Salary : Circa £45,000 - £55,000 depending on experience Dynamic (hybrid) working … treatments Facilities : Fantastic site facilities including subsidised meals, free car parking and much more... The opportunity: The MBDA IM GenAI delivery Office department is looking for an experienced data engineer able to evaluate design, deploy, improve and support MBDA data sets. You will ensure MBDA data pipelines are designed to be resilient, secure and … responsive. You will use your data engineering expertise to collaborate with different internal customers regarding their data, ensuring they are optimised and secured for their needs. You will provide your knowledge in data management and data quality to guarantee compliance to MBDA data governance. A key part of this role More ❯

and Healthcare technology sector Salary up to £130k + Equity Paddington based (4-5 days per week in-office) Tech environment: Python | PyTorch | TensorFlow | scikit-learn | NLP | LLMs | Data Engineering If you wish to keep your CV/data private, feel free to WhatsApp your details/CV to me, Dan - WHO WE ARE: We're … product, and domain experts). Design, develop, and deploy end-to-end ML systems , from concept to production. Build models for intelligent automation, natural language processing (NLP), and data-driven insights. Work with Python , PyTorch , TensorFlow , and scikit-learn to prototype and scale solutions. Partner with senior leadership to define the AI roadmap and long-term strategy. Optimise … or parallel processing (Ray, Spark, etc.). Experience deploying models in production environments (Docker, cloud services). Exposure to data engineering or working alongside data pipeline teams. A genuine passion for AI innovation and real-world applications in health, petcare, or automation. TO BE CONSIDERED... Please either apply online or email me directly at .By More ❯

Senior Data Engineer Hybrid (3 Days Per Week) - London Up to £80,000 + Benefits We're partnering with one of the most exciting InsurTech scale-ups in the market - a company transforming how brokers and insurers exchange risk, already processing over $150m in premium and targeting $1B by 2027 . They're looking for a Senior Data Engineer (3-5 years' experience) to help scale their modern data platform as they continue rapid growth. What you'll do: Build and maintain scalable, automated, reliable data pipelines across a modern cloud stack Extend and improve a cutting-edge Data & Analytics Platform supporting mission-critical insurance products Implement data quality checks, observability metrics and troubleshooting processes Manage cloud resources via Infrastructure-as-Code Ensure strong data security, access control, and governance Work closely with commercial, analytics and engineering teams to deliver high-quality data products What you'll bring: 3-5 years' experience as a Data Engineer Strong SQL and Python More ❯

Analytics Engineer Location: London About the Role: We are seeking an experienced Analytics Engineer to help design and scale a modern data platform for a global organisation. This role is ideal for someone passionate about building robust data architectures, enabling actionable insights, and driving analytics maturity across the business. Enjoy owning the full analytics workflow from … raw ingestion to dashboards. Value clean, documented, and tested data models. Have a product mindset and embrace stakeholder feedback. Stay current with modern data tooling and best practices. Key Responsibilities: Design and maintain scalable data warehouse architecture using the Medallion model (Bronze/Silver/Gold layers). Build, test, and deploy dbt/… dataform models with reusable SQL-based transformations. Develop and optimise BI dashboards and data products using Tableau, translating business needs into visual insights. Orchestrate and monitor data pipelines, ensuring data quality and timely delivery. Implement data quality checks, observability, and maintain data cataloging and lineage. Drive CI/CD practices More ❯

A well-established business in Brentford is seeking an experienced BI Developer to join their BI & Data Team as they embark on a major transformation journey, moving from legacy systems towards a modern Microsoft ecosystem built on Azure and Fabric. The team operates mostly remotely, with office collaboration up to once per week alongside the wider BI & Data … and ensure the new set-up supports analytics, forecasting, and AI enablement. Key responsibilities will include: Designing and delivering scalable BI solutions using Microsoft Fabric Building and managing data pipelines with OneLake, Dataflows Gen2, and Data Factory Developing semantic models in Power BI and integrating with DirectLake or Warehouse datasets Optimising data models for … performance and reusability Supporting governance, security, and compliance best practices in a modern data platform Tooling for migration and reconciliation of data from legacy systems or acquisitions Providing technical support and hands-on data engineering across the full stack We are looking for: Strong experience as a BI Developer, Data Engineer, or More ❯

Role Title: Data Engineer Location: London, UK Work Model: Hybrid (3 days onsite per week) Contract Duration: 12 Months Role Overview We are seeking a highly skilled Data Engineer to design, develop, and maintain robust data pipelines and dashboards supporting business-critical insights. The ideal candidate will have strong hands-on programming experience in … Python , with deep expertise in data manipulation, analysis, and visualization using Plotly Dash . The role requires close collaboration with analytics, business, and engineering teams to deliver scalable data solutions with a strong focus on software development best practices. Key Responsibilities Design, develop, and maintain end-to-end data pipelines and processing frameworks. Perform … data extraction, transformation, and loading (ETL) from multiple sources. Implement advanced data visualizations and interactive dashboards using Plotly Dash. Ensure data quality, integrity, and performance through automated testing and validation. Collaborate with cross-functional teams to define data requirements and technical solutions. Apply software engineering principles such as version control, modular coding More ❯

Senior Platform Engineer £500-£600 per day Outside IR35 6-months Join one of the UK's leading online retailers as they evolve their next-generation data platform. This is an opportunity to shape the backbone of a modern data ecosystem, empowering analysts, ML engineers, and data scientists to deliver smarter, faster insights at … scale. The Role You'll play a key role in designing and engineering platform services that treat data as a core product. This means building scalable, secure, and observable systems that help teams confidently leverage data across the business. You'll work closely with a wide range of technical and non-technical partners to deliver resilient … infrastructure, champion data governance, and mentor others in engineering excellence. In this role, you will: Shape the data platform roadmap: Introduce modern observability, quality, and governance frameworks that elevate how teams access and trust data. Build and scale infrastructure: Develop services, APIs, and data pipelines using modern cloud tooling and automation-first principles. Drive More ❯