26 to 50 of 107 Data Pipeline Jobs in the South East

Data Scientist 6 Month contract initially Based: Hybrid - Maximum of 3 days p/w - Wokingham Rate: £Market rates p/d (via Umbrella company) We have a great opportunity with a world leading organisation where you will be provided with all of the support and development to succeed. A progressive organisation where you can really make a … difference. We have a great opportunity for a highly experienced Data Scientist to join the team. We are seeking a skilled and experienced Data Scientist with expertise data scientists and LLM use cases and Data Engineering with Graph DB experience and Vector DB experience. As a Data Scientist, you will … datasets, building predictive models, and extracting meaningful insights to drive informed decision-making. Key Responsibilities: * Analyse and pre-process large-scale time series datasets, identifying relevant variables and data cleansing requirements. * Develop and implement advanced statistical models and machine learning algorithms to perform predictive analysis on time series data. * Build and validate forecasting models to predict future trends More ❯

The Green Recruitment Company is working with an Environmental and Sustainability Business that supports and empowers their customers' journey to net zero. To join their Data-Technology team, we have an opportunity for a Data Engineer to help support the wider business (cross-functional) to meet their reporting and data requirements. About the role … The Data Engineer will work with the latest innovative technologies to design, build, and maintain data solutions, constructing processes to surface data both internally for reporting purposes and externally through the customer portal. The Data Engineer will be responsible for developing scalable data pipelines to integrate diverse data sources while ensuring data quality under the framework of a new Data Platform for real-time application integration and reporting. They will work closely with business stakeholders to support data-driven decision-making by delivering clean, well-structured datasets that can be utilized for reporting purposes in a performant, secure way. Key More ❯

needs of the BioPharma sector. IDBS, a Danaher company, leverages 35 years of scientific informatics expertise to help organizations design, execute and orchestrate processes, manage, contextualize and structure data and gain valuable insights throughout the product lifecycle, from R&D through manufacturing. Known for its signature IDBS E-WorkBook software, IDBS has extended its flexible, scalable solutions to … fail and fun environment which is founded on trust, empowerment and autonomy? Do you enjoy solving complex customer problems as a team? We are currently seeking a Principal Data Engineer who will be a vital cog in our team, designing and developing IDBS's data driven products. You will deliver data-rich software and … design, technical approach and implementation mechanisms adopted by the team.You will be directly involved in the development of data-centric products from ingest to egress via pipelines, data warehousing, cataloguing, integrations and other mechanisms. The role will be involved in all aspects of the software delivery lifecycle including the creation and elaboration of business requirements, functional More ❯

remote Benefits: Healthcare and great holidays The Role As a Machine Learning Operations Engineer, you will be instrumental in designing, deploying, and maintaining machine learning systems that drive data-driven decision-making in the pensions and financial services sector. Using Azure's cloud ecosystem, you will build scalable ML workflows that support actuarial modelling, risk prediction, and client … classification, regression, ensemble methods, survival models) to improve predictions and automate core processes. 2. MLOps & Model Lifecycle Management * Own the end-to-end ML lifecycle using Azure ML pipelines, Data Factory (ADF), and ML tracking tools.* Implement CI/CD pipelines with Azure DevOps, ensuring robust version control, testing, and seamless deployment.* Monitor production ML systems for performance … data drift, and anomalies using Azure Monitor or other observability tools.* Schedule and automate model retraining pipelines to maintain performance over time. 3. Data Engineering & Preprocessing * Develop and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Data Lake, and SQL.* Prepare and preprocess large datasets to ensure More ❯

Job Title : Data Engineer - Snowflake | DBT | SQL £700/day (Umbrella) London - 3 days per week on-site 6 months (Initial Contract) Are you ready to play a key role in shaping the future of a high-impact enterprise data platform? Join a fast-growing data team working on a greenfield data warehousing project at one of the world's most respected financial institutions. This is an opportunity to work on cutting-edge data infrastructure using Snowflake, DBT, and Sigma, supporting business-critical data needs and enabling meaningful insights at scale. You'll be part of a collaborative team split across London and Ireland, contributing to … a platform that directly supports secure, scalable data sharing and real-time decision-making. What You'll Be Doing : Model and build robust, scalable data pipelines and warehouse structures using Snowflake and DBT Collaborate with stakeholders to ensure data solutions meet customer and business needs Develop and optimise data models to support More ❯

Senior Data Engineer London, UK About the Role We're looking for a Senior Data Engineer to lead the design and delivery of modern, cloud-based data solutions. You'll play a key role in transforming enterprise data platforms, enabling global data alignment, and driving business value through scalable architecture … and advanced analytics. Key Responsibilities Design and implement end-to-end data pipelines using Azure and Databricks. Modernize legacy data warehouses and unify data across global regions. Optimize performance, cost, and scalability of data platforms. Mentor junior engineers and promote best practices. Collaborate with cross-functional teams to translate business needs into … technical solutions. Core Skills Cloud & Platforms : Azure, AWS, SAP Data Engineering : ELT, Data Modeling, Integration, Processing Tech Stack : Databricks (PySpark, Unity Catalog, DLT, Streaming), ADF, SQL, Python, Qlik DevOps : GitHub Actions, Azure DevOps, CI/CD pipelines Please click here to find out more about our Key Information Documents. Please note that the documents provided contain More ❯

Devonshire Hayes have partnered with a fantastic organisation to help them secure a dynamic and hands-on Engineering Manager across Data & AI. You will have experience - - Leading, managing, building and scaling data teams in a SaaS, RegTech, or technology driven environment. - Hands-on expertise in modern data engineering practices, cloud data platform and full data lifecycle. - Strong programming skills would be ideal for this position, languages such as Python, Java or Scala with Data pipeline frameworks and cloud infrastructure (AWS or Azure). - A proven track record of delivering innovative, data driven products from concept to production, ideally in a regulated industry. … Deep understanding of data governance, security, privacy standards especially within a B2B or regulated context. Working arrangement: 4 days in the office/1 day from home . More ❯

Team: The Academic Information Systems ( AI S) DataOps team is a shared technology group responsible for building, administering, governing, and setting standards for a growing number of strategic data platforms and services. Our capabilities enable data to be extracted, centralized, transformed, transmitted, and analyzed across a range of products in the AIS space. Due to our … footprint across the enterprise, we are relied upon to ensure our systems are trusted, reliable and available.The technology underpinning these capabilities includes industry leading data and analytics products such as Snowflake, Astronomer/Airflow, Kubernetes , DBT, Tableau, Sisense , Collibra, and Kafka/Debezium . Our mission is to enable frictionless experiences for our AIS colleagues and customers so … that they can openly and securely consume trustworthy data, enhancing everyday interactions and decisions. About the Role: As a S enior Data Engineer I , you will be responsible for helping to creat e a data infrastructure that is secure, scalable, well-connected, thoughtfully architected while also building a deep domain knowledge of our business More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: from £70,000 depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … design, through development and testing, to deployment, production, monitoring and continuous improvement optimising cutting-edge AI solutions across the business. One day you might be collaborating with our Data Scientists, Software Engineers and Architects on a new GenAI capability. The next, you're fine-tuning prompts or experimenting with Computer Vision and Natural Language Processing (NLP). You … control, and continuous integration. Develop and maintain automated frameworks for testing, validation, and monitoring of AI model accuracy, performance, and reliability. Establish best practices for AI data pipeline development and integration with infrastructure to support scalable deployment. Collaborate closely with Data Scientists, Data Engineers, Software Developers, and Architects for seamless execution of AI More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's … and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and … food & drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining - we provide the inspiration, insight and connections to power our customers' success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company's … and to work remotely for the rest of the week. Position Position: Full time - permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence's data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and … food & drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you'll More ❯

DATABRICKS ENGINEER 6-MONTH CONTRACT £450-£550 PER DAY (OUTSIDE IR35) This role is a great opportunity for a skilled Databricks Engineer to join a data-driven financial services firm undergoing a major transformation of their data infrastructure. You'll be a key player in modernising their data platform with Databricks and Azure, while … supporting scalable data pipelines and machine learning workflows. THE COMPANY This business is investing heavily in data as it digitises operations across its risk, product, and customer intelligence teams. They're building a modern Lakehouse architecture using Databricks, Delta Lake, and Azure Data Lake. You'll be part of a collaborative, forward-thinking team … with a focus on best practices, automation, and end-to-end data enablement. THE ROLE You'll work closely with Data Engineers, Scientists, and Architects to design, build, and optimise core data pipelines on Databricks. Your focus will be on enabling analytics and machine learning at scale, using best-in-class tools across the More ❯

Role: Senior Data Engineer Rate : £700 per day inside IR35 Duration : 4 months + Ext Location : National - London travel required (hybrid) Clearance : Active SC clearance requiredAre you a Senior Data Engineer with experience in modern, cloud-native data platforms and a drive to shape performance-led digital delivery? We are hiring on behalf of … a central government programme undergoing a transformative journey to enhance data-driven decision-making at scale. The Opportunity - Senior Data Engineer The Senior Data Engineer will join a multi-disciplinary team working to redefine how performance is measured and managed across a large, national directorate. The team has already delivered an MVP dashboard using … fully automated, code-first approach. This is more than a dashboard project - it's a strategic initiative to improve organisational health, leadership alignment, and delivery effectiveness through better data foundations. The Senior Data Engineer play a key role in transforming manual pipelines into scalable, automated solutions within a modern analytics platform, while embedding AI-native tools More ❯

Head of Data Engineering | High-Growth InsurTech London - Hybrid (Once per week in office)Up to £120,000 (Maybe £130,000) + Bonus + Share Options Are you a data leader who loves building high-performing teams and scalable platforms? I'm hiring for a Head of Data Engineering at a rapidly growing InsurTech … insurance works-making it simpler, fairer, and more personalised. This is a hands-on leadership role where you'll set the strategy, guide architecture, and empower a talented data engineering team to deliver world-class data systems in a fast-paced, product-led environment. Why This Role Stands Out Competitive salary + company share options Hybrid … engineering roadmap aligned with business goals Own the architecture, reliability, and scalability of the data platform end-to-end Drive best practices in ETL/ELT pipelines, data modelling, and real-time processing Partner with stakeholders to ensure data solutions are fit for purpose and future-proof Introduce and champion modern engineering practices (testing More ❯

great opportunity for an Azure Databricks Engineer to join a renewable energy firm based in London. You'll play a hands-on role in developing and optimising modern data lakehouse solutions on Azure, while supporting critical analytics and data delivery systems. The environment encourages technical ownership, collaboration, and the chance to tackle complex cloud-native engineering … challenges. THE COMPANY This is a leading organisation within the renewable energy sector, dedicated to sustainable innovation and data-driven operations. The business is undergoing rapid digital transformation, investing in cloud-based technologies to optimise performance, forecasting, and environmental impact. With operations across multiple regions, their data initiatives play a key role in supporting clean energy … and efficient data platforms on Microsoft Azure. Your work will directly support migration initiatives, analytics enablement, and platform reliability. You'll be responsible for data pipeline development, resource deployment, and ongoing optimisation of cloud-native systems. Your responsibilities will include: Designing and implementing scalable data lakehouse architectures using Databricks on Azure. Building efficient More ❯

Palantir Foundry Data Engineer - DV Cleared NEW CONTRACT OPPORTUNITY FOR A PALANTIR FOUNDRY DATA ENGINEER TO WORK ON A NATIONAL SECURITY PROJECT IN LONDON WITH DV CLEARANCE - Contract role in London for a Palantir Foundry Data Engineer - Must hold DV Security Clearance - Central London based - Daily rate up to £800 - Hybrid position - To apply … email: or call Who we are... We are seeking an experienced Palantir Foundry Data Engineer with current DV clearance to join a high-profile programme. This is a contract position offering hybrid working and a daily rate of up to £800 . In this role, you will be responsible for designing, developing, and optimising data pipelines … and integrations within Palantir Foundry , ensuring data is efficiently processed, transformed, and made available for analysis and operational use. You will collaborate closely with analysts, data scientists, and business stakeholders to deliver robust, secure, and scalable data solutions. What we're looking for... Key Responsibilities: Develop and maintain data pipelines and workflows More ❯

app, so it’s easier than ever to achieve your goals and build wealth, whatever your starting point. Job Brief Moneybox is growing rapidly, and our technical and data teams are no exception. We have more users, more accounts, more money invested, more features, more systems, more code, more data and more teams than ever before. … We’re looking for a Senior Data Engineer who can maintain and improve our existing data infrastructure, while continuing to build out our abilities, as well as contribute expertise across the board. In this unique role, you’ll be the interface between the backend and insight teams, collating, ingesting and organising data to drive … action and results. What You’ll Do As a Senior Data Engineer at Moneybox, you will play a critical role in building and maintaining the data infrastructure that powers our business. You'll be responsible for designing and implementing robust data pipelines and integrations, ensuring the seamless and accurate flow of data More ❯

Job Title: Business Intelligence (BI) Analyst Location: Oxford (2 days on-site) Salary: £35,000 - £50,000 DOE + Bonus About Us We're a fast-growing data consultancy helping forward-thinking clients transform their customer engagement through intelligent use of CRM platforms and AI. We specialise in building integrated data ecosystems that drive smarter business … insights, and measurable ROI. Our clients range from scaling SaaS startups to global enterprises across sectors like retail, finance, technology, and healthcare. We work at the intersection of data, automation, and customer intelligence . As we scale, we're looking for a talented BI Analyst to join our analytics team and help our clients extract true business value … from their data. The Role As a BI Analyst , you will play a critical role in helping our clients understand and optimise their CRM and business performance through data-driven insights. You'll work closely with client stakeholders, CRM specialists, and data engineers to develop scalable dashboards, uncover trends, and turn data into action. More ❯

Job Title: Business Intelligence (BI) Analyst Location: Milton Keynes (2 days on-site) Salary: £35,000 - £50,000 DOE + Bonus About Us We're a fast-growing data consultancy helping forward-thinking clients transform their customer engagement through intelligent use of CRM platforms and AI. We specialise in building integrated data ecosystems that drive smarter … insights, and measurable ROI. Our clients range from scaling SaaS startups to global enterprises across sectors like retail, finance, technology, and healthcare. We work at the intersection of data, automation, and customer intelligence . As we scale, we're looking for a talented BI Analyst to join our analytics team and help our clients extract true business value … from their data. The Role As a BI Analyst , you will play a critical role in helping our clients understand and optimise their CRM and business performance through data-driven insights. You'll work closely with client stakeholders, CRM specialists, and data engineers to develop scalable dashboards, uncover trends, and turn data into action. More ❯

Company Description At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in fair and equitable way. With over 20 brands across 30+ countries, we strive for fair and … the worlds leading job-tech platform. Job Description The role of Product Analytics Manager in our company is at the intersection of several disciplines: Product Analytics, Insights Analytics, Data Engineering and Data Science. Your teams projects will cover a broad range of topics, from working with engineers to implement event tracking on our platforms, all the … way to generating data insights and sometimes building predictive models, ultimately helping our Product organisation deliver great products, which solve meaningful user problems. You and your team are part of a larger Product Analytics group, and will be working closely with Product Directors, Heads of Product, Data Engineers, Data Scientists and many other stakeholders More ❯

per day Outside IR35 6 - months Remote Company A well-established investment and asset management organisation is looking for a Platform Engineer to undertake a large-scale data transformation, building out a new cloud-native data platform to support decision-making across the business. The firm is part-way through the development of a greenfield cloud … architect. As the work progresses into its next phase, the business is hiring a Platform Engineer to join the build effort, with a particular focus on infrastructure, automation and pipeline orchestration. This Platform Engineer will sit within the central finance and planning function and work closely with senior stakeholders, including programme sponsors and business leads. Key responsibilities - Platform Engineer … standards. There is potential for future responsibility in mentoring or overseeing junior team members. Required experience Hands-on experience working with Snowflake, including schema development and data pipeline integration. Familiarity with Azure services, including resource provisioning and identity setup. Experience using Terraform for infrastructure deployment (ideally with cloud data services). Strong working knowledge of More ❯

Contract Data Engineer Financial Services 6+ Months Competitive Day Rate My client, a global consultancy, is looking for an experienced Data Engineer to join on a contract basis to support major digital transformation projects with Tier 1 banks. You'll help design and build scalable, cloud-based data solutions using Databricks , Python , Spark , and … traffic financial applications. Key Skills & Experience: Strong hands-on experience with Databricks , Delta Lake , Spark Structured Streaming , and Unity Catalog Advanced Python/PySpark and big data pipeline development Familiar with event streaming tools ( Kafka , Azure Event Hubs ) Solid understanding of SQL , data modelling , and lakehouse architecture Experience deploying via CI/CD tools (e.g. … Azure DevOps, GitHub Actions) Nice to Have: Knowledge of Scala/Java Understanding of GDPR and handling sensitive data This is a contract role (UK-based) offering the chance to work on high-impact projects shaping the future of finance with some onsite presence required. More ❯

operating across domestic and international markets. The organisation offers a comprehensive portfolio of innovative risk solutions and services to businesses of all sizes, with a strong emphasis on data-driven decision-making and digital transformation. The Role This position will lead the development and delivery of enterprise-wide data solutions. The role combines technical leadership, stakeholder … engagement, and hands-on execution to support business growth and operational excellence through advanced analytics and data strategy. Key Responsibilities Develop and lead the execution of data and analytics strategies aligned to wider business objectives. Design and deploy advanced analytical models and dashboards to extract insights, forecast trends, and inform strategic decision-making. Collaborate with functions … including Underwriting, Claims, Actuarial, and IT to integrate data solutions into day-to-day operations. Provide data expertise and support to transformation initiatives, ensuring alignment with digital innovation programmes. Manage and mentor a hybrid team of data analysts, engineers, and specialists across both onshore and offshore locations. Coordinate task prioritisation, resource allocation, and delivery More ❯

Analyst Location: London (SOHO Hybrid 1/2 days a week onsite) Salary: £35,000 - £50,000 DOE Role Profile We are seeking a strategic and commercially-minded Data Analyst to lead the data strategy, elevate our reporting capabilities, and deliver impactful insights that influence executive decision-making and drive performance across the organisation. This role … sits at the heart of our transformation journey - reporting directly to the Chief Executive Officer and working closely with C-suite leaders to ensure data is a key driver of operational and strategic success. Key Responsibilities Partner with the CEO, CFO, Head of Risk , providing strategic data and insight to support their decision-making. Design, build … and deliver group-wide reporting programmes , primarily using Power BI , aligned with leadership priorities and business strategy. Ensure data quality and governance , maintaining the accuracy, validation, and trustworthiness of insights used across the business. Provide executive-level analytics, including: Forecasting support to the CFO Strategic planning and hypothesis testing with the CEO Bespoke data support for More ❯

GCP Data Engineer I am working with a leading Lloyd's of London reinsurance broker that is expanding its cloud data capabilities and looking for a GCP Data Engineer to join their growing team. This is a fantastic opportunity to work on a major cloud migration project and help shape the future of their … data platform. As part of this role, you will be responsible for some of the following areas: Develop and maintain robust, scalable data pipelines and ETL workflows within Google Cloud Platform (GCP) Take ownership of a major cloud migration initiative from Azure to GCP, ensuring smooth data integration and minimal disruption Partner with data scientists, analysts, and business stakeholders to deliver impactful, data-driven solutions Consolidate data from multiple sources, ensuring high standards of data quality, consistency, and security Contribute to the implementation of emerging AI technologies across the data platform To be successful in the role you will have: Proven experience as a More ❯