1 to 25 of 71 Permanent Data Pipeline Jobs in the South East

Location: London, Potters Bar or Bristol (Hybrid working options available) The Data Engineer is a hands-on technical role responsible for designing, developing, and maintaining data pipelines within the IT department. The pipelines will be realised in a modern lake environment and the engineer will collaborate … guiding and upskilling more junior data engineers and setting data standards and guidelines. What you'll do Data Pipeline Development Design, model, develop and maintain data pipelines to ingest, store, process, and present data. Ensure data quality, accuracy ...

Robert Half Technology are assisting a market leading AI-driven data platform organisation to recruit a Data Platform Engineer paying c£125 - £150k per annum. Remote working (UK based). Role The Data Platform Engineer will be an expert level engineer within Snowflake … build scalable solutions within the Data Platform Perform root cause analysis on often complex errors to help ensure data pipeline availability Help drive technical & architectural decisions on the data platform including decisions on data architecture, data engineering processes, data ...

undertaking one of the largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Data Engineer, you will support the development of HMLR's data engineering capability by helping to build and maintain reliable data … and analysing source systems to produce clear, actionable insights. Desirable Skills Knowledge of DevOps processes: (e.g. Terraform) Knowledge of data pipeline testing (e.g. end-to-end testing, data quality testing, monitoring & alerting, unit & contract testing) Knowledge of the data lifecycle (e.g. ...

Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth … management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Engineer will include: Understand ...

Description We are seeking an experienced Data Architect to join our Group Technology team in Milton Keynes. You will help realise the value of the immense Connells Group dataset for the benefit of customers, colleagues and the overall business. You will use your expertise to define, evolve … communicate the existing enterprise data architecture, to democratise safe access to data to help engineering teams create personal, relevant and timely customer experiences. The data architecture will also support colleagues in accessing data, getting insights and providing next best actions for faster ...

Lead Data Engineer Lead Data Engineer required to join my Client’s Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...

Adword Job Title: Data Architect (Insurance Domain) Location: London UK Hybrid role Responsibilities: Experience Level 15 years with at least 5 years in Azure ecosystem Role: We are seeking a seasoned Data Architect to lead the design and implementation of scalable data solutions … strategic insurance project The ideal candidate will have deep expertise in Azure cloud services Azure Data Factory and Databricks with a strong understanding of data modeling data integration and analytics in the insurance domain Key Responsibilities Architect and design end to end data ...

have a new opportunity for an IT Data Engineer to join our existing team as part of a new phase of expansion. Whilst we're looking for individuals with previous experience working for a Professional Services organisation, as a medium sized business we operate with a much smaller … multi skilled IT Team than you will find at larger enterprise companies. Although the role is primarily an IT Data Engineer, you will also need to be able to display BI Developer and strong Analytical skills and play a crucial role in designing, building, and maintaining our data ...

summary The Data Test Engineer plays a key role in ensuring the quality, reliability, and performance of the Trust's digital applications, data platforms, and integrated clinical systems, focusing on areas such as Electronic Patient Records (EPR), Clinical Applications, Interoperability, Data Systems, Infrastructure … Digital Assurance. Reporting to the Data Assurance and Quality Lead, the role requires strong expertise in data testing and validation and involves designing, executing, and maintaining manual and automated testing processes, ensuring that all systems meet the highest standards of performance, security, and usability. The Test ...

pipelines and transformation workflows using Databricks and Python. Ensure data platforms support analytics, business intelligence, and emerging GenAI/ML needs. Pipeline Development & Workflow Management Develop, optimise, and monitor ETL/ELT pipelines across various data sources. Implement data validation, governance, quality … engineering within the organisation. Ensure data models and pipelines effectively support reporting and decision-making. Performance & Continuous Improvement Monitor system and pipeline performance, ensuring SLAs are met. Evaluate and implement new technologies and tools to improve data capabilities. Automate and streamline processes to enhance ...

Data Engineer (Snowflake) We are seeking an experienced Data Engineer (Snowflake) to join our clients team on a permanent basis. This role will focus on administering and developing our Snowflake data platform, building robust data pipelines, and transforming data to support analytics and marketing activation use cases. The successful candidate will initially work on projects involving the ingestion of multiple data sources - including Google Analytics 4 (GA4)- and transforming data to surface insights within Google Ads. Key Responsibilities Administer, maintain, and optimise ...

Senior Data Engineer Salary: Up to £70,000 I am working with a forward-thinking organisation that is modernising its data platform to support scalable analytics and business intelligence across the Group. With a strong focus on Microsoft technologies and cloud-first architecture, they are looking … bring on a Data Engineer to help design and deliver impactful data solutions using Azure. This is a hands-on role where you will work across the full data stack, collaborating with architects, analysts, and stakeholders to build a future-ready platform that drives ...

Senior Data Engineer Salary: Up to £70,000 I am working with a forward-thinking organisation that is modernising its data platform to support scalable analytics and business intelligence across the Group. With a strong focus on Microsoft technologies and cloud-first architecture, they are looking … bring on a Data Engineer to help design and deliver impactful data solutions using Azure. This is a hands-on role where you will work across the full data stack, collaborating with architects, analysts, and stakeholders to build a future-ready platform that drives ...

Senior Data Engineer (Databricks) Full Time/Permanent £70,000 - £80,000 + car allowance, generous bonus, private medical and other extensive benefits Hybrid - 1 day a week in the Oxfordshire head office required The Company: My client is an industry leading and award-winning financial services organisation … closely with the Head of Data, Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from a wide-ranging dataset to support executive and operational decision making that will underpin sustained ...

Data & Integration's Lead (Azure) I am recruiting for a rapidly growing, multi-site healthcare organisation in the middle of a major digital transformation. As their Data & Business Intelligence function continues to expand, they require a hands-on Data & Integration's Lead/Manager … Essential: Strong hands-on experience with the Azure data platform Proven experience delivering API and enterprise system integrations ETL/ELT pipelines, data modelling, and data warehousing Understanding of how data feeds into Power BI and analytics platforms Desirable: GCP exposure ...

Senior Data Engineer The Senior Data Engineer will play a crucial role in designing, implementing, and maintaining scalable data pipelines and infrastructure. This position is ideal for those with strong technical expertise and a passion for working in the Insurance/Financial services industry. … Client Details Senior Data Engineer The employer is a medium-sized organisation operating in the F sector. They focus on delivering innovative solutions and maintaining a strong reputation for excellence in analytics and data-driven decision-making. Description Senior Data Engineer Develop and maintain ...

largest transformation programmes in government, modernising the digital systems that support over £7 trillion of property ownership. As a Senior Data Engineer, you will help establish a new data engineering capability, contributing to the development of reliable data pipelines and products that improve data access, integrity and value across the organisation. Your work will support programmes that shape how HMLR manages and uses its data for years to come. Salary up to £60,800, 29% employer pension contribution plus full Civil Service benefits. Flexible, hybrid working from Plymouth, Croydon ...

Lead Data Platform Engineer A fast-growing financial technology business is expanding its data capability and is looking for an experienced data professional to help shape and scale its analytics platform. This role is ideal for someone who enjoys building robust data foundations and wants greater exposure to solution design and platform architecture. You’ll be instrumental in evolving a cloud-based data environment, enabling reliable reporting, analytics, and downstream decision-making across the organisation. Working alongside product teams, engineers, and business users, you’ll translate complex requirements ...

Data Engineer | Hybrid | London | Databricks | Azure | 85k I'm working with a global powerhouse that's been setting the standard for excellence for over 60 years. With more than 1,000 projects delivered worldwide and a combined value exceeding $150 billion, they've earned a reputation … organisation where world-class projects meet an environment that prioritises your well-being and career development. I'm looking for a Data Engineer who thrives on innovation and loves tackling complex data challenges. If building scalable, cloud-based solutions excites you, this is your chance ...

Title: Senior Data Analytics Engineer Salary: £90,000 - £95,000 (+ Equity & Benefits) Location: London (4 days on-site) Overview We are partnering with a venture-backed, high-growth technology company that is entering a critical scale-up phase and doubling the size of its data team. Data is already core to how the business operates, powering day-to-day decision-making, product development, and long-term strategy and is now being significantly expanded to support the next stage of growth. The platform is live, complex, and scaling fast, with data ...

Senior DataBricks Engineer - £70,000 - Hybrid We're looking for a hands-on Senior Databricks Engineer to lead the delivery of scalable data solutions within an Agile environment. Working closely with the Data Product Manager and Data Architect, you will shape and develop … data models, schemas, and documentation. Operate CI/CD practices in Azure DevOps and contribute to Agile sprint cycles. Troubleshoot and resolve pipeline issues promptly. Stay current with industry trends and recommend improvements. Ensure adherence to governance standards. Line-manage and mentor a small team of Data ...

maintain feature stores, vector/embedding stores, and core data assets for ML. Develop and manage end-to-end traditional ML pipelines: data prep, training, validation, deployment, and monitoring. Implement data quality checks, drift detection, and automated retraining processes. Optimise cost, latency, and performance … computer science principes and statistical methods. Strong experience with cloud technology (AWS or Azure). Strong experience with creation of data ingestion pipeline and ET process. Strong knowledge of big data tool such as Spark, Databricks and Python. Strong understanding of common machine learning techniques ...

Administer Microsoft Fabric Lakehouse and Azure services Optimise performance across queries, datasets, and pipelines Apply data validation, cleansing, and standardisation rules Document pipeline logic and contribute to business-wide metadata catalogues Collaborate with BI, Change, and Product teams to align data outputs to needs Support … teams will be key to success in this role. You’ll be a technically strong data professional with hands-on experience in pipeline development, cloud-based data infrastructure, and performance optimisation. You will be at your best when working collaboratively in fast-paced environments ...

Data Engineer - London - Databricks - Azure - 75k + bonus + benefits I'm currently working with a company that continues to grow even after 60 years in operation. With more than 1,000 projects completed worldwide and a combined project value exceeding $150 billion, they've established themselves … near or far employees live. Tech Stack: Azure | Databricks | Power BI | Python They're looking to grow their team with a Data Engineer that thrives on innovation and cutting-edge technology. If you love solving complex data challenges and building scalable solutions, this is your chance ...

Data Engineer - FinTech Scale-Up Hybrid, London - £60,000 - £70,000 Company Our client is a fast-growing and innovative FinTech company at the forefront of analytics and technology. They have developed a proprietary, cutting-edge technology platform that integrates decision engines, databases, embedded modelling, analytics capabilities … third-party integrations. This organization is in full scale-up mode and is seeking top-tier talent to drive their data and engineering capabilities to the next level. The Role This is a fantastic opportunity for a skilled Data Engineer to take ownership of key aspects ...