1 to 25 of 90 Data Pipeline Jobs in the South East

analytics teams. Design architecture to support data consumption for reporting systems, operational applications, and analytics platforms. Implement automation, orchestration, and scalable pipeline frameworks using tools such as Apache Airflow. Collaborate with business stakeholders and technical teams to align the data platform with enterprise data … transformation and performance optimization Python (preferred) for automation and data engineering tasks. Data Engineering Enterprise ETL/ELT pipeline architecture Data warehousing and enterprise data modelling Dimensional modelling (Star Schema, Snowflake Schema) Data pipeline scalability ...

High-Growth Technology Consultancy | Hybrid (UK) Ready to work on complex, high-impact data challenges across industries like Private Capital Clients and Financial Services? We’re a fast-growing technology consultancy delivering advanced engineering solutions in highly demanding environments. Our model focuses on deploying top-tier engineers into … mission-critical projects, combining deep technical expertise with a strong delivery mindset. We’re now hiring a Data Scientist to design and build scalable data solutions for leading organisations. Why Join Work on high-impact, complex data projects Hybrid working with flexibility Collaborate with ...

Lead Data Analyst Salary: Up to £70,000 + Benefits Location: Esher - Hybrid (4 days onsite, 1 day remote) Working Hours: Full time - PermanentA large well-established firm has recently implemented Microsoft Fabric and is now seeking a Lead Data Analyst to take ownership … organisation's data and analytics capability. This role will lead the development of the company's data platform, ensuring data is transformed into meaningful insights that support decision-making across the business. The Lead Data Analyst will work across the full data ...

Were looking for a talented and passionate Core Data Engineer to join our Group Technology team in Milton Keynes. Youll play a key role in delivering Connells Group Reporting Data, covering architecture, data modelling, design, and pipelines. Youll work closely with technical specialists … Maintain the Common Data Model to ensure organisation-wide consistency. Apply Agile principles for iterative and collaborative development. Ensure data pipeline quality, reliability and performance. Develop, test and implement monitoring to ensure effective operation. Support cross-functional data projects, providing expertise as required. ...

passionate about data and eager to advance your career in a dynamic environment? Join our client as a Data Engineer and drive the growth and efficiency of the Data Warehouse and Data Pipelines alongside a talented team. This role is perfect … models using dbt Core and VS Code. Data Source Integration : Integrate new data sources into the Data Pipeline and Data Warehouse. Essential Skills and Experience : SQL : Proficiency in PostgreSQL or Snowflake SQL. dbt Experience : Preferably with dbt Core. Business Process ...

passionate about data and eager to advance your career in a dynamic environment? Join our client as a Data Engineer and drive the growth and efficiency of the Data Warehouse and Data Pipelines alongside a talented team. Why This Role Stands … models using dbt Core and VS Code. Data Source Integration: Integrate new data sources into the Data Pipeline and Data Warehouse. Essential Skills and Experience: SQL: Proficiency in PostgreSQL or Snowflake SQL. dbt Experience: Preferably with dbt Core. Business Process ...

Location: London, Watford or Bristol (Hybrid working options available) The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires strong expertise in Azure cloud services, Databricks, data engineering … DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain and enterprise data products. Overseeing Data Analysts ...

Full time hours. We are happy to discuss flexible working! Top 3 skills needed for this role: Expert in building scalable, high-quality data pipelines Hands-on experience with cloud data platforms The ability to optimise, automate, and deliver reliable data solutions independently What … this role is all about: Join us as a Data Engineer and become a driving force behind high-impact, high-performance data solutions. You’ll take ownership of designing and supercharging data pipelines that keep our business moving, bringing fresh thinking and technical flair ...

Role: Data Engineer (AI and Automation) Location: Milton Keynes (Hybrid – 3 Days In-Office Weekly) Salary: £45,000 – £55,000 Network IT are partnering with a large, enterprise-scale organisation undergoing significant modernisation of their data and automation platforms. We’re seeking an experienced Data … Monitoring and troubleshooting daily data operations, resolving issues following ITIL best practices, and implementing proactive improvements, alerting, and self-healing mechanisms. Enhancing pipeline performance and observability, improving monitoring, alerting, and automated preventative rules. Supporting data governance processes such as data quality, lineage, masking ...

ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries … lineage practices using Microsoft Purview . Build and maintain CI/CD pipelines to automate deployment of Fabric assets, notebooks, and data pipeline A bit about YOU! As much as we just love working with great, fun people, there are some obvious required Skills and Experience ...

Data Engineering Lead Milton Keynes Hybrid Permanent Full time - 35 hours £75,000 - £85,000 Join the ICAEW At ICAEW, you'll be part of an organisation that's shaping the future of business, finance and the accountancy profession on a global scale. Our bold 2030 Strategy puts … looking for a role with purpose, influence and opportunity, ICAEW is a place where your future can truly take shape. Role Profile The Data Engineering Lead is responsible for building and leading the data engineering capability at ICAEW, ensuring that data is collected, transformed ...

Cleared Data Warehouse Engineer - Outside IR35 - Remote Role Overview We are seeking a skilled Data Warehouse Engineer to design, build, and maintain scalable data warehouse solutions within the Microsoft Azure ecosystem. The role focuses on developing robust data models, optimizing analytical queries … supporting enterprise reporting through Azure SQL, OLAP technologies, and DAX-powered semantic models. You will collaborate with data engineers, analysts, and business stakeholders to ensure reliable, high-performance data pipelines and analytics platforms. Key Responsibilities Data Warehouse Development Design and develop enterprise data ...

Data Engineer Up to £80,000 About the Role I am seeking a technically strong Data Engineer to support the development and scaling of a modern cloud-based data platform within a fast-growing B2B SaaS organisation that specialises in marketing data integrity. The company provides a platform that helps organisations automate and standardise the flow of lead and marketing data across multiple systems, improving data quality, transparency and operational efficiency. Working within a small but growing data function, this role will focus ...

Data Engineer Up to £80,000 About the Role I am seeking a technically strong Data Engineer to support the development and scaling of a modern cloud-based data platform within a fast-growing B2B SaaS organisation that specialises in marketing data integrity. The company provides a platform that helps organisations automate and standardise the flow of lead and marketing data across multiple systems, improving data quality, transparency and operational efficiency. Working within a small but growing data function, this role will focus ...

Data Warehouse Engineer - Outside IR35 - Hybrid Job Summary We are seeking a skilled Data Warehouse Engineer with strong Power BI experience to design, develop, and maintain scalable data warehouse solutions and deliver impactful business intelligence dashboards. The ideal candidate will have expertise in data modeling, ETL/ELT processes, and Power BI reporting to support data-driven decision-making across the organization. Key Responsibilities Design, develop, and maintain enterprise data warehouse architectures and data pipelines. Build and optimize ETL/ELT processes to integrate data ...

analysts in developing predictive models and advanced analytics solutions.* Architect, maintain, and scale robust data infrastructures, including ETL/ELT pipelines, data lakes, and warehouses.* Establish and maintain a comprehensive data governance framework meeting regulatory and security standards.* Partner with cross-functional teams … functions. * Hands-on experience with machine learning, predictive modelling, statistical analysis, and integration strategy/implementation. * Experience implementing and managing ETL/ELT pipelines, data lakes, and data warehouses. * Proven track record of successfully leading organization-wide transformation of data strategy & supporting governance. ...

Trading Data Engineer Abingdon, Oxfordshire (Hybrid - 1-2 days per week in office) Up to £55,000 DOE + Bonus + Excellent Benefits Applicants must be within a 1 hour 30 minute commute of Abingdon. Due to significant company growth, a newly created and exciting opportunity has arisen … Delta Lake tables and SQL databases, applying strong data modelling and optimisation strategies. Develop monitoring dashboards and alerting to ensure transparency around pipeline health and data freshness. Implement data validation and reconciliation checks across multiple market data sources. Optimise pipeline ...

Data Engineer Full Time/Permanent £55,000 - £60,000 plus up to 20% bonus, private medical and other extensive benefits Hybrid - 1-2 days a week in the North Oxfordshire head office The Company: My client is an industry leading and award-winning financial services organisation … possess: Proven experience with databricks Proficiency in programming languages such as Python, Spark, SQL. Strong experience with SQL databases. Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. Knowledge ...

Databricks Data Architect - Hybrid - Permanent Job Summary We are looking for a Databricks Data Architect with Databricks certifications to design and implement scalable data platforms using the Databricks Lakehouse architecture. The role involves building modern data pipelines, optimizing data platforms … Data Engineer Associate/Professional) Strong experience with Databricks, Apache Spark, and Delta Lake Proficiency in Python, SQL, and data pipeline development Experience with cloud platforms (Azure, AWS, or GCP) Solid understanding of modern data architecture and big data solutions ...

Databricks Data Engineer Up to £75,000 I am currently recruiting for a Databricks Data Engineer to support the delivery of modern data platform and engineering programmes within a growing data focused consultancy. Working across a range of enterprise clients, this role … focuses on designing and delivering scalable data solutions using the Databricks Data Platform. This position sits at the intersection of data architecture, engineering delivery and client engagement. You will be responsible for building robust data pipelines, supporting cloud data platforms ...

Architect is responsible for designing, developing, and overseeing the architecture of artificial intelligence solutions leveraging Palantir Foundry as a core enterprise data platform. This role works closely with stakeholders and technical teams to ensure scalable, secure, and effective AI implementation that aligns with business objectives and drives value … governance, and ethical considerations in all Foundry-based AI solutions. Lead review and troubleshooting of system architecture, AI performance, reliability, and data pipeline health on Foundry. Stay informed of AI, ML, data engineering, and Foundry platform advancements, championing adoption of innovative solutions. Qualifications: Bachelor ...

will be responsible for: Designing, implementing, and maintaining scalable data pipelines and ETL processes Developing and optimising databases and data storage solutions for structured and unstructured data Collaborating with data scientists and analysts to deliver reliable, high-quality data … building and maintaining ETL pipelines and data workflows Familiarity with cloud data platforms (AWS, Azure, GCP) and data pipeline orchestration tools (Airflow, Prefect, etc.) Understanding of data modelling, schema design, and performance optimisation Experience with agile development methodologies, including Scrum ...

Interim Head Of Data & Digital Architecture 3-6-Month Contract | Inside IR35 | £600-£800 per dayRemote First with Occasional National TravelStart: ASAP Your New Organisation A large, national, mission-driven organisation is undergoing significant digital, data and technology modernisation. To maintain momentum during a period … transition, they are seeking an Interim Head of Data & Digital Architecture to provide technical leadership, delivery assurance and stability across their data and digital transformation portfolio.This is an ideal role for an experienced interim who can quickly embed, guide teams, and take ownership of critical data ...

Overview: We are working with a leading UK-based wealth and investment management firm seeking a skilled Data Engineer to support the build and evolution of their modern data platform. This role will focus on developing scalable data pipelines and contributing to a cloud … native lakehouse architecture. Key Responsibilities: Design, build, and maintain robust data pipelines using Azure-based services Develop and optimize data workflows within Databricks Implement and manage data ingestion processes, including real-time streaming with Kafka Structure and maintain data across bronze, silver ...

seeking a skilled Data Engineer to join a fast-paced analytics team within the technology industry. This temporary role, based in London, requires a strong technical background to support data processing and integration tasks. Client Details A global technology leader known for pioneering innovation across consumer … with the ability to approach problems both strategically and creatively. Background in designing scalable data warehouse architectures and enhancing data pipeline performance. Practical experience working with analytics for mobile applications. Demonstrated capability to influence stakeholders and drive technical projects to completion. Solid understanding of data ...