101 to 125 of 274 Data Pipeline Jobs in the South East

engineering, and publishing in one role. This is a fantastic opportunity to join a growing, tech-forward quant research team. As a Senior Data Scientist, you’ll be joining a collaborative and innovation-focused environment where you’ll help solve complex problems using modern AI and machine learning … techniques. You’ll work on designing intelligent systems that uncover hidden signals in data and influence how assets are allocated. What you’ll be doing: This role is ideal for someone who’s motivated by research, enjoys working with large-scale data systems, and wants to … unstructured or alternative sources) Strong coding ability in Python; familiarity with cloud environments and scalable data platforms Experience with data pipeline tools (e.g. Kafka, SQL, DevOps, microservices) Prior publications, patents or research contributions What you’ll get in return: A salary of between More ❯

is seeking a software engineer to join their team in Mayfair, London. We are looking for a Senior Backend Software Engineer with strong data engineering skills to join a small, agile team developing software solutions for our energy supply and trading functions. Hybrid working is in play, with … days at home. Software Engineer- About the role: My client’s energy business is growing rapidly with a strong focus on using advanced data systems and analytics to deliver exceptional service. We are looking for someone to take ownership of the backend architecture that underpins our analytics applications … Databricks Containerisation: Docker, Kubernetes CI/CD: Azure DevOps, GitHub Actions Relational databases and data lake architecture Model and data pipeline integration (e.g. MLflow) Microsoft Azure (Functions, Storage, Compute) Monitoring tools (Grafana, Prometheus, etc.) Mentoring and knowledge sharing within the team Senior Engineer - Desirable Skills More ❯

Data Manager | London 3 or 4 times a month |£74,000-£84,000 + Huge Bonus My client, a forward-thinking organisation in the interactive tech and entertainment space, is on the lookout for an experienced Engineering Manager to head up their data engineering function. This … a high-performing team to deliver it. You'll collaborate with analysts, scientists, and stakeholders to design fast, scalable pipelines and shape the data architecture that fuels innovation. What You'll Be Doing: Lead a team of data engineers, providing technical guidance, mentoring, and support. Oversee … the build and optimisation of scalable data pipelines and robust ETL workflows. Partner with teams across the business to gather data requirements and deliver accessible, reliable datasets. Champion best practices in data quality, governance, and platform security. Modernise and evolve the data More ❯

We are seeking a skilled senior data engineer to join a dynamic team in London responsible for building a global and scalable data lakehouse which will be used by multiple trading desks at the fund. This role offers the opportunity to work with cutting-edge technologies … and collaborate with multiple trading teams to drive data-driven decision-making. Key Responsibilities: Design, develop, and maintain a robust data lakehouse solution for use by multiple trading desks. Collaborate with trading teams to understand their data needs and provide tailored solutions. Implement data pipelines in python using data libraries and cloud software development kits (APIs). Optimise performance, data storage and retrieval processes for efficiency and scalability. Ensure the data lake and Online Analytical Processing DB (OLAP - Redshift or similar) is able to handle large More ❯

Data Engineer (Airport/Manufacturing Experience Required) Location: Middlesex 3 days in the office 2 days' work from home Salary: Negotiable to 70,000 Dependent on Experience Job Reference J12953 Please note we can only accept applications from those with current UK working rights for this role, this … client cannot offer visa sponsorship. A market leading global logistics organisation seeks an experienced Data Engineer to support the development and optimisation of data pipelines. The role will focus on ensuring the reliable flow of information across the business, maintaining the highest standards of quality data … and collaborative team working in a fast paced, team orientated environment. Job Role and Responsibilities Assist in the design, development, and maintenance of data pipelines and ETL processes Collaborate with data scientists, analysts, and other stakeholders to ensure accurate data collection and delivery Monitor More ❯

Data Engineer (Airport/Manufacturing Experience Required) Location: Middlesex 3 days in the office 2 days' work from home Salary: Negotiable to £70,000 Dependent on Experience Job Reference J12953 Please note we can only accept applications from those with current UK working rights for this role, this … client cannot offer visa sponsorship. A market leading global logistics organisation seeks an experienced Data Engineer to support the development and optimisation of data pipelines. The role will focus on ensuring the reliable flow of information across the business, maintaining the highest standards of quality data … and collaborative team working in a fast paced, team orientated environment. Job Role and Responsibilities ·Assist in the design, development, and maintenance of data pipelines and ETL processes ·Collaborate with data scientists, analysts, and other stakeholders to ensure accurate data collection and delivery ·Monitor More ❯

Staffworx are planning for future talent pool projects. Azure Data Engineer with AI/Machine Learning experience for a leading specialist consulting ogranisaiton and Digital FS Fintech client. Key Responsibilities for the Azure Data Engineer. Excellent experience in the Data Engineering Lifecycle, you will … have created data pipelines which take data through all layers from generation, ingestion, transformation and serving. Strong experience in building data solutions using Azure, Azure Data Lake Storage Gen2, Azure Databricks, Azure Data Factory, Azure Synapse, Data Fabric. … Azure certified Data Engineer/Architect Knowledge of Machine Learning and NLP unstructured data. Implemented ML platform in enterprise client experience of ML use-cases AIML Platforms: DataRobot, Dataiku, Anaconda, Sagemaker, Vertex etc. AIML Frameworks: MLFlow, KubeFlow, BentoML, TensorFlow etc. AIML Development: PyTorch, Jupyter Notebooks, XGBoost, Tensorflow etc. More ❯

Data Engineering Team Lead London x2 days a month A fast-growing technology company is looking for an experienced Data Engineering Team Lead to guide and grow its core data infrastructure. This is a key leadership role for someone excited about building scalable systems … managing a high-performing team, and collaborating across disciplines to support advanced analytics, product development, and data-driven decision-making. Role Overview You'll take ownership of the data engineering function, ensuring the systems in place are robust, efficient, and capable of handling the company’s … and advising on architecture, this role balances technical execution with strategic oversight. In this role, you’ll: Lead and support a team of data engineers working on the company’s key data platforms Design and implement reliable, high-throughput data pipelines to serve diverse More ❯

cutting-edge AI Innovation Team, and we are looking for an exceptional Machine Learning Engineer/MLOps Engineer/AIOps Engineer/AI Data Engineer/Data Scientist/Data Science Engineer/Software Engineer Tech Lead to be at the heart of this … transformation. Call it what you want, but this is a critical role for someone who can bridge the gaps between data science, data engineering and software engineering, ensuring AI/ML models are successfully built, deployed and scaled. You will work on real-world machine learning … doing: Develop and deploy AL/ML artificial intelligence/machine learning models for large-scale business applications. Build and maintain high-performance data pipelines, integrating structured and unstructured data sources. Take AI models from prototype to fully scalable production systems. Implement CI/CD pipelines More ❯

re on a mission to create a virtual sales agent that performs better than a human sales agent. We’re looking for a Data Engineering Manager to lead a small team in building a key part of our data infrastructure - evolving and scaling the ingestion of … internal systems. This role blends people management, individual contribution, and technology leadership. People Management: You will lead and mentor a small team of Data Engineers, fostering a high-performance culture by guiding their professional growth and ensuring effective communication within the team and with stakeholders. Your strong interpersonal … Python and Docker in our pipelines. You’ll need to be highly proficient in these or similar tools and comfortable navigating a modern data ecosystem. The person we’re looking for Passionate about designing and delivering solutions to complex problems Curious with a desire for continuous learning Friendly More ❯

Role: Data Engineers Location: Reading, Hybrid working 2-3 days a week Salaries: £40,000-£55,000 We're seeking a number of skilled Data Engineers to join one of our growing clients based in Reading! In this role, you'll play a key part in … designing, developing, and maintaining data solutions that drive digital transformation for our clients. Key Responsibilities: Design and implement data solutions using SQL and cloud-based technologies. Manage data migration and transformation projects. Collaborate across teams to integrate data solutions. Build scalable, secure … data architectures using Azure services. Required Skills: Advanced proficiency in SQL (MS SQL Server/PostgreSQL), with strong experience in query optimisation and performance tuning. 3years+ commercial experience Expertise in Azure services like Data Factory, SQL Database, and Synapse Analytics. Strong knowledge of ETL/ELT More ❯

Lead Data Engineer | Build and Lead a New Data Team I am looking for a Lead Data Engineer to establish and lead a new Data Engineering team. This is a unique opportunity to shape data architecture from the ground up … working with cutting-edge technology to drive business performance. The Role As the first Data Engineering hire, you will: Design and implement scalable data architectures for efficient storage and access. Build and maintain data pipelines handling terabyte-scale datasets. Work closely with data scientists, analysts, and stakeholders to optimize data solutions. Own the reliability, performance, and scalability of data infrastructure. Recruit and lead a growing team of data engineers. Tech Stack Python (3.10+), Pandas, NumPy PostgreSQL (TimescaleDB), SQL optimization RabbitMQ, ZeroMQ, Linux servers Prometheus, Grafana More ❯

Our client, a top systematic hedge fund, are seeking an experienced Python developer to join their Data Team (Alpha Data), which is responsible for delivering vast quantities of data to users worldwide. Heavily responsible for data pipelines. This role involves becoming a … technical subject matter expert and developing strong relationships with quant researchers, traders, and colleagues across the Technology organisation. The Data teams deploy valuable data quickly, ensuring ingestion pipelines and data transformation jobs are resilient and maintainable, with data models designed in collaboration … code quality. They value teamwork, collaboration, excellence, diversity of thought, and creative solutions, emphasizing a culture of learning, development, and growth. Responsibilities: Manage Data Pipelines: Take part ownership of the expanding estate of data pipelines, ensuring they are robust, efficient, and scalable. Innovate and Improve: Propose More ❯

Data Scientist (Mid Level) - Maidenhead We are looking for a mid-level Data Scientist to join our client's growing team. You will use your skills in data analysis and machine learning to uncover insights, build predictive models, and support decision-making across various … projects. You’ll also work closely with engineers, product teams, and other stakeholders to deliver data-driven solutions. Benefits: Pension Health insurance Employees will be receiving a quarterly stipend to spend Employee Assistance programme – wellbeing 25 days holidays Group Life assurance scheme Long Term Disability Scheme Key Responsibilities … identify patterns and insights Build and improve machine learning models to solve business problems Design and analyze experiments (A/B testing, etc.) Data Engineering Support Work with data engineers to ensure clean, usable data Build and maintain data pipelines for model More ❯

seeking a People Systems Analyst to focus on building Power BI skills and a consultative mindset to support the HR team in leveraging data to drive strategic future decisions. The ideal candidate will be experienced in HR systems, reporting, and analytics, and have a proven ability to translate … data insights into actionable recommendations for stakeholders across the business. Responsibilities: Power BI Reporting & Dashboarding Design, develop, and maintain interactive Power BI dashboards and reports focused on workforce data, DEI, engagement, turnover, and other people metrics. Ensure data integrity and consistency by creating robust … data models and using Power Query effectively. Automate reporting processes and create scalable solutions for recurring data needs. HR Systems & Data Management Work with HRIS (e.g., Workday, SAP SuccessFactors, Oracle HCM, etc.) to extract and manipulate data for reporting and analysis. Collaborate More ❯

Role: Analytics Engineer/Data Analyst Duration: 3 Months Rolling Rate: £350-400/Day (Outside IR35) Location: Remote (Occasional London Office visits) We are seeking a highly skilled Analytic Engineer/Data Analyst for a 3-month contract position within the wellness industry. This is … a fully remote role with occasional office visits to London as required. The successful candidate will play a key role in a major data migration project focused on redesigning and optimising a Looker instance. This position offers a competitive daily rate of £350-£400 and operates outside IR35. … The ideal candidate will possess a strong background in data analytics, with particular expertise in business intelligence tools and data modelling. You will work closely with other data professionals to ensure a smooth migration and to maximise the performance and usability of the Looker More ❯

Position: GCP Data Engineer Employment Type: Contract, Full time Start: ASAP Location: London – Hybrid Languages: English Role – We are seeking a GCP Data Engineer to join our client’s dynamic team and help us architect and optimize our cloud-based data infrastructure. Key skills … 5+ years of experience in data engineering, with at least 1–2 years hands-on with Google Cloud Platform. Strong experience with BigQuery, Cloud Storage, Pub/Sub, and Dataflow. Proficient in SQL, Python, and Apache Beam. Familiarity with DevOps and CI/CD pipelines in cloud environments. … Experience with Terraform, Cloud Build, or similar tools for infrastructure automation. Understanding of data warehousing concepts and architecture. Consulting background is a plus. Strong communication skills (oral & written) Rights to work in the UK is must (No Sponsorship available) Responsibilities: Design, build, and maintain scalable and reliable data More ❯

Senior Consultant - Data & AI Disruptive Global Strategy Consultancy 🏠 Hybrid/London 💸 £65k - £75k plus bonus & equity Omnis Partners is delighted to be partnered with a disruptive, innovative strategy consultancy, hiring for highly commercial and strategic Senior Data Consultants with an array of expertise across the data lifecycle and a digital first mindset. You will spearhead the design, shaping and delivery of innovative data science, AI and analytics solutions for a portfolio of clients. This individual will play a pivotal role in seamlessly aligning technical solutions with business objectives, ensuring clients realise maximum … value from a range of data products and solutions. Key Responsibilities: Solution Design & Delivery Collaborate with clients to understand their business challenges, objectives, and data needs. Design end-to-end data solutions in partnership with engineering and consulting teams, from discovery to deployment, tailored More ❯

an experienced Senior Machine Learning Engineer with a passion for AI? Do you have a proven track record of harnessing the power of data, developing advanced algorithms, and building predictive models? If so, AI71 offers a unique opportunity for you to play a pivotal role in shaping AI … actionable machine learning tasks. Model Optimization : Continuously monitor, evaluate, and improve models based on real-world performance and evolving business needs. Data Pipeline Maintenance : Implement and manage robust data preprocessing pipelines to ensure high-quality, reliable input data for model development. Qualifications Experience … 5+ years of experience in AI, Machine Learning, Reinforcement Learning (RL), Data Science, or a related field. Expertise in LLMs : Proven experience with Large Language Models (LLMs) and fine-tuning techniques. Education : Master’s or Ph.D. in AI, Data Science, Computer Science, Statistics, or a related More ❯

Job Title: SC Cleared Data Engineer Location: London - regular travel to client sites will be required. Contract Type: Permanent Salary: All levels considered Overview: I'm currently seeking SC Cleared Data Engineer or Data Scientists to join my rapidly growing client. This exciting opportunity … will involve working on critical projects within the UK government sector, leveraging cutting-edge technologies to manage and process large-scale data sets. Key Responsibilities: Design, develop, and maintain data pipelines to process large datasets. Ensure the security, integrity, and quality of data in … compliance with government standards. Collaborate with cross-functional teams to deliver innovative data solutions. Troubleshoot and optimise data workflows for maximum performance and reliability. Requirements: Active SC clearance . Proven experience as a Data Engineer or Data Scientist, preferably in a government More ❯

Data Scientist Remote (UK-Based) Up to £45,000 The Company This UK-based start-up has grown rapidly in just two years. With a team of ~30 people, they are scaling quickly, supported by recent funding and a strong growth pipeline. They specialise in predictive analytics, tracking … KPIs for a wide range of companies and industries. Their insights empower investors to make informed decisions by providing performance data ahead of public reports. The Role As a Data Scientist, you’ll play a pivotal role in developing and refining KPI prediction models, working with … real-world data to create actionable insights. Clean and process data to ensure accuracy and usability. Build and maintain linear regression models for KPI tracking. Access APIs and integrate software tools to enhance workflows. Collaborate with the revenue team to generate insightful reports. Support internal product More ❯

Location: London, Hybrid 💰 Rate: Up to £600 per day 📆 Contract: 6 months (Outside IR35, potential to go perm) 🛠 Tech Stack: Azure Data Factory, Synapse, Databricks, Delta Lake, PySpark, Python, SQL, Event Hub, Azure ML, MLflow We’ve partnered with a new AI-first professional services consultancy that’s … a founding team of contractors with the view to scale into permanent leadership as the business grows. They’re now hiring a Senior Data Engineer to build robust, scalable data solutions powering AI, analytics, and future client delivery. If you love creating high-performance data … clean, governed data layers for ML, analytics, and application use 🔹 Supporting LLM/AI data workflows through structured and unstructured pipeline design 🔹 Contributing to reusable data engineering components across client and internal use cases 🔹 Collaborating with data scientists, architects, and product More ❯

Senior Data Engineer – Financial Services Sector Location: London (4 days per week in-office) Salary: up to £80,000 We are working with a financial services company currently undergoing a significant data transformation. This is an exciting opportunity for a Senior Data Engineer to … join the team and help build a modern, cloud-first data environment. About the Role: In this hands-on engineering role, you will work with a range of tools and technologies, including SQL, Azure, and cloud-based solutions, to develop and optimise scalable data pipelines. The … role will also involve establishing data governance and ensuring the seamless flow of data throughout the organisation. You’ll have the opportunity to work with the latest technologies in the industry, including Azure, Microsoft Fabric, and modern data architecture practices, while collaborating with cross More ❯

Select how often (in days) to receive an alert: VIE Data Scientist Databricks About Crown Crown Holdings, Inc. , is a world leader in the metal packaging production process. We design and manufacture a wide range of innovative and sustainable metal packaging solutions and products. Our clients are some … to our long-term future. About this opportunity Your work environment : Our European Information Systems and Services (EISS) department is looking for a Data Scientist Databricks Engineer on a VIE contract for 12-24 months based at Wantage (UK). With a good background in data engineering, you will support our IT Teams in the development and maintenance of data dashboards using Microsoft technologies (including Power BI, Azure Data Factory) and Databricks. The ideal candidate will be capable to learn or have a first experience in designing scalable data More ❯

Company: My client are a fast-growing fintech transforming how people manage and move money. As a Data Engineer, you’ll play a pivotal role in building and scaling the data infrastructure that powers everything from real-time fraud detection to personalized financial insights. Key Responsibilities … Design, build, and maintain scalable data pipelines (batch & streaming) Work with Data Scientists and Analysts to enable fast, reliable access to data Optimize our data architecture for performance, reliability, and cost Collaborate with engineers to integrate data best practices across … teams Champion data quality, governance, and documentation Key Requirements: Strong experience with Python, SQL, and modern ETL tools (e.g., Airflow, dbt) Solid grasp of cloud platforms (AWS/GCP/Azure) and data warehouses (e.g., BigQuery, Snowflake) Familiarity with streaming technologies (Kafka, Kinesis, etc.) Passion for More ❯