1 to 25 of 80 Data Pipeline Jobs in Oxford

Key Responsibilities: Data Pipeline Development: o Develop and maintain data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, files) into the Azure Databricks platform. o Implement data extraction, transformation, and loading (ETL) processes. o Ensure data pipelines are efficient, reliable, and scalable. Data Transformation & Processing: o Implement data transformations using Spark (PySpark or Scala) and other relevant tools. o Perform data cleaning, validation, and enrichment. o Ensure data quality and consistency. Azure Databricks Implementation: o Work … in team meetings and code reviews. Automation & DevOps: o Build CI/CD pipelines, for environmental deployments. o Contribute to automating data pipeline deployments and other data engineering tasks. o Learn and apply DevOps principles. More ❯

Job Title: Senior Data Engineer Key Requirements: 4-8 years of experience from tier 1 or 2 big tech companies Job Location: Abu Dhabi, UAE Benefits: Work with cutting-edge technology through modern infrastructure and automation projects Thrive in a growth-focused environment that prioritizes learning, innovation, and … role requires a deep understanding of modern data engineering practices, real-time processing, and cloud-native solutions. Key Responsibilities: Data Pipeline Development & Management: Design, implement, and maintain scalable and reliable data pipelines to ingest, transform, and load structured, unstructured, and real-time data … environments. Machine Learning & Advanced Analytics Enablement: Collaborate with data scientists to prepare and serve features for ML models. Maintain awareness of ML pipeline integration and ensure data readiness for experimentation and deployment. Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow More ❯

Data Management Specialist (Azure) - Newcastle/Hybrid You will provide expert-level troubleshooting, root cause analysis, and performance optimisation for data platforms,, such as Azure SQL databases, Fabric Warehouse and Onelake, Databricks, and Azure Data Factory. Purview or another MDM tool is highly desirable. … Skills/experience Bachelor’s degree in Information Technology, Computer Science, Data Management, or a related field. 4+ years of experience in data management, data operations, or IT support roles, with at least 2 years in Level 3/4 support or equivalent. Hands … on experience with database technologies ( Azure landscape , Oracle, PostgreSQL, etc.). Desirable: Industry certifications in professional data management, cloud platforms (AWS, Azure, GCP), metadata management, or database administration (e.g., Microsoft Certified: Azure Data Engineer Associate, DAMA CDMP) are desirable. Proven experience with ETL tools, data More ❯

Key aspects of the role include: Data Pipeline Development: Architect, develop, and optimise data extraction, transformation, and loading (ETL) processes for high-volume healthcare data. Integration of NHS Systems Data: Work directly with NHS data sources and ensure seamless integration of … systems like UDAL, NCDR, SUS+, HES, and ODS into our analytics platform. System Performance: Monitor and enhance the performance of our data systems to ensure reliability and responsiveness. Collaboration: Partner with data scientists, analysts, and stakeholders to ensure that data solutions align with business … needs and analytic strategies. Scalability & Security: Implement and enforce best practices for data security, quality, and scalability across our data infrastructure. Essential Skills: Healthcare Data Expertise: Proven experience in designing and managing data solutions within healthcare environments. Demonstrated ability to work with More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

join us at FPSM and be part of something bigger... What we are looking for: We are seeking a highly motivated and experienced Data Product Manager to own the strategy, roadmap, and execution of our Customer Data Platform (CDP) and Single Customer View (SCV). This … is a critical role within our rapidly growing data organization, and you will be instrumental in enabling data-driven decision-making across the business. You'll work closely with engineering, marketing, product, and other internal teams to ensure our CDP is a powerful tool for understanding … with overall business objectives and stakeholder needs. Requirements Gathering: Proactively gather, analyze, and prioritize requirements from internal stakeholders (marketing, product, analytics, etc.) for data integration, access, and utilization. Data Source Integration: Oversee the integration of various data sources into the CDP, ensuring data More ❯

London (links Piccadilly in the south to Oxford Street in the north) **Work Arrangement:** In-office only, five days a week. **Job Title:** Data Architect/Data Engineer **Experience Required:** 7-8 Years **Role Overview:** We are seeking a Senior Data Architect/Data Engineer to design and implement scalable data solutions, including real-time and ETL/ELT data pipelines. Responsibilities include optimizing our data warehouse, creating Power BI reports, and developing AI-driven solutions using OpenAI APIs. **Key Responsibilities:** - Design and implement robust real … time data pipelines from diverse sources. - Maintain a high-performance data warehouse for reporting and analytics. - Develop insightful Power BI dashboards and reports for stakeholders. - Use Azure Data Factory, Azure Functions, and Logic Apps for data integration. - Employ Python and SQL for More ❯

Senior Data Developer - Flexible location Bibby Financial Services have an exciting opportunity available for a dynamic Senior Data Developer to join our team, working in any of our UK locations . You will join us on a full time, permanent basis and in return, you will … an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained … engineering or a related field. Proficiency in programming languages such as Python, Spark, SQL. Strong experience with SQL databases. Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. There's no More ❯

make better use of it. We provide advice, support and delivery services across various industry sectors covering a multitude of areas, ranging from Data Strategy, Governance and Security to Data Platform Modernisation, Cloud and Customer Intelligence. We do everything with a view to creating tangible business … measure how we are performing and ensures we deliver the value that our customers deserve. Summary We are seeking a skilled and proactive Data Engineer with experience in Microsoft Fabric to join our growing data team. You will be responsible for developing, maintaining, and optimising data … lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity with DevOps practices, particularly around data pipeline deployment. Good problem-solving skills and the ability to work under minimal supervision. Effective communicator with stakeholders of varying technical expertise. Benefits Annual Leave More ❯

Azure Data Engineer/Consultant – Up to £75K + Bonus Location: Remote (UK-based, with very occasional travel) Salary: Up to £75,000 + bonus Company & role Join one of the UK’s most advanced Microsoft partners, specialising in Azure-led Data & AI solutions. This consultancy … is known for transforming data into tangible value through innovative platforms and strategic data services. With a collaborative team of experts, they deliver impactful solutions across enterprise clients, leveraging the very latest in Microsoft technology. Why This Role Stands Out Play a key role in shaping … across the Azure Data Platform (Fabric, Synapse, Databricks, Data Lake, Data Factory, Purview, etc.) Strong data pipeline and ETL skills, including data modelling and transformation Experience implementing Medallion Architecture (Bronze, Silver, Gold layers) in lakehouse or Databricks environments Familiarity More ❯

Azure Data Engineer Remote (UK-based) Up to £60,000 per annum About the Company We are a leader in the insurance sector, committed to data-driven decision making and modernising our technology landscape. As part of our continued growth, we’re seeking a skilled Azure … Data Engineer to support our data platform and engineering initiatives. Role Overview As an Azure Data Engineer, you will be instrumental in designing, building, and optimising data pipelines and architecture in our Azure environment. This role is ideal for someone with strong … SQL skills and a background in Azure data services, looking to play a key role in transforming and scaling our data operations. Key Responsibilities Develop and maintain scalable data pipelines in Azure. Build and optimise data integration workflows using Azure Data More ❯

Data Engineer/Data Architect Location: Penryn, Cornwall- On premise About Us: Aspia Space is building the next generation of planetary intelligence. We transform observational data into trusted, consumable intelligence for agriculture, finance, environmental planning and policy. From our offices in Harwell and Cornwall … we push Earth data to its limits to deliver insights no one else can, developing products that combine satellite imagery and expert ground truth with the very best observational science and deep learning tools to support clients across the world, powering everything from smallholder farming programmes in Africa … impact. Our ambition is global, but our focus is always local, measurable, and relevant. Role Overview: We’re looking for a highly skilled Data Engineer/Data Architect who can hit the ground running and join us in our Penryn office. You will be instrumental in More ❯

A high performing, multi-billion dollar AUM hedge fund are looking to make a newly created Data Analyst hire into their rapidly growing centralised Data Management team. Reporting into the Global Head of Data and taking on a highly visible role within the team … the hire will be working very closely with Operations, Product Control, Risk, Trading and Research teams to ensure the smooth transmission of data, in … a role that has a highly technical/engineer angle. You will optimize the operation and quality management of the internal data pipeline with oversight of raw data initially being onboarded through to the delivery of datapoints to front office/investment teams. You will More ❯

collaboration, recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: The Data & AI Solutions Deployment Architect will be instrumental in architecting and deploying Azure Data & AI Solutions. A solid, technical, ‘hands-on’ (not just … grasp of Azure Fabric is essential as we navigate clients through all of the infrastructure, coding, and product development lifecycle challenges around successful Data and AI implementation and deployment. This customer-centric position involves delivering projects, conducting workshops and physically working on client’s environments via Python, and … C#. This role would suit an experienced Data platform engineer or Data Solutions Architect who thrives in working across multiple projects with a diverse range of clients, and who places the importance of bridging the gap between complex data problems and real life product More ❯

Role Title: Lead Data & Insights Engineer Salary: £65,00-£80,000 Location: UK Remote Full-time | Permanent | 37.5 hours/week Apply by: 12/06/2025 Hiring Manager : Phil Walter | Recruiter: Rikki Spencer-Cox Help us “Elevate Education, Everywhere.” Team: Technology & Digital | Etio At Etio, we … We manage both internal and partner delivery streams, bringing resilience to complex systems and driving continuous improvement across live services. The Role: Lead Data & Insights Engineer We're looking for a strategic and delivery-focused data leader to join Etio as our Lead Data … who combines deep technical expertise with strong autonomy and a sharp eye for operational value. This is the perfect opportunity for a senior data professional who wants to own and evolve data architecture across a growing organisation. You’ll act as the primary in-house expert More ❯

Senior Data Engineer Bristol 6-month contract Paying up to £80p/h (Outside IR35) *** Please note that due to the nature of the work you must hold or be eligible to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards. … Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity. Develop robust data models to support analytics and reporting within secure environments. Perform troubleshooting, debugging, and performance tuning of data pipelines and the Elastic Stack. More ❯

Job Title: Data Operations Engineer Location: Hybrid – 1 day per fortnight in the Wilmslow offices Working hours 8am to 16:30pm The Role Following recent investment, The Citation Group are looking to build out their data capabilities to be Best in Class. As such, a fantastic … opportunity has arisen for a strong data engineer to work in the data engineering team to maintain robust data pipelines. We’re looking for a business focussed individual, who can work independently in time sensitive situations to ensure the reliability of data … on issues impacting them managing Data Warehouse small change overseeing deployments maintaining documentation on team processes designing and maintaining data pipeline performance reporting The Person We are looking for someone who can roll their sleeves up and ‘dig in’ with the rest of the team. More ❯

Data Engineer We’re working with a forward-thinking Microsoft partnered consultancy who are looking for a Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects on Databricks implementations. … You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design to insights creation. … This is a fantastic opportunity for someone who is passionate about building scalable, high-performance data solutions utilising the latest cutting-edge cloud technologies. As part of this role, you will be responsible for some of the following areas • Design and develop scalable data pipelines to More ❯

a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for an experienced Azure Data & AI Engineer with a strong focus on advanced analytics, machine learning, and applied AI - particularly Generative AI. This role will suit a technically capable … Insights or Log Analytics. KEY RESPONSIBILITIES: Have 5+ years of technical consulting or a similar chronology of demonstrable success in coding and deploying Data and AI models onto Azure environments. At least one year using Azure Fabric Create scalable and reliable data pipelines for data processing, transformation, and storage. Establish and enforce data governance policies and be ‘hands-on’ in exploratory data analysis to identify and measure quality gaps that are a block to Data and Ai implementation. Implement robust security measures to protect sensitive data More ❯

Azure Data Architect Contract role - Inside IR35 Windsor, UK – Hybrid (1 day per week on-site) 6 Months - options to extend Must have or be eligible for SC Clearance We are currently working with a leading, global technology consultancy who are looking for an experienced Azure Data Architect to join a major transformation programme within the energy sector. This role focuses on shaping data strategy and architecture across a large-scale smart metering initiative. Key Responsibilities: Interpret complex, large-scale datasets to deliver meaningful insights Source, transform, and manage data across … the Azure ecosystem Design and implement robust data models for analytics and reporting Ensure data quality, integrity, and lifecycle governance Collaborate with cross-functional teams to deliver data-driven outcomes Resolve issues related to data accessibility, consistency, and analysis Key Skills & Experience More ❯

Job Title: Data Analyst Location: LS12, On-site Reports To: Marketing Director/Operations Manager Job Type: Full-Time Salary: £40- £45k DOE About Yorkshire Dental Suite Yorkshire Dental Suite is a leading private dental practice, known for its innovative approach to patient care, advanced cosmetic treatments, and … a commitment to excellence. As we continue to grow, we’re looking for a data-driven professional to help us make smarter business decisions through insightful analysis and strategic guidance. Role Overview We're looking for a proactive Data Scientist/Analyst to join our growing … performance across all areas of the business, with a strong focus on marketing campaigns, lead generation, and conversion rates. Using HubSpot and other data sources, you’ll be responsible for turning data into actionable insights that drive growth and optimise performance. Key Responsibilities Analyse data More ❯

Integration · Design, build and maintain AI-driven information retrieval and generation workflows · Securely integrate and manage external and internal AI services · Develop advanced data matching and search solutions · Architect effective interaction frameworks and context-management strategies · Collaborate on extending core model capabilities and protocols Data Engineering … Design and maintain data pipelines for efficient data processing · Ensure efficient data flow between systems and LLM components · Implement data validation, transformation, and enrichment processes · Optimise data storage and retrieval for AI/ML workloads Security & Compliance · Implement security best … understanding of software design principles and coding standards Preferred Skills and Capabilities · Experience with vector databases and embedding models · Knowledge of data pipeline tools and ETL processes · Familiarity with React or other frontend technologies for better cross-team collaboration · Experience implementing LLM integration frameworks · Background in pharmaceutical More ❯

leading-edge finance solutions through a unique combination of teamwork and technology. From this continued success we are now looking to recruit a Data Analyst to allow us to continue our exciting growth plans. Our aim is to take the service we offer to the next level, to … d like to be part of? As a key member of our team, you’ll be responsible for translating business requirements into practical data models, reports, and dashboards that deliver real insights Role responsibilities; Stakeholder Engagement: Collaborate with key stakeholders across the business to understand their data needs, gather requirements, and provide clear insights that drive decision-making. Data Modelling & Analysis : Design, develop, and maintain scalable data models to ensure data quality and accuracy, utilising SQL and Azure Synapse where necessary. Dashboard Development: Build and maintain visually compelling and More ❯

Recruitment Company is working with an Environmental and Sustainability Business that supports and empower their customers journey to net zero. To join their Data-Technology team, we have an opportunity for a Data Engineer to help support the wider business (cross-functional) to meet their reporting … and data requirements. About the role: The Data Engineer will be working with the latest innovative technologies, to design, build and maintain data solutions, constructing process to surface data both internally for reporting purposes and externally through the customer portal. The Data Engineer will be responsible for developing scalable data pipelines to integrate diverse data sources whilst ensuring data quality under the framework of a new Data Platform for real time application integration and reporting, and will work closely with business stakeholders More ❯

OpenAI models with structural biology tools Develop context-aware chat systems that maintain conversation history across sessions Create modular, scalable architectures for bioinformatics data processing Bioinformatics Integration Integrate with protein structure databases (PDB, AlphaFold, custom TCR structures) Build APIs connecting LLMs to molecular visualization tools (PyMOL, ChimeraX, NGLView … Develop specialized functions for TCR-peptide-HLA interface analysis Create automated workflows for immune repertoire data processing Data Infrastructure Design PostgreSQL schemas for storing structural and sequence data Implement efficient data retrieval systems for large-scale protein datasets Build real-time data … platforms (AWS, GCP, Azure) and big data technologies Familiarity with DevOps practices and deployment of ML applications Data preprocessing and pipeline automation for structured/unstructured biological data Understanding of data security and compliance requirements for sensitive datasets Bioinformatics & domain* knowledge More ❯