1 to 25 of 402 Data Pipeline Jobs in England

that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … re underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data … data engineering projects. You will work closely with cross-functional teams and contribute to the strategic direction of our data initiatives. RESPONSIBILITIES Data Pipeline Development: Lead the design, implement, and maintain scalable data pipelines for ingesting, processing, and transforming large volumes of data from various sources using tools such More ❯

Role: Technical Data Architect Location: UK (remote is fine, candidate must be in UK and available for any IMP meeting) Contract: 3 months (will likelyextend) Data Feed Factory - for Telco Network Function Expectations on the role : Hands on Experience on design & architecture of the Data Platform, Technical components and Data Engg. related … Data management. This includes assessing data quality, accessibility, data contract and lineage including any other potential capability evaluation Analyze existing Data pipeline and data workflows to determine the integration points and any design considerations/framework and patterns for the data factory as per the need for … the business users including any ad hoc demand for Data Processing. Support the Automation Code samples and examples produced during MVP phase to address Data pipeline build including Data Platform capabilities More ❯

NATIONAL BUSINESS REQUIRES PROACTIVE BUSINESS INTELLIGENCE STRATEGIST/LEAD DATA ANALYST TO SPEARHEAD DATA AND REPORTING STRATEGY, BUILDING A DATA-DRIVEN CULTURE FROM THE GROUND UP WITH A DATA WAREHOUSE-FIRST MINDSET. TITLE: Business Intelligence Strategist/Lead Data Analyst SALARY: £(phone number removed) LOCATION: Office Based near Wakefield You … may have been a: Data Officer, Data Strategist, Data Analytics Manager, Business Intelligence Manager, Data Governance Manager, Reporting and Analytics Manager, Data Operations Manager, Head of Data Strategy, Business Intelligence Strategist, Data Insights Manager, Enterprise Data Manager, Data Program Manager, Analytics and … Reporting Lead, Data Solutions Architect RESPONSIBILITIES: Business Intelligence Strategist/Lead Data Analyst Engage with non-technical stakeholders to identify business challenges, define requirements, and create effective reporting solutions. Lead the transition from reporting on production databases to a robust data warehouse as the single source of truth. Design and build new ETL/ More ❯

Job Title: Senior Data Architect Salary: £70,400 - £94,100 Location: Cambridge/Hybrid with office attendance for an average of 2 days a week Contract: Permanent Shape the future of data and AI at Cambridge University Press & Assessment We are Cambridge University Press & Assessment, a world-leading academic publisher and assessment organisation and a proud … part of the University of Cambridge. About the role As a Senior Data Architect, you will play a pivotal role in delivering a coherent and scalable data framework aligned with our enterprise data strategy. You'll advance key architectural principles such as data mesh, data products, and data … data warehouse, and data virtualization concepts. Mastery of data modelling (conceptual, logical, physical), integration patterns (APIs, event-driven, streaming), and data pipeline orchestration. Experience enabling AI/GenAI capabilities and understanding of ethical and responsible AI considerations. Excellent stakeholder engagement and communication skills across technical and non-technical teams. Experience coaching More ❯

and health security Detect: use cutting edge environmental and biological surveillance to proactively detect and monitor infectious diseases and threats to health Analyse: use world-class science and data analytics to assess and continually monitor threats to health, identifying how best to control and mitigate the risks Respond: take rapid, collaborative and effective actions nationally and locally to … lead strong and sustainable global, national, regional and local partnerships designed to save lives, protect the nation from public health threats and reduce inequalities. Job overview The UKHSA Data Design & Architecture (DD&A) team is responsible for supporting data architecture and data solutions across the organisation. We are a small team of solution architects … data architects, and data modellers. We also work closely with other parts of the organisation who also are involved in development and maintenance of infrastructure and software, including Programme Teams, Engineering & Enablement, Surveillance Systems, Data Services & Quality, Genomics, Enterprise Architecture and the Development and Operations team. The DD&A team supervises and actively develops More ❯

Data Architect – Data & AILocation: Hybrid – Burton on Trent Salary: £70,000 REED Technology are working with a client who are looking for a hands-on Data Architect with a passion for building scalable data solutions? This is a fantastic opportunity to join a data-first business with major investment in … its data function, working on modern platforms and with cutting-edge AI and ML initiatives. Key Responsibilities Design and deliver enterprise data models and data architectures Support roadmaps for data platforms, integration, and data processing Work with engineers, data scientists, and stakeholders to deliver trusted, high-quality data solutions Align solutions with governance, compliance, and business requirements Contribute to data standards and best practices Skills and Experience Proven experience as a Data Architect Strong knowledge of data modelling, processing, and integration Hands-on experience with modern data platforms (Azure, Databricks or similar) Ability to translate business needs into More ❯

Data Architect - Data & AI Location: Hybrid - Burton on Trent Salary: £70,000 REED Technology are working with a client who are looking for a hands-on Data Architect with a passion for building scalable data solutions? This is a fantastic opportunity to join a data-first business with major investment … in its data function, working on modern platforms and with cutting-edge AI and ML initiatives. Key Responsibilities Design and deliver enterprise data models and data architectures Support roadmaps for data platforms, integration, and data processing Work with engineers, data scientists, and stakeholders to deliver trusted, high-quality … data solutions Align solutions with governance, compliance, and business requirements Contribute to data standards and best practices Skills and Experience Proven experience as a Data Architect Strong knowledge of data modelling, processing, and integration Hands-on experience with modern data platforms (Azure, Databricks or similar) Ability to translate business needs More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or … email WHO WE ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security … projects within UK Govt. Departments in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience More ❯

Are you a Data Engineer, seeking a new challenge? Do you have passion for future vehicle development? If so, Expleo have an opportunity for you! Our client, a prestigious Automotive Manufacturer, is currently recruiting for a Data Engineer to join their Customer Relationship Centre team. As a Data Engineer you will play a key … Engineering, or a related field Experience as a Data Engineer, ideally within a customer service or contact centre environment Knowledge of SQL, Python, and data pipeline development Skilled in Google Cloud Platform (GCP) and cloud data tools Background in CRM systems and customer data structures Understanding of data warehousing … concepts and cloud architecture Experience with ETL tools and frameworks Airflow, Git, CI/CD pipeline Data Insights reporting experience Competent with real-time data processing and streaming technologies Proficiency in Tableau or other data visualisation tools is desirable ** PLEASE NOTE ** To meet with current legislation, right to work checks will be carried More ❯

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to … a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. You will collaborate with stakeholders to understand their strategic … objectives and identify opportunities to leverage data and data quality. You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems. More ❯

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to … a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. You will collaborate with stakeholders to understand their strategic … objectives and identify opportunities to leverage data and data quality. You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems. More ❯

Purpose of the Job: Design, build, and maintain robust data systems and pipelines that support data storage, processing, and analysis on the Cloud. Work with large datasets, ensuring data quality, scalability, and performance, while collaborating. closely with data scientists, analysts, and other engineering teams to understand their data needs and … provide them with high-quality, accessible data. They are responsible for ensuring that the underlying data infrastructure supports the organizations broader data and business goals, enabling more effective data-driven decision-making. Key Accountabilities: Design and implement scalable, efficient, and secure data architectures, ensuring optimal data flow across systems in … and process across the team along with BI lead. Influence the evolution of business and system requirements and contribute to the design of technical solutions to feed a delivery pipeline that increasingly employs Agile methods such as SCRUM and Kanban You will be required to develop unit tested code and then support test cycles including post implementation validation. You More ❯

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Engineer will include: Understand the business/product strategy and … Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

Engineer, you will operate within an Agile delivery environment, working closely with the Data Product Manager and Data Architect to ensure your team maintains a pipeline of delivery against the Backlog; providing vital insight from our wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of BFS business units … solutions. You will also have management responsibilities for a small team of Data Engineers, who you will coach, support and organise to ensure we sustain a predictable pipeline of delivery, whilst ensuring all appropriate governance and best practice is adhered to. Your responsibilities as our Senior Databricks Engineer will include: Understand the business/product strategy and … Azure DevOps, collaborating on Sprint cycles, code deployment, version control, and development practices Develop and maintain data models, schemas, and documentation Monitor and troubleshoot data pipeline issues, ensuring timely resolution Stay up-to-date with the latest industry trends and technologies in data engineering and recommend improvements to existing systems or processes as More ❯

Practice Group/Department: Integrations/Development & Data Management Job Description We're Norton Rose Fulbright - a global law firm with over 50 offices and 7,000 employees worldwide. We provide the world’s preeminent corporations and financial institutions with a full business law service. At Norton Rose Fulbright, our strategy and our culture are closely entwined. We … as the relevant skills and experience, we're looking for people who are innovative, commercial and value the work that they do. We are embarking on an exciting Data Programme of work and are looking for a talented Data Engineer to join our team. You will play a crucial role in building and managing data pipelines that enable efficient and reliable data integration, transformation and delivery for all data users across the EMEA Region. Responsibilities Design and develop data pipelines that extract data from various sources, transform it into the desired format, and load it into the appropriate data storage systems Implement data More ❯

Data Architect Salary : Up to £85,000 (Based on candidate experience) Employee Package: Outstanding employee benefits Hybrid Model : Once a week (London) Job Type: Permanent Job Summary Our client, a leading IT services and consulting firm, is looking for a skilled Data Architect to support enterprise-wide data architecture initiatives. This role focuses on … transforming core data assets into trusted, reusable resources that drive service delivery improvements, business growth, and AI innovation across multiple departments. Understanding of public sector compliance, regulations, and cross-departmental data sharing challenges Key Responsibilities: Build scalable data architecture for high-value organizational data assets Work with product teams and stakeholders to …/foundational data experience, cloud-native platforms knowledge, AI/ML data requirements understanding, data federation/cached services familiarity, data pipeline development, and Dell Data Lakehouse/DDAE administration experience. To be considered, please ensure you complete your application on the Computappoint website. Services offered by Computappoint Limited More ❯

Data Engineer Sr - Informatica ETL Expert page is loaded Data Engineer Sr - Informatica ETL Expert Apply locations Two PNC Plaza (PA374) Birmingham - Brock (AL112) Dallas Innovation Center - Luna Rd (TX270) Strongsville Technology Center (OH537) time type Full time posted on Posted 3 Days Ago job requisition id R185351 Position Overview Job Description Summary At PNC, our … day to foster an inclusive workplace culture where all of our employees feel respected, valued and have an opportunity to contribute to the company's success. As a Data Engineer within PNC's Technology organization, you will be based in Pittsburgh, PA; Cleveland, OH; Birmingham, AL or Dallas, TX. The position is primarily based in a PNC location. … manager's discretion. PNC will not provide sponsorship for employment visas or participate in STEM OPT for this position Key responsibilities - - Design, Develop and maintain scalable and efficient data pipelines and ETL processes - Collaborate with analysts and stakeholders to gather requirements and implement data solutions that meet business needs - Proposes & designs data solutions to More ❯

private and commercial banking, wealth planning and investment management. We believe in traditional relationship and service-led banking powered by modern technology. Job purpose Develop and maintain complex data systems that support the Bank's operations and reporting needs, ensuring they meet all essential data requirements, following strong engineering and automation best practices and collaborating with … Significant hands-on experience with the Azure Data Stack, critically ADF and Synapse (experience with Microsoft Fabric is a plus) Highly developed python and data pipeline development knowledge, must include substantial PySpark experience Demonstrable DevOps and DataOps experience with an understanding of best practices for engineering, test and ongoing service delivery An understanding of Infrastructure … as Code concepts (Demonstrable Terraform experience a plus) Demonstrable experience of Data Pipeline testing, including automated testing, data validation and code assurance Demonstrable experience of working within Agile Delivery projects An understanding of data formats for ingest, transformation and analytics, data security, access control and authorisation, GDPR, data privacy More ❯

Select how often (in days) to receive an alert: Location: UK - Hatfield Job-ID: 215349 Contract type: Standard Business Unit: Data Management/Reporting Life on the team Hatfield based (with min of 2 days in the office) Competitive basic salary + Core & flexible benefits Join Data Management within our Data & Analytics function. We … operate across four pillars: Data Management, Data Strategy, Data Governance and Data Delivery. We work in agile, delivering in sprints with modern software engineering and DevOps practices to ship reliable data products at pace. The team owns the Group Data Warehouse, a global data platform that … supports Computacenter's combined reporting requirements across the world. In Data Management, you will turn Data Demand into prioritised backlog requirements and partner with business units to deliver maximum customer value from data. If you enjoy practical delivery, measurable outcomes and helping teams make better decisions with trusted data, you will fit right in. More ❯

Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Essential Skills & Experience: 10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks. Strong proficiency in Python and Spark (PySpark) or Scala. Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns. Extensive experience with Azure data services, including Azure Data Factory … Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality and data governance More ❯

Overview We're seeking a Senior Data Scientist to lead the development of advanced analytics and AI/ML solutions that unlock real value across our business. This is a contract role for 6 months . In this contract role, you'll work with proprietary and B2B research datasets to design, deliver, and scale data-driven … Research, and Technology, you'll help turn strategic ideas into working MVPs-ensuring high standards of methodology, quality, and business relevance throughout. You'll also help shape the data science environment by working alongside our tech teams to support a robust and flexible infrastructure, including sandbox environments for onboarding and evaluating new data sources. This is … refined and productionized in the future. Work with Tech colleagues to improve the Data Science workspace, including providing requirements for Data Lake, Data Pipeline, and Data Engineering teams. Expand on the tools and techniques already developed. Help us understand our customers (both internal and external) better so we can provide the More ❯

with successful projects in key government departments like the Department for Work and Pensions, Ministry of Justice, HM Passport Office, and more. Overview We're seeking a seasoned Data Lead to own and deliver the data strategy for Govt client that uses services used by over 18m citizens encompassing three newly rebuilt benefits systems. You will … define where our data capabilities are today, set the future vision, and architect the roadmap to get us there-then design the data team to execute it. Key Responsibilities Lead the end-to-end Data Strategy for Bereavement & Care services. Map the "as-is" and "to-be" state of our data platforms … strategies in complex organisations. Technical Breadth : Cloud-based data platforms AWS must (Azure, AWS or equivalent) Modern ETL/ELT tools and data pipeline frameworks Data modelling, warehousing and transformation best practices Data science/ML lifecycle from prototype to production Government/Public Sector : Experience to GDS-equivalent More ❯

hunt for builders . No, we've not ventured into construction in our quest to conquer the world, rather a designer and builder of systems for all things data related where we are conquering the Data World. We can offer an interesting insight into projects spanning a variety of sectors, which may include industries such as … to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We're Intuita - a fast growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … in the data pipelines. • Stay updated with the latest Azure technologies and industry best practices to continuously enhance data engineering capabilities. Looking at our current pipeline of work, we can also consider those with an Analytics Engineering lean, with experience within BigQuery (GCP) with data modelling in DBT and mobile/telecoms industry More ❯

AWS Data Engineer - VP Level Location: London (Canary Wharf)Salary: £115000 - 120000 A leading financial institution is seeking a Senior AWS Data Engineer to join a greenfield initiative focused on transforming market data access and utilization. This VP-level role offers strategic influence, technical leadership, and cross-functional collaboration across business units. Key Responsibilities … Design and maintain scalable data pipelines, warehouses, and lakes using AWS technologies.* Implement robust data governance, quality, and security practices.* Collaborate with data scientists to deploy machine learning models.* Lead or contribute to strategic planning, risk management, and stakeholder engagement.* Drive innovation through advanced analytics and research-based problem solving. To be successful you … should have: 10 years hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Previous experience in implementing best practices for data engineering, including data governance, data quality, and data security. Proficiency in data More ❯

AWS Data Engineer - VP Level Location: London (Canary Wharf) Salary: £(phone number removed) - (phone number removed) A leading financial institution is seeking a Senior AWS Data Engineer to join a greenfield initiative focused on transforming market data access and utilization. This VP-level role offers strategic influence, technical leadership, and cross-functional collaboration across … business units. Key Responsibilities: * Design and maintain scalable data pipelines, warehouses, and lakes using AWS technologies. * Implement robust data governance, quality, and security practices. * Collaborate with data scientists to deploy machine learning models. * Lead or contribute to strategic planning, risk management, and stakeholder engagement. * Drive innovation through advanced analytics and research-based problem solving. … To be successful you should have: 10 years hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Previous experience in implementing best practices for data engineering, including data governance, data quality, and data security. Proficiency More ❯