26 to 50 of 607 Data Pipeline Jobs in England

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London Bristol Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London Manchester Bristol Hybrid Permanent Our client is a leading global technology and consulting organisation , recognised … environments. Due to the nature of these programmes, active SC clearance is required for this role . This opportunity sits within a growing Data & AI Architecture capability , focused on delivering complex, high-impact programmes at the heart of government. The role combines deep technical architecture expertise with leadership ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London Bristol Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London Manchester Bristol Hybrid Permanent Our client is a leading global technology and consulting organisation , recognised … environments. Due to the nature of these programmes, active SC clearance is required for this role . This opportunity sits within a growing Data & AI Architecture capability , focused on delivering complex, high-impact programmes at the heart of government. The role combines deep technical architecture expertise with leadership ...

hiring a Data Engineer Apprentice to train and work alongside experienced Microsoft consultants on real client engagements. You will spend time designing, planning and building data integrations, data pipelines & data platforms. You will work alongside the Chief Data Offices, Data Architects and Data Integration Experts. Role Please note that this is an apprenticeship position and therefore anyone with more than six months professional experience working as a Data Engineer or who holds a degree or Master’s degree in a related subject (such ...

Overview This is an exciting opportunity for a technically minded Data Engineer to join a growing and innovative organisation working at the forefront of data-driven solutions. Youll play a key role in building, maintaining, and optimising data systems that support operational performance … reporting. This role offers exposure to modern data tools, cloud technologies, and large-scale datasets, making it ideal for someone looking to develop a career in data engineering. Data Engineer Key Responsibilities Data Integration & ETL Design, develop, and optimise ETL processes ...

seeking an experienced Data Architect to join our Group Technology team on a 6-month contract. You will help realise the value of the immense Connells Group data landscape for the benefit of customers, colleagues and the overall business. You will use your expertise to define … evolve and communicate the existing Estate Agency enterprise data architecture, to democratise safe access to consolidated and unified data, modelled to help engineering teams develop single customer and property views. The data architecture will also support system migration and integration, to establish effective master ...

Director of Data and AI Department: Platform Employment Type: Permanent Location: London Reporting To: James Complin Description We’re seeking a strategic Director of Data and AI to lead, develop, and empower our Data and AI teams. This role balances leadership with technical excellence … define how data, analytics, machine learning, and generative AI enable the wider business. You’ll work closely with senior stakeholders, translating business objectives into a clear Data and AI strategy, and ensuring the team delivers scalable, trusted, secure, and commercially impactful solutions. The ultimate goal will ...

Description Job Title: Engineering Manager Data Platforms SENIOR LEVEL Hybrid - Sheffield 2/3 days per week Inside IR35 Contract Job Description This role leads a high-performing data engineering team focused on building and operating modern data platforms using cloud-native technologies. … teams in a technical environment.Solid understanding of data engineering principles, including ETL/ELT, data warehousing and data pipeline orchestration.Additional Skills & Qualifications:experience working with large-scale, high-volume data platforms.Familiarity with infrastructure-as-code and CI/CD practices ...

flexible working arrangements for any of our roles and offer workplace accommodations to ensure you can deliver effectively. Key Responsibilities Document and catalogue data requirements for existing and redesigned business processes. Lead complex data analysis to validate business requirements, interrogating source systems directly. Translate data … models and dimensional modelling (star schemas, fact/dimension tables). Proficient in data architecture principles, ETL processes and data pipeline concepts. Experience with data cataloguing tools, SQL for data validation and analysis, and familiarity with data visualisation tools ...

Data Platform Manager UK/Remote Circa £65k - £75k per annum + bonus & benefits Are you ready to take ownership of a data platform and shape how data drives business decisions? This is a rare opportunity to step into a leadership role where … combine hands-on data engineering with strategic product management, all while building and mentoring a high-performing team. You'll play a pivotal role in evolving a modern data platform (Microsoft Fabric/Azure Synapse), ensuring it delivers real business value, scalability, and innovation. ...

part of this position. Main Responsibilities Conduct and automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Ensure find-ability. availability, scalability, reproducibility, accessibility, interoperability and reusability … Jupyter Notebooks Experience working with geospatial data (raster and vector) Databases (NoSQL, SQL, Graph Dbs, Principles of RDBs) Data pipeline design skills Knowledge of cloud platforms like GCP, AWS or Azure Experience and understanding of CI/CD pipelines Collaborative code management using Git & GitHub ...

part of this position. Main Responsibilities Conduct and automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Ensure find-ability. availability, scalability, reproducibility, accessibility, interoperability and reusability … Jupyter Notebooks Experience working with geospatial data (raster and vector) Databases (NoSQL, SQL, Graph Dbs, Principles of RDBs) Data pipeline design skills Knowledge of cloud platforms like GCP, AWS or Azure Experience and understanding of CI/CD pipelines Collaborative code management using Git & GitHub ...

part of this position. Main Responsibilities Conduct and automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Ensure find-ability. availability, scalability, reproducibility, accessibility, interoperability and reusability … Jupyter Notebooks Experience working with geospatial data (raster and vector) Databases (NoSQL, SQL, Graph Dbs, Principles of RDBs) Data pipeline design skills Knowledge of cloud platforms like GCP, AWS or Azure Experience and understanding of CI/CD pipelines Collaborative code management using Git & GitHub ...

part of this position. Main Responsibilities Conduct and automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Ensure find-ability. availability, scalability, reproducibility, accessibility, interoperability and reusability … Jupyter Notebooks Experience working with geospatial data (raster and vector) Databases (NoSQL, SQL, Graph Dbs, Principles of RDBs) Data pipeline design skills Knowledge of cloud platforms like GCP, AWS or Azure Experience and understanding of CI/CD pipelines Collaborative code management using Git & GitHub ...

part of this position. Main Responsibilities Conduct and automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Ensure find-ability. availability, scalability, reproducibility, accessibility, interoperability and reusability … Jupyter Notebooks Experience working with geospatial data (raster and vector) Databases (NoSQL, SQL, Graph Dbs, Principles of RDBs) Data pipeline design skills Knowledge of cloud platforms like GCP, AWS or Azure Experience and understanding of CI/CD pipelines Collaborative code management using Git & GitHub ...

part of this position. Main Responsibilities Conduct and automate data collection and processing scripts Create and maintain optimal, performant data pipeline architectures, both internally and externally Propose improvements to infrastructure, schemas, platforms, toolchains and configurations Ensure find-ability. availability, scalability, reproducibility, accessibility, interoperability and reusability … Jupyter Notebooks Experience working with geospatial data (raster and vector) Databases (NoSQL, SQL, Graph Dbs, Principles of RDBs) Data pipeline design skills Knowledge of cloud platforms like GCP, AWS or Azure Experience and understanding of CI/CD pipelines Collaborative code management using Git & GitHub ...

automation in data engineering — this is a small team that needs to move fast, and we expect the use of AI‐assisted pipeline development and management to be embedded in how we work Data Governance Lead the Data Governance function from a standing … alongside a technology partner or platform team (similar to our Ingenuity relationship) Demonstrated use of AI in data engineering contexts — AI‐assisted pipeline development, automated quality monitoring, or similar Strong leadership and stakeholder management skills — able to influence at Director and C‐suite level Experience ...

Data Engineer (Cloud Architecture) Contract until 31 March 2027 | East Midlands | Hybrid Working | Inside IR35 Rate: Negotiable Dependent on Experience Data Careers is supporting a secure public sector organisation in the East Midlands in the search for an experienced Data Engineer/Cloud Architect. … ingestion and integration from multiple source systems. Cloud-based data platform experience, ideally Azure. API integration and data pipeline development. SQL and data modelling expertise. Experience working with large and complex datasets. Strong understanding of modern data architecture principles. ...

Description \n We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior … Blob Storage, and Azure SQL \n Proven expertise with Databricks, including hands-on implementation experience \n\n Key Responsibilities: \n \n Data Pipeline Development & Optimisation: \n Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various ...

Azure Data Engineer Up to £65,000 - Fully Remote We are seeking a Data Engineer to join a well-established, international organisation operating within a sustainability-focused industry. Our client is a global leader in chemical cleaning and environmental solutions, offering a fully integrated service across … Azure Data Factory, Azure Data Lake and Azure Synapse Analytics Solid understanding of ETL processes, data integration and pipeline development Advanced SQL skills as well as Python/PySpark experience for data processing Exposure to Power BI or other reporting tools ...

Implement retrieval-augmented generation (RAG) architectures and manage vector databases such as Pinecone , Weaviate , FAISS , and Milvus to support enterprise knowledge intelligence systems. Data Platform & Engineering Excellence Lead the evolution of the enterprise data estate, leveraging modern data platforms such as Databricks , Snowflake , Azure … Synapse , and BigQuery . Oversee data engineering using Apache Airflow , dbt , and Prefect , ensuring data pipelines are performant, governed, and aligned with enterprise metadata standards ( Collibra , Alation , Microsoft Purview ). Drive the adoption of Delta Lake , Iceberg , and Hudi for scalable data lakehouse architectures. ...

driving the evolution of our enterprise data engineering capabilities across our cloud and legacy environments. Your remit spans cloud platform engineering, pipeline automation, real‐time data processing, curation, and the enablement of business intelligence, data science and AI teams. You will … concepts clearly and frame engineering decisions in terms of business impact. Ensure data platforms meet regulatory, security, and compliance requirements, including secure pipeline design, access control, and lineage. Embed good governance practices across metadata, cataloguing, quality, and monitoring. Define and maintain data engineering standards, documentation ...

have a background in Automotive Data Quality, are you excited about data management and validation? Expleo are seeking a highly organised and proactive Data Quality Engineer, you will be a part of the team testing the next generation of electrified propulsion systems, based … Warwickshire on a Contract basis. Key Responsibilities of the Data Quality Engineer include: * Work across Electric machine, Electric Drive Unit (EDU), Inverter, Cell, Battery, Power in loop (PiL) and Vehicle in Loop (ViL) test beds * Provide timely, accurate, secured and accessible test data for wider engineering ...

Methods are looking for an experienced DV cleared Architect - supporting data modelling looking at data transfer ensuring data is assured and reliable, tie in with NCSC standards. Daily rate: £600 inside IR35 Duration: 6 months with possible extension Location: hybrid; 3days/w onsite … dictionaries and visualisations will be key to gaining stakeholder buy in and driving data quality. Create and maintain optimal data pipeline architecture by designing and implementing data ingestion solutions on AWS using AWS native services (such as GLUE, Lambda) or using data ...

exciting technology-led organisation in London is looking for a Lead Data Engineer to join their growing platform team as they continue to build out their data and analytics capability. Based in: London Hybrid working: 1-2 days a week in the office Permanent role Start … delivery of a modern cloud data platform supporting analytics, AI and client-facing data products Owning data pipeline architecture across ingestion, transformation and data product layers Setting and maintaining data engineering standards, patterns and best practices across squads Mentoring ...

Description Key Responsibilities:Design our scalable, secure and cost-effective cloud hybrid data solution aligned with Omnia enterprise architecture and Army training objectives.Design innovative data models and metadata systems to interpret and enhance business needs, promoting data as a strategic asset.Develop transitional data … maps in alignment with Omnia digital transformation objectives, enabling the evolution of integrated training solutions.Collaborate with cross-functional teams and partners to ensure data architectural integrity and alignment.Translate complex technical concepts for a non-technical audience, fostering understanding and buy-in from stakeholders.Support horizon scanning to identify ...