151 to 175 of 1,690 Data Pipeline Jobs in the UK

OpportunityJoin a team building the data foundations that support the firm's AI and analytics capabilities. This role sits within the engineering effort to develop a modern Lakehouse and AI data platform that enables reliable, well-governed and high-performing data use across … common data formats such as JSON, Avro and Parquet. For More Experienced CandidatesStronger ownership of technical design across multiple datasets or pipeline domains. Experience guiding implementation standards, code quality and engineering practices within a team. Ability to lead delivery for a workstream, manage dependencies and support less ...

must have a UK passport or be able to live and work in the UK without employer sponsorship. At Coeo, we believe data has the power to transform organizations. As one of the UK's leading Microsoft Data & AI consultancies, we help our clients unlock … full value of their data by combining deep technical expertise with business-focused consulting. Our mission is simple: to help our clients predict their future . For over 18 years, we've specialized exclusively in the Microsoft ecosystem, helping organizations modernize their data platforms, harness ...

TitleData Engineering Technical LeadThe RoleThe Data Engineering Technical Lead will play a critical role in shaping and delivering Vanguard Europe's data and analytics capabilities. Working within the Chief Data & Analytics Office (CDAO), this role will lead the technical design, development, and evolution … data products that support business decision-making across Financial Advice Services, Marketing, Operations, Risk, and other key business functions. Operating in a modern cloud-based environment leveraging Databricks, AWS, and Infrastructure as Code, the successful candidate will lead a team of data engineers while partnering closely ...

Data Engineering Manager | Azure | SQL | Python | Team Leadership Hybrid Working 3 Days Office/2 Days Remote Competitive Salary + Benefits We're partnering with a market-leading, highly regulated organisation to recruit a newly created Data Engineering Manager position. This is a fantastic opportunity … hands-on data engineering leader to take ownership of a growing data function, leading a team while remaining actively involved in technical delivery. Acting as the bridge between senior leadership and the data team, you'll be responsible for the data engineering ...

Senior AWS Data Engineer (Fixed Term Contract) When registering to this job board you will be redirected to the online application form. Please ensure that this is completed in full in order that your application can be reviewed. Join Microlise as a Senior AWS Data Engineer … month fixed term contract and help build the data foundations behind the next generation of customer-facing analytics and AI products. This is a hands-on engineering role in a major cloud data platform programme, where youll help turn operational, telematics, customer and third-party data ...

Senior AWS Data Engineer (Fixed Term Contract) When registering to this job board you will be redirected to the online application form. Please ensure that this is completed in full in order that your application can be reviewed. Join Microlise as a Senior AWS Data Engineer … month fixed term contract and help build the data foundations behind the next generation of customer-facing analytics and AI products. This is a hands-on engineering role in a major cloud data platform programme, where youll help turn operational, telematics, customer and third-party data ...

Senior Data Engineer - Up to £85k Newcastle Upon Tyne - 3 days per week in office Our client are seeking an experienced Senior Data Engineer to play a pivotal role in designing and building the data platform that will power the organisation's next generation … analytics and AI capabilities. This is a hands-on leadership role where you will take ownership of how data is structured, governed, and leveraged across the business. You will be responsible for defining the strategic direction of the data platform while actively contributing to its design ...

Data Engineer Up to £60,000 We are working with an organisation that is going through an exciting period of growth and continued investment across its technology and data landscape. With data playing an increasingly important role across the business, there is a real … focus on strengthening the platform, improving engineering capability and creating a more scalable approach to how data is managed and used. As part of this investment, they are looking for a Data Engineer to join their Data & Innovation team. This is a great opportunity ...

Data Engineer Up to £60,000 We are working with an organisation that is going through an exciting period of growth and continued investment across its technology and data landscape. With data playing an increasingly important role across the business, there is a real … focus on strengthening the platform, improving engineering capability and creating a more scalable approach to how data is managed and used. As part of this investment, they are looking for a Data Engineer to join their Data & Innovation team. This is a great opportunity ...

Data Engineer Up to £60,000 We are working with an organisation that is going through an exciting period of growth and continued investment across its technology and data landscape. With data playing an increasingly important role across the business, there is a real … focus on strengthening the platform, improving engineering capability and creating a more scalable approach to how data is managed and used. As part of this investment, they are looking for a Data Engineer to join their Data & Innovation team. This is a great opportunity ...

Data Engineer Up to £60,000 We are working with an organisation that is going through an exciting period of growth and continued investment across its technology and data landscape. With data playing an increasingly important role across the business, there is a real … focus on strengthening the platform, improving engineering capability and creating a more scalable approach to how data is managed and used. As part of this investment, they are looking for a Data Engineer to join their Data & Innovation team. This is a great opportunity ...

Software Engineer - Data, Lakehouse and AI Data Platform Engineer - Analyst/Associate - London location_on London, Greater London, England, United Kingdom The Opportunity Join a team building the data foundations that support the firm’s AI and analytics capabilities. This role sits within … data formats such as JSON , Avro and Parquet . For More Experienced Candidates Stronger ownership of technical design across multiple datasets or pipeline domains. Experience guiding implementation standards, code quality and engineering practices within a team. Ability to lead delivery for a workstream, manage dependencies and support ...

transforming, validating and serving complex datasets. Design scalable data models, schemas and storage systems for structured, semi-structured and geospatial data. Build pipeline orchestration using directed acyclic graphs (DAGs) to manage dependencies, retries, scheduling and observability. Develop systems for data quality testing, lineage, versioning, reconciliation … products, customers and AI systems. Develop workflows for batch processing, event-driven processing and long-running computational jobs. Create monitoring and alerting for pipeline failures, unexpected data changes and quality regressions. Work directly with customers and domain experts to understand source systems and data problems. ...

DescriptionData EngineeringHybrid Role - 2 days office basedMon-Fri 37.5 hours per weekAt Biffa, we're transforming how data is used across our business, moving beyond traditional reporting towards advanced analytics, automation, and AI-driven decision making. As a Data Engineer, you'll play a key role … designing and building the data platforms, pipelines and architecture that underpin critical business insights across operations, customer services, finance and commercial functions. Working with Microsoft Fabric, Azure Data Lake, Azure SQL and modern cloud technologies, you'll help create reliable, scalable and high-quality data ...

automated testing to build and own features from conception to deployment. Requirements SQL/data processing experience Scalable data pipeline development Some experience building effective programmatic interfaces in any language. Desirables Experience with PostgreSQL query performance optimisation Experience with Python HTTP, API development, automated testing … data pipeline design. Experience ensuring data quality, integrity, and performance Hands-on experience with financial data sources (e.g., Bloomberg, Refinitiv) #J-18808-Ljbffr ...

Apache Iceberg as the core storage format, ensuring high-performance querying and seamless interoperability with Snowflake and heterogeneous compute engines. AI-Accelerated Schema & Pipeline Engineering: Develop and maintain end-to-end multi-stream ingestion pipelines for complex clinical trial schemas. Use AI-driven schema inference and ontology alignment tools … required under GxP, HIPAA, and GDPR standards. System Resilience: Troubleshoot complex production issues across distributed data environments and implement resilient, self-healing pipeline architectures. Key Business Value & Strategic Impact Your leadership will directly advance life sciences technology. By pairing modern lakehouse architecture (Snowflake, Apache Iceberg, Kafka) with ...

hackajob is partnering directly with Accenture to hire for this role. Job Role : Data Science Associate Manager Location: London/Manchester Career Level : Manager – ML8 We Are: Accenture Song accelerates growth and value for our clients through sustained customer relevance. Our capabilities span ideation to execution: growth, product … help our clients operate at the speed of life through the unlimited potential of imagination, technology and intelligence. Visit us at: The Data & AI team: The Data and AI revolution is changing everything. It's everywhere – transforming how we work and play. Join Accenture and help ...

being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. Your role in the team Allstate's Data & Analytics Technology organization is seeking a highly skilled and hands-on Senior Data Engineer to design, build, optimize, and support scalable, reliable … high-performing data platforms and pipelines. This role is focused on developing enterprise data solutions that enable analytics, reporting, AI/ML, and data-driven decision making across the organization. The ideal candidate possesses strong expertise in modern data engineering practices, Apache ...

system questions and translate findings into clear intelligence that supports senior decision making. The role will work closely with colleagues across analytics, BI, data engineering, information governance, commissioning and system partners, while focusing on advanced analysis, evidence generation and evaluation rather than routine reporting or dashboard development. Main … skills, sound judgement, and the ability to work collaboratively across organisational boundaries. You will support the development of advanced analytical capability within the Data, Analytics and Population Health Intelligence function and help ensure analysis is robust, proportionate and useful for decision making. About us NHS Essex ...

Multiple Data Engineer & Data Analyst Contracts | 6-Month Initial Contract at £430/day Inside IR-35 | London/Hybrid (max 2 days per week on site) We're supporting a major data transformation programme and are looking to hire multiple Data Engineers and Data Analysts on an initial 6-month contract. These opportunities are well-suited to contractors with around 2-4 years of commercial experience who are looking to build on their data engineering, BI, reporting, ETL, or analytics expertise within a modern ...

Описание Agoda is a travel platform that connects people with destinations and experiences through hotels, holiday properties, flights, and activities worldwide. Its Data department enables data-driven decision-making through operational and analytical databases, queue systems, BI tools, and data science technologies. Задачи Design … build, and maintain scalable ETL/ELT pipelines for CEG systems, third-party tools, and logs; Develop and optimize data models for reporting, monitoring, forecasting, quality assurance, and experimentation; Implement validation checks, anomaly detection, and monitoring for key datasets and metrics; Define and enforce data definitions ...

Data Engineer required by leading Professional Services organisation in Bristol Salary: Up to £85,000 + 10% Bonus Location: Bristol – Hybrid (3 days onsite) A leading Professional Services organisation is looking for an experienced Data Engineering Lead to play a key role in the continued development … transformation of its data capability. This is an excellent opportunity for a technically strong Data Engineering professional who enjoys combining hands-on engineering with team leadership. You will lead a talented team of Data Engineers, provide technical direction and coaching, and remain actively involved ...

Advanced Driving. We develop advanced Perception and Planning technologies, and their production software for multiple AD/ADAS systems. To deliver reliable data-driven technologies to millions of Toyota vehicles, we are solving complex real-world problems using large-scale data, machine learning, and state … architectures for Perception, Prediction, and Motion Planning. WHO ARE WE LOOKING FOR? The team is seeking an experienced, technical, and hands-on Autonomy Data Manager to grow and lead a talented team composed of Data Scientists, Data Engineers and ML Ops Engineers, working ...

innovative solutions to life. Your visionary leadership and pursuit of excellence makes a lasting impact on the firm and industry. As a Principal Data Engineer at JPMorganChase within the [insert LOB or sub LOB], youprovide expertise and data engineering excellence as an integral part … proficiency in designing and optimizing data models for analytics, reporting, and business intelligence use cases Demonstrated ability to automate data pipeline deployment and monitoring using CI/CD tools and infrastructure-as-code practices Hands-on expertise with distributed data processing frameworks (e.g. ...

Data Solution Architect Remote working £650-675/day overall assignment rate to umbrella 3-month initial contract Working with a market leading client who have a requirement for a Data Solution Architect to design, lead and deliver scalable, enterprise-grade data platforms. This … with Databricks (preferred) or similar platforms: Snowflake, BigQuery, Redshift, Synapse, or equivalent Strong proficiency with: SQL (advanced level) Spark/PySpark Data pipeline orchestration tools (e.g., Airflow, ADF, etc.) Data Modelling Extensive experience designing: Fact and dimension tables Star and snowflake schemas Aggregation layers ...