176 to 200 of 488 Data Pipeline Jobs in the UK excluding London

Role: Snowflake Data Architect Location: Hove, UK Type: Permanent Role Work Mode: Hybrid Role & Responsibilities Define and implement the end-to-end architecture of Data warehouse on Snowflake. Create and maintain conceptual, logical, and physical data models in Snowflake. Design data pipelines and ingestion frameworks using Snowflake native tools. Collaborate with Data Governance teams to establish data lineage, data quality, and access control mechanisms. Engage with data stewards and stakeholders to build a comprehensive and scalable data warehouse. Implement RBAC, data masking, and encryption practices to ensure compliance with data security policies. Qualifications & Skills 10+ years of experience … in designing enterprise data platforms, with at least 5+ years in Snowflake. Strong expertise in SQL and data warehousing. Hands-on experience working in the insurance industry; prior experience with L&G is an advantage. 3+ years of experience with DBT for data transformation. Deep understanding of agile methodologies in data environments. More ❯

Fully remote Data Analyst & Senior Data Analyst opportunities (Please note:- you must be based in the UK for these roles) I am working with a consumer lender on two new roles within their Credit Risk & Data team. The role includes translating complex business needs into scalable & actionable insights. You will deliver reporting, dashboards and … analysis that drive value. Experience required and the remit includes: - Owning and leading data infrastrcutrure (design and lead implementation of enterprise-grade ETL and data pipeline solutions) - Take ownership of the data warehouse and related infrastructure - Experience working with cloud platforms (such as BigQuery, Snowflake, Azure) - Embed data governance strategies - Must More ❯

Evaro is looking to do for health care what online banking has done for finance, and we're looking for a Head of Data Science to help us that through data-driven insights and innovations. Our mission? To increase accessibility to prescription medications and improve health outcomes by providing a seamless, technology-driven solution that empowers … brands to integrate digital health services effortlessly, Evaro strives to build the online banking for UK healthcare. About the job We're looking to hire a Head of Data Science to build out and lead the data science capabilities across the organisation. You'll have a background in analytics, machine learning, and leading data teams. You'll be joining the company at an exciting time, working to build out a data team to help drive the company's direction. Ensuring that data isn't just analyzed but transformed into actionable insights that directly improve patient outcomes. Join Evaro as Head of Data Science to harness the More ❯

this role could be for you. The Role You will interact and build relationships with the client's front office and technology teams. Key responsibilities include: Data Pipeline Development: Design and develop sophisticated data pipelines to import data from external vendors, sell-side partners and other providers seamlessly into their central data … of their platform to ensure it aligns with ever-changing business requirements. Test the system regularly to confirm its effectiveness and perform troubleshooting when necessary Platform Maintenance and Data Reliability: Ensure the platform is well maintained, enabling uninterrupted access to crucial data points. Continuously verify data quality and integrity essential for investment process Continuous … improvement and collaboration: Collaborate with internal stakeholders to streamline data accessibility and usability. Drive innovation by adopting advanced analytics technologies and methodologies The Requirements This is an outstanding opportunity where you will be able to make an impact from day one. Working with an exceptionally talented group of people, you will have exposure to a wide variety of More ❯

Job Title: Graduate Data Engineer Location: Brighton, UK About Us: We are a dynamic and innovative technology consultancy based in Brighton. We specialise in providing cutting-edge solutions to our clients, enabling them to leverage data for strategic decision-making and operational efficiency. Our team is composed of talented professionals who are passionate about technology and … committed to delivering exceptional results. Job Description: Position Overview: We are seeking a highly motivated and enthusiastic Graduate Data Engineer to join our team. As a Graduate Data Engineer, you will be an integral part of our data engineering team, working on a variety of projects that involve data collection, transformation, and … analysis. This is an excellent opportunity for a recent graduate to kick-start their career in data engineering within a supportive and collaborative environment. Key Responsibilities: Assist in the design, development, and maintenance of data pipelines and ETL processes. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and More ❯

We currently require the services of a Senior Data Analyst for a 6 Month Fixed Term Contract based in Nottingham. Job Overview This role will be responsible for providing up-to-date, accurate, and relevant data analysis to drive business decisions. The ideal person for this role thrives in fast paced environments with high levels of … our capability. A taste of what you'll be doing: Consultative Leadership : Spearhead initiatives with cross-functional stakeholders, employing a consultative approach to distil complex requirements into robust data/analytics approaches. Data Mastery : A trusted data expert, knowing what data is available, and which analytical technique is most relevant, ranging from … Deep expertise in SQL and Python Experienced with advanced analytics techniques including modelling, and segmentation Strong visualisation skills including experience with Tableau Experience with cloud-based data pipeline architectures (Databricks) and platforms (AWS) Familiarity with Git-based source control methodologies, including branching and pull requests Excellent communication and presentation skills with the ability to engage non-technical More ❯

UK rail network companies operating with rail infrastructure and asset management has a need to develop and support enterprise-level information systems.To act as the design authority for data-centric projects and programmes, responsible for shaping high-level data architecture aligned with strategic business and technology goals. This role focuses on designing solutions for Route Services … Information Technology (RSIT) customers, with an emphasis on graph-based data modelling and network management, ensuring alignment with both current and target-state infrastructure. Responsibilities Architect and design data solutions that support route services, asset management, and operations across the rail domain-ensuring scalability, quality, and performance.Develop data architectures and models (especially graph-based … that support seamless integration of infrastructure, operational data, and business intelligence.Define and enforce data solution standards, ensuring technical consistency and reuse across programmes.Collaborate with RSIT colleagues and enterprise architects to ensure proposed designs align with existing and future infrastructure strategies.Manage stakeholder engagement to translate complex data requirements into clear, actionable solutions-communicating both technical More ❯

Role: Data Engineering Manager Salary: £65,000- £75,000 per annum Location: Leeds (One day on site). VIQU have partnered with a leading supply chain organisation who are looking to expand their data teams. The Data Engineering Manager will manage a team of eight to help with an on-going digital transformation. The … the clients Databricks platform (AWS is preferred but open to Azure.GCP experience also), utilising Python and SQL, contribute to CI/CD pipelines, strategy development, cost optimisation and data governance frameworks. Job duties of the Data Engineering Manager: Manage a team of eight engineers, helping to mentor and coach the team. Manage the adoption of automated … experience in a managerial role, coaching similar sized teams. Deep knowledge of the Databricks platform. Hands on Python development experience. SQL optimisation. Experience with large scale data pipeline optimisation. Experience with Streaming and Batch Spark workloads. Strong people management skills. Role: Data Engineering Manager Salary: £65,000- £75,000 per annum Location: Leeds (One day More ❯

Job Title: Data Architect •Key Skills: SPARQL, Python, Clinical Knowledge Graph and GraphDB •Experience: 8+ Years •Location: London, UK •We at Coforge are seeking “Data Architect” with the following skill-set: Job Overview We are seeking a highly experienced Data Architect to support the ongoing development and continuous improvement of our Clinical Knowledge Graph … platform. This role is pivotal in enhancing technical architecture, streamlining processes, and ensuring high-quality delivery aligned with customer use cases. Key Responsibilities Design, develop, and maintain scalable data pipelines using SPARQL and Python. Create and optimize complex SPARQL queries for data retrieval and analysis. Develop graph-based applications and models to extract insights and solve … experience with SPARQL and Python. Strong understanding of graph databases (e.g., RDF, Neo4j, GraphDB). Experience in data modeling and schema design. Familiarity with data pipeline tools and frameworks (e.g., Apache Airflow, Luigi). Excellent problem-solving and analytical skills. Ability to work independently and collaboratively within cross-functional teams. Preferred Background Experience in Health More ❯

Vacancy for Research Data Engineers at NPL 6 July 2021 Locations: Glasgow & Teddington NPL is the UK's National Measurement Institute, providing measurement expertise that underpins UK prosperity and quality of life. We are a world-leading research facility, bringing together scientists and engineers from various fields to help save lives, protect the environment, and support global trade … and innovation. We are investing in Data Science to address scientific challenges in Advanced Manufacturing, Energy & Environment, and Life Sciences & Health, aligned with our organizational growth and transformation plans. The Data Science team at NPL is expanding, and we are seeking motivated candidates at all levels, from early career to experienced scientists, data engineers … partners in academia and industry, you will help advance research by creating optimal data infrastructures across various projects. You will work across the entire data pipeline, from configuring data sources to integrating analytical tools. Responsibilities include developing data architectures, protocols, and software tools to promote the FAIR principles (Findable, Accessible, Interoperable More ❯

Vacancy for Research Data Engineers at NPL 6 July 2021 Locations: Glasgow & Teddington NPL is the UK's National Measurement Institute, providing measurement expertise that underpins UK prosperity and quality of life. We are a world-leading research facility, bringing together scientists and engineers from various fields to help save lives, protect the environment, and support global trade … and innovation. We are investing in Data Science to address scientific challenges in Advanced Manufacturing, Energy & Environment, and Life Sciences & Health, aligned with our organizational growth and transformation plans. The Data Science team at NPL is expanding, and we are seeking motivated candidates at all levels, from early career to experienced scientists, data engineers … partners in academia and industry, you will help advance research by creating optimal data infrastructures across various projects. You will work across the entire data pipeline, from configuring data sources to integrating analytical tools. Responsibilities include developing data architectures, protocols, and software tools to promote the FAIR principles (Findable, Accessible, Interoperable More ❯

arisen to join our Business Intelligence (BI) Team as a BI Technical Engineer at The Veterinary Defence Society (VDS). Youll play a pivotal role in shaping our data and reporting capabilitiessupporting informed decision-making, improving service delivery, and helping our teams make the most of data. This position combines data engineering, analytics, and stakeholder collaboration … offering an excellent opportunity to grow within a forward-thinking organisation. Key Responsibilities Design, develop, and maintain robust data pipelines into the data warehouse Create and maintain consistent business-wide data definitions and KPIs Develop interactive dashboards and reports to support data-driven decision-making Analyse data to uncover trends … patterns, and insights Collaborate with IT, Finance, Marketing, Compliance, and Operations teams Present insights and reports to senior leadership Identify and address data quality issues and improve data processes Contribute to project teams, ensuring data requirements are addressed from the outset Continuously improve BI tools and data engineering practices Required Skills & Experience More ❯

Who We Are TetraScience is the Scientific Data and AI Cloud company. We are catalyzing the Scientific AI revolution by designing and industrializing AI-native scientific data sets, which we bring to life in a growing suite of next gen lab data management solutions, scientific use cases, and AI-enabled outcomes. TetraScience is the … in this vital new market, generating more revenue than all other companies in the aggregate. In the last year alone, the world's dominant players in compute, cloud, data, and AI infrastructure have converged on TetraScience as the de facto standard, entering into co-innovation and go-to-market partnerships: Latest News and Announcements TetraScience Newsroom In connection … EU. The ideal candidate should have expertise in customer and field enablement, adult learning principles, educational program creation, use case architecture and implementation, and a genuine passion for Data and AI technologies. The candidate should be driven by a desire to educate and inspire, and have the technical skills to quickly prototype new ideas and solutions. And finally More ❯

Haywards Heath, Home Office (Remote) or Manchester Salary: £55,000 - £65,000 depending on experience Department: Finance We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an excellent service. And that's … Lead Finance Solutions Developer 1st Central are on the lookout for a technically strong and analytically minded Lead Finance Solutions Developer who can bridge the gap between finance, data engineering, and actuarial analytics. If you're passionate about delivering high-quality, scalable data solutions to support business-critical decisions, and you enjoy working across multidisciplinary teams … this could be the perfect role for you. You'll play a key role in designing and maintaining data pipelines and tools that enable complex financial and actuarial modelling, reporting, and insight. Even if your background is more analytical or engineering-focused - and you don't meet every single requirement - we still encourage you to apply . We More ❯

Data Software Engineer (Python PySpark) Remote UK to £95k Are you a data savvy Software Engineer with strong Python coding skills? You could be progressing your career in a senior, hands-on Data Software Engineer role as part of a friendly and supportive international team at a growing and hugely successful European car insurance … company as they expand their UK presence; their platform enables an insurance quote to be made to the consumer within 60 seconds, using just 4 clicks. As a Data Software Engineer within the Claims team you will help shape the architecture of data products, building reusable technology that enables teams to ingest, store, transform and serve … their own data products. You'll take a lead in data transformation, setting up best practices in areas like Data modelling, performance optimisation and Data Governance to ensure that the data used within the business is consistent, available and reliable. You will be supported with continual learning and self development More ❯

Data Scientist - Hybrid (Bristol-based) £40,000 - £45,000 (up to £50,000 for exceptional candidates) Hybrid Working | Python & Pandas Are you passionate about data and ready to make a real impact in the world of cyber risk? We're working with a forward-thinking company that's pioneering cyber risk modelling using advanced stochastic techniques … and they're on the lookout for a skilled Data Scientist to join their growing team. This is a brilliant opportunity for someone with a sharp analytical mind and solid Python skills, who enjoys building efficient data pipelines and uncovering insights from complex datasets. The Role You'll play a key role in cleaning, enriching, and … preparing insurance portfolio data that feeds into cutting-edge risk models. From day one, you'll work closely with modellers, data scientists, and engineering experts to ensure high data quality and process efficiency. The work you do will directly influence insights into cyber exposure and risk trends. Key Responsibilities Clean, validate, and standardise large More ❯

The Green Recruitment Company is working with an Environmental and Sustainability Business that supports and empowers their customers' journey to net zero. To join their Data-Technology team, we have an opportunity for a Data Engineer to help support the wider business (cross-functional) to meet their reporting and data requirements. About the role … The Data Engineer will work with the latest innovative technologies to design, build, and maintain data solutions, constructing processes to surface data both internally for reporting purposes and externally through the customer portal. The Data Engineer will be responsible for developing scalable data pipelines to integrate diverse data sources while ensuring data quality under the framework of a new Data Platform for real-time application integration and reporting. They will work closely with business stakeholders to support data-driven decision-making by delivering clean, well-structured datasets that can be utilized for reporting purposes in a performant, secure way. Key More ❯

Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible business value. This is not a role for someone just … moving data from A to B with Python its for someone who understands how to model, optimise, and apply data to support better business decisions. Key Experience Required: Expertise in SQL Server (approx. 75% of the role) including performance tuning, data warehousing, and reporting. Experience with AWS data services (approx. 25%), particularly … RDS, S3, Lambda, EventBridge, and building data pipelines in cloud-native environments. Proven delivery of dimensional/Kimball data models in collaboration with Data Analysts. Strong proficiency with Power BI, including performance optimisation and deployment strategies. Hands-on experience with Python for automation and data transformation (not just file handling). Understanding More ❯

i am recruiting for a Data Engineer to work in Glasgow 3 days a week, 2 days remote. The role falls inside IR35 so you will have to work through an umbrella company. Banking/Financial Services experience is required. You will have a number of years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects. Experience in data development and solutions in highly complex data environments with large data volumes. SQL/PLSQL experience with the ability to write ad-hoc and complex queries to perform data analysis. Experience developing data pipelines and data warehousing solutions using Python and … libraries such as Pandas, NumPy, PySpark, etc. You will be able to develop solutions in a hybrid data environment (on-Prem and Cloud). Hands on experience with developing data pipelines for structured, semi-structured, and unstructured data and experience integrating with their supporting stores (e.g. RDBMS, NoSQL DBs, Document DBs, Log Files etc More ❯

to achieve this for a 7th time across the coming period. Due to these increasing levels of high activity, they are generating more and more customer and performance data than ever before and are embarking on a key project to best manage & utilise this. An agile and robust data management and utilisation plan will be key … e.g., star/snowflake schemas) Administer Microsoft Fabric Lakehouse and Azure services Optimise performance across queries, datasets, and pipelines Apply data validation, cleansing, and standardisation rules Document pipeline logic and contribute to business-wide metadata catalogues Collaborate with BI, Change, and Product teams to align data outputs to needs Support groundwork for future data … requirements clearly across business teams will be key to success in this role. You’ll be a technically strong data professional with hands-on experience in pipeline development, cloud-based data infrastructure, and performance optimisation. You will be at your best when working collaboratively in fast-paced environments and when translating complex business needs More ❯

to explore our dynamic team where you can truly act as an expert in your field in support of our clients and their challenges in the world of data and technology, read on! The Team We're Intuita - a fast-growing consultancy that's making waves in both the consultancy and technology space. With our ambitious goals for … a variety of industries, which may include telecoms, insurance, healthcare, finance and mortgages across various sectors. The Role We are seeking a skilled Analytics Engineer to join our Data Engineering team, ideally as a permanent consultant opportunity. We can move fast and adapt our selection period to our needs. With this in mind, immediate or quick availability is … permanent rights to work are essential, alongside other factors we'll consider. This is a hands-on Analytics Engineering role where you'll be at the heart of data-driven decisions. Day to day you will be transforming raw data in clean, reliable and performant data models using dbt within Google Cloud Platform (GCP More ❯

control for subscribers. The world's largest content providers, including Amazon, Google and Microsoft trust Bango technology to reach subscribers everywhere. Bango, where people subscribe. Role As Product Data Analyst you will play a key role in building the Bango Digital Vending Machine that makes Bango the place where people subscribe. Reporting to VP Product, you will play … ignite ideas and opportunities to drive the growth of the DVM as well as design dashboards for tracking performance. We are seeking a highly motivated and detail-oriented Data Analyst to join our team. In this role, you will be responsible for turning raw data into actionable insights that drive strategic decisions across the business. Responsibilities … Discover opportunities in data for Bango to drive the performance of the Bango Digital Vending Machine and new data product opportunities. Conduct in-depth exploratory, descriptive, and diagnostic analysis to identify patterns, trends, and anomalies. Build and maintain dashboards and reports to track key performance indicators (KPIs) Collaborate with stakeholders across product, marketing, engineering, operations, sales More ❯

Senior Data Engineer An exciting opportunity has arisen for a Senior Data Engineer to join my clients dynamic and growing data team. In this role, you will work across the full data lifecyclestreaming, enrichment, and curationwithin a cloud-based environment. You will be responsible for ensuring data quality, integrating key … data sets, and supporting the insights and data science teams. As part of this role, you will also develop your expertise in Artificial Intelligence (AI) and Machine Learning (ML), with access to advanced training in ML Ops. Key Responsibilities: Automate and maintain data pipelines within a cloud-based environment (AWS/GCP/Azure … . Source and verify data from multiple sources, ensuring it is ready for ingestion. Gain experience in data infrastructure and contribute to the development of new cloud-based methodologies. Analyse large datasets using Python and SQL. Set up new pipelines for data streaming, enrichment, and curation. Manage and maintain source code repositories (GitHub). More ❯

AWS Data Engineer - Manchester - Hybrid We're working with a global insurance company that's redefining the industry through technology. As a key end user of AWS, they're leveraging cloud-native solutions and advanced analytics to transform how they serve millions of customers. They're looking for Data Engineers who are passionate about building scalable … data platforms and want to be part of a forward-thinking team. You'll work on modern data pipelines, cloud infrastructure, and real-time analytics projects that directly impact business outcomes. As an AWS Data Engineer, you'll play a critical role in building and maintaining our cloud-based data infrastructure. You … ll work closely with data scientists, analysts, and other engineers to design, develop, and deploy scalable data solutions on the AWS platform. The client operates with a hybrid working model, with two days per week in their Manchester office. Responsibilities: -Design, build, and maintain data pipelines using AWS services such as S3, Glue, Lambda More ❯

AWS Data Engineer - Manchester - Hybrid We're working with a global insurance company that's redefining the industry through technology. As a key end user of AWS, they're leveraging cloud-native solutions and advanced analytics to transform how they serve millions of customers. They're looking for Data Engineers who are passionate about building scalable … data platforms and want to be part of a forward-thinking team. You'll work on modern data pipelines, cloud infrastructure, and real-time analytics projects that directly impact business outcomes. As an AWS Data Engineer, you'll play a critical role in building and maintaining our cloud-based data infrastructure. You … ll work closely with data scientists, analysts, and other engineers to design, develop, and deploy scalable data solutions on the AWS platform. The client operates with a hybrid working model, with two days per week in their Manchester office. Responsibilities: -Design, build, and maintain data pipelines using AWS services such as S3, Glue, Lambda More ❯