101 to 125 of 142 Permanent Data Pipeline Jobs in the UK excluding London

trusted partner, a leading financial services provider is currently hiring an Lead Azure DevOps Engineer who has recent experience working alongside a large data infrastructure department implementing CI/CD pipelines within an Azure environment our client transitions their legacy IT estate into the cloud. This is an … be able to demonstrate strong capabilities in Azure DevOps methodologies with the ability to implement CI/CD pipelines in collaboration with the data engineering team. Core responsibilities: Lead the implementation and maintenance of CI/CD pipelines for data projects, ensuring efficiency and scalability. Collaborate … for process improvement and implement solutions to streamline development workflows. Monitor system performance and implement optimizations to ensure the reliability and availability of data pipelines and services. Collaborate with cross-functional teams to troubleshoot issues, implement fixes, and ensure timely resolution of technical challenges. Stay up-to-date more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

Senior Data Engineer Hybrid (flexible) Scotland £45 - 60K + 10% Bonus Are you ready to play a pivotal role as a Data Engineer in a major greenfield project? A FTSE 100 energy company, dedicated to becoming a leader in the low carbon world, is investing … them on their ambitious journey towards net zero and help create a sustainable and inclusive future for everyone. The Role: As a Senior Data Engineer, you will develop and optimise data pipelines within the Microsoft data capability stack, focusing on the new Fabric data platform. Reporting to the Lead Data Engineer, you'll be part of a dynamic team driving innovation and enhancing data-driven decision-making. Key Responsibilities: Lead the design and implementation of sophisticated data models and pipelines. Collaborate with data management more »

the forefront of our journey to Net Zero. Because of this though, they currently use a lot of third parties to store their data and are looking to build out an internal risk function to utilise data more efficiently. You'll get involved in immediately organising … the data structures, building out a Data Warehouse and data pipelines from the multiple data sources. From there you'll start including other data sources including telephony and others to strengthen Risk decision making. It will be your job to … bolster the current Risk function, helping to build better models using Credit Risk Data to allow them to compete across multiple financial sectors. It's a great opportunity to build an overall risk profile, refine the decision engines and eventually manage the processes overall! What you'll need more »

We are seeking a passionate and driven Junior SQL Data Engineer to join our team. As a Junior SQL Data Engineer, you will work closely with our data engineering and analytics teams to develop, optimize, and maintain SQL databases and data pipelines. … paced, dynamic environment . REQUIRED - 5 years in the UK as a minimum Role and responsibilities: Design, develop and optimize SQL databases and data models to support business requirements. Build and maintain data pipelines for efficient data extraction, transformation, and loading (ETL) processes. Collaborate … with cross-functional teams to understand data requirements and implement solutions that meet business needs. Perform data analysis and troubleshoot issues to ensure data accuracy and integrity. Support Legacy Data Warehouse: Bug fixes, batch ETL processing and data related queries. more »

We are seeking a passionate and driven Junior SQL Data Engineer to join our team. As a Junior SQL Data Engineer, you will work closely with our data engineering and analytics teams to develop, optimize, and maintain SQL databases and data pipelines. … paced, dynamic environment . REQUIRED - 5 years in the UK as a minimum Role and responsibilities: Design, develop and optimize SQL databases and data models to support business requirements. Build and maintain data pipelines for efficient data extraction, transformation, and loading (ETL) processes. Collaborate … with cross-functional teams to understand data requirements and implement solutions that meet business needs. Perform data analysis and troubleshoot issues to ensure data accuracy and integrity. Support Legacy Data Warehouse: Bug fixes, batch ETL processing and data related queries. more »

Lead Database & ETL Developer looking for an exciting opportunity? Our Technology team at Southern Housing is searching for someone who can expertly manage data across our technology estate, optimising and developing source data systems to the highest quality standards. In this role, you'll take full … ownership of data management, ensuring its consistency throughout our ecosystem. Collaboration is key, as you will work alongside the data community of practice/guild to uphold consistent data practices and set the bar for organisational best practice and lead fellow Data … processes like Data Integration, Governance, Metadata Management Experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using traditional data integration technologies. Designing source data and data management principles. Demonstrated success more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

Data Engineer - Manchester - £35,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into … their central Microsoft Azure repository. Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power … will not have to use Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you more »

created role within the Business Improvement & Change function responsible for delivering and driving business change across the organisation. Candidate Profile: A passionate experienced data and business intelligence professional with ideally experienced within a highly regulated industry. Skilled in Power BI, DAX, Excel and MS SQL, with hands on … experience developing and designing end user reports Strong management and leadership skills Experience and understanding of data architecture and infrastructure to include data pipelines, data warehousing and ETL Knowledge in supporting regulatory reporting and experience of data governance. If you are interested … experience and skills evidenced on the CV. For information on how your personal details may be used by Sellick Partnership, please review our data processing notice on our website. more »

our client's UK-based team. The successful candidate will: -have previous experience of mentoring a team of developers - be adept at managing data pipelines, working with data exports in Business Central - possess a solid understanding of financial reporting. Key Responsibilities : Design, develop, and maintain advanced … PowerBI dashboards and reports to drive business decisions. Expertly craft DAX formulas for complex calculations and data analysis within PowerBI. Utilise SQL queries to manipulate and retrieve data efficiently from various databases. Implement and manage data pipelines to ensure seamless data flow … and integration. Work with data exports from Business Central to optimise data usage in PowerBI. Leverage Synapse Analytics to handle large volumes of data and perform big data analytics. Provide insights into financial reports including General Ledger (GL), Profit & Loss (P&L more »

DOE Vision of the role: This is an exciting role which will drive impactful growth through advanced segmentation, personalisation, and data management. As a key member of our marketing team, you will implement sophisticated techniques to optimise funnel conversion rates, ensuring that every subscriber receives timely and relevant … messaging. Your role will also focus on maintaining and enhancing our data management processes, ensuring that campaign data is up-to-date and accurately mapped. This isn't just another job; it's an opportunity to leave your mark and shape something exciting. Join us in … transforming how we engage with our audiences and deliver exceptional value through targeting and strategic data techniques. Traits & Characteristics: In this role, you'll be instrumental in optimising and managing our data using Salesforce and SQL. Taking full responsibility for data configuration and performance more »

DOE Vision of the role: This is an exciting role which will drive impactful growth through advanced segmentation, personalisation, and data management. As a key member of our marketing team, you will implement sophisticated techniques to optimise funnel conversion rates, ensuring that every subscriber receives timely and relevant … messaging. Your role will also focus on maintaining and enhancing our data management processes, ensuring that campaign data is up-to-date and accurately mapped. This isn't just another job; it's an opportunity to leave your mark and shape something exciting. Join us in … transforming how we engage with our audiences and deliver exceptional value through targeting and strategic data techniques. Traits & Characteristics: In this role, you'll be instrumental in optimising and managing our data using Salesforce and SQL. Taking full responsibility for data configuration and performance more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

Your new company You will be working for a welcoming and engaging organisation which is currently going through a comprehensive data transformation programme, designed to establish a robust approach to modernising the use and management of all data, to inform decision-making and support regulatory activity. … Your new role As a data engineer, you will help build and maintain the data infrastructure and systems that collect, manage and transform raw data for onward use by data analysts and data scientists. You will implement efficient data … of database design and development, data management and systems integration Knowledge of automation testing as part of a data engineering pipeline Knowledge of software development approaches, disciplines and best practice Awareness of how data is used by Analysts, Data Scientists and more »

Data Architect + Salary: £85,000 - £100,000 + Security Clearance: Must hold SC or DV + Location: Romsey or Woking (Hybrid) *UK Eyes only - Dual Citizenship or overseas card not eligible due to nature of projects Areas of Responsibility/Tasks: Help Defence customers develop their strategy … for data as a strategic asset and define the appropriate level of governance needed and the appropriate processes. Communicate the data strategy to non-technical stakeholders and technical experts. Define and the architecture for data software and analytics solutions, either as standalone engagements or … high level technical requirements. Provide technical guidance and coaching to junior members of the team. Essential skills/experience: Alongside your skills with Data specific technologies, you have a broad technical background which allows you to rapidly understand new systems and domains, and prototype solutions based on your more »

Data Architect + Salary: £85,000 - £100,000 + Security Clearance: Must hold SC or DV + Location: Romsey or Woking (Hybrid) *UK Eyes only - Dual Citizenship or overseas card not eligible due to nature of projects Areas of Responsibility/Tasks: Help Defence customers develop their strategy … for data as a strategic asset and define the appropriate level of governance needed and the appropriate processes. Communicate the data strategy to non-technical stakeholders and technical experts. Define and the architecture for data software and analytics solutions, either as standalone engagements or … high level technical requirements. Provide technical guidance and coaching to junior members of the team. Essential skills/experience: Alongside your skills with Data specific technologies, you have a broad technical background which allows you to rapidly understand new systems and domains, and prototype solutions based on your more »

A Data Engineer is sought to drive impactful data initiatives within a high performing organisation. The Data Engineer will spearhead data strategies and foster innovation across the operations. The organisation is a premier provider of essential products and services across Europe, dedicated … to improving quality and reliability in the sector. In this role, the data engineer will be pivotal in designing and executing solutions for the entire data lifecycle, including data acquisition, storage, modeling, transfer, hosting, visualisation, analysis, and consumption. The Data Engineer will … also be responsible for guiding and developing the skills of team members. Key Responsibilities: Architect and implement comprehensive data pipelines for efficient data acquisition, storage, processing, and interface creation. Generate both machine-readable interfaces and user-friendly data products, encompassing standard and custom reports. more »

trusted partner, a leading financial services provider is currently hiring an Lead Azure DevOps Engineer who has recent experience working alongside a large data infrastructure department implementing CI/CD pipelines within an Azure environment our client transitions their legacy IT estate into the cloud. This is an … be able to demonstrate strong capabilities in Azure DevOps methodologies with the ability to implement CI/CD pipelines in collaboration with the data engineering team. Core responsibilities: Lead the implementation and maintenance of CI/CD pipelines for data projects, ensuring efficiency and scalability. Collaborate … for process improvement and implement solutions to streamline development workflows. Monitor system performance and implement optimizations to ensure the reliability and availability of data pipelines and services. Collaborate with cross-functional teams to troubleshoot issues, implement fixes, and ensure timely resolution of technical challenges. Stay up-to-date more »

trusted partner, a leading financial services provider is currently hiring an Lead Azure DevOps Engineer who has recent experience working alongside a large data infrastructure department implementing CI/CD pipelines within an Azure environment our client transitions their legacy IT estate into the cloud. This is an … be able to demonstrate strong capabilities in Azure DevOps methodologies with the ability to implement CI/CD pipelines in collaboration with the data engineering team. Core responsibilities: Lead the implementation and maintenance of CI/CD pipelines for data projects, ensuring efficiency and scalability. Collaborate … for process improvement and implement solutions to streamline development workflows. Monitor system performance and implement optimizations to ensure the reliability and availability of data pipelines and services. Collaborate with cross-functional teams to troubleshoot issues, implement fixes, and ensure timely resolution of technical challenges. Stay up-to-date more »

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our … client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data streams to our clients Data Platform. Shape data from various sources into a transactional ODS for detailed reporting and a Kimball-modelled Data Warehouse for analytics and dashboards. Define and embed data quality measures within data pipelines. Ensure more »

Job Title: Data Engineer Role Type: Permanent Location: Hybrid (Birmingham) Role Overview As the Data Engineer, you will be responsible for managing a team of data engineers, analysts and leveraging your expertise in Microsoft BI tools and cloud-based technologies to drive their data initiatives. You will play a critical role in guiding the team, developing curated business models, and utilizing Azure services to optimize our data infrastructure. Key Responsibilities Provide leadership, guidance, and support to team members, ensuring the successful execution of projects and tasks. Mentor and support the wider … business, including Business Intelligence teams, to leverage data for decision-making using PowerBI and other Microsoft tools. Collaborate with cross-functional teams to achieve common business goals. Develop and maintain curated business models to support accurate and insightful decision-making. Utilize SSRS, SSAS, and SSIS to design, develop more »

to Friday. As a DevOps/MLOps Engineer you will be operationalising machine learning effectively. You will support the architectural needs of their Data Science team to ensure the seamless deployment, monitoring, and maintenance of machine learning models and data pipelines. You will work in close … collaboration with the Data Science team to design and implement scalable and reliable infrastructure for machine learning model deployment and data processing. The successful candidate will deploy machine learning models and data pipelines to production environments and establish robust monitoring and alerting systems to … machine learning model deployment process and ensure reproducibility. The DevOps/MLOps Engineer will implement security best practices and ensure compliance with relevant data privacy regulations in all processes as well as work cross-functionally with Data Scientists, Software Engineers and DevOps team members to facilitate more »