1 to 25 of 34 Data Pipeline Jobs in the North of England

Job summary The Senior Data Engineer will have direct oversight and responsibility for the development, implementation, review, and establishment of data and techniques used in the Advanced Data Analytics Portfolio (DAP). As a Senior Data Engineer, you will work with project … managers, data scientists, counter fraud experts, stakeholders, and senior management across the full extent of the NHSCFA and our wider stakeholders in pursuit of the above. Your primary responsibilities will include developing data pipelines, processing data, and preparing data suitable for analysis. … data wrangling methods, models, data structures, and data formats. oJSON, SQL, and XML oWriting robust data pipeline code that can run unattended. oMachine learning for engineering practices, such as meta driven intelligent ETL and pipeline processes. oStrong skills in relevant more »

Job summary This is an exciting opportunity to join The Christie's Clinical Outcomes and Data Unit (CODU) as a Senior Data Scientist. The CODU's strategy is to improve patient outcomes through the robust selection, analysis, and visualisation of data. We work closely with colleagues … across the trust to support the use of data in clinical and operational decision making. We are experts in data visualisation, creating data analysis tools, and helping colleagues to use these tools in their daily work. You will be expected to work with the … Analysts, Data Scientists and Statisticians within the team, working on projects with stakeholders throughout the Christie, extracting insights from data collected throughout the hospital to be presented back to clinical and operational teams to inform improvements in the hospital. With your organised, enthusiastic and inquisitive approach more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

UK (Hybrid: Flexible working arrangements) Salary: Up to £90,000 per annum Are you a seasoned IT professional with expertise in Cyber Security, Data Compliance (GDPR), Data Engineering, Data Warehousing, and Cloud Engineering (AWS)? We have an exciting opportunity for an IT Director to … of IT initiatives alongside our CTO, aligned with business goals. Cyber Security measures, ensuring the protection of our systems and data. compliance with data regulations, particularly GDPR, and … implement best practices for data governance. data engineering projects, including data modeling, ETL processes, and data pipeline development. data warehousing solutions, optimizing for performance, scalability, and reliability. Cloud Engineering efforts, leveraging AWS services for infrastructure and application needs. and more »

s overall commitment to responsible business practices. Ready to level up your career? Playtech‘s BI Unit is looking for an expert Senior Data Engineer with excellent analytical mind set and problem-solving skills to join our Data Programme team Job Description Your influential mission. You … will... Be designing, implementing, and maintaining scalable and efficient data pipelines, ensuring data quality, and optimizing data processing performance Strength our data stack to bear the load of our ever expanding, data driven business Develop and maintain data models, ETL processes, and data warehousing solutions to support analytics, machine learning, and reporting Ensure data security and compliance with industry regulations and best practices Identify, analyse, and resolve data-related issues to improve data reliability and maintain data more »

Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business Analysts and Data Architects with discovery and best practices. Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? Advanced Azure knowledge and experience working and migrating data products from … on-prem to Azure. Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark. Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis. Strong analytic skills related to working with unstructured more »

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on business requirements and priorities As part of … Coding experience with Python/Javascript/C# Familiarity with statistical/machine learning/AI concepts and techniques Understanding of data pipeline/orchestration tools e.g. dbt, dataform Appreciation of GCP’s serverless technologies e.g. Cloud Run/Workflows Understanding of Google’s marketing stack, Google more »

get the chance to get matched to this role and other similar roles, click on Apply to set up your free profile. Their Data Team is made up of 50+ people, covering data engineering, data science, and data architecture specialisms. The team … works with a range of public and private sector clients, building production grade cloud solutions focussed on streaming, graph, big data, and data science use cases. Job Description Due to the nature of the client engagements, every employee needs to be able to achieve Security Clearance. … and are proud to have an organisational culture where employees can bring their authentic selves to work. Team They are constructing the top data engineering practice in the UK, and their team build bespoke, mission critical data solutions for the UK Government as well as bluechip more »

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

About Us Airtime Rewards is delivering the leading data-led rewards technology globally. We believe every shopper should feel great about their daily spend. Our app is loved by our members (>3.5m!) and we're continually building new features that drive towards our vision that sees hundreds of … and insight that transforms their understanding of their customers. We do all this with our cutting-edge proprietary technology, utilising real-time purchase data and AI learning to delight our members and maintain relationships with >200 retailers (including Boots, Aldi, Tesco, Greggs, Selfridges, and Halfords to name a … ourselves on culture, are solving new problems, and need great people to join us on our international journey as we deliver the leading data-led rewards technology globally. The Opportunity We are looking to recruit a Data Engineer to join and strengthen our existing team and more »

Senior Data Engineer Manchester (Hybrid Role) £90,000 per annum Position Summary: We are seeking a talented Senior Data Engineer to spearhead the design and implementation of robust data pipelines and advanced scripts. You will play a key role in architecting dynamic data warehousing systems on the Azure platform, harnessing the power of data lakes, Databricks, and Synapse Analytics. Your contributions will significantly propel this organisation into a new era of data-driven excellence, driving innovation and delivering impactful solutions. Key Responsibilities: Collaborate closely with cross-functional … teams, including Data Scientists, Software Engineers, and Business Analysts, to deliver impactful solutions aligned with business goals. Develop and deploy scalable data pipelines for the ingestion, incremental loading, transformation, and modeling of data. Architect agile data warehousing systems on the Azure platform, utilising data more »

Data Engineer - Manchester - £35,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into … their central Microsoft Azure repository. Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power … will not have to use Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Data Engineer Our growing client based in Manchester is currently looking for a skilled Data Engineer to contribute to the development of our clients' cloud-native data platform in AWS. In this role, you'll collaborate with stakeholders to architect and implement data solutions that drive business outcomes. Responsibilities: Collaborate with stakeholders to translate requirements into scalable data solutions. Architect and oversee the migration to a cloud-native data platform in AWS. Utilise Agile methodologies to manage the development lifecycle. Design and implement data pipelines … ensuring data quality and integrity. Requirements: Proficiency in ETL tools such as SQL, SSIS, AWS, Lambda, and Python. Strong understanding of data warehouse concepts. Excellent problem-solving and communication skills. Benefits: Competitive salary and benefits package. Opportunities for career growth and development. Collaborative and inclusive work more »

Sheffield, mainly remote or something in-between, believe that your best work happens when you have the freedom to create your ideal workspace Data Scientist Salary: £30-50,000 Location: UK - Remote/Hybrid/Sheffield HQ Twinkl is embarking on an exciting journey, and we're at … the beginning of something extraordinary. As we reshape the future of educational resources, data-driven decisions will be at the heart of our transformation. Join our team of over 20 data enthusiasts and contribute to shaping what the future of learning looks like! Why You'll … of education We are a high-spirited, conscientious team that celebrates inclusivity and where work is rewarding and fun! Your Role: As a Data Scientist, you're not just crunching numbers - you're influencing the educational landscape. Our work ranges from ensuring the entire business has the data more »

companies to GPs and individuals to get people the support they need to feel better. We are looking for an expert in cloud data solutions to Lead our Data Team as part of a 6 month fixed term contract. As a Senior Data Engineer … together a single view of the client journey spanning a number of sources. You will be responsible for implementing the right architecture and data pipelines to enable the company to utilise its data assets. To be successful in this role you will need to: Ensure that … the business’s information architecture, entity modelling, intersystem data consolidation at an enterprise level and pipelines are well designed and fulfil current and future business requirements Ensure that good development and architectural practices are adhered to Monitor and refine data pipelines to ensure adherence to expected more »

In this role, you'll be part of a team that leverages cutting-edge tools and technologies to extract, analyse, and visualise complex data, ultimately contributing to the organisation's success. If you're driven, adaptable, and thrive in a fast-paced environment, we encourage you to apply. … Responsibilities: Conduct data manipulation and transformation in Azure, Snowflake, and other specified data warehouses Design and execute data solutions. Manage dataset access and controls. Draft and validate processes. Document and log structural alterations in Azure/Snowflake. Develop and sustain data processes … applications, and features. Deploy and uphold database objects. Enhance and maintain tools for system analysis. Construct and manage Power BI data models in line with team requirements. Collaborate with stakeholders to implement existing and newly acquired contracts. Establish and maintain data warehouse infrastructure, flows, and pipelines. more »

Are you interested in working for a scaling technology company that specialises in delivering innovative data solutions? Found Talent are seeking a talented Data Engineer to join the company and work alongside other passionate individuals who share this vision. You will work closely with the organisation … creating apps and using data sources across multiple platforms. You will manage company data, monitor accuracy and completeness, and advise on ways that data quality can be improved. As a member of the team, you will work on exciting projects that challenge you and … help you develop your skills. Responsibilities: Develop and maintain reports and dashboards from a variety of data sources Manage company data, monitor accuracy and completeness, and advise ways that data quality can be improved Design, develop, and implement data pipelines Identify, root more »

Senior Data Engineer (Databricks) Hybrid working - 3 days onsite in Manchester Up to £70,000 I'm currently working with a data-centric organisation who are looking for a Senior Data Engineer with strong Databricks experience to join their team. The primary focus of … the role is Databricks data engineering. You will be building data pipelines using Databricks, coding using PySpark, and supporting internal applications. You will also be using Python for Data Transformations and work across the Azure Data Platform. Must Have Strong Databricks Data Engineering skills, not just admin but actually building data pipelines in Databricks and using it regularly. Strong coding experience with Pyspark. Strong experience in SQL Server and Python coding. Knowledge of Azure Data Factory. Strong 3-5 years working as a Data more »

the forefront of our journey to Net Zero. Because of this though, they currently use a lot of third parties to store their data and are looking to build out an internal risk function to utilise data more efficiently. You'll get involved in immediately organising … the data structures, building out a Data Warehouse and data pipelines from the multiple data sources. From there you'll start including other data sources including telephony and others to strengthen Risk decision making. It will be your job to … bolster the current Risk function, helping to build better models using Credit Risk Data to allow them to compete across multiple financial sectors. It's a great opportunity to build an overall risk profile, refine the decision engines and eventually manage the processes overall! What you'll need more »