1 to 25 of 35 Data Pipeline Jobs in Yorkshire

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data More ❯

to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality care. Through our innovative Healthcare Operations Platform, we're connecting data to unlock trusted insights that enable improved decision-making and help deliver safer healthcare for all. At RLDatix were making healthcare safer, together. Our … respectful culture makes it all possible. As a team, we collaborate globally to reach our ultimate goalhelping people. Were searching for a Senior Data Engineer to join our Data Platform team, so that we can build and maintain robust infrastructure for handling large-scale data … governance and security policies within the data lake to maintain compliance and data integrity. Automating data pipeline execution and monitoring to enhance efficiency and reduce manual intervention. Developing and maintaining Python scripts for data processing, automation, and integration to More ❯

Job summary Ready to take on a career-defining challenge? HDFT are looking for two Senior Data Engineers to play a pivotal role in a ground-up deployment of Microsoft Fabric. This is a rare opportunity to work on a completely greenfield project, shaping architecture and developing robust … scalable data pipelines using best-fit technologies. What's in it for you??Immediate exposure to Microsoft Fabric -- be at the forefront of cutting-edge data engineering.?Greenfield deployment -- minimal legacy constraints, just innovation.?Critical role -- influence architecture, tooling, and best practices from day one.?Technology … first environment -- work with modern cloud and data technologies to build something that lasts. What you'll be doing? Designing and implementing high-performance data pipelines for real-time and batch processing.? Architecting a future-proof data platform, leveraging Microsoft Fabric and other best More ❯

Senior Data Engineer - Data Infrastructure and Architecture: C-4 Analytics C-4 Analytics is a fast-growing, private, full-service digital marketing company that excels at helping automotive dealerships increase sales, increase market share, and lower cost per acquisition. We are currently hiring for a Senior … Data Engineer as we look to expand our team and support our growing roster of local and national clients. If you are unable to complete this application due to a disability, contact this employer to ask for accommodation or an alternative application process. Who We're Looking For … growing AI team, you'll play a critical role in the orchestration of Intelligent Systems. Working with AI related orchestration and data pipeline technologies to turn information into insights using multiple platforms. We're not just processing data-we're transforming it into organizational intelligence. More ❯

Data Engineering Vacancies - Mid to Lead Level - Leeds I am working with a brand new client, and end user based in Leeds who are building an exciting data practice, doing some highly advanced work in the data space. Salary and Benefits Highly comptetitive salary … days per week in Leeds office Competitive annual leave package And many more Role and Responsibilities Design and manage Snowflake-based data pipelines, ensuring data flows seamlessly from multiple sources into the data platform. Collaborate with business stakeholders and data analysts to … identify data requirements and deliver the appropriate solutions. Ensure the integration of structured and unstructured data sources into Snowflake, optimizing data models for reporting. Work with data analysts to support their data needs and optimize semantic models for Snowflake-based More ❯

My client is based in the Leeds area are currently looking to recruit for an experienced Data Engineer to join their Data & AI Consulting team. They are a specialist Tech organisation, that are at the forefront of engineering practices. They are currently going through a period … of growth and are looking for an experienced Data Engineer to join their team. They only recruit the "best" talent and have a diverse workforce. Key Responsibilities: Design, build, and manage data pipelines in Snowflake, ensuring seamless data flow from diverse sources into the … data platform. Collaborate with business stakeholders and data analysts to gather data requirements and deliver effective solutions. Integrate structured and unstructured data sources into Snowflake, optimising data models for analytics and reporting. Support data analysts by optimising semantic More ❯

Snowflake Data Engineer I am working with a hugely successful organisation based in Leeds who are looking for a Snowflake Data Engineer to join their newly formed data practice. You will join a business to work on their exciting Greenfield data platform … project, where you will have the opportunity to create the data warehouse from scratch and shape the ongoing direction of the data platform. You will work to build and maintain a robust and scalable data platform and will support the organisation's BI and … analytics goals. You will work closely with developers to transform data ready for reporting purposes to deliver accurate information to key business stakeholders. As part of this role you will be responsible for - Design and develop data pipelines ensuring the successful integration of data More ❯

Graduate Data Engineer - LeedsGraduate Data EngineerLocation: Leeds, Thorpe Park, Hybrid working. We\\\'re on a mission to make credit work better for all. We buy debt from lots of different companies in all kinds of sectors. We treat people with dignity, helping customers pay off their … millions of people going through tough times. But enough about us. Let\\\'s talk about your new role with Lowell. Working alongside the Data Management Team Lead, the Data Engineer will look to perform a variety of tasks that will ensure the data community … have the data used in our everyday decision making through the delivery of final state \\\'data products\\\' within a governed manner. Accountabilities and Responsibilities:Build relationships within the business and developer and deploy data pipelines in a governed manner, ensuring that outputs meet key More ❯

The Data Engineering Manager is responsible for establishing and overseeing the Data Engineering and Data Ops functions, ensuring the efficient and effective management of data to drive business value. Key Responsibilities Develop and own the data engineering strategy and roadmap … to maximize long-term business value. Prioritize, plan, and ensure the timely and high-quality delivery of data engineering initiatives. Oversee third-line support, technology upgrades, and the introduction of new technologies within agreed timelines. Provide technical guidance and mentorship to the team and wider organization on data engineering challenges and solutions. Design and architect scalable data pipelines for efficient data ingestion, transformation, and loading. Manage and optimize data platforms, including infrastructure, upgrades, and connectivity. Build and lead a high-performing Data Engineering team, including internal staff and More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

Software Engineer – Data focused – Hybrid in York – up to £60,000 About the Role We are seeking an experienced and highly motivated Senior C# Developer with a strong focus on data-centric development to join our dynamic technology team. You will play a pivotal role in … designing, developing, and maintaining robust C# applications with a deep integration into large-scale data pipelines, databases, and analytics platforms. Key Responsibilities Design, develop, and maintain C# applications and backend services with a strong emphasis on data integration and transformation. Optimise large-scale data … and ensure high-performance querying and storage. Develop and maintain RESTful APIs and services that interact with large datasets. Implement best practices for data integrity, data quality, and data security. Contribute to the design of data models, schemas, and ETL pipelines. Collaborate More ❯

Data Governance & Quality Manager Build from Scratch Leeds (Hybrid 3 days per week onsite) £55,000 £65,000 + Benefits Were hiring on behalf of a growing, tech-led organisation thats at the beginning of an exciting new chapter for their data function. With a newly … appointed VP of Data at the helm, theyre investing across engineering, analytics, and governance and this role is the first of its kind in the business. This is a greenfield opportunity to build data governance and quality frameworks entirely from the ground up. If youve ever … wanted the chance to shape your own processes, set the standard for best practice, and genuinely influence how a business treats and uses data this is it. What youll be doing: Designing and implementing the entire data governance strategy from scratch Leading the development of data More ❯

Lead/Senior Data Consultant - Leeds/Hybrid - £70,000-90,000 Darwin Recruitment have partnered with a Leeds-based Consultancy who are in a growth-phase, investing heavily in their technical teams. They are searching for a Lead/Senior Data Consultant to play a … environment Focus on new products and features. A clear path to Leadership. The Role You will lead on internal projects centred around developing data processing pipelines & GenAI applications within Cloud environments. … These projects are large-scale, complex and have a huge impact for their clients. Experience of Interest Python, FastAPI, Application Development. Data Pipeline Processing/Data Engineering Cloud expertise - AWS/GCP Terraform, Docker, Bash Github, CI/CD, Jira, Confluence Agile, Scrum, Kanban Previous More ❯

Data Engineer An exciting opportunity has arisen for a skilled Data Engineer to support a government department in transitioning a successful proof-of-concept (PoC) business intelligence and data warehousing solution into a fully operational, production-ready platform. Over a four-year period, a … options aligned with the departments long-term digital strategy. Through agile delivery and close collaboration, the organisation significantly improved its understanding of internal data assets and the Microsoft technology ecosystem, enhancing its reporting capabilities and data-driven decision-making. The next phase of this programme will … Factory (ADF): Incremental creation of data dimensions to optimise processing, reduce overheads, and improve cost efficiency across compute, storage, and networking. Enhancing pipeline security by replacing basic authentication with managed identities or service principals. Introducing parallelism into pipeline workflows to improve performance and scalability. Refactoring existing More ❯

Data Analyst Location: Leeds, United Kingdom Are you interested in building new data products that will be a value center as opposed to a cost center? Or creating new value and insights for customers with a new data platform and data products … worth $Billion+? If so, check out the below A leading Logistics & Supply chain organization is building a new data team to develop a new platform based on Snowflake that will help their customers get direct data insights that can impact their supply chains and enable informed … decisions. The role will report to the Head of Data. Managing Snowflake and data pipelines, and creating key visualizations in Snowflake or Power BI using SQL and Python (through Snowpark) alongside the Microsoft stack, managing data across cloud and legacy systems. You will be helping to More ❯

A fantastic opportunity has arisen for a Data Analyst to join a business in Pocklington. In this key role, you will be responsible for capturing, analysing, and reporting data to optimise supply chain efficiency, biological asset management, and commercial decision-making. This position offers the chance … to provide valuable insights that drive business performance and strategic growth. The Role Reporting to the Head of Optimisation, the Data Analyst will generate data-driven insights to enhance performance across the business. This is an excellent opportunity for a data professional to contribute … and exciting opportunities for career development within a dynamic, forward-thinking environment. You will be involved in cutting-edge data projects that are shaping the future of food production. Key Responsibilities: Ensure accurate and timely data capture across the entire supply chain. Develop and maintain automated More ❯

Data Engineer Azure Stack | £60,000–£70,000| Leeds – Hybrid (2 days/week) A leading professional services firm is looking for a hands-on Data Engineer to join them at a pivotal moment in their data journey. This is a unique opportunity to … own and shape the development of a modern Azure-based data platform from the ground up — replacing legacy reporting tools, consolidating business-critical data sources, and paving the way for Microsoft Fabric adoption. The organisation is mid-way through a modernisation programme. They’ve moved away … from outdated SAP BO reports and started building a scalable data foundation using Azure Synapse, ADF, and Power BI, with support from a Microsoft partner. They are now looking for someone to take ownership of the platform and guide the business through the next phase of growth. What More ❯