14 Data Pipeline Jobs in Yorkshire

UK (Hybrid: Flexible working arrangements) Salary: Up to £90,000 per annum Are you a seasoned IT professional with expertise in Cyber Security, Data Compliance (GDPR), Data Engineering, Data Warehousing, and Cloud Engineering (AWS)? We have an exciting opportunity for an IT Director to … of IT initiatives alongside our CTO, aligned with business goals. Cyber Security measures, ensuring the protection of our systems and data. compliance with data regulations, particularly GDPR, and … implement best practices for data governance. data engineering projects, including data modeling, ETL processes, and data pipeline development. data warehousing solutions, optimizing for performance, scalability, and reliability. Cloud Engineering efforts, leveraging AWS services for infrastructure and application needs. and more »

Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business Analysts and Data Architects with discovery and best practices. Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? Advanced Azure knowledge and experience working and migrating data products from … on-prem to Azure. Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark. Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis. Strong analytic skills related to working with unstructured more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Sheffield, mainly remote or something in-between, believe that your best work happens when you have the freedom to create your ideal workspace Data Scientist Salary: £30-50,000 Location: UK - Remote/Hybrid/Sheffield HQ Twinkl is embarking on an exciting journey, and we're at … the beginning of something extraordinary. As we reshape the future of educational resources, data-driven decisions will be at the heart of our transformation. Join our team of over 20 data enthusiasts and contribute to shaping what the future of learning looks like! Why You'll … of education We are a high-spirited, conscientious team that celebrates inclusivity and where work is rewarding and fun! Your Role: As a Data Scientist, you're not just crunching numbers - you're influencing the educational landscape. Our work ranges from ensuring the entire business has the data more »

companies to GPs and individuals to get people the support they need to feel better. We are looking for an expert in cloud data solutions to Lead our Data Team as part of a 6 month fixed term contract. As a Senior Data Engineer … together a single view of the client journey spanning a number of sources. You will be responsible for implementing the right architecture and data pipelines to enable the company to utilise its data assets. To be successful in this role you will need to: Ensure that … the business’s information architecture, entity modelling, intersystem data consolidation at an enterprise level and pipelines are well designed and fulfil current and future business requirements Ensure that good development and architectural practices are adhered to Monitor and refine data pipelines to ensure adherence to expected more »

the forefront of our journey to Net Zero. Because of this though, they currently use a lot of third parties to store their data and are looking to build out an internal risk function to utilise data more efficiently. You'll get involved in immediately organising … the data structures, building out a Data Warehouse and data pipelines from the multiple data sources. From there you'll start including other data sources including telephony and others to strengthen Risk decision making. It will be your job to … bolster the current Risk function, helping to build better models using Credit Risk Data to allow them to compete across multiple financial sectors. It's a great opportunity to build an overall risk profile, refine the decision engines and eventually manage the processes overall! What you'll need more »

AWS Data Engineer | £50-60k | Fintech | Hybrid Leeds Want to work for a business that uses Data to create predictions that shape the future of fintech decision making? If so, AWS Data Engineers this one is for you... About the business 🚀 G.Digital has … how the everyday person gets closer to financial freedom! They've kicked off some exciting new projects including the development of a new Data Lakehouse and the implementation of an iPaaS solution and now they're looking to hire a Data Engineer to join their small … Python Any exposure to Terraform would be great Liaising with other areas across the business to help define requirements for new projects, including both pipeline and ETL requests What’s on offer to you? 💰 £50-60k Bonus of up to 10% Flexible working (core hours) Private health more »

Data Engineer | Yorkshire | up to £45,000 basic | Flexible Working A regular feature in the "UK's Top 10 places to work", my client is an award-winning business with a reputable brand and is widely respected for investing in their employees, placing importance on personal development and … career progression. The Environment you'll be joining: You'll be joining a friendly 10+ Data Engineering team as the business undergoes a complete greenfield re-architecture from the ground up in Microsoft Azure. The Tech you'll be playing with: Azure Data Factory Azure Databricks … PySpark SQL DBT What you need to bring: 1-3 year's experience in building Data Pipelines SQL experience in data warehousing Python experience would be desirable Experience in Azure/GCP/AWS is a bonus Why join? Joining an award-winning business comes with more »

a few. We are hiring for Senior Product Developer ( Full time/Fixed term contract ) Job Description:- Design, developing and testing large scale data processing systems through data pipelines and ETL's. Working closely with architects, analysts, and stakeholder to bring efficient and scalable solutions in … data processing. Skills : Specific skills we need – strong SQL, performance tuning, python for ETL frameworks and robust data warehousing experience and GCP. Strong experience in python strong knowledge of sql/plsql and ability to write performant sql queries Experience working on data pipelines … data warehouse and ETL's. GCP experience (Migration to cloud is a plus)(pub/sub, dataflow, dataproc, big query, cloud sql) knowledge in containers and container orchestration CI/CD experience version control (GIT) Orchestration tools ( airflow or cloud composer more »

in the resolution of complex user requests and ensuring a minimum of the agreed service level agreements. Maintain confidentiality in accordance with our data protection policies and procedures. Delivering to service quality KPI's that underpin the management of Masteks services Demonstrate knowledge of the specific technologies necessary … software applications, systems, and networks. Knowledge of programming languages Java, JVM, DynamoDB, AWS IAM, CloudWatch, PagerDuty, Tooling TypeScript, Node.js, SRE, AWS Data Pipeline & Visualisation and scripting is a plus. Excellent problem-solving skills with the ability to analyse complex scenarios. Outstanding communication skills, both written and verbal more »

acquisition of a new BI Developer. As a BI Developer, you will collaborate closely with cross-functional teams to understand business requirements, design data models, and develop robust BI reports and dashboards. This role will be based from the Leeds office on a hybrid working model to be … BI solutions using tools such as Power BI, Tableau, or similar. Collaborate with stakeholders to gather and analyse business requirements. Develop and maintain data models, ETL processes, and data pipelines. Create interactive dashboards and reports to provide insights into key business metrics. Optimise query performance and … ensure data accuracy and integrity. Stay updated with emerging BI trends and technologies to drive continuous improvement. Utilise real time analytics to have a meaningful impact on business performance. Requirements: Relevant Degree in Computer Science or similar field Advanced Power BI SQL & SSRS DAX Experience with cloud platforms more »

is on an exciting journey and there is no better a time to join us. The investments we are making in our people, data, and technology are leading to innovative projects; fresh possibilities have provided new ways for our people to work, learn and thrive. About us… Like … the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform the way we meet the ever-changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too… What you'll … across Product & Engineering. Proven experience in hands-on software engineering using a broad range of technologies including the following: Java or Python Microservices Data pipelines and database programming such as DBT, SQL, BigQuery, Cloud Composer etc CI/CD/DevOps tooling experience e.g., GIT, Jenkins etc What more »