1 to 25 of 120 Data Pipeline Jobs in the East Midlands

for new, innovative and sustainable products and solutions, both for today and for a new era of building. To support our progress, we are currently recruiting for a Data Engineer (Databricks & BI) to come and join our team at Ibstock Head Office, LE67 6HS. (Applicants must have Right to work in the UK - We are unable to provide … sponsorship for this role) Job Purpose: The Data Engineer/BI Developer will play a critical role in developing and refining our modern data lakehouse platform, with a primary focus on Databricks for data engineering, transformation, and analytics. The role will involve designing, developing, and maintaining scalable data solutions to support business … and on-premises JDE systems to provide near real-time insights for decision-making. Key Accountabilities: Ensure the existing design, development, and expansion of a near real-time data platform integrating AWS, Databricks and on-prem JDE systems. Develop ETL processes to integrate and transform data from multiple sources into a centralised data platform. More ❯

Join to apply for the Data Engineer role at Ibstock Plc Join to apply for the Data Engineer role at Ibstock Plc Direct message the job poster from Ibstock Plc Resourcing Business Partner @ Ibstock PLC WE ARE 200 years of history and over 2,300 employees strong. WE ARE a business loaded with opportunity and career … for new, innovative and sustainable products and solutions, both for today and for a new era of building. To support our progress, we are currently recruiting for a Data Engineer (Databricks & BI) to come and join our team at Ibstock Head Office, LE67 6HS. (Applicants must have Right to work in the UK - We are unable to provide … sponsorship for this role) Job Purpose: The Data Engineer/BI Developer will play a critical role in developing and refining our modern data lakehouse platform, with a primary focus on Databricks for data engineering, transformation, and analytics. The role will involve designing, developing, and maintaining scalable data solutions to support business More ❯

P lease note: This is an apprenticeship position. Therefore, anyone with more than six months of professional experience working as a Data Engineer or who holds a degree or Master’s degree in a related subject (such as Data Scienceor similar) will not be eligible. You will also need to commit to completing a Level … Data Engineering Apprenticeship. Are you eager to combine paid work with study to earn a qualification? Do you want to join a strong team dedicated to revolutionising digital delivery while kickstarting your career in Data Engineering? This is a fantastic opportunity to join AND Digital as a Data Engineering Apprentice , where you’ll gain … hands-on experience, be part of a supportive and forward-thinking team, and work towards a Level 5 Data Engineering qualification. You’ll learn on the job while applying your skills to real world challenges. Who We Are: AND Digital are a tech company focused on accelerating digital delivery and dedicated to closing the digital skills gap. We More ❯

centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your role and responsibilities IBM is seeking a skilled Senior Data Engineer to join our dynamic team, focusing on public sector accounts. This role offers an exciting opportunity to leverage your expertise in data engineering to drive impactful … solutions for government clients. The Senior Data Engineer will be responsible for designing, developing, and managing scalable data pipelines, integrating heterogeneous systems, and implementing robust data models. The ideal candidate will collaborate with cross-functional teams to ensure data integrity, security, and availability, while meeting regulatory requirements specific to the public sector. … Required education None Preferred education Bachelor's Degree Required technical and professional expertise Responsibilities: Design, build, and maintain scalable data pipelines and ETL processes. Collaborate with data scientists and engineers to integrate complex data systems. Ensure data quality, accuracy, and reliability through testing and validation procedures. Develop and implement data More ❯

About the role... Do you get satisfaction out of all things data? Interested in pushing your career to the next level at one of the Sunday Times Top 100 Best Companies to Work For? Cooper Parry are seeking a skilled and proactive Data Engineer to join our growing Data & Analytics team. You will play … Engineer... Design and build end-to-end data pipelines and integrations using Azure Data Factory, Azure Synapse and related tools Monitor data pipeline schedules and resolve issues related to job failures, data delays, or quality problems Develop and support a Lakehouse architecture, including structured and unstructured data ingestion … you will work cross-functionally in a hybrid business/technical team, so strong communication is a must. Of course you'll need an understanding of data pipeline monitoring, alerting, and observability best practices. You also need: Proven experience in a Data Engineering role within enterprise environments Hands-on experience designing, implementing and maintaining complex More ❯

Join to apply for the Senior Data Engineer role at IBM Introduction In this role, you’ll work in one of our IBM Consulting Client Innovation Centres (Delivery Centres), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centres offer our clients locally based … maternity return schemes Standard benefits like holiday allowance, discounts, Employee Assistance Program, and a pension plan with employer contributions Your Role and Responsibilities We are seeking a Senior Data Engineer to join our team, focusing on public sector accounts. Your role involves designing, developing, and managing scalable data pipelines, integrating diverse systems, and implementing data … and schema design Provide technical support for data issues Stay updated with industry trends and emerging technologies Required Technical and Professional Expertise Experience in data pipeline and ETL development Collaboration with data teams Data quality assurance Data modeling and storage solutions Technical support and troubleshooting Knowledge of Java, Python More ❯

About the role North Northamptonshire Council are working to modernise their data management and visualisation processes. We are working to deliver our data analytics strategy. This role will … support the design and delivery of the data warehousing, data infrastructure and (where required) the migration of existing data sources (data pipeline and Extract Transform Load (ETL) processes), the primary objective is to create a secure and efficient route for dispersed data sets to be accessed, analysed and visualised … through tools such as Power BI and Excel power query. The current technology stack is predominantly based on Microsoft SQL databases, and we are focussing our data strategy on the Microsoft Azure, Fabric and Power BI toolsets. What will you be doing? The Key Responsibilities of the role will be: Understand and document the data landscape More ❯

Social network you want to login/join with: Lead Data Scientist (Equity Only) - 1%, northampton col-narrow-left Client: Location: northampton, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Lead Data scientist - Equity-Only role 1% About Luupli … marginalized communities. Luupli will highlight the work of diverse creators and provide them access to all the opportunities in the social media space. Job Description: As a Lead Data Scientist at Luupli, you will play a pivotal role in leveraging AWS analytics services to analyse and extract valuable insights from our data sources. You will collaborate … with cross-functional teams, including data engineers, product managers, and business stakeholders, to develop data-driven solutions and deliver actionable recommendations. Your expertise in AWS analytics tools and techniques will be crucial in shaping our data strategy and driving business growth. Responsibilities: Collaborate with cross-functional teams to understand business objectives, identify data More ❯

Social network you want to login/join with: Lead Data Scientist (Equity Only) - 1%, derby col-narrow-left Client: Location: derby, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Lead Data scientist - Equity-Only role 1% About Luupli … marginalized communities. Luupli will highlight the work of diverse creators and provide them access to all the opportunities in the social media space. Job Description: As a Lead Data Scientist at Luupli, you will play a pivotal role in leveraging AWS analytics services to analyse and extract valuable insights from our data sources. You will collaborate … with cross-functional teams, including data engineers, product managers, and business stakeholders, to develop data-driven solutions and deliver actionable recommendations. Your expertise in AWS analytics tools and techniques will be crucial in shaping our data strategy and driving business growth. Responsibilities: Collaborate with cross-functional teams to understand business objectives, identify data More ❯

Join to apply for the Senior Data Engineer (SQL Server/AWS) role at Adria Solutions Ltd 2 days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible business value. This is not a role for someone just moving data from A to B with Python; it’s for someone who understands how to model, optimize, and … apply data to support better business decisions. Key Experience Required Expertise in SQL Server (approx. 75% of the role) including performance tuning, data warehousing, and reporting. Experience with AWS data services (approx. 25%), particularly RDS, S3, Lambda, EventBridge, and building data pipelines in cloud-native environments. Proven delivery of dimensional/Kimball More ❯

Social network you want to login/join with: Lead Data Scientist (Equity Only) - 1%, Lincoln col-narrow-left Client: Location: Lincoln, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Lead Data Scientist - Equity-Only role 1% About Luupli … which aims to provide opportunities for diverse creators from marginalized communities. It will highlight their work and offer access to social media opportunities. Job Description: As a Lead Data Scientist at Luupli, you will leverage AWS analytics services to analyze data and extract insights. You will work with data engineers, product managers, and stakeholders … to develop data-driven solutions and recommendations, shaping our data strategy and supporting business growth. Responsibilities: Collaborate with teams to understand business goals, data needs, and analytics objectives. Develop data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design data pipelines and ETL processes for diverse More ❯

Social network you want to login/join with: Lead Data Scientist (Equity Only) - 1%, Leicester col-narrow-left Client: Location: Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Lead Data Scientist - Equity-Only role 1% About Luupli Luupli is a … provide opportunities for diverse creators from marginalized communities. It will highlight their work and offer access to opportunities in the social media space. Job Description: As a Lead Data Scientist at Luupli, you will leverage AWS analytics services to analyze data and extract insights. You will work with cross-functional teams to develop data-driven solutions and provide actionable recommendations, shaping our data strategy and supporting business growth. Responsibilities: Work with teams to understand objectives, data needs, and analytics goals. Develop and implement analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design data pipelines and ETL processes for data extraction More ❯

technologies to improve safety and the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models, perform data cleansing, transformation, and validation. Maintain accurate documentation of data … resources and troubleshooting data-related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist More ❯

technologies to improve safety and the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models, perform data cleansing, transformation, and validation. Maintain accurate documentation of data … resources and troubleshooting data-related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist More ❯

technologies to improve safety and the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models, perform data cleansing, transformation, and validation. Maintain accurate documentation of data … resources and troubleshooting data-related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist More ❯

technologies to improve safety and the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models, perform data cleansing, transformation, and validation. Maintain accurate documentation of data … resources and troubleshooting data-related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist More ❯

technologies to improve safety and the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models, perform data cleansing, transformation, and validation. Maintain accurate documentation of data … resources and troubleshooting data-related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist More ❯

Job Description Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting talented data engineers. As a major UK energy provider, our client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer … hybrid, with one day a week based in their Nottingham office, negotiable. It is a full-time role, 37 hours per week. Accountabilities: Develop and maintain scalable, efficient data pipelines within Databricks, evolving them as requirements and technologies change. Build and manage an enterprise data model within Databricks. Integrate new data sources into the … logical structures like data warehousing. Ability to write production-quality, repeatable code for data pipelines, using templating and parameterization. Ability to recommend data pipeline designs based on business needs. Experience with data migration is a plus. Open to new technologies and ways of working. Self-motivated, goal-oriented, and proactive. Strong More ❯

Data Engineer – Job Specification Location: Hybrid (1–2 days per month in Nottingham) Salary: £60,000 Summary An exciting opportunity for a passionate Data Engineer to join a growing consultancy business at a pivotal stage of its development. This role sits at the forefront of data infrastructure design, development, and optimisation — supporting enterprise-level … solutions, modern data platform projects, and consultancy-led client engagements. You’ll play a hands-on role in delivering robust, scalable data engineering solutions while advocating for best practices across the business. Ideal for someone with a proactive mindset, who wants to make a tangible impact and be part of shaping the future of a data … Vault 2.0. Development Experience: Minimum 3 years in database and/or analytics systems development and deployment. Strong understanding of Python and Spark for data transformation and pipeline development. Consulting & Client-Facing: Experience working on consultancy-led projects with external clients. Ability to deliver against agreed project milestones and manage client expectations. Comfortable running advisory and enablement More ❯

Senior Data Engineer My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment and is passionate about leveraging data to deliver tangible business value. This is not a role for someone just … moving data from A to B with Python its for someone who understands how to model, optimise, and apply data to support better business decisions. Key Experience Required: Expertise in SQL Server (approx. 75% of the role) including performance tuning, data warehousing, and reporting. Experience with AWS data services (approx. 25%), particularly … RDS, S3, Lambda, EventBridge, and building data pipelines in cloud-native environments. Proven delivery of dimensional/Kimball data models in collaboration with Data Analysts. Strong proficiency with Power BI, including performance optimisation and deployment strategies. Hands-on experience with Python for automation and data transformation (not just file handling). Understanding More ❯

Social network you want to login/join with: Senior Data Engineer (SC Cleared), northampton col-narrow-left Client: CALIO Consulting Group (CCG) Location: northampton, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex … data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting the technical direction and ensuring engineering best practices are followed throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions … that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯