51 to 75 of 127 Data Pipeline Jobs in the East Midlands

Data Engineer (AI-Driven SaaS plaform) (Python, Snowflake, Data Modelling, ETL/ELT, Apache Airflow, Kafka, AWS) Large-scale data environment Up to £70,000 plus benefits FULLY REMOTE UK Are you a Data Engineering enthusiast who thrives from designing and implementing robust ETL processes, highly scalable data structures and … data pipelines within a truly enterprise-scale data processing environment? Do you want to work on an AI-Driven SaaS platform that's utilised by some of the biggest brands in the world? If so - look no further. This is your chance to help my client build their new Data Infrastructure and essentially help … them to leverage the power of data, working on large-scale data processing systems. They have an award-winning, enterprise-scale SaaS platform that was without a doubt, revolutionized its industry and is being utilised by some of the biggest companies and brand names in the WORLD. They have grown quickly and have truly made an More ❯

SecurityScorecard is proud to be funded by world-class investors including Silver Lake Waterman, Moody’s, Sequoia Capital, GV and Riverwood Capital. About the Team: At SecurityScorecard, the Data Science organization builds AI and ML products that empower our customers to manage cybersecurity risk. We leverage massive datasets sourced by our internal Threat Intelligence teams to create the … LLM-powered systems for automating and accelerating cybersecurity risk assessment workflows. About the Role: As an ML Engineer, you will design and optimize machine learning algorithms, build scalable data pipelines, and deploy reliable models into production environments. You'll collaborate with cross-functional teams to integrate ML solutions into products, conduct research to stay ahead of emerging technologies … a dynamic, collaborative environment. Responsibilities: Technical Leadership: Establish best practices and share expertise through mentorship. Model Development: Design, train, and optimize machine learning models and algorithms. Data Pipeline Creation: Build and maintain scalable data pipelines to preprocess, clean, and transform raw data for analysis and model training. Model Deployment: Implement and manage models More ❯

DOE) + Benefits SQL Database Developer needed for a permanent career opportunity based in Derby . A chance to join an established + growing software business who develop data solutions for large Retail brands. Must be willing to work from the Derby office full-time. Start ideally in Spring/Summer 2025. Key experience + responsibilities: Designing, developing … + maintaining SQL based solutions that power core business applications. Building/optimising data pipelines and integrations across cloud platforms. Strong hands-on SQL development skills including: MS SQL Server, T-SQL, indexing, stored procedures, relational/dimensional modelling, data dashboards. Any cloud platforms experience would be helpful including: such as Snowflake, Databricks, BigQuery, Azure SQL. … Working closely with key stakeholders including data architects, analysts, testers and managers. Working across the full SQL development life-cycle including: design, development, documentation and testing. Advantageous Skills: Power BI, NoSQL, Azure Synapse, data visualisation tools, Data Lakes, streaming technologies, MDM, Git, DevOps pipelines. Benefits include: 25 days holiday (plus BHs) + pension + More ❯

DOE) + Benefits SQL Database Developer needed for a permanent career opportunity based in Derby . A chance to join an established + growing software business who develop data solutions for large Retail brands. Must be willing to work from the Derby office full-time. Start ideally in Summer 2025. Key experience + responsibilities: Designing, developing + maintaining … SQL Server database solutions that power core business applications. Strong hands-on SQL Server database development skills including: complex stored procedures T-SQL, indexing, relational/dimensional modelling, data dashboards. Building/optimising data pipelines and integrations across cloud platforms. Any cloud platforms experience would be helpful including: such as Snowflake, Databricks, BigQuery, Azure SQL. Working … closely with key stakeholders including data architects, analysts, testers and managers. Working across the full SQL development life-cycle including: design, development, documentation and testing. Advantageous Skills: Power BI, NoSQL, Azure Synapse, data visualisation tools, Data Lakes, streaming technologies, MDM, Git, DevOps pipelines. Benefits include: £40k-50k Base (DOE) + 25 days holiday (plus More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

/Part time Full-time Experience Level Experienced Professional A snapshot of your day As the Digital Intelligence Lead, you will be responsible for guiding the business on data architecture and data engineering to best deliver strategic data and business intelligence solutions. You will also be responsible for developing application services to our internal … Intelligence (DI) team who operate out of the Lincoln site. In addition, you will provide real time strategic direction for the company's existing third parties working on data modelling projects via university links. Key responsibilities Mentor and support the progression of Digital Intelligence colleagues in the Transformation team with particular respect to Data Engineering and … Data Governance process. Work alongside internal and external partners to translate their business requirements into workable solutions. Optimise and innovate our end to end data pipeline Identify and work with related projects to address any interdependencies, ensuring a coordinated portfolio of projects. Identify, share and promote best practices and lessons learned to create a culture More ❯

Social network you want to login/join with: We’re working with a forward-thinking Microsoft partnered consultancy who are looking for a Data Engineer to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects on Databricks implementations. You will join a team … at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle from platform design to insights creation. This is a fantastic opportunity for someone who is passionate about building scalable, high-performance … data solutions utilising the latest cutting-edge cloud technologies. As part of this role, you will be responsible for some of the following areas • Design and develop scalable data pipelines to support analytics and operational reporting. • Build and maintain ETL/ELT processes to ingest, transform, and store data from various sources. • Collaborate with More ❯

Social network you want to login/join with: Location: Remote (UK-based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both remotely and on-site to lead analysis efforts … and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. - Work closely with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops … and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive client value. Key Experience & Skills: - 5+ years in a business/data analyst role, ideally in a consultancy or commercial setting. - Strong analytical, problem More ❯

Social network you want to login/join with: Location: Remote (UK-based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both remotely and on-site to lead analysis efforts … and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. - Work closely with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops … and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive client value. Key Experience & Skills: - 5+ years in a business/data analyst role, ideally in a consultancy or commercial setting. - Strong analytical, problem More ❯

Social network you want to login/join with: Location: Remote (UK-based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both remotely and on-site to lead analysis efforts … and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. - Work closely with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops … and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive client value. Key Experience & Skills: - 5+ years in a business/data analyst role, ideally in a consultancy or commercial setting. - Strong analytical, problem More ❯

Social network you want to login/join with: Location: Remote (UK-based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both remotely and on-site to lead analysis efforts … and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. - Work closely with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops … and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive client value. Key Experience & Skills: - 5+ years in a business/data analyst role, ideally in a consultancy or commercial setting. - Strong analytical, problem More ❯

Social network you want to login/join with: Location: Remote (UK-based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both remotely and on-site to lead analysis efforts … and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. - Work closely with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops … and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive client value. Key Experience & Skills: - 5+ years in a business/data analyst role, ideally in a consultancy or commercial setting. - Strong analytical, problem More ❯

Social network you want to login/join with: Location: Remote (UK-based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both remotely and on-site to lead analysis efforts … and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. - Work closely with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops … and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive client value. Key Experience & Skills: - 5+ years in a business/data analyst role, ideally in a consultancy or commercial setting. - Strong analytical, problem More ❯

Location: Leicester (Onsite, 5 days a week) We’re partnering with a client to find an experienced Data Analyst in a Fixed Term Contract role. This is a fantastic opportunity to work on cutting-edge data projects, enhance reporting processes, and deliver high-value insights within a dynamic and collaborative team environment. About the Role: Utilize … tools such as SQL, Power BI, Databricks, and Data Lakes to develop data pipelines and streamline reporting processes. Support data modeling projects, including implementing Medallion architecture to achieve gold-standard data sets. Handle month-end, year-end reporting, ad-hoc requests, and assist with BAU reporting. Contribute to a key Oracle project … supporting its implementation and ensuring reporting needs are met. Collaborate with internal teams, senior stakeholders, and peers to provide actionable data-driven insights. Key Skills and Experience Required: Advanced proficiency in SQL, Power BI, and Databricks. Experience with process streamlining, automation scripting, and data modeling. Strong analytical mindset with a problem-solving approach. Ability to work More ❯

rail network companies operating with rail infrastructure and asset management has a need to develop and support enterprise-level information systems. To act as the design authority for data-centric projects and programmes, responsible for shaping high-level data architecture aligned with strategic business and technology goals. This role focuses on designing solutions for Route Services … Information Technology (RSIT) customers, with an emphasis on graph-based data modelling and network management, ensuring alignment with both current and target-state infrastructure. Responsibilities Architect and design data solutions that support route services, asset management, and operations across the rail domain—ensuring scalability, quality, and performance. Develop data architectures and models (especially graph … based) that support seamless integration of infrastructure, operational data, and business intelligence. Define and enforce data solution standards, ensuring technical consistency and reuse across programmes. Collaborate with RSIT colleagues and enterprise architects to ensure proposed designs align with existing and future infrastructure strategies. Manage stakeholder engagement to translate complex data requirements into clear, actionable More ❯

you will work closely with various business functions reviewing their information needs and processes. You will recommend, develop and support improvements or new systems to capture and store data and manage business processes. These systems will also provide robust management reporting capabilities. Our goal is to support evidence-based decision making throughout the organisation to deliver the best … are looking for an Information Systems Developer to join the team who can: Design and develop apps in low code cloud-based systems to collect structured and unstructured data from end users Develop SQL databases and stored procedures to provide data storage for the low code apps, including DB maintenance and performance tuning. Build data pipelines to automate ETL workloads to refresh curated data sets which support reporting and analysis of information Solve complex problems in creative ways and propose appropriate best fit solutions according to different needs and priorities. Work independently using existing technical skills including: SQL database development Writing SQL code, stored procedures for applications, views for data More ❯

England and Wales, and an agricultural network of over 350 farms, spanning from North Yorkshire to the South Coast and Wales. About the Role: Are you passionate about data and digital transformation? Looking for a new challenge? Do you have experience or qualifications in IT? Avara Foods is an inclusive, forward-thinking business that has invested heavily in … its IT systems.We are seeking a motivated and enthusiastic individual to join our growing Data Operations team. This is an exciting opportunity for someone eager to build a strong foundation in data solution development and engineering, learning numerous programming languages and skills along the way. Working hours will be - Monday to Friday 08.00 - 17.00 Please note … Avara? As a Junior Analyst Developer, you will be joining a team that is instrumental in driving process digitization and automation through the development of custom low-code data-centric applications and integrations . Your role will blend hands-on support and app development of these solutions, which integrate seamlessly into our existing data architecture. Th More ❯

One of the biggest UK rail network companies operating with rail infrastructure and asset management has a need to develop and support enterprise-level information systems. Align the data science initiatives with the overall business goals. This could range from improving customer satisfaction, enhancing operational efficiency, to driving sales growth. Responsibilities DWH … development Data modelling Requirements clarification Customer communications Skills Must have Data Modelling Azure Data Lake Azure Data Factory Data Pipeline development Postgres, MySQL and SQLite Nice to have Machine learning Python More ❯

Social network you want to login/join with: Data & AI Solutions Deployment Architect, nottingham col-narrow-left Client: Bytes Software Services Location: nottingham, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 8 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Bytes is a top provider of premium IT solutions … foster a culture of innovation, collaboration, recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: The Data & AI Solutions Deployment Architect will be instrumental in architecting and deploying Azure Data & AI Solutions. A solid, technical, ‘hands-on’ (not just the theory) grasp of Azure … Fabric is essential as we navigate clients through all of the infrastructure, coding, and product development lifecycle challenges around successful Data and AI implementation and deployment. This customer-centric position involves delivering projects, conducting workshops and physically working on client’s environments via Python, and C#. This role would suit an experienced Data platform engineer or More ❯

Social network you want to login/join with: Data & AI Solutions Deployment Architect, lincoln col-narrow-left Client: Bytes Software Services Location: lincoln, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 8 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Bytes is a top provider of premium IT solutions … foster a culture of innovation, collaboration, recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: The Data & AI Solutions Deployment Architect will be instrumental in architecting and deploying Azure Data & AI Solutions. A solid, technical, ‘hands-on’ (not just the theory) grasp of Azure … Fabric is essential as we navigate clients through all of the infrastructure, coding, and product development lifecycle challenges around successful Data and AI implementation and deployment. This customer-centric position involves delivering projects, conducting workshops and physically working on client’s environments via Python, and C#. This role would suit an experienced Data platform engineer or More ❯