51 to 75 of 284 Data Pipeline Jobs in the Midlands

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board. Company Description Job Description The IT Data Engineering Manager will play a pivotal role in advancing the data maturity of the Data & AI department by owning and delivering the data engineering roadmap. … They will manage the Data Engineering team, providing best practices and specialized support as an expert and consultant to deliver solutions that enable the business to maximize value. The IT Data Engineering Manager will be responsible for the entire engineering lifecycle, from data ingestion to transformation to serving. They will support the development and … optimization of the environment and platforms to ensure ongoing growth and adherence to industry best practices. Define and implement data engineering strategies and best practices Oversee data platform architecture for scalability and reliability Lead and manage a team of data engineers Collaborate with architects, analysts, and business teams to align data solutions More ❯

Lead Data Scientist (Equity Only) - 1% About Luupli Luupli is a social media app 'in development' that aims to provide opportunities for diverse creators from marginalized communities. The platform will highlight their work and offer access to social media opportunities. Job Description: As a Lead Data Scientist at Luupli, you will leverage AWS analytics services to … analyze data and extract insights. You will collaborate with cross-functional teams to develop data-driven solutions and shape our data strategy to support business growth. Responsibilities: Work with teams to understand objectives, data needs, and analytics goals. Develop data analysis strategies using AWS tools like Amazon Redshift, Athena, EMR … and QuickSight. Design data pipelines and ETL processes for data ingestion and transformation. Apply statistical and machine learning techniques for predictive and segmentation analyses. Create dashboards and KPIs with Amazon QuickSight for decision-making. Perform exploratory data analysis to identify trends and insights. Collaborate on data architecture, quality, and governance improvements. Requirements More ❯

Lead Data Scientist (Equity Only) - Nottingham Job Details Client: Luupli Location: Nottingham, United Kingdom Job Category: Other EU Work Permit Required: Yes Job Description Luupli is a social media app 'in development' that aims to provide opportunities for diverse creators from marginalized communities. The platform will showcase their work and offer access to social media opportunities. Role: Lead … Data Scientist This role involves leveraging AWS analytics services to analyze data, collaborate with cross-functional teams, and develop data-driven solutions to support business growth. Responsibilities Collaborate with teams to understand objectives and define analytics goals. Develop data analysis strategies using AWS tools such as Amazon Redshift, Athena, EMR, and QuickSight. … Design data pipelines and ETL processes for data extraction and transformation. Apply statistical and machine learning techniques for predictive and pattern analysis. Develop KPIs and dashboards using Amazon QuickSight for decision-making. Perform exploratory data analysis to identify trends and insights. Work with data engineers on data architecture, quality, and More ❯

Data Scientist - Grid Innovation Model Development (Energy Sector Experience Required) Join to apply for the Data Scientist - Grid Innovation Model Development (Energy Sector Experience Required) role at Energy Job Search Data Scientist - Grid Innovation Model Development (Energy Sector Experience Required) 2 days ago Be among the first 25 applicants Join to apply for the … Data Scientist - Grid Innovation Model Development (Energy Sector Experience Required) role at Energy Job Search Job Description Summary Join us in our journey to redefine what's possible with AI and make a lasting impact on the world of Energy. Job Description Summary Join us in our journey to redefine what's possible with AI and make a … security, and improved quality of life. Are you excited at the opportunity to electrify and decarbonize the world? We are seeking a dynamic, forward-thinking, and results-driven Data Scientist who will primarily focus on deriving advanced models for grid innovation applications. Reporting to the AI leader in the CTO organization, the Data Scientist will collaborate More ❯

digital-first environment and we do things differently. We're focused on our core values; using these we've seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of the fastest-growing consultancies globally. … Translate client requirements into scalable, cloud-based AI architectures that address both technical feasibility and business impact. Propose end-to-end AI/ML solutions-including model design, data pipelines, MLOps, and platform integration-tailored to each opportunity. 3. Support Sales and Bid Activity Lead the technical response for AI-related RFPs, RFIs, and proposals, including solution overviews … e.g. vector databases, RAG pipelines, prompt engineering) can drive value in future proposals. Qualifications Experience & Skills Proven experience in pre-sales or client-facing architecture roles involving AI, data science, or analytics. Strong ability to elicit business needs and align them with AI/ML solutions in cloud environments (Azure, AWS, or GCP). Deep technical understanding of More ❯

believe in the power of technology and people, and we help everyone here to succeed. At TXP, you can multiply your potential. We are seeking a Head of Data & AI to join our technology function. The practice is built on the belief that architecture should be business driven and purposeful. You'll be joining a collaborative team, co … creating tools, supporting each other, providing governance, and building a community. The Head of Data & AI will act as a catalyst for innovation, spotting emerging client challenges and translating them into repeatable scalable data solutions. This role can be completed in a hybrid way, spending 2 days a week in our Solihull, or Dudley offices, or … and data migration. Strong knowledge of SQL, NoSQL, cloud-based databases (e.g., AWS Redshift, Snowflake, Google BigQuery, Azure Synapse). Experience in ETL development, data pipeline automation, and data integration strategies. Familiarity with AI-driven analytics Strong understanding of data governance, security, and regulatory compliance. Excellent communication skills, with the ability More ❯

digital lifecycle and helping them outperform their competition through speed and innovation. About Apexon: Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation … TDD) . Excellent problem-solving, debugging, and performance-tuning skills. Preferred Qualifications Strong communication skills and demonstrated ability to engage with business stakeholders and product teams. Experience in data modeling , data warehousing (e.g., Snowflake , AWS Glue , EMR , Apache Spark ), and working with data pipelines . Leadership experience—whether technical mentorship, team leadership, or managing More ❯

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client is committed to 100% renewable energy and sustainability, focusing on delivering exceptional customer experiences. … day a week being based in their Nottingham office, this is negotiable. It is a full-time role, 37 hours per week. Accountabilities: * Develop and maintain scalable, efficient data pipelines within Databricks, continuously evolving them as requirements and technologies change. * Build and manage an enterprise data model within Databricks. * Integrate new data sources into … such as data warehousing. * Able to write repeatable, production-quality code for data pipelines, utilizing templating and parameterization where needed. * Can make data pipeline design recommendations based on business requirements. * Experience with data migration is a plus. * Open to new ways of working and new technologies. * Self-motivated with the ability More ❯

based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from ADLIB Recruitment | B Corp Lead Senior Data Recruiter at ADLIB - B Corp Certified - Ambassador at MotherBoard Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to … scaling fast and now looking for their very first Data Engineer. You’ll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform. You’ll be leading on the design and implementation of scalable, secure data pipelines - getting experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. This role combines classic data engineering work with data management strategy, data lineage tracking, and storage infrastructure design; from cold archiving through to high-speed access for ML models, you’ll be the go-to person. You More ❯

Social network you want to login/join with: B-Stock is actively seeking a skilled Senior Data Engineering Developer to spearhead the design, development, scaling, and maintenance of our cutting-edge SaaS infrastructure. In this pivotal role, you will collaborate closely with cross-functional teams encompassing Data Science, Engineering, and Product/Business Technology. Your … primary mission will be to construct robust data infrastructure, establish streamlined processes, and enhance our toolset. ESSENTIAL JOB DUTIES AND RESPONSIBILITIES Pioneering the vision for Business Intelligence (BI) and Data Warehousing, steering the strategic plan to fruition. Assembling a high-caliber BI and Data Warehouse team, fostering their growth and skill development. Cultivating collaborative … raw source data into SQL columns. Experience with GCP solutions such as DataFlow and Pubsub are huge plus. Understanding and experience in AI/ML platform and pipeline, such as Vertext AI. EMPLOYEE BENEFITS Competitive compensation packages including bonus and options Medical, dental, and vision benefits Matching 401(K) Paid time off Telecommuting and remote-work options More ❯

We are looking for a Data Engineer to join our eCommerce Data team at NEXT. Based from NEXT Head Office in Leicestershire with a competitive salary range of £49,000 - £60,000 with great benefits! Let’s talk numbers. When it comes to UK retail, it’s hard to find a bigger name. We sell thousands … of items an hour and are expanding our e-commerce business by the second. For anyone in Tech, this is the place to learn, grow, and thrive. eCommerce Data provides the department and the business the means to see what is working and what is not by drawing data and analysing patterns of shopping on our … site and in general. The role As a Data Engineer within eCommerce Data team NEXT, you will be working with Big Data to help the business make informed decisions. What else is involved? Develop and implement data transformation processes, including data cleansing, aggregation, and enrichment, to prepare data More ❯

Pharmalex is looking for a Data Engineer to join their growing team. This will be a remote-based role but there is a requirement to travel to Lutterworth one day of the month. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into a central Microsoft Azure repository and hosted … MS SQL database. Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Core responsibility will be using the NHS Secure Data Environment which utilises databricks, to design and extract regular datasets. Configure and troubleshoot Microsoft Azure, manage data ingestion using LogicApps and Data … with Power BI (you will not have to use Power BI, but being aware of how to collaborate with people that do is important). Work closely with data analysts and scientists, contribute to data models and testing of outputs. EDUCATIONAL QUALIFICATIONS: Bachelor’s Degree in Statistics, Computer Science, Information Technology or any other related discipline More ❯

Lead Data Scientist (Equity Only) - Shrewsbury Client: N/A Location: Shrewsbury, United Kingdom Job Category: Other EU work permit required: Yes Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 Job Description: Role: Lead Data Scientist - Equity-Only Role (1%) About Luupli: Luupli is a social media app currently in development, aimed at providing opportunities for … from marginalized communities. It will highlight their work and facilitate access to social media opportunities. Responsibilities: Collaborate with teams to understand business objectives and define analytics goals. Develop data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design data pipelines and ETL processes for data extraction, transformation, and loading into … AWS. Apply statistical and machine learning techniques for predictive and segmentation analyses. Develop KPIs and dashboards using Amazon QuickSight for decision-making. Perform exploratory data analysis to identify trends and insights. Work with data engineers to optimize data architecture, quality, and governance in AWS. Requirements: Bachelor's or master's degree in Computer Science More ❯

Verisk Get AI-powered advice on this job and more exclusive features. Principle Software Architect At Verisk Analytics, we’re driving the future of insurance with world-class data analytics and risk assessment solutions. As a global tech leader, we empower insurers to make faster, smarter decisions through the power of advanced AI, machine learning, and cutting-edge … purpose—and where your work can truly make a difference. Job Description Principle Software Architect At Verisk Analytics, we’re driving the future of insurance with world-class data analytics and risk assessment solutions. As a global tech leader, we empower insurers to make faster, smarter decisions through the power of advanced AI, machine learning, and cutting-edge … Architecture & Solution Design: Oversee the technical architecture of our solutions, ensuring they meet performance, scalability, and security requirements. Design and develop scalable AWS architectures for API-based and data-centric applications. Define data pipelines, ETL processes, and storage solutions using AWS services such as S3, OpenSearch, Redshift, Step Functions, Lambda, Glue, and Athena. Architect RESTful APIs More ❯

Social network you want to login/join with: Senior Data Engineer – 6-Month Contract | London | Insurance Sector We're exclusively recruiting for a Senior Data Engineer to join a leading organisation within the Property & Casualty Insurance sector. ? Location : London (Hybrid) ? Sector : Insurance – Property & Casualty ? Work Type : Contract (Inside IR35/Outside – subject to discussion) You … ll be embedded within the Actuarial team , building scalable data platforms and pipelines to support pricing analysis. You’ll work closely with stakeholders, lead third-party collaborations, and play a critical role in optimising and managing robust data infrastructure. ? Key Responsibilities: Collaborate with pricing actuaries and analysts to gather technical and business requirements. Architect a scalable … You’ll Need: Proven experience as a Data Engineer (ideally in the insurance or financial sector). Expertise in SQL Server , ETL frameworks , and data pipeline development . Solid knowledge of Python , Azure , AWS , and tools like Databricks , Glue , S3 , etc. Ability to identify and resolve performance bottlenecks and data quality issues. Comfortable More ❯

Data Engineer Hybrid - requirement to work from the office once every 2 weeks with additional ad hoc travel as required. Salary of up to £47,000, pension, critical illness, life assurance, family health care, 33 days holiday (including bank holidays), exclusive company discounts on used car purchases, leasing deals and aftersales services. As a Data Engineer … you will be responsible for developing and maintaining data pipelines, optimising databases, creating ETL processes, designing data models and ensuring data quality. Reporting into the Lead Data Engineer, you will use your expertise in data engineering to derive valuable insights from our data assets and shape data … for someone who has: Proven experience as a Data Engineer or similar role. Strong SQL skills with relational and NoSQL databases. Demonstrated experience with data pipeline and ETL tools (e.g., Azure Data Factory, Azure Logic Apps, Databricks, APIs). Understanding of different data environments (Data Lakes, Synapse, Delta Lakes More ❯