19 Data Pipeline Jobs in the West Midlands

Job summary The Senior Data Engineer will have direct oversight and responsibility for the development, implementation, review, and establishment of data and techniques used in the Advanced Data Analytics Portfolio (DAP). As a Senior Data Engineer, you will work with project … managers, data scientists, counter fraud experts, stakeholders, and senior management across the full extent of the NHSCFA and our wider stakeholders in pursuit of the above. Your primary responsibilities will include developing data pipelines, processing data, and preparing data suitable for analysis. … data wrangling methods, models, data structures, and data formats. oJSON, SQL, and XML oWriting robust data pipeline code that can run unattended. oMachine learning for engineering practices, such as meta driven intelligent ETL and pipeline processes. oStrong skills in relevant more »

Data Engineer – Hybrid Working £50,000 - £55.000 30 Days Holidays + 4 Days Christmas + Bank Holidays Great Pension Career Development Flexible Working - (Hybrid) A Great Working Environment Excellent Sport & Leisure Facilities Training and Personnel Development Offerings Office Location is close to A45, A46, M1, M6, M40, M42 … implement data security measures Design and implement data quality checks and validation processes within the pipelines using expectations with the pipeline, or dedicated testing tools (SODA) Collaborate with data governance, architects, system/product owners and end users to ensure quality issues are … addressed as needed. Create and maintain technical documentation, including data pipeline specifications, data models, and transformation logic Contribute to data modelling and schema design standards and related documentation. Qualifications & Requirements Degree in Computer Science, Data Engineering, or a related field or more »

Azure Head of Data Engineering Salary- £90,000 - £110,000 + Excellent benefits Location - Birmingham/Hybrid Key skills - Azure - Databricks - Data factory - Data Lakes - Synapse - Modelling - Agile Role purpose: We are actively seeking a dynamic professional to play a pivotal role in the … organisation and contributing to the exciting digital transformation journey. Reporting directly to the Chief Data Officer, you will lead team of skilled data engineers to architect, build, and maintain a new data lakehouse solution and pipelines that drive our digital transformation initiatives and support … business reporting requirements. You will be responsible for overseeing all aspects of data engineering, from strategy to implementing cutting-edge technologies like Microsoft and Databricks and will enjoy being hands-on. Collaborating with leaders in the business, Analytics, Data Governance, Data Science and AI more »

Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work … Maintaining and enhancing data pipelines to support business reporting processes Formulating test cases and test plan to validate all data pipeline changes Investigating potential data quality issues in the data pipeline to identify true root cause along with an action … and continually enhancing data quality and data governance of data pipelines Maintaining documentation of the data pipeline process to ensure business continuity Maintaining documentation of the data stored in BigQuery to support business Essential Skills: + 4 years of more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer. The ideal candidate will have a proven … of large data sets Data quality system and process design and implementation. Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

A fantastic opportunity has a risen with our Financial Services client, for a Head of Data Engineering to join the team. The Head of Data Engineering will be responsible leading a team of data engineers to architect, build, and maintain a new data lakehouse solution and pipelines that drive the digital transformation initiatives and support business reporting requirements. The Head of Data Engineering will be involved from the very beginning of the project and will have experience of Azure Datalake and Databricks. Key responsibilities for the Head of Data Engineering Define and drive the data engineering strategy and technical roadmap in alignment with the company's digital transformation goals. Lead and mentor a team of data engineers to design, develop, and deploy data pipelines and solutions that meet business needs. Lead more »

using your expertise to uncover valuable insights that drive strategic decision-making and fuel business growth? Do you thrive in a high volume data-oriented environment, where every record holds the potential to uncover radical insights and opportunities? Do you have exceptional skills in big data technologies, real-time data processing, and advanced analytics, and would be capable of handling and extracting insights from a highly dynamic dataset growing by 8 billion records each day? If youre a Big Data Analyst used to working with big data and … high-volume records, and have what it takes to transform complex data into actionable recommendations, informed decisions, and impactful outcomes, then this could be the perfect position for you! Salary & Benefits: Competitive salary between £60,000 - £80,000 per annum depending on relevant technical skills and experience Fully more »

Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to … support the organisation's data processing needs and facilitate BI reporting and analytics delivery. Responsibilities for the Senior Data Engineer Design, develop, and maintain scalable data pipelines and workflows using Azure … Data Factory and Databricks Implement data quality checks and validation processes to ensure accuracy, completeness, and consistency of data. Monitor pipeline performance and troubleshoot issues promptly to ensure uninterrupted data processing. Key Skills & Experience for the Senior Data Engineer Essential Hands more »

Data Engineer Hybrid, West- Midlands £56k + bonus & great benefits Our client are a fast growing SaaS scale-up, revolutionising supply chain ecosystems and increasing revenue for their customers. You'll contribute to the organisation's high-quality data engineering practices, participating in technical design, implementation … testing, deployment and ongoing support and maintenance of the data platform. By going above and beyond implementing new features, the company focus on customer experience, building a high-quality data platform. You'll apply your skills effectively and continue to develop them, while benefiting from the … expertise of your more experienced colleagues, including: Skill set & Experience: • Data Modelling and Querying - Proficiency in designing and implementing data models, including star schemas and snowflake schemas. Expertise in SQL. • Data Storage Technologies - Experience in SQL, NoSQL, Blob, Delta Lake , and/or other more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

Senior Data Engineer- Fast growing SaaS Scale up 🚀 West Midlands- hybrid working Up to £86K base with bonus and benefits The client SaaS Software business platform which is revolutionising financial management for their customers. Responsibility: Working to ensure a high-quality data platform. Design, develop, test … and deploy data pipelines and integrations using IPaaS technology Collaborate on engineering platform ingestion, orchestration, data warehouse/data lake and API strategies for the data management ecosystem Willingness and an enthusiastic attitude to work within existing processes/methodologies. Collaborate with … the DevOps team to provide high availability data solutions that scale geographically. Big data processing - Expertise in processing enterprise-scale volumes of data, ideally with proficiency in Snowflake. Experience Data Stores - Technical excellence in SQL, NoSQL, Blob,Delta Lake, and other enterprise more »

We are seeking a passionate and driven Junior SQL Data Engineer to join our team. As a Junior SQL Data Engineer, you will work closely with our data engineering and analytics teams to develop, optimize, and maintain SQL databases and data pipelines. … is eager to learn and grow in a fast-paced, dynamic environment . Role and responsibilities: Design, develop and optimize SQL databases and data models to support business requirements. Build and maintain data pipelines for efficient data extraction, transformation, and loading (ETL) processes. Collaborate … with cross-functional teams to understand data requirements and implement solutions that meet business needs. Perform data analysis and troubleshoot issues to ensure data accuracy and integrity. Support Legacy Data Warehouse: Bug fixes, batch ETL processing and data related queries. more »

Job DescriptionSenior Data Engineer- Fast growing SaaS Scale up 🚀West Midlands- hybrid working Up to £86K base with bonus and benefitsThe clientSaaS Software business platform which is revolutionising financial management for their customers.Responsibility:Working to ensure a high-quality data platform.Design, develop, test, and deploy data pipelines and integrations using IPaaS technologyCollaborate on engineering platform ingestion, orchestration, data warehouse/data lake and API strategies for the data management ecosystemWillingness and an enthusiastic attitude to work within existing processes/methodologies.Collaborate with the DevOps team to provide high … availability data solutions that scale geographically.Big data processing - Expertise in processing enterprise-scale volumes of data, ideally with proficiency in Snowflake. ExperienceData Stores - Technical excellence in SQL, NoSQL, Blob,Delta Lake, and other enterprise scale data stores.Data Orchestration - Enterprise scale usage of more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Data Engineer Birmingham - AWS Hybrid working 1 day every 3 weeks out of their Birmingham City Centre offices. Salary 55-65k plus 10% bonus, 28 days holidays Childcare vouchers, Life Assurance, pension. We are a looking for an experienced Data Engineer to play a pivotal … role in constructing and maintaining data pipelines within a dynamic, Agile environment. This opportunity is based in Birmingham, West Midlands, with a hybrid work model. As a key member of their Data team, you'll be instrumental in translating technical requirements into actionable pipelines, developing solutions … contact us at 0161 438 1178 for more information. Key skills; AWS Data Engineer, AWS Cloud, Python, SQL, AWS, Glue, ETL Pipelines, Data Engineer, Birmingham, West Midlands Follow us on Twitter @erinassociates for updates on similar opportunities. Erin Associates Ltd is an equal opportunity employer. more »

hybrid role 80% homeworking available and 20% in Stratford Upon Avon About the role We are seeking a skilled Developer to join our Data Engineering team. In this role, you will play a pivotal part inmaintainingand enhancing our technical service offerings, ensuring operational efficiency and effectiveness. As a … Developer in our Data Engineering team, you willbe responsible formanaging technical service operationssupporting data pipelines throughout the Cloud Data Platform. With a focus on problem-solving, adaptability, and analytical skills. Collaborating closely with stakeholders, you will gain a deep understanding of business imperatives and … Experience in data management, with an understanding of data storage and extraction principles. Azure Data Factory (error handling, pipeline triggers), Azure Storage, Azure Synapse and Azure SQL Server. Previous experience in technical service operations or a related field Strong problem-solving abilities, adaptability more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … Azure or AWS cloud services, and a proven track record in delivering high quality work to tight deadlines. You will work closely with data scientists, software engineers, and domain experts, to gather the business needs and translate them into AI applications. Designing, testing, evaluating, and deploying cutting-edge … efficiency of various domains. There will also be the opportunity to research and implement best practices and standards for AI development, such as data quality, scalability, security, and ethics. SC Clearance/Eligibility required. Qualifications Experience in developing and deploying AI solutions using Python, TensorFlow, PyTorch, Keras, Snowflake more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … implementing cloud solutions for different applications, automating cloud operations and cloud deployments Assume responsibility for the architecture of solutions that leverage advanced analytics, data pipelines, web portals, statistical models, Machine Learning and AI, through our technology platform Draw on the strength and experience of a wider team of more »