24 of 24 Data Pipeline Jobs in Birmingham

Databricks ML and Azure ML to develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage … Minimum 10+ years of experience as a Data Engineer or similar role.* Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.Security ...

data‐enabled products. Establish and champion engineering best practices, including CI/CD, automated testing, version control, monitoring and alerting on pipeline failures. Work closely with Data Architects to implement target‐state data models and modern data engineering principles. Partner with … Factory Azure Synapse Analytics Microsoft Fabric Azure Data Lake Advanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable, monitored production‐grade data pipelines. Experience integrating data ...

place where you can grow, belong and thrive. Your day at NTT DATA Primary Responsibilities Client Engagement & Delivery Data Pipeline Development (Batch and Streaming) Databricks & Lakehouse Architectures Data Modelling & Optimisation (Delta Lake, Medallion architecture) Collaboration & Best Practices Quality, Governance & Security Business Relationships Solution … Architect, and Analytics leadership To thrive in this role, you need to have: Key Competencies Proven experience in data engineering and pipeline development on Databricks and cloud-native platforms. Strong consulting values with ability to collaborate effectively in client-facing environments. Hands-on expertise across ...

Data Engineer Location: Birmingham Hybrid Working Permanent Full Time Salary: up to £45,000 We’re looking for a Data Engineer to join a growing Data & Analytics team, helping to build and develop the data platform that supports reporting, analytics and emerging … cases across the organisation. This is a broad Data Engineering position covering the full data lifecycle. You’ll work from the point data is connected at source, through ingestion, transformation and modelling, into the central data platform where it can be used ...

About the role. As part of the development of our Digital Services function, we are strengthening internal digital capability within the Data Team. These roles are central to building sustainable in-house expertise that supports the design, development, and delivery of digital solutions across the transport network. … focus of this campaign is creating new opportunities, and as a result, we are recruiting Lead Data Engineers. This is a pivotal role within the organisation. In this role, you will work as part of a collaborative team, partnering with stakeholders across the business to understand user needs ...

including RBAC, encryption at rest/in transit, privileged access management, and audit logging, in support of ISO27001 compliance. Own the ETL/ELT pipeline architecture connecting source systems to the data warehouse, including data quality validation and error handling. Develop and implement routines … equivalents (e.g., Azure SQL, Snowflake). Experience with ETL/ELT tooling (e.g., SSIS, dbt, Azure Data Factory) and data pipeline design. Understanding of data modelling principles (normalisation, dimensional modelling/star schema for data warehousing). Experience of diagnosing ...

looking for an experienced Data Engineer to support a data migration and integration programme within a relatively low maturity Azure environment. Key Skills & Experience Azure Data Engineering Azure Data Factory (ADF) Azure Data Lake Databricks Building ETL/ELT pipelines … Large-scale data migration and integration Oracle and/or Oracle Fusion data sources SharePoint data extraction and integration Working with multiple and varied source systems Data transformation, mapping and validation Designing data pipelines in environments where architecture and processes ...

GlobalData Healthcare operates an intelligence platform that empowers leaders to act decisively in a world of complexity and change. By uniting proprietary data, human expertise, and purpose-built AI into a single, connected platform, we help organizations see what’s coming, move faster, and lead with confidence. … from a range of internal and external sources. Design and maintain data models and database structures. Monitor data quality and pipeline health, and resolve issues quickly. Optimise database performance and manage schema changes. Work with the wider team and the infrastructure team to keep pipelines ...

GlobalData Healthcare is building an AI-enabled data platform in Birmingham to ingest and normalise data from internal and external sources. You will design data models, ensure data quality, and keep pipelines robust for consultants and AI features. Ideal candidates have 2+ … years in production data pipelines, strong PostgreSQL skills, and experience with external data sources such as APIs and feeds. The role is based in Birmingham with a fast-paced, collaborative environment. #J-18808-Ljbffr ...

software and systems, architect low latency infrastructure solutions, proactively guard against cyber threats, and leverage machine learning alongside financial engineering to continuously turn data into action. Create new businesses, transform finance, and explore a world of opportunity at the speed of markets. Who We Look For Goldman Sachs … industry or a related field. Familiarity with cloud‐based data warehouses (e.g., Snowflake, GBQ). Familiarity with cloud‐based data pipeline services (e.g. AWS Glue) or distributed processing frameworks like Apache Spark. Equal Opportunity Employment Goldman Sachs is an equal opportunity employer and does ...

creating personalised products and services that bring the right content to the right people at the right times— a personalised BBC. Data is fundamental to our future and in Product Analytics we help shape that future by harnessing broad and exciting data sets to understand … experiences and needs of our audiences, providing data‐driven insights that help Product Group create richer, more personalised experiences that our audiences love. Key Responsibilities and Impact Build a clear understanding of our audiences’ experience and needs to guide product design and development Work closely with product managers ...

What You’ll Be Doing We are seeking an experienced Business Intelligence Data Engineer & Report Writer with 3+ years of strong SQL experience, deep Power BI expertise, and hands‐on familiarity with Microsoft Fabric tenants. In this dual-function role, you will design, develop, and maintain robust … data pipelines, manage Fabric environment configurations, build scalable semantic models, and deliver intuitive Power BI reports. You will act as the key technical bridge between backend data architectures and front‐end business insights. Microsoft Fabric & Data Engineering Design, build, and optimize complex SQL queries ...

feeling. It’s what we do for thousands of people at more than 150 sites across the UK. Be a part of it. Data Engineer Location: Birmingham (Hybrid) Hours: Full‐time, 40 hours per week About the role Cygnet is strengthening its data capability following … period of change, with a focus on building a sustainable, well‐supported engineering environment. We are looking for an experienced Data Engineer to join a growing team supporting key business areas, including clinical, finance and corporate services. This role forms part of a restructured team model, designed ...

secure digital services. You will act as the technical authority for quality engineering, establishing modern automated test frameworks from scratch, overseeing complex data and non-functional testing, and embedding continuous quality gates within modern CI/CD pipelines. Key Responsibilities Strategic Leadership & Governance Define Strategy: Set the strategic … business and technical stakeholders. Quality Engineering & Continuous Improvement Framework Architecture: Design, build, and maintain scalable, reusable automation frameworks for UI, API, and backend data flows using modern languages (TypeScript, Python, Java, or C#). Data & ETL Testing: Oversee end-to-end data testing strategies ...

Inside IR35 Location: Birmingham Working Pattern: Hybrid - 3 days per week onsite at Birmingham office We are looking for an experienced Senior Data Engineer to join a major enterprise technology programme within the financial services sector. You will be responsible for designing, building and optimising large-scale data … environment . The role will also support modern AI/ML and Generative AI initiatives by developing scalable, secure and reliable data platforms. Key Responsibilities Design, build and maintain high-throughput data pipelines using Apache Spark and cloud-native technologies. Develop scalable ETL/ELT workflows ...

optimization of industrial automation and digital manufacturing solutions. This role is ideal for someone who combines deep OT expertise with modern industrial data architectures, connectivity platforms, and visualization technologies. You will play a key role in driving smart factory initiatives, designing scalable OT infrastructures, connecting shop-floor systems … enterprise platforms, and enabling data-driven decision-making across manufacturing environments. Key Responsibilities Design and implement OT architectures for industrial automation environments. Develop and maintain connectivity between PLCs, SCADA systems, historians, and enterprise applications. Architect and deploy solutions using FactoryTalk Optix and Siemens Industrial Edge . Design ...

Data Engineer Pay of up to £75,664, 28.97% employer pension contributions, hybrid working, flexible hours, and great work life balance. DWP. Digital with Purpose. Are you an experienced Senior Data Engineer with strong skills in Azure and data pipelines and experience leading technical … teams? Join DWP's Data Engineering community and help build the data platforms and services that support millions of click apply for full job details ...

Digital Limited is recruiting a Contract Data Engineer to join our Birmingham network. You will build data pipelines and partner with multidisciplinary teams to deliver value from data, ensuring quality and scalable architectures. The role focuses on hands-on coding with Python/… cloud platforms, delivering outcomes for clients. You will bring practical data engineering experience, a proactive mindset, and the ability to work with diverse stakeholders in a fast paced environment while #J-18808-Ljbffr ...

DATA, Inc. is seeking a senior data engineer in the United Kingdom to lead client engagements, design and implement data pipelines on the Databricks platform, and shape cloud-native data architectures for enterprise-scale solutions. You will own data modelling … governance, and security, mentor engineers, and collaborate with architects and analytics leadership to deliver scalable, lakehouse-based data solutions. #J-18808-Ljbffr ...

leading global consulting firm is seeking a Data Engineer in Birmingham to design and implement high-performance data pipelines and maintain secure data platforms. The role requires at least 10 years of relevant experience, expertise in cloud technologies like AWS and Azure, and strong ...

Ports North in Birmingham is seeking a Senior Data Engineer to design, build and optimise large-scale data pipelines in an AWS environment, and to support AI/ML and Generative AI initiatives with scalable data platforms. You will develop high-throughput Spark pipelines …/ELT workflows for diverse datasets, and Java or Scala components with advanced SQL, contributing to lakehouse architectures and secure data governance. #J-18808-Ljbffr ...

Selco Builders Warehouse is seeking an experienced Business Intelligence Data Engineer & Report Writer in Birmingham. You will design, develop, and maintain end-to-end data pipelines, manage Fabric environments, and deliver intuitive Power BI reports. This dual role acts as the bridge between backend data ...

Technology Specialist to join a well-established manufacturing business in a hands-on role where you'll take ownership of business-critical applications, data platforms and systems integration whilst helping drive automation and AI initiatives across the organisation. The business is continuing to invest heavily in its internal … technology capability, with a focus on modernising systems, improving data platforms and reducing manual processes through automation. This is a varied role where you'll work across software development, cloud technologies, data engineering and integrations, supporting existing platforms whilst delivering new technical solutions that have ...

technology consulting firm in Birmingham is seeking an Elastic Engineer for a hybrid role focused on building and maintaining data ingestion pipelines and the ELK stack. Candidates should have strong experience with Elastic search, Kibana, and Logstash, along with data engineering skills and cloud awareness. This … role involves analyzing data insights and collaborating with stakeholders. The contract is for 6 months with a daily rate of £300 - £350. #J-18808-Ljbffr ...