1 to 25 of 94 Data Pipeline Jobs in Northern Ireland

Description Data System Reliability Engineer (dSRE) Role Overview: A crucial role in CME's Cloud data transformation, the data SRE will be aligned to data product pods ensuring the our data infrastructure is reliable, scalable, and efficient as the GCP … data footprint expands rapidly. Accountabilities: Automate data tasks on GCP Work with data domain owners, data scientists and other stakeholders to ensure that data is consumed effectively on GCP Design, build, secure and maintain data infrastructure, including data pipelines, databases, data warehouses, and data processing platforms on GCP Measure and monitor the quality of data on GCP data platforms Implement robust monitoring and alerting systems to proactively identify and resolve issues in data systems. Respond to More ❯

Description Data System Reliability Engineer (dSRE) Role Overview: A crucial role in CME's Cloud data transformation, the data SRE will be aligned to data product pods ensuring that our data infrastructure is reliable, scalable, and efficient as the GCP … data footprint expands rapidly. Accountabilities: Automate data tasks on GCP Work with data domain owners, data scientists, and other stakeholders to ensure effective data consumption on GCP Design, build, secure, and maintain data infrastructure, including data pipelines, databases, data warehouses, and data processing platforms on GCP Measure and monitor the quality of data on GCP data platforms Implement robust monitoring and alerting systems to proactively identify and resolve issues in data systems. Respond to More ❯

The Role As part of a global team you will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data solutions and building them from the ground up. The Data Engineer will support our software developers, database architects, data analysts and data scientists while ensuring optimal data delivery architecture is consistent throughout ongoing projects. The Data Engineer will be responsible for the day-to-day activities related to the implementation of new services and support for existing services. We are looking for intelligent, driven individuals who are passionate about what they do and More ❯

The Data Quality Engineer plays a crucial role in ensuring the integrity, accuracy, and reliability of our organization's data assets. This position combines technical expertise with strong collaborative skills to implement and maintain data quality standards across the enterprise. Key Responsibilities: Data Quality Framework: Develop and implement a comprehensive data quality framework, including defining data quality metrics, setting up data quality checks, and automating quality monitoring. SLA and Data Contract Enforcement: Work with domain data owners and DPOs to ensure … adherence to SLAs and data contracts, and monitor data quality against these agreements. Data Analysis: Conduct in-depth data analysis to identify data quality issues, anomalies, and inconsistencies. Data Validation: Develop and execute data validation rules More ❯

EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: Job Title: Senior Data Engineer Key Requirements: 4-8 years of experience from tier 1 or 2 big tech companies Job Location: Work with cutting-edge technology through … role requires a deep understanding of modern data engineering practices, real-time processing, and cloud-native solutions. Key Responsibilities: Data Pipeline Development & Management: Design, implement, and maintain scalable and reliable data pipelines to ingest, transform, and load structured, unstructured, and real-time data … environments. Machine Learning & Advanced Analytics Enablement: Collaborate with data scientists to prepare and serve features for ML models. Maintain awareness of ML pipeline integration and ensure data readiness for experimentation and deployment. Documentation & Continuous Improvement: Maintain thorough documentation including technical specifications , data flow More ❯

Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: You will provide expert-level troubleshooting, root cause analysis, and performance optimisation for data platforms such as Azure SQL databases, Fabric Warehouse, Onelake, Databricks, and Azure Data Factory. Purview or another MDM tool is highly desirable. Skills …/experience Bachelor’s degree in Information Technology, Computer Science, Data Management, or a related field. 4+ years of experience in data management, data operations, or IT support roles, with at least 2 years in Level 3/4 support or equivalent. Hands-on … experience with database technologies ( Azure landscape , Oracle, PostgreSQL, etc.). Industry certifications in professional data management, cloud platforms (AWS, Azure, GCP), metadata management, or database administration (e.g., Microsoft Certified: Azure Data Engineer Associate, DAMA CDMP) are desirable. Proven experience with ETL tools, data integration More ❯

Role: Data Engineer Location: Belfast Duration: Long Term Contract Opportunity - Rolling Contract Rate: Market Rates - Inside IR35 Job Description : Fujitsu's Decision Intelligence practice in the UK helps organisations bridge the gap between data and insights, empowering businesses to make smarter decisions, optimise operations, and drive … innovation. From AI-powered analytics to data governance and security, we offer a comprehensive suite of services to help our Public and Private Sector customers unlock the full potential of their data. Job Summary : We are seeking a skilled and experienced AWS Data Engineer to join … our team. The successful candidate will be responsible for implementing, and managing data architecture solutions for our customers, with a strong emphasis on Cloud technologies (Preferably AWS) and tooling. This role requires understanding of data modelling, database design, and data integration techniques. Key Responsibilities More ❯

Systems Architecture - AWS data engineer Job Description Location: UK - Will require travel to customer site ](Belfast) Job Summary: We are seeking a skilled and experienced AWS Data Engineer to join our team. The successful candidate will be responsible for implementing, and managing data architecture … solutions for our customers, with a strong emphasis on Cloud technologies (Preferably AWS) and tooling. This role requires understanding of data modelling, database design, and data integration techniques. Key Responsibilities -Data Ingestion and Extraction: Design and implement efficient data ingestion pipelines to … and from databases and file storage services. -Data Transformation and Cleaning: Transform and clean raw data to ensure data quality and consistency. -Data Pipelines: Build, maintain, and optimise data pipelines to automate data flows and enable real-time More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast paced organisation. You will join as a Senior Platform Data Engineer providing technical leadership to the Data Engineering team. You will work closely with our Data Scientists and business stakeholders to ensure value is delivered through our solutions. Job … environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing unbounded data (pubsub, message queues, event streaming etc) Understanding of the most commonly used Data More ❯

join us at FPSM and be part of something bigger... What we are looking for: We are seeking a highly motivated and experienced Data Product Manager to own the strategy, roadmap, and execution of our Customer Data Platform (CDP) and Single Customer View (SCV). This … is a critical role within our rapidly growing data organization, and you will be instrumental in enabling data-driven decision-making across the business. You'll work closely with engineering, marketing, product, and other internal teams to ensure our CDP is a powerful tool for understanding … with overall business objectives and stakeholder needs. Requirements Gathering: Proactively gather, analyze, and prioritize requirements from internal stakeholders (marketing, product, analytics, etc.) for data integration, access, and utilization. Data Source Integration: Oversee the integration of various data sources into the CDP, ensuring data More ❯

operate globally from offices across the UK, Ireland, US, Nordics, and Netherlands. Job Description Do you have what it takes to turn raw data into actionable insights and drive innovation? As a team, we transform our client’s businesses using a combination of strategic thinking, customer-centric service … an inclusive community for the curious, generous, pragmatic and committed digital practitioner. You'll have: Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Perform tasks such as writing scripts … with a diverse and growing capability and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. There are a variety of different tools More ❯

make better use of it. We provide advice, support and delivery services across various industry sectors covering a multitude of areas, ranging from Data Strategy, Governance and Security to Data Platform Modernisation, Cloud and Customer Intelligence. We do everything with a view to creating tangible business … measure how we are performing and ensures we deliver the value that our customers deserve. Summary We are seeking a skilled and proactive Data Engineer with experience in Microsoft Fabric to join our growing data team. You will be responsible for developing, maintaining, and optimising data … lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity with DevOps practices, particularly around data pipeline deployment. Good problem-solving skills and the ability to work under minimal supervision. Effective communicator with stakeholders of varying technical expertise. Learn to Earn More ❯

Company Description At our core, Data Intellect is a data and technology consultancy firm. Our key area of expertise is financial and capital markets technology solutions. However, the utility of these solutions allow us to apply fintech data expertise to other industries such as … smart energy and healthcare. This proprietary offering is complemented by a wealth of experience in data engineering, electronic trading systems, data capture applications, regulatory and compliance systems and middle and back-office enterprise web solutions. Our mission is to help organisations unlock the full potential of … their data, enabling strategic decision-making and transformative business growth. We are known for our deep technical expertise, collaborative approach, and commitment to innovation. Simply put – we turn big data problems into smart data solutions . Job Description We are seeking a highly skilled More ❯

Social network you want to login/join with: Mortgages Data and ETL Engineer, belfast col-narrow-left Client: Nationwide Building Society Location: belfast, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job … advertised date, so please apply as soon as you can. What you’ll be doing Contribute to the design and execution of the data migration and integration strategy within the Mortgages area, supporting the broader integration programme objectives. Collaborate with internal stakeholders, business analysts, and architects to translate … functional and non-functional requirements into technical data solutions. Design, build and maintain robust, scalable and high-performance ETL/ELT pipelines using modern data engineering tools and practices, ensuring quality, lineage and auditability. Support data discovery activities and analysis to inform data More ❯

Enso Recruitment is hiring on behalf of a fast-paced and forward-thinking global organisation that is on the lookout for a Senior Data Engineer to join their data team. This individual will help drive innovation by building and refining scalable data solutions that … support a wide range of business operations. The successful candidate will work with a global team of software developers, analysts, and data scientists, playing a crucial role in developing and optimising data pipelines and infrastructure to ensure efficient data flow across the business. Key … large data sets Familiarity with ETL tools such as Fivetran and Azure Data Factory Experience with modern data pipeline design and stream processing Understanding of CI/CD pipelines and experience with tools like Azure DevOps or GitHub/GitLab Strong problem-solving More ❯

Social network you want to login/join with: Azure Data Engineer/Consultant – Up to £75K + Bonus Location: Remote (UK-based, with very occasional travel) Salary: Up to £75,000 + bonus Company & role Join one of the UK’s most advanced Microsoft partners, specialising in … Azure-led Data & AI solutions. This consultancy is known for transforming data into tangible value through innovative platforms and strategic data services. With a collaborative team of experts, they deliver impactful solutions across enterprise clients, leveraging the very latest in Microsoft technology. Why This … across the Azure Data Platform (Fabric, Synapse, Databricks, Data Lake, Data Factory, Purview, etc.) Strong data pipeline and ETL skills, including data modelling and transformation Experience implementing Medallion Architecture (Bronze, Silver, Gold layers) in lakehouse or Databricks environments Familiarity More ❯

Data Engineer – Shape the Future of Data Innovation Belfast, Northern Ireland (Hybrid) Competitive Salary - Up to £55,000 An exciting opportunity has opened for an experienced Data Engineer to design and build large-scale data … solutions in a fast-paced, high-impact environment. This role is ideal for someone with a strong background in AWS cloud technologies, ETL pipelines, data warehousing, and big data architectures. The Role As a Data Engineer , you will: Design and deploy production data pipelines from ingestion to consumption within a big data architecture. Work with technologies such as Python, Java, Scala, Spark, and SQL to extract, clean, transform, and integrate data. Build scalable solutions using AWS services like EMR, Glue, Redshift, Kinesis, Lambda, and DynamoDB. Process large volumes of More ❯

Social network you want to login/join with: ZONTAL is revolutionizing data management and digital transformation for the life sciences industry. Our cutting-edge platform enables seamless data integration, standardization, and accessibility—empowering scientists and organizations to drive innovation, enhance compliance, and accelerate breakthroughs in … a subject matter expert in the ZONTAL Platform and its customer use-cases. Analyze business requirements for customer-facing projects, with emphasis on data flows and data formats as they feed into & out of the ZONTAL Platform. Create functional and design specifications for the proposed solution … software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and More ❯

At Citi Fund Services is undergoing a major transformation effort to transform the way data is integrated, processed and leveraged to drive business value. As part of this journey we are building scalable containerised solutions that enable real time data processing and seamless integrations across the … funds services estate. We are looking for a talented lead data engineer to help shape the future state and modernise our existing data platforms. This is an exciting opportunity to join the organisation at the early stages of this data transformation journey which will … solutions Key requirements: Substantial hands-on experience in software development, with at proven experience in data integration/data pipeline developments. Proven experience in Data integration development (Ab Initio, Talend, Apache spark, AWS Glue, SSIS or equivalent) including optimization, tuning and benchmarking More ❯

We are looking for a Senior Data Engineer who will join the Enterprise, Data and Analytics Team and help us make the world a better place through innovation, which means we’re taking risks and questioning conventional thinking, and developing new technologies and ways of doing … day-to-day – We do what others say can’t be done Provide technical expertise and execute the design, development and support of data solutions for Wolfspeed business partners, including configuration, administration, monitoring, performance tuning, debugging, and operationalization. Build and maintain data solutions using Snowflake, dbt … data build tool), Fivetran, Azure Cloud (storage, VMs, containers, Azure Data Factory), Python, Docker and SQL. Participate in the development lifecycle using Agile/DevOps methodologies using Azure DevOps. Translate simple to complex requirements into functional and actionable tasks. Serve as a subject matter expert for More ❯

Social network you want to login/join with: Data & AI Solutions Deployment Architect, belfast col-narrow-left Client: Bytes Software Services Location: belfast, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job … collaboration, recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: The Data & AI Solutions Deployment Architect will be instrumental in architecting and deploying Azure Data & AI Solutions. A solid, technical, ‘hands-on’ (not just … grasp of Azure Fabric is essential as we navigate clients through all of the infrastructure, coding, and product development lifecycle challenges around successful Data and AI implementation and deployment. This customer-centric position involves delivering projects, conducting workshops and physically working on client’s environments via Python, and More ❯

Social network you want to login/join with: Head of Data Engineering & Governance, belfast col-narrow-left Client: Data Science Talent Location: belfast, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 04.06.2025 Expiry Date: 19.07.2025 col … wide Job Description: Head of Data Engineering & Governance Investment & Wealth Management Hybrid (3 days at home with 2 days traveling in the UK) £120k - £140k basic (DOE) + bonus (10-25%) and benefits (pension, life insurance, healthcare, holidays, & more). “Money makes the world go round,” they say. … on wealth management. But now? This company – a trusted name in the UK financial services sector – fully recognise this. They understand that embracing data and AI is what will continue to position them at the forefront of the UK’s investment management sector. This isn’t a dalliance More ❯

messaging, voice, directory and analytics. Over 1000 institutions use our modular technology built for global finance. Security is in our DNA with uncompromising data protection, end-to-end encryption and resilient architecture, all created on a foundation of trust with our customers . But that was only chapter … elsewhere. Role Description The Analytics division of Symphony Communications is looking to fill an immediate opening for a highly skilled and motivated Junior Data Scientist/Data Scientist to join our team. As a Junior Data Scientist/Data Scientist, you will … cutting-edge AI and machine learning models to extract valuable insights from large datasets. You will collaborate with cross-functional teams to drive data-driven decision-making and contribute to the development of innovative solutions. The position is part of the Solutions Center team, which is under the More ❯

permit required: Yes col-narrow-right Job Views: 4 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Lead Backend Engineers (Platform Experience & Data Warehousing teams) Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland numi is proud to have partnered with a front-runner in data … some of the biggest names in the industry. We are seeking experienced Lead Backend Engineers (PHP) to join either the Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimizing end-to-end platform journeys and building impactful customer experiences. They are currently developing a … data visualization tool (dashboards) and building features primarily from scratch. The Data Warehousing team is responsible for data storage and transfer solutions, helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring More ❯