26 to 49 of 49 Data Pipeline Jobs in Belfast

Hybrid) Day Rate: 600 p/d (Outside IR35) About the company: I'm working with a digital consultancy at the forefront of data-driven transformation within the sports industry. They partner with some of the world's most recognised football organisations to deliver strategic, technology-enabled solutions … client is seeking an experienced and dynamic Analytics Consultant to join a growing team. In this high-impact role, you will lead complex data science initiatives and guide strategic decision-making across a portfolio of client projects. You will play a key part in developing advanced recommendation systems … improving CRM workflows, and enabling actionable insights through data visualisation and analytics. You will work closely with cross-functional teams and clients, manage a small team of analysts and data scientists, and oversee the delivery of analytics projects from inception through to execution. This is a More ❯

Job Title: Data/Business Analyst Location: Remote (UK-based) with occasional client site visits Salary: £55–65k This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The … role involves working both remotely and on-site to lead analysis efforts and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system … with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive More ❯

AWS infrastructure – from EC2, S3, FSx, to IAM. Take charge of AWS admin and automation tasks, including deployments, auto-scaling, and data pipeline management. Work independently, taking ownership of problems and delivering practical solutions with minimal hand-holding. Collaborate closely with Data Engineers to support … and improve automation around large-scale data operations. Use your Python or Bash scripting skills to optimize and automate infrastructure and data workflows. Play a key role in the evolution of the DevOps practices, helping define best-in-class systems for a cloud-native environment. What More ❯

working directly with senior architects and distributed peers across the US and EMEA. You'll lead by doing — designing and building serverless microservices, data-rich APIs, and resilient infrastructure that scales. This is a hands-on role that also offers long-term opportunities to grow into technical leadership … Build and refine APIs (REST and GraphQL) using AppSync, API Gateway, and EventBridge • Work with DynamoDB, Aurora Serverless, and S3 for cloud-native data solutions • Collaborate with frontend (Vue.js) and data platform engineers (Snowflake, Airflow) • Contribute to CI/CD pipelines, observability, and day-2 operational … non-technical audiences Bonus Experience • Familiarity with IaC frameworks (CloudFormation, Terraform, SAM) • Exposure to Snowflake, DBT, Airflow, or cost analytics/data pipeline tools • Knowledge of FinOps practices or cost intelligence platforms • Experience contributing to open-source platforms or cloud-native communities • Working knowledge of ML or More ❯

of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for a motivated and technically capable Graduate Data & AI Engineer to join our growing Microsoft consultancy team. This is an exciting opportunity for someone early in their career to gain hands-on … experience delivering real-world Data and AI solutions on the Azure platform, while also developing consulting skills through direct customer engagement. In this role, you’ll support the design, development, and deployment of data pipelines, analytics solutions, and AI-powered applications. You’ll work alongside experienced … engineers and consultants, contributing to a wide range of projects- from traditional data engineering and reporting to modern machine learning and Generative AI initiatives. We’re looking for someone who is passionate about technology, eager to learn, and comfortable working in a dynamic environment. You should have a More ❯

Associate, Software Engineer – Data Focus I am searching for an Associate, Software Engineer – Data Focus for my client, a leading technology-driven commercial real estate firm focused on bringing digital innovation to the sector through advanced data and software solutions . You will join … a collaborative team of software engineers, machine learning scientists, and UX/UI designers, working on the buildout of transformative data-driven products. Key Responsibilities: Architect, build, and maintain efficient, scalable, and reliable data pipelines. Curate, onboard, and document external datasets for internal use. Conduct forensic … data analysis and troubleshooting to ensure data quality. Produce high-quality, maintainable code and contribute actively to peer reviews. Collaborate with stakeholders to understand analytical and product requirements. Integrate diverse data sources (APIs, S3 buckets, web interfaces) in multiple formats. Develop programmatically validated data More ❯

Senior Data Engineer Competitive Salary and Benefits Package Fully Remote I am working with a leading Fintech business who are currently strengthening their data team. In this key role, you will be working in an agile environment supporting multiple teams to develop creative data-driven solutions, building high performance, resilient, automated data pipelines and data transformation applications. If you have a strong mix of the following skills and experience, I would be very keen to hear from you: Advanced SQL Knowledge (Oracle, PostgreSQL, MSSQL, etc.). Scripting languages … Python, PowerShell). Web service APIs (SOAP, REST). Data modelling experience. Knowledge of Snowflake Analytics Platform would be an advantage. Experience in working within an Agile environment. Knowledge of GIT, Jenkins (CI). Experience with Automation, including Unit and Integration Testing. Knowledge of Cloud Concepts. For a More ❯

Senior Data Operations Engineer Fully Remote Competitive Salary and Benefits Package I am working with a leading fintech client who are strengthening their data team. This is a key role, working as part of a team tasked with designing and developing high-performance and resilient automated … data pipelines and data transformation applications. If you have a strong mix of the following skills and experience, I would be really keen to hear from you: Advanced SQL Knowledge (Snowflake, PostgreSQL, MSSQL, etc.). Scripting languages (Python, PowerShell). Data quality and resolving … related processes Cloud Data Warehousing solutions and ELT/ETL solutions (e.g., Snowflake, DBT). Experience in working within an Agile environment. Experience with Automation, including Unit and Integration Testing. Knowledge of Cloud Concepts. For more information and a confidential chat about this role, contact Mark Raine at More ❯

A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager … will come from a data engineering background and have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role … you will need the following: Experience designing, improving and maintaining robust data pipelines Strong SQL programming skills. Knowledge of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data Engineers Strong experience working More ❯

VANRATH is pleased to be partnering with a global payments leader to recruit a Lead Data Engineer for a fully remote, permanent role. This is a unique opportunity to establish and lead a Data Analytics function, shaping strategy and delivering insights that drive growth and innovation … empowers small teams to tackle real-world problems with curiosity and pragmatism. Key Responsibilities - Partner with stakeholders to scope, prioritise, and execute complex data analyses that inform strategic decisions - Develop insights and models using SQL, Looker, and other reporting tools to optimise business outcomes - Oversee advanced analytics and … define key performance indicators and performance metrics - Collaborate with Data Engineering to build data pipelines and define reporting requirements - Lead the creation of frameworks, processes, and tools to embed analytics into business decision-making - Deliver compelling data visualisations and self-service reporting to support More ❯

a strong background in MLOps principles, cloud technologies (AWS), and a passion for building robust and efficient systems. You will collaborate closely with data scientists, engineers, and product teams to deliver high-quality ML solutions that directly impact our business. The mission of the Data Science … practices Cloud Infrastructure Management: Manage and optimize our AWS cloud infrastructure for machine learning, ensuring cost-effectiveness, security, and high availability CI/CD Pipeline Development: Develop and maintain robust CI/CD pipelines for continuous integration and deployment of ML models and related infrastructure Monitoring and Observability: Build … systems for our ML infrastructure and models, leveraging tools like DataDog to ensure system health and performance Collaboration and Mentorship: Collaborate effectively with data scientists, engineers, and other stakeholders. Provide guidance and support to junior team members Performance Optimization: Continuously optimize ML model performance, data pipelines More ❯

direct our technical roadmap and proposing the adoption of new technology or techniques. Providing breakdowns of project deliverables and estimates. Designing and building data pipelines and Hadoop storage objects. Assisting in the resolution of production issues when required. Mentoring team members. Working with data analysts to … define logical data structures. Encouraging self-learning among the team. Essential Skills & Qualifications: A confident engineer with an authoritative knowledge of Java and Hadoop including HDFS, Hive, and Spark. Comfortable working with large data volumes and able to demonstrate a firm understanding of logical data … in identifying and resolving code vulnerabilities and familiarity with utilizing Citi tools in this area. Able to demonstrate expertise in identifying and resolving data quality issues - in datasets at rest and in flight. An expert SQL coder and at ease writing Linux shell scripts. Experienced with automated build More ❯

for our innovative products and services. This position requires deep expertise in Python and hands-on experience with best practices in software architecture, data structures, algorithms, and design patterns. Your Responsibilities Design, implement, and optimize robust Python applications to support our core business functionalities, ensuring high performance and … Master’s degree in Computer Science, Software Engineering, or related field. Experience with Python-based machine learning libraries is a plus. Experience with data pipelines and Big Data frameworks. Familiarity with Agile methodologies, especially Scrum or Kanban. Why Work at A5 Labs? At A5 Labs, you More ❯

Data Engineer London (Hybrid) or Remote (UK) Up to £75k | 4-day workweek | | Unlimited leave About us Climate Policy Radar is on a mission to help people access and understand long climate documents. Nearly 350,000 users from over 100 countries already use our open databases and AI … of that, we have embraced a flexible, hybrid approach to work, including a 4 day workweek. Role Overview: We are looking for a Data Engineer to join our Platform team. Working with the existing team of three engineers and collaborating with the data science and application … teams. In this role, you will help build and improve the data and machine learning infrastructure supporting our R&D and production platforms of high-impact tools and products for global climate law and policy, already serving 330,000 users annually and opening up 500,000 pages of More ❯

machine learning, generative AI, and cloud-native tools, this is an opportunity to shape the future of the product and how they use data to solve real-world challenges. What You'll Be Doing: AI/ML Project Ownership Lead the delivery of machine learning initiatives from exploration … through to deployment and monitoring. Own the full development cycle for ML systems — including architecture, data pipelines, model training, and production deployment. Cross-functional Collaboration Work closely with Product, Engineering, and DevOps teams to embed intelligent features into our platform. Ensure smooth end-to-end integration of AI … programming, and technical reviews. Share learnings and help foster a culture of innovation and experimentation. Problem Solving at Scale Tackle challenges related to data quality, interpretability, bias, and reliability. Build processes and infrastructure that make AI/ML workflows efficient, robust, and repeatable. Documentation & Continuous Improvement Contribute to More ❯

Our client, a leading financial services organisation, is looking for a Data Solutions Manager to lead a small team of experienced data engineers. You will be joining a fast growing team who are responsible for delivering, improving and maintaining robust data pipelines within an … ambitious data architecture. Our client has already fully transitioned to cloud, there is a mature platform in place, and you will be joining a high performing, proactive, and collaborative team. To be successful in this role, you will need the following experience: Strong hands-on data engineering experience Previous experience managing and mentoring data engineering teams Significant experience working with Snowflake, Azure, Data Factory and Azure DevOps Strong communication and stakeholder management skills This role is almost fully remote, with quarterly workshop visits to the clients office in the South More ❯

Software Engineer with strong Python or Java experience and a passion for cloud/platform technologies skills to join our talented and innovative data engineering team. This role sits within a part of Optum UK responsible for taking large data sets from various sources and converting … them into meaningful insights. You will get to work with Big Data utilising cutting edge Cloud services and technologies. Your work will help healthcare teams to identify opportunities to be more efficient, improve services, and design/optimise healthcare interventions. We are a collaborative team, we work hard … part of then apply today! What you’ll do You will be working with cloud infrastructure/technology to expand and advance our data platform capabilities. You will support your team through identifying and implementing improvements and efficiencies. Other key responsibilities and accountabilities will include; Successfully develop, deliver More ❯

Senior Data/Consulting Engineer (Palantir Foundry) – London – Salary Up To £60,000 per annum Are you a seasoned engineer ready to lead in the AI era? A true Palantir expert? Then Morela has the opportunity for you. Morela are proud to be working with one of the … UK's leading Palantir partners, who are experiencing rapid growth and now looking to bring on a Senior Data/Consulting Engineer to help drive complex, high impact projects forward. This role is about more than just technical proficiency it's about leadership, strategy, and joining a team … world impact and long term value. Core Responsibilities Client Strategy & Leadership: Work closely with senior stakeholders to understand critical challenges, shaping long-term data strategies and scalable solutions using Palantir Foundry. Solution Design & Architecture: Take ownership of the design and architecture of complex data systems, ensuring More ❯

Key Skills Required:** GBP 75k PA REMOTE in UK - Proficient in PySpark and AWS - At least 8 years of hands-on experience in data engineering projects - Strong experience in designing, implementing, and debugging ETL pipelines - Expertise in Python, PySpark, and SQL is essential - In-depth knowledge of Spark … and Airflow - Experience in designing data pipelines using cloud-native services on AWS - Extensive knowledge of AWS services, including API Gateway, Lambda, Redshift, Glue, CloudWatch, etc. - Experience in deploying AWS resources using Terraform - Hands-on experience in setting up CI/CD workflows using GitHub Actions **Eligibility:** - Must More ❯

a collaborative environment. At Yelp, we're dedicated to delivering the most relevant search results by leveraging cutting-edge techniques in machine learning, data mining, and backend engineering. Our engineers play a key role in improving search recall, enriching results with contextual annotations, and optimizing search data … infrastructure, and driving innovation in search relevance, we'd love to have you on board! The Search Quality team is looking for a data-oriented backend engineer to build and improve our internal systems to better support prototyping, testing, and scaling the next generation of Search with us. … profilers, debuggers, visualization tools). Capable of working and coordinating requirements across teams. Excellent documentation skills. Interest or experience in developing infrastructure supporting data-intensive applications. What you'll get: Full responsibility for projects from day one, a collaborative team, and a dynamic work environment. Competitive salary, a More ❯

to-senior level Machine Learning Engineer, you will be involved in creating ML models to be deployed in the cloud and supporting the Data Engineering, DataOps and Devops. You will be working with the latest technology on highly visible and large-scale projects. What you’ll bring to … Azure (Azure DevOps, Azure ML, Azure SQL, ADF etc.) Able to work with databases like SQL Server, NoSQL, etc Experience with ETL process, data pipelines, Devops This role is hybrid, with requirement to be in one of their UK offices in either Scotland or England on occasion (they More ❯

Swagger . Mobile Testing Focus on mobile app quality across Android/iOS devices. Manual and automation testing using Appium , XCUITest , TestFairy . Data/ETL Testing Ensures accurate data flow, transformation, and validation in data pipelines. Works with SQL, Informatica , Talend , SSIS , Snowflake More ❯

Actian is transforming how enterprises discover, understand, and govern their data assets through our innovative data catalog and intelligence platform. Our customers rely on us to provide a seamless and scalable experience, and we’re looking for a Technical Implementation Advisor to lead our customer technical … management skills to ensure customers see long-term success with Actian solutions. Responsibilities: Technical Implementation & Onboarding Lead technical onboarding process for new Zeenea Data Intelligence Platform customers Develop and execute customer implementation plans ensuring smooth deployment and adoption Manage the technical setup, configuration, and deployment of Zeenea, ensuring … case studies showcasing innovative metadata implementations Skills and Expertise: 5+ years in technical implementation, consulting, professional services, or customer success in a SaaS, data management, or cloud-based environment Excellent ability to translate customer needs into actionable technical requirements Experience managing multiple concurrent implementation projects with enterprise customers More ❯

unique opportunity like no other in Northern Ireland... Do you want to join a global software house dedicated to maximising client revenue through data analysis and management? They maximise cutting-edge solutions to enable businesses to harness the power of data for complex decision making which … is a company where at the end of each day you'll see the impact of your work, feel fulfilled and know your data driven problem solving expertise has positively impacted your clients. What will you be doing? They are seeking an experienced Senior Software Engineer to join … dynamic development team. In this role, you will develop, and maintain scalable, high-performance backend systems. You will work on integrating systems managing data pipelines, and ensuring system reliability and security in a cloud environment. In addition you'll work very closely with some global clients, ensuring you More ❯