26 to 50 of 50 Data Pipeline Jobs in Edinburgh

technology for insight and efficiency to make our business better and to help clients realize the objectives they desire. At BlackRock, there is a rich problem space for data scientists and engineers across all areas of the business including investments, sales, marketing, operations, product, UX, etc. and the potential to have large scale impact. In 2018, BlackRock accelerated … innovation and technology again with additional investment in artificial intelligence and data science and all the potential they represent. AI Labs was formed to act as a central hub with a firm-wide remit to solve strategic business challenges for the firm by bringing to bear our expertise in data science, machine learning, generative AI, optimization … a history of demonstrating machine learning at BlackRock to create alpha, the goal is to apply these same techniques throughout the business. The team has grown to 30+ data scientists and data engineers. Working collaboratively, the team is multi-disciplinary with the following skills and capabilities: machine learning, statistical modeling, signal detection, natural language processing, data More ❯

Octopus Investments and Octopus Money. Check out the Seccl website for the latest on our products and our mission to shape the future of investments. The role The Data Squad engineering manager's purpose is to lead and empower a high-performing team of data engineers to deliver scalable, reliable, and secure data capabilities. … This role is central to enabling internal and external data products, supporting business insights, and developing a modern data platform. The role will work closely with Product, Engineering, and Data Operations to align delivery with business outcomes, support the team's growth, and help shape our overall data strategy. On a typical … day you will Guide and mentor, a team of data engineers, fostering their professional growth and ensuring high performance.Setting clear, measurable goals with regular performance reviews, development plans, and recognition. Collaborate with product managers and engineering leaders to define priorities and align data initiatives with business goals. Provide technical guidance and architectural oversight across the data More ❯

We’re Hiring: Lead AI and Data Engineer 📍 Edinburgh (Hybrid) | 💰 £60,000–£68,000 Are you passionate about AI, data engineering , and building systems that actually make an impact ? We’re looking for a strategic and hands-on leader to shape the way our organisation leverages data and AI—from predictive models that drive … your chance to take the lead in a high-impact role where innovation, automation , and engineering excellence come together. 🚀 What You’ll Be Doing ✅ Design and deliver scalable data architecture , pipelines, and semantic models ✅ Build and deploy production-grade AI solutions (predictive & generative) ✅ Champion automation-first engineering and modern DataOps/MLOps practices ✅ Lead the development of AI … data products tied to measurable business outcomes ✅ Manage, mentor, and grow a high-performing data engineering team ✅ Work cross-functionally with architects, analysts, data scientists, and IT ✅ Use tools like Azure AI, Power BI , and open-source frameworks ✅ Stay ahead of the curve with GenAI and cloud advancements 🧠 What You Bring Strong background in More ❯

Job Title: Data Engineer Location: Edinburgh, UK About Us: Join one of the leading utilities companies in Edinburgh, driving innovation through data! We are looking for a skilled Data Engineer to support our data infrastructure and empower our teams with reliable and efficient data solutions. If you’re passionate about … building robust data pipelines and transforming raw data into valuable insights, we want you on our team! Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes. Collaborate with data analysts and stakeholders to understand data requirements. Ensure data integrity, security, and compliance with industry standards. … Optimize data architectures for performance and scalability. Monitor and maintain data systems to ensure high availability. Key Requirements: Proven experience as a Data Engineer or similar role. Proficiency in SQL, Python, or other data processing languages. Experience with cloud platforms (e.g., Azure, AWS, or Google Cloud). Knowledge of data More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

Blend is an award-winning pure play data consultancy who help people do data right through project delivery across strategy and consulting, data science and BI, and data engineering. As a trusted Data & AI partner we co-create value with clients across a wide variety of industries. Our company has … to implementing a BI dashboard to help swimmers win more medals – nothing we do is designed to be left on the shelf. Job Description Life as a Lead Data Engineer at Blend We are looking for someone who is excited by the idea leading a data engineering squad to develop best in class analytical infrastructures and … resource utilization, training, mentoring, and recruitment. Stakeholder engagement by preparing and present data-driven solutions to stakeholders, translating complex technical concepts into actionable insights. Data pipeline ownership by designing, develop, deploy, and maintain scalable, reliable, and efficient data pipelines. Domain expertise by keeping up to date on emerging trends and advancements within data More ❯

Wood Mackenzie is the global data and analytics business for the renewables, energy, and natural resources industries. Enhanced by technology. Enriched by human intelligence. In an ever-changing world, companies and governments need reliable and actionable insight to lead the transition to a sustainable future. That's why we cover the entire supply chain with unparalleled breadth and … action Key responsibilities Ownership of Enterprise Master Datasets (EMD) Liaise with SMEs and conduct research to build and provide business knowledge for the EMD owned Collaborate with segment data owners to understand: Value of creating an EMD Content and structure requirements of EMD Understanding of existing data sources and systems Design data models for … EMD Define tasks and groom backlog for EMDM Data Stewards to prepare data to populate EMD Collaborate with Data Engineers to design data pipelines, storage, and surfacing of data Define business logic to be included in data pipelines and surfacing of data Use influencing and project More ❯

Social network you want to login/join with: Location: Remote (UK-based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both remotely and on-site to lead analysis efforts … and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. - Work closely with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops … and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive client value. Key Experience & Skills: - 5+ years in a business/data analyst role, ideally in a consultancy or commercial setting. - Strong analytical, problem More ❯

and our employee exit rate is astonishingly low. Join us on our journey... Let's create something awesome, together, today. About the role and team: As a Lead Data Engineer, you'll play a hands-on technical leadership role in our Data Practice. You'll be instrumental in shaping how we deliver data engineering … engagements, working closely with client stakeholders, internal teams and fellow consultants. You'll bring strong technical expertise, mentorship, and a practical approach to building scalable and value-driven data platforms. What you'll be doing: Leading the design and implementation of robust, cloud-native data platforms Architecting and optimising data pipelines and data models for performance and scalability Championing best practices across data engineering, including testing, automation, and documentation Mentoring junior engineers and guiding technical delivery across projects Working directly with client stakeholders to define goals, shape roadmaps and deliver real business impact Driving innovation through continuous improvement and staying ahead of industry trends We'd love to talk More ❯

team; as we scale up and drive digital and financial inclusion across our markets. As a Senior Analytics & MLOps Platform Engineer, you will be designing, deploying and managing data and machine learning infrastructure to make it easy for data scientists to experiment, train, serve and monitor batch and online machine learning models in production. About Role … Our mission is to improve the ability of Product, Operations and Data Science teams in M-KOPA to make data driven decisions and automate them using machine learning. You will be designing and implementing architectures to streamline exploration, training, deployment and monitoring of machine learning models. Building and maintain CI/CD pipelines to deploy machine … sets to ensure reproducibility, traceability, and compliance with best practices. Using Azure and infrastructure-as-code tools (e.g., Azure Bicep, Terraform) you will automate and manage infrastructure for data pipelines, machine learning model training, and serving. Additionally, you will establish infrastructure and engineering patterns to feature engineering and reuse across suite of models. Developing workflows for model validation More ❯

Are you a passionate Data Engineering Manager ready to unlock the power of data? Our client is a leading UK-based consultancy seeking a skilled professional to shape data strategies, mentor dynamic teams, and deliver cutting-edge solutions. With hands-on expertise in Spark, SQL, and cloud platforms like Azure, you’ll lead end … to-end projects, drive innovation, and collaborate with clients across industries. What You’ll Do: Lead complex data engineering solutions with technical excellence. Mentor teams and foster a culture of growth and quality. Showcase your expertise in pre-sales and client workshops. Design data pipelines, lakes, and warehouses with best practices. Skills They're Looking For … Proven Data Engineering experience (5+ years). Consultancy experience is a must. Leadership and multi-project environments experience. Expertise in ETL, data modelling, and Azure Data Services. Experience in designing and implementing data pipelines, data lakes, and data warehouses. Hands-on experience with Apache Spark and bonus points More ❯

Social network you want to login/join with: Data Engineering Manager/Edinburgh/Microsoft Gold Partner, edinburgh col-narrow-left Client: Opus Recruitment Solutions Location: edinburgh, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 2 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Are you a passionate Data Engineering Manager ready to unlock the power of data? Our client is a leading UK-based consultancy seeking a skilled professional to shape data strategies, mentor dynamic teams, and deliver cutting-edge solutions. With hands-on expertise in Spark, SQL, and cloud platforms like Azure, you’ll lead end-to-end projects, drive innovation … and collaborate with clients across industries. What You’ll Do: Lead complex data engineering solutions with technical excellence. Mentor teams and foster a culture of growth and quality. Showcase your expertise in pre-sales and client workshops. Design data pipelines, lakes, and warehouses with best practices. Skills They're Looking For: Proven Data Engineering More ❯

Social network you want to login/join with: Data & AI Solutions Deployment Architect, edinburgh col-narrow-left Client: Bytes Software Services Location: edinburgh, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 8 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Bytes is a top provider of premium IT solutions … foster a culture of innovation, collaboration, recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: The Data & AI Solutions Deployment Architect will be instrumental in architecting and deploying Azure Data & AI Solutions. A solid, technical, ‘hands-on’ (not just the theory) grasp of Azure … Fabric is essential as we navigate clients through all of the infrastructure, coding, and product development lifecycle challenges around successful Data and AI implementation and deployment. This customer-centric position involves delivering projects, conducting workshops and physically working on client’s environments via Python, and C#. This role would suit an experienced Data platform engineer or More ❯

many ways. Here are some examples to give you a flavour of what you will do: Identify and define technical tasks from project requirements Implement machine learning models, data pipelines, and integrations with Storm's product suite Investigate new AI approaches, frameworks, and best practices for application in public sector contexts Work closely with AI Consultants to refine More ❯

Social network you want to login/join with: A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager will … come from a data engineering background and have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role you will need the following: Experience designing, improving and maintaining robust … data pipelines Strong SQL programming skills. Knowledge of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data Engineers Strong experience working in a cloud environment and knowledge in the following very beneficial: Microsoft Azure, Azure Data Factory and Azure DevOps More ❯

Data Engineer| 6 Month Contract | (Inside IR35) | Hybrid - Edinburgh | Starting ASAP Day Rate: DOE Role Overview Harvey Nash are seeking a highly skilled and experienced Data Engineer to join our team. This role is ideal for someone with a strong background in automated data processing, relational databases, and real-time data feeds … using Python. You will be responsible for designing and implementing data pipelines, developing interactive dashboards, and delivering insightful analytics to support decision-making across the University. You will collaborate closely with internal team members and stakeholders from across the University, gathering requirements, documenting specifications, and presenting your work to both technical and non-technical audiences. Key Responsibilities Design … and implement automated data processing pipelines using Python. Develop and maintain relational database schemas and data models. Integrate real-time data feeds and API-based data sources. Create and manage web-based data visualisation dashboards. Collaborate with stakeholders to understand data requirements and translate them into actionable insights. More ❯

Location: Birmingham, Bristol, Cambridge, Cardiff, Edinburgh, Gatwick, Glasgow, Leeds, Liverpool, Manchester, Milton Keynes, Newcastle, Reading, Southampton Business Line: Enabling Functions Date published: 28-May-2025 Job Title: Data Analyst/Technical Business Analyst Connect to your Industry: Do you enjoy being the “voice of the business" ensuring that our technology teams deliver solutions that meet business needs? If … so, this opportunity is for you! Deloitte is looking for a mid-level Data Analyst/Technical Business Analyst to join its talented Business Change & Analysis team. Connect to your career at Deloitte: Deloitte drives progress. Using our expertise, we help clients become leaders. We invest in outstanding people, build diverse teams, and empower them to achieve more. … firm, using traditional and innovative tools to enable positive transformation. Industry experience is welcomed but not required. Your role involves ensuring solutions meet business and technical needs, transforming data into insights for strategic decisions, understanding business processes, eliciting requirements, and improving user experience and technical quality. You will also support the Head of Business Analysis in practice development More ❯

Who We Are Addepar is a global technology and data company that helps investment professionals provide the most informed, precise guidance for their clients. Hundreds of thousands of users have entrusted Addepar to empower smarter investment decisions and better advice over the last decade. With client presence in more than 45 countries, Addepar's platform aggregates portfolio, market … and client data for over $7 trillion in assets. Addepar's open platform integrates with more than 100 software, data and services partners to deliver a complete solution for a wide range of firms and use cases. Addepar embraces a global flexible workforce model with offices in Silicon Valley, New York City, Salt Lake City, Chicago … London, Edinburgh and Pune. The Role We are seeking a Head of Portfolio Data Operations who excels in strategic problem-solving, innovative thinking, and strategic execution, with a proven track record of building impactful teams focused on operational excellence. This role is based in Addepar's Edinburgh, UK office! As part of the wider Addepar Data More ❯

Social network you want to login/join with: ZONTAL is revolutionizing data management and digital transformation for the life sciences industry. Our cutting-edge platform enables seamless data integration, standardization, and accessibility—empowering scientists and organizations to drive innovation, enhance compliance, and accelerate breakthroughs in healthcare and biotechnology. ZONTAL has offices in the US, Europe … the job. Your Responsibilities: Be a subject matter expert in the ZONTAL Platform and its customer use-cases. Analyze business requirements for customer-facing projects, with emphasis on data flows and data formats as they feed into & out of the ZONTAL Platform. Create functional and design specifications for the proposed solution, focusing on overall Platform architecture … sciences data acquisition software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and container orchestration tools (e.g., Docker More ❯

regulatory reporting solutions. While a large part of our work involves building and maintaining ETL adapters between Avaloq and external systems, were also responsible for native reporting logic, data model extensions, and ongoing support of core legal reporting features. If you're passionate about data pipelines, financial systems, and regulatory tech, this role offers both depth … and diversity. What Youll Do Design, develop, and maintain data integration components (ETL/adapters) connecting Avaloqs data model to third-party reporting platforms, and native reporting solutions built directly within Avaloq Collaborate with business stakeholders and internal tech teams to ensure regulatory requirements are translated into robust, scalable reporting logic Drive improvements in PL/… SQL logic, data structures, and mapping layers Contribute to ongoing efforts around data quality, performance tuning, and compliance-driven automation Act as a senior engineer within the team, offering technical guidance and support to colleagues Required profile: Strong proven track record of working in a similar role at a senior level Strong experience with relational databases More ❯

reporting solutions. While a large part of our work involves building and maintaining ETL adapters between Avaloq and external systems, we’re also responsible for native reporting logic, data model extensions, and ongoing support of core legal reporting features. If you're passionate about data pipelines, financial systems, and regulatory tech, this role offers both depth … and diversity. What You’ll Do Design, develop, and maintain data integration components (ETL/adapters) connecting Avaloq’s data model to third-party reporting platforms, and native reporting solutions built directly within Avaloq Collaborate with business stakeholders and internal tech teams to ensure regulatory requirements are translated into robust, scalable reporting logic Drive improvements in … PL/SQL logic, data structures, and mapping layers Contribute to ongoing efforts around data quality, performance tuning, and compliance-driven automation Act as a senior engineer within the team, offering technical guidance and support to colleagues Qualifications Strong proven track record of working in a similar role at a senior level Strong experience with relational More ❯

Your role will include: Understanding core heating system and physics concepts underpinning our modelling. The design, development and maintenance of our core platform services, including APIs, workflows and data pipelines. Supporting front end teams with integrating UI products with our APIs and services. Supporting product owners in refining requirements by providing technical insight. Supporting existing applications in production. More ❯

Data Engineer - Remote - £65,000 My client, a growing, high-impact consultancy is looking for a hands-on Data Engineer to join its expert team. Working across a mix of exciting, high-profile clients in various different sectors. You will join their expanding team to build robust platforms and create intelligent solutions. If you thrive in … fast-paced environments, enjoy variety in your work, and want to build meaningful data products using Snowflake, dbt, Python, and SQL, this role is for you. Requirements: Experience designing and building scalable data pipelines using Snowflake, dbt, and Python Proven experience as a Data Engineer or Analytics Engineer Great knowledge of Snowflake SQL optimization … and warehouse design experience Strong Python skills for scripting, orchestration, and data manipulation Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and More ❯

Vacancy for Senior Data Engineer at National Records of Scotland Vacancy for Senior Data Engineer at National Records of Scotland 30 July 2021 Edinburgh Full-Time Overview National Records of Scotland (NRS) is a Non-Ministerial Department of the Scottish Government, supporting the Registrar General for Scotland and the Keeper of the Records for Scotland. Both … Scotland. Alongside this NRS are delivering an ongoing programme of technology modernisations and improvements aligned with the Scottish Governments Digital, Cloud and Green IT Strategies. As a Senior Data Engineer you will be part of the data team at NRS offices in Corstorphine, Edinburgh, working collaboratively across NRS teams on a variety of projects. You will … implement data pipelines and the full lifecycle of data, delivering high quality digital services. Able to execute a wide range of Dba Microsoft SQL Server and SSIS skills and demonstrate knowledge of open source tools such as R or Python. Provide clear communications to both technical and non-technical stakeholders Investigate problems and opportunities in existing More ❯

permit required: Yes col-narrow-right Job Views: 4 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Actian is transforming how enterprises discover, understand, and govern their data assets through our innovative data catalog and intelligence platform. Our customers rely on us to provide a seamless and scalable experience, and we’re looking for a … strategic thinking, and strong project management skills to ensure customers see long-term success with Actian solutions. Responsibilities: Technical Implementation & Onboarding Lead technical onboarding process for new Zeenea Data Intelligence Platform customers Develop and execute customer implementation plans ensuring smooth deployment and adoption Manage the technical setup, configuration, and deployment of Zeenea, ensuring seamless integration into customer environments … reinforce business impact Contribute to case studies showcasing innovative metadata implementations Skills and Expertise: 5+ years in technical implementation, consulting, professional services, or customer success in a SaaS, data management, or cloud-based environment Excellent ability to translate customer needs into actionable technical requirements Experience managing multiple concurrent implementation projects with enterprise customers Knowledge of APIs & software development More ❯