1 to 25 of 34 Permanent Data Pipeline Jobs in Edinburgh

Senior Data Engineer Who we are We are an advanced data and business consultancy headquartered in Edinburgh, UK. We are a practitioner-led organisation that collaborates with top consumer brands to drive transformation and foster customer-centricity through our expertise in customer strategy, innovative design … business challenges in an inclusive environment that fosters continuous learning, knowledge sharing, and clear career development. What you will be doing Data Pipeline Development: Design and implement robust, scalable, and efficient data pipelines to collect, transform, and integrate data from various sources. Data ...

Role As a Core Data Engineer, you will play a pivotal role in designing, building, and optimising data pipelines, architectures, and workflows for our diverse client base. You’ll work within dynamic, multi-disciplinary project teams to implement scalable data solutions while adhering … engineer in different disciplines, as well as a clear path to career development and promotion within the role. Key Responsibilities Data Pipeline Development: Design and implement robust, scalable, and efficient data pipelines to collect, transform, and integrate data from various sources. Data ...

Description: Your Impact As a Data Engineer, you will design, develop, deploy, and maintain data architecture which employs various methods to transform raw data into processed data. You will own the DataOps infrastructure, ensuring the performance, reliability, and scalability of data ingestion … processing pipelines to support evolving business and operational demands. To succeed in this data engineering position, you should have strong problem-solving skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages. What ...

hackajob is partnering directly with Leonardo to hire for this role. Job Description: Your Impact As a Data Engineer, you will design, develop, deploy, and maintain data architecture which employs various methods to transform raw data into processed data. You will own the DataOps … infrastructure, ensuring the performance, reliability, and scalability of data ingestion and processing pipelines to support evolving business and operational demands. To succeed in this data engineering position, you should have strong problem-solving skills and the ability to combine data from different sources. Data ...

technical problems. Our globally distributed team values technical excellence, ownership, proactive communication, and collaboration. About the Role We are looking for a Senior Data Platform Engineer to join a high-impact engagement with one of our partners, a global leader in wealth-management technology. This is a hybrid … this position to go to the office between 1 to 2 times per week. You will help build and evolve a financial data platform developed on top of Databricks and used by major enterprise clients. The platform supports the ingestion, transformation, modeling, and delivery of complex financial data. ...

largest engineering investments. - Responsible for the systems that ensure accurate, scalable, and efficient accounting across global operations. - Expanding into data analytics and pipeline initiatives using Snowflake, Redis, and Kafka to manage high-volume, real-time data. - Collaborates closely with Product, Operations, and other Engineering teams to deliver … approach. - Build and maintain microservices and event-driven systems to process and distribute large-scale financial data. - Develop data integration and pipeline components that connect systems across Snowflake, SQL Server, and real-time streaming platforms. - Implement and optimize Redis-based caching and data stores ...

Optima Partners is seeking a Core Data Engineer to design, build, and optimise data pipelines, architectures, and workflows for a diverse client base in Edinburgh, UK. You will work in cross-functional teams and contribute to scalable data solutions while adopting best practices … emerging trends in data engineering. You will collaborate with data scientists, analysts, and stakeholders, delivering robust ETL/ELT processes, data integration, and documentation. #J-18808-Ljbffr ...

ensure successful client delivery of Prism solutions, playing a crucial player/coach role.This role sits at the intersection of client reporting, data engineering, and people management. The ideal candidate thrives in ambiguous, fast-evolving product environments, brings hands-on technical depth in data pipelines … drive solutions across the Prism teamOperate within a global frameworkDemonstrate effective management of both people and projects.Required skills:Deep understanding of data pipeline design, data ingestion, and data normalizationProficiency in SQL and query development for reporting and data analysisExperience with client ...

Handle data migration/integration between Databricks and AWS: storage, permissions, IAM alignment Work within CI/CD and IaC patterns for pipeline deployment; document runbooks and hand over to Evoke teams Collaborate daily with Evoke ML engineering, the CF team, and AWS ProServe counterparts Skills & experience … Must-have Python/PySpark - Expert. Production data pipeline development, not analysis-only AWS data/ML stack - Advanced. S3, Glue and/or EMR, IAM basics; AWS ML stack SageMaker (Pipelines, Feature Store, Endpoints) SQL — Advanced strongly preferred. ML pipeline experience. Pipelines feeding ...

opening with your name on it As a Senior Engineering Manager, you'll lead teams with blend of consultants and employees with diverse data engineer background who build scalable data pipelines to power business intelligence, analytics, fraud detection, and operational reporting across FanDuel. You'll partner … with Data Architects, Product Managers, Analytics, and Engineering teams to define technical strategy and drive platform governance. This role demands both organizational leadership and technical depth; you'll build high-performing teams, own platform reliability and cost, and enable data-driven decision-making through pragmatic problem ...

roster has an opening with your name on itWe are seeking a Data Engineering Manager to lead a team of data engineers in building high-quality, scalable data products and infrastructure. In this hybrid role, you'll balance people management with technical delivery—mentoring … engineers, guiding solution design, and collaborating across teams to deliver data systems that support analytics, data science, and operational needs. This role is ideal for an experienced data engineer or tech lead who is ready to take the next step into engineering management ...

Date Wednesday 16 September 2026 Salary Range £92,701 - £109,060 Flexible Working Options Hybrid Working, Job Share Job Description JOB TITLE: Lead Data Engineer SALARY: £92,701 - £109,060 LOCATION: Edinburgh, Leeds, Manchester, Bristol HOURS: Full time (35 hours) WORKING PATTERN: Our work style is hybrid, which … Lloyds Banking Group, we are transforming how we protect our customers, colleagues and services in an increasingly sophisticated threat landscape. The Security Data and AI lab within the Chief Security Office is at the forefront of this transformation - engineering data platforms and AI-driven capabilities that ...

long way, there's still so much exciting work to do. Come join us at the heart of trust! About The Role Data isn’t just a byproduct of our business; it’s the engine that drives our growth. We are looking for a Lead Pricing & Monetization Analyst … this role, you’ll focus on empowering the Pricing & Monetization team while working cross-functionally across our commercial organization, and broader analytics and data teams. What You’ll Be Doing Pricing & Monetization Analytics: Partner with product and commercial leadership to evaluate pricing and packaging strategies, analyzing discount behaviors ...

extension (3-year programme) We're supporting a major strategic banking initiative to build a greenfield Enterprise Knowledge Management platform, creating a foundational data layer that connects knowledge across the organisation and enables advanced AI, search and retrieval capabilities. We're looking for an experienced Data Engineer to join the programme during its shaping and architecture phase, with the opportunity to influence target-state architecture, data design, technical spikes and platform development from the outset. What you’ll be doing Design and develop scalable ETL/ELT data pipelines across ...

Bright Purple is recruiting an experienced Data Engineer for Edinburgh on a contract basis to work on a data transformation programme moving … Microsoft Fabric. The role focuses on final migration tasks, data validation and debugging, with transition into post go-live data pipeline development and reporting support. The candidate will bring strong Fabric exposure, Synapse, PySpark and SQL skills, plus experience in data pipelines ...

Data Science ManagerAre you an experienced Data Science leader with a passion for building and scaling AI/ML products? Lead a team of exceptional Data Scientists and ML Engineers building next-generation AI solutions for financial markets. Drive innovation using LLMs, Generative … world business impact. If you're passionate about shaping the future of AI, we'd love to talk to you. ROLE SUMMARYAs a Data Science Manager, you will lead a high-performing team of Data Scientists delivering AI-powered products that create measurable business value ...

Lloyds Banking Group is hiring a Lead Data Engineer in Edinburgh with hybrid work. You will shape the data engineering capability, own data pipelines and secure-by-design data foundations for AI and analytics. The role combines leadership with deep technical delivery … across a complex enterprise. You will mentor engineers, partner with Security, Cloud, Architecture and Product teams, and help drive the data strategy in a regulated financial services environment. #J-18808-Ljbffr ...

Security Engineering Lead to design, implement and lead security for AI/ML initiatives across the bank. The role covers model lifecycle security, data pipelines and secure deployment in hybrid environments. Based in or working across offices such as Edinburgh, Leeds, Bristol, Manchester or London, you’ll lead ...

real business problems We are looking for an experienced Software Engineer/Forward Deployed Engineer (FDE) to work at the intersection of technology, data, AI and the business. This is not a traditional software engineering role. You will work directly with our investment, operations and distribution teams, spending … Deployed Engineer, you will: Work directly with business teams to understand their workflows, challenges and opportunities. Identify high-impact problems where software, automation, data or AI can improve how we operate. Rapidly prototype solutions, test them with users and iterate based on real-world feedback. Take successful prototypes ...

Codelitt is hiring a Senior Data Platform Engineer in Edinburgh for a hybrid role. You will contribute to a financial data platform built on Databricks, working across Python services, APIs, data pipelines, and data models with an established Edinburgh team. The ideal ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

systems, including non-deterministic and agentic applications. OptimizeAI systems and workloads for latency, throughput,computeefficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoingoperation. Establish engineering standards,mentorengineers,and influencetechnical strategy across teams. Theminimumrequirements … model-driven applications in production. Strongproficiencyin Python anda track recordof developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

deterministic and agentic applications. Optimize AI systems and workloads for latency, throughput, compute efficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoing operation. Establish engineering standards, mentor engineers, and influence technical strategy across … production. Strong proficiency in Python and a track record of developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

deterministic and agentic applications. Optimize AI systems and workloads for latency, throughput, compute efficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoing operation. Establish engineering standards, mentor engineers, and influence technical strategy across … production. Strong proficiency in Python and a track record of developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

seeking an experienced Architect specializing in infrastructure and software architecture to shape how AI workloads are designed, placed, and scaled across on-premises data centres, edge environments, and public cloud. This is an architecture leadership role: you will own the reference architectures, decision frameworks, and technical standards that … architecture for workloads spanning the on-premise server and public cloud compute and GPU estate. Define the patterns teams use for hosting, compute, data pipelines, training and fine-tuning, model serving, and retrieval-augmented systems. Workload Placement and Portability: Establish the decision framework that determines where a given ...