Senior Data Engineer

Role OverviewThe Senior Data Engineer is the technical owner of the ClarusONE data platform. This is a hands-on engineering role with real ownership: alongside building and delivering data pipelines, you will raise the engineering standard of the platform — improving its reliability, scalability, security, and quality and help shape where it goes next.The platform has grown quickly, and this role is central to establishing the engineering patterns, frameworks, and best practices that will support it at scale. You will bring a technical lens to infrastructure, deployment practices, and architecture, and act as a trusted technical voice within the team.You will operate within the ClarusONE data governance framework, ensuring sensitive data is properly protected and that data can be traced end to end through its lifecycle. You will work closely with Analytics, Data Science, Software Engineering, and IT/Infrastructure to maintain an accurate, efficient, and compliant data environment — and will communicate confidently with stakeholders across the business, including Finance.Key ResponsibilitiesPlatform Ownership & Engineering StandardsTake technical ownership of platform components, ensuring quality and consistencyEstablish, apply, and evolve engineering best practices, design patterns, and coding standardsDefine reusable patterns and frameworks across the data platform (including layered/medallion architecture approaches)Identify opportunities to improve performance, cost efficiency, scalability, and reliabilityContribute to the target architecture and long-term platform directionData Engineering & DeliveryDesign and build robust, scalable data pipelines (Snowflake, dbt, Airflow, ADF, Python)Apply strong practices in test-driven development, monitoring, logging, and observabilityOwn more complex technical solutions and problem-solvingSupport production issues and drive root-cause improvements rather than quick fixesData Governance, Traceability & ComplianceEnsure data lineage and traceability across the data lifecycle, so any figure can be traced back to sourceEnsure sensitive data is appropriately protected within the ClarusONE data governance frameworkWork with IT teams to ensure solutions meet governance and compliance requirements (e.g. SOX)Understand and manage the implications of production changes within a controlled release processInfrastructure & DevOpsContribute to and maintain Infrastructure as Code (IaC) for the platform (Azure, AKS) in collaboration with the Infrastructure teamWork within and help mature CI/CD pipelines, deployment workflows, and governance processesContinuously improve how the team builds, tests, and deploys data pipelinesInnovation & Platform EvolutionBring forward ideas to improve the platform, tooling, and developer experienceEvaluate emerging technologies and contribute to adoption decisionsSupport platform evolution, including re-architecture and migration activitiesCollaboration & CommunicationSupport other Data Engineers by sharing best practices and technical approachesCollaborate closely with Analytics & Data Insights, Software Engineering, and IT/InfrastructurePresent technical work and recommendations to a range of audiences, including company-wide forumsBuild strong working relationships with business stakeholders, including Finance, and translate technical concepts into clear, practical terms(The above statements describe the general nature and level of work being performed in this job. They are not intended to be an exhaustive list of all duties.)Minimum RequirementDegree or equivalent and typically requires 7+ years of relevant experience.EducationBachelor's degree level or aboveCritical Skills6+ years' experience in data engineering or platform engineering, including at least 2 years at senior or lead level4+ years' experience building and maintaining CI/CD pipelines, deployment workflows, and associated governance processesAdvanced SQL and Python, with hands-on experience building data pipelines and transformations at scaleHands-on experience with a modern cloud data stack, including Snowflake, dbt, Airflow, and Databricks, on a cloud platform (Azure preferred)Demonstrated experience delivering data lineage and traceability within a regulated environment (e.g. SOX, financial services, healthcare, or similar)Experience contributing to platform migrations, re-architecture, or modernisation programmesProven ability to present technical concepts to non-technical and senior stakeholders, including Finance, and influence decisions through practical recommendationsAdditional Knowledge & SkillsPlatform & InfrastructureMaintaining Infrastructure as Code for cloud-based data platformsExposure to containerised or distributed systems (AKS advantageous), including deployment, scaling, and operational considerationsOrchestration & Version ControlOperating Airflow at scale, including DAG reliability, scheduling, and failure handlingVersion control, branching strategies, and release processesEngineering Best PracticeTest-driven development and automated testing within CI/CD workflowsDefining and enforcing standardised engineering patterns across a shared codebaseOperational reliability, including monitoring, structured logging, alerting, and systematic failure recoveryDesirablePySparkExperience supporting Airflow in a self-managed environmentExperience in a business building a data platform from the ground upWorking ArrangementsThis is a hybrid role based in the UK, with an expectation of two days per week onsite. Applicants must hold existing right to work in the UK; sponsorship is not available for this position.McKesson has become aware of online recruiting-related scams in which individuals who are not affiliated with or authorized by McKesson are using McKesson’s (or affiliated entities, like CoverMyMeds or RxCrossroads) name in fraudulent emails, job postings or social media messages. In light of these scams, please bear the following in mind:McKesson Talent Advisors will never solicit money or credit card information in connection with a McKesson job application.McKesson Talent Advisors do not communicate with candidates via online chatrooms or using email accounts such as Gmail or Hotmail. Note that McKesson does rely on a virtual assistant (Gia) for certain recruiting-related communications with candidates.McKesson job postings are posted on our career site: careers.mckesson.com.SummaryLocation: LondonType: Full time