Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 15 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding client … status, civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior Data Engineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our collective success? The Data & Analytics department transforms raw data into actionable insights to drive informed decision-making and optimize business operations. The Senior Azure Data Engineer will support these goals by designing, implementing, and managing scalable data solutions on the Azure platform, ensuring efficient data processing, storage, and retrieval. You will play a key role in modernizing our dataMore ❯
divisions provides its customers with clear advantage, and its technology-led service provides access to all major exchanges, order-flow management via screen, voice and DMA, plus award-winning data, insights and analytics. The Technology Department delivers differentiation, scalability and security for the business. Reporting to the COO, Technology provides digital tools, software services and infrastructure globally to all … and design. The IT Group runs our enterprise-wide services to end users and actively manages the firm's infrastructure and data. Within IT, Marex Technology has established a Data team that enables the firm to leverage data assets to increase productivity and improve business decisions, as well as maintain data compliance. The Data Team encompasses … Database Administration, Data Engineering, Data Analysis, Data Architecture, Data Intelligence and AI expertise. In recent years, they have developed a Data Lakehouse architecture, that is relied upon by different departments across the firm. Marex now seeks to strengthen its capabilities further and elevate the role of data in the operating models of Marex's More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Noir
Data Engineer - Leading Energy Company - London (Tech Stack: Data Engineer, Databricks, Python, PySpark, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) Company Overview: Join a dynamic team, a leading player in the energy sector, committed to innovation and sustainable solutions. Our client are seeking a talented Data Engineer to help build and optimise our data infrastructure, enabling them to harness the power of data-driven insights to drive our business forward. Responsibilities: Design and develop a cutting-edge data warehouse capable of efficiently ingesting and organising large volumes of data from multiple sources. Champion best practices in data architecture governance, ensuring compliance with security and privacy regulations. Implement automated, scalable … data migration processes across various project phases. Conduct rigorous dataquality assessments, employing cleansing and validation techniques as needed. Construct robust data pipelines for cleaning, transforming, and aggregating diverse datasets. Collaborate closely with software development and product teams to align data strategies with business objectives. Stay abreast of emerging trends and technologies in dataMore ❯
Data Engineer - Leading Energy Company - London (Tech Stack: Data Engineer, Databricks, Python, PySpark, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) Company Overview: Join a dynamic team, a leading player in the energy sector, committed to innovation and sustainable solutions. Our client are seeking a talented Data Engineer to help build and optimise our data infrastructure, enabling them to harness the power of data-driven insights to drive our business forward. Responsibilities: Design and develop a cutting-edge data warehouse capable of efficiently ingesting and organising large volumes of data from multiple sources. Champion best practices in data architecture governance, ensuring compliance with security and privacy regulations. Implement automated, scalable … data migration processes across various project phases. Conduct rigorous dataquality assessments, employing cleansing and validation techniques as needed. Construct robust data pipelines for cleaning, transforming, and aggregating diverse datasets. Collaborate closely with software development and product teams to align data strategies with business objectives. Stay abreast of emerging trends and technologies in dataMore ❯
City of London, London, United Kingdom Hybrid / WFH Options
FairPlay Sports Media
along the way. So why not join us at FairPlay and be part of something bigger... What we are looking for: We are seeking a highly motivated and experienced Data Product Manager to own the strategy, roadmap, and execution of our Customer Data Platform (CDP) and Single Customer View (SCV). This is a critical role within our … rapidly growing data organization, and you will be instrumental in enabling data-driven decision-making across the business. You'll work closely with engineering, marketing, product, and other internal teams to ensure our CDP is a powerful tool for understanding and engaging our users. You will report to the Head of Core Product. You will be responsible for … for our CDP and SCV, aligning with overall business objectives and stakeholder needs. Requirements Gathering: Proactively gather, analyze, and prioritize requirements from internal stakeholders (marketing, product, analytics, etc.) for data integration, access, and utilization. Data Source Integration: Oversee the integration of various data sources into the CDP, ensuring dataquality, consistency, and completeness. This includes More ❯
along the way. So why not join us at FairPlay and be part of something bigger... What we are looking for: We are seeking a highly motivated and experienced Data Product Manager to own the strategy, roadmap, and execution of our Customer Data Platform (CDP) and Single Customer View (SCV). This is a critical role within our … rapidly growing data organization, and you will be instrumental in enabling data-driven decision-making across the business. You'll work closely with engineering, marketing, product, and other internal teams to ensure our CDP is a powerful tool for understanding and engaging our users. You will report to the Head of Core Product. You will be responsible for … for our CDP and SCV, aligning with overall business objectives and stakeholder needs. Requirements Gathering: Proactively gather, analyze, and prioritize requirements from internal stakeholders (marketing, product, analytics, etc.) for data integration, access, and utilization. Data Source Integration: Oversee the integration of various data sources into the CDP, ensuring dataquality, consistency, and completeness. This includes More ❯
is Operations that develops and manages the processes and controls that enable business flow. OUR IMPACT The team is seeking a skilled professional who will provide business insights for data driven decisions. In this role, you will apply your quantitative, problem solving and client service skills to support the various business units and clients. You will also play a … key role in suggesting and implementing process improvements for the team to mitigate risks and enhance the overall client experience. JOB SUMMARY AND RESPONSBILITIES: Data Analysis and Process Improvement: •Analyze trade lifecycle and operational workflows to identify areas for optimization and automation. •Enable strategic decision making through data driven analytics. •Develop detailed technical specifications for BI solutions based … on business requirements, adhering to SDLC best practices. BI Solution Development: •Design, develop, test, and deploy end-to-end Business Intelligence solutions using Alteryx for data preparation, SQL for data transformation and storage, Tableau for data visualization, and R/Python for advanced analytics. •Design, implement, and maintain ETL pipelines using Alteryx to extract data from More ❯
London, England, United Kingdom Hybrid / WFH Options
Luupli
Senior Data scientist (Social Media App) - Equity-Only role 0.25% – 0.5% About Luupli Luupli is a social media app 'in-development', which will provide opportunities for diverse creators coming from marginalized communities. Luupli will highlight the work of diverse creators and provide them access to all the opportunities in the social media space. Work Arrangement The commitment required from … with a range of vested benefits. Once the app launches in the spring of 2024, this role will transition into a paid full-time role. Job Description: As a Data Scientist at Luupli, you will play a pivotal role in leveraging AWS analytics services to analyse and extract valuable insights from our data sources. You will collaborate with … cross-functional teams, including data engineers, product managers, and business stakeholders, to develop data-driven solutions and deliver actionable recommendations. Your expertise in AWS analytics tools and techniques will be crucial in shaping our data strategy and driving business growth. Responsibilities: Collaborate with cross-functional teams to understand business objectives, identify data requirements, and define analytics More ❯
Role Summary The Reference Data Lead is a very important role as part of the EMEA Division’s Data Governance and BCBS239 Programme. The ideal candidate must have knowledge of master and reference data management, including the implementation and support of master and reference data policies, standards, procedures & processes. The role will require working with stakeholders … across all functions and regions to ensure fit-for-purpose data, as we look to leverage best practice across the industry. As the concepts of Data Governance and Master & Reference Data Management are new to the organisation, the role also requires an ability to educate and convince stakeholders at all levels on the essential nature of this … an empathetic manner, while helping the wider team to have an ethos of openness and transparency that will help us nurture real business innovation. Business Area Background: The EMEA Data Office sits within the Operations, Planning and Data Department, covering all EMEA entities (including Securities and Banking subsidiaries) and all datasets. This team is responsible for defining and More ❯
City of London, London, United Kingdom Hybrid / WFH Options
SMBC Group
Role Summary The Reference Data Lead is a very important role as part of the EMEA Division’s Data Governance and BCBS239 Programme. The ideal candidate must have knowledge of master and reference data management, including the implementation and support of master and reference data policies, standards, procedures & processes. The role will require working with stakeholders … across all functions and regions to ensure fit-for-purpose data, as we look to leverage best practice across the industry. As the concepts of Data Governance and Master & Reference Data Management are new to the organisation, the role also requires an ability to educate and convince stakeholders at all levels on the essential nature of this … an empathetic manner, while helping the wider team to have an ethos of openness and transparency that will help us nurture real business innovation. Business Area Background: The EMEA Data Office sits within the Operations, Planning and Data Department, covering all EMEA entities (including Securities and Banking subsidiaries) and all datasets. This team is responsible for defining and More ❯
/50 split) About the Organisation This organisation is a specialist provider of financial services, committed to delivering exceptional support and insights to business clients. Its strategic approach to data-driven decision-making and customer-focused innovation plays a central role in supporting long-term growth, performance, and value creation. About the Department The Business Intelligence team is a … core function responsible for managing the entire reporting and analytics lifecycle-from requirements gathering and data extraction to visualisation, testing, and delivery. The team provides critical support across finance, treasury, risk, and strategic planning, while also managing enterprise BI tools and platforms. With a focus on excellence, the team leverages analytics to support informed decision-making, operational efficiency, and … long-term business value. Key Responsibilities Champion analytics and business intelligence initiatives across all departments, promoting a culture of data-led decision-making. Serve as a subject matter expert for the data platform and reporting tools, offering guidance to key stakeholders. Maintain and optimise reporting outputs, identifying areas for enhancement and automation. Conduct ad-hoc analysis to meet More ❯
professionals, we work across a range of industries including energy, water, waste, and environmental policy. We are looking to expand our team and are seeking a motivated and analytical Data Analyst to join us in driving the future of sustainable energy. Position Overview: As a Data Analyst, you will play a key role in helping our clients navigate … the complex landscape of energy and environmental data. You will work with a variety of data sources, analyze trends, and support decision-making through your insights and expertise. This role will involve collaborating with project teams, managing datasets, performing statistical analysis, and presenting findings in a clear and concise manner to both technical and non-technical stakeholders. Key Responsibilities … and organize large datasets from various sources related to energy consumption, emissions, environmental factors, and sustainability metrics. Conduct in-depth analysis of energy usage trends, carbon footprints, and environmental data to support clients in their sustainability goals. Apply statistical techniques and models to identify patterns, correlations, and forecasts relevant to energy transition and environmental management. Develop data visualizations More ❯
Senior Analytics Engineer Location: London, Hybrid (minimum 2 days per week in office) Type: Full-Time, Permanent Reports to: Engineering Manager/Lead Data Engineer Salary: £55,000-£70,000 per annum Due to the nature of our work, candidates must be eligible for Security Clearance. Join Our Mission At QuantSpark, we're transforming how data and AI … high-street brands, and premium consumer goods companies optimise inventory, enhance price competitiveness, and deliver personalised customer experiences. Asset Management: We build AI-powered investment decision support systems, alternative data integration platforms, and automated risk management solutions for prestigious asset management firms. Public Sector: We're trusted by multiple UK government departments and public sector organisations to deliver predictive … global manufacturing leaders, our cross-industry expertise ensures we bring diverse perspectives to complex challenges. We're seeking an experienced Senior Analytics Engineer who's passionate about turning complex data into actionable insights that drive remarkable results for our clients. Why You'll Love QuantSpark Work That Matters: Lead high-impact analytics projects across diverse sectors-from building predictive More ❯
Crawley, England, United Kingdom Hybrid / WFH Options
McCabe & Barton
enior Analytics Data Engineer Location: UK (Hybrid/Remote) Salary: £55,000 - £70,000 A leading Financial Services firm is hiring Analytics Data Engineers to support a major Data Transformation programme. In this permanent role, you'll help design and deliver scalable data products that enable self-service analytics using Snowflake, Power BI, Python, and SQL. … What You’ll Do: Build robust ETL/ELT pipelines and dimensional models for analytics Enforce dataquality, security, and governance in a Data Mesh setup Enable self-service insights through intuitive data models and training Own data products end-to-end—from design to continuous improvement Promote innovation and best practices across the organisation … What We’re Looking For: Strong skills in SQL and Power BI. Python is beneficial Solid experience with data modelling and ETL pipelines Knowledge of cloud environments – Azure Experience with Snowflake and Databricks Familiarity with data governance in decentralised environments Excellent communication and stakeholder engagement skills A proactive, problem-solving approach Interested? Apply with your latest CV to More ❯
Daintta are a rapidly growing, values-driven team of specialists who work with government clients across Cyber, Telecommunications and Data. We are seeking a talented and motivated Data Engineer to join our team and contribute to our mission of protecting the UK through data-driven insights and solutions. As a Data Engineer, you will work closely with … our public sector clients and project teams to develop and implement data engineering pipelines to support data science and business/mission intelligence use cases. Key Responsibilities Assessing your clients' technical needs and understanding how their needs are different to wants and managing clients' stakeholders relationship appropriately Identifying data sources, data extraction, transformation, and loading (ETL …/ELT) concepts and methods Designing, evaluating, and implementing on-premise, cloud-based and hybrid data engineering solutions (including providing review and guidance on testing aspects related to data engineering, identification of risks and proposing and implementing their mitigations) Modelling, structuring and storing data along with their data flows for uses including - but not limited to More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Osmii
Databricks Architect (Contract) - Greenfield Data Platform Location: Hybrid working (London) Duration: 12-month initial contract Are you a visionary Databricks Architect with a passion for building cutting-edge data platforms from the ground up? Do you thrive on shaping strategy and driving technical excellence in a greenfield environment? Our client is embarking on a pivotal journey to establish … a brand-new, enterprise-grade data platform using the full power of Databricks. This is a unique opportunity to lead the architectural design and implementation of a truly greenfield data ecosystem that will underpin all future data-driven initiatives, from advanced analytics to AI/ML. We are looking for a hands-on architect who can translate … business needs into robust, scalable, and secure Databricks solutions. The Role: As our Databricks Architect, you will be instrumental in defining and delivering our new data strategy and architecture. This is a greenfield project, meaning you'll have the exciting challenge of building the entire Databricks Lakehouse Platform from scratch. You will provide critical technical leadership, guidance, and hands More ❯
Databricks Architect (Contract) - Greenfield Data Platform Location: Hybrid working (London) Duration: 12-month initial contract Are you a visionary Databricks Architect with a passion for building cutting-edge data platforms from the ground up? Do you thrive on shaping strategy and driving technical excellence in a greenfield environment? Our client is embarking on a pivotal journey to establish … a brand-new, enterprise-grade data platform using the full power of Databricks. This is a unique opportunity to lead the architectural design and implementation of a truly greenfield data ecosystem that will underpin all future data-driven initiatives, from advanced analytics to AI/ML. We are looking for a hands-on architect who can translate … business needs into robust, scalable, and secure Databricks solutions. The Role: As our Databricks Architect, you will be instrumental in defining and delivering our new data strategy and architecture. This is a greenfield project, meaning you'll have the exciting challenge of building the entire Databricks Lakehouse Platform from scratch. You will provide critical technical leadership, guidance, and hands More ❯
South East London, England, United Kingdom Hybrid / WFH Options
Osmii
Databricks Architect (Contract) - Greenfield Data Platform Location: Hybrid working (London) Duration: 12-month initial contract Are you a visionary Databricks Architect with a passion for building cutting-edge data platforms from the ground up? Do you thrive on shaping strategy and driving technical excellence in a greenfield environment? Our client is embarking on a pivotal journey to establish … a brand-new, enterprise-grade data platform using the full power of Databricks. This is a unique opportunity to lead the architectural design and implementation of a truly greenfield data ecosystem that will underpin all future data-driven initiatives, from advanced analytics to AI/ML. We are looking for a hands-on architect who can translate … business needs into robust, scalable, and secure Databricks solutions. The Role: As our Databricks Architect, you will be instrumental in defining and delivering our new data strategy and architecture. This is a greenfield project, meaning you'll have the exciting challenge of building the entire Databricks Lakehouse Platform from scratch. You will provide critical technical leadership, guidance, and hands More ❯
Place To Work. This prestigious award is based entirely on what current employees say about their experience working at Circana. Job description: We are seeking a skilled and motivated Data Engineer to join a growing global team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines and infrastructure on the Azure cloud … platform. You will leverage your expertise in PySpark, Apache Spark, and Apache Airflow to process and orchestrate large-scale data workloads, ensuring dataquality, efficiency, and scalability. If you have a passion for data engineering and a desire to make a significant impact, we encourage you to apply! Job Responsibilities ETL/ELT Pipeline Development: Design … develop, and optimize efficient and scalable ETL/ELT pipelines using Python, PySpark, and Apache Airflow. Implement batch and real-time data processing solutions using Apache Spark. Ensure dataquality, governance, and security throughout the data lifecycle. Cloud Data Engineering: Manage and optimize cloud infrastructure (Azure) for data processing workloads, with a focus on More ❯
Derby, England, United Kingdom Hybrid / WFH Options
identifi Global Resources
Senior Digital Data Engineer Permanent opportunity Salary: £50,000 – £55,000 per annum Location: Derby (Hybrid – 2–3 days onsite per week) 🔐 Security Clearance: Due to the nature of the work, candidates must be eligible for SC clearance. Unfortunately, on this occasion we cannot consider applicants who require visa sponsorship. ABOUT THIS ROLE We’re working with an organisation … of change, moving from legacy on-premise systems (SAP-based) to a modern, cloud-based Microsoft Azure environment. As part of this transformation, they’re looking for a Senior Data Engineer to help ensure data is well-managed, accessible, and reliable throughout the process. WHAT YOU WILL DO As the Senior Data Engineer, you will lead the … data workstream and guide other teams through the transformation. This includes mapping the data currently held in various systems, speaking with data owners to understand how it is used, and helping define data workflows. You’ll play a key role in visualising how data flows across the business and identifying any risks or challenges related More ❯
Nottingham, England, United Kingdom Hybrid / WFH Options
Cloud2 Consult
Data Engineer – Job Specification Location: Hybrid (1–2 days per month in Nottingham) Salary: £60,000 Summary An exciting opportunity for a passionate Data Engineer to join a growing consultancy business at a pivotal stage of its development. This role sits at the forefront of data infrastructure design, development, and optimisation — supporting enterprise-level solutions, modern data platform projects, and consultancy-led client engagements. You’ll play a hands-on role in delivering robust, scalable data engineering solutions while advocating for best practices across the business. Ideal for someone with a proactive mindset, who wants to make a tangible impact and be part of shaping the future of a data-driven organisation. Key Responsibilities … Consultancy & Client Delivery: Communicate clearly with project managers and stakeholders, translating technical concepts for non-technical audiences. Run client advisory sessions and online enablement workshops focused on modern data tools, including Power BI and metadata-driven solutions. Provide guidance and mentoring to junior team members on project delivery standards and best practices. Data Engineering & Infrastructure: Develop and maintain More ❯
Thatcham, Berkshire, United Kingdom Hybrid / WFH Options
Thatcham Research
Data Business Analyst Circa £45,800 negotiable + excellent benefits Permanent Hybrid About The Role Would you like to work for a company that makes a real difference in the automotive industry? Are you passionate about Data Analysis and delivering customer value whilst expanding your skills? Are you keen to convert business needs into data-driven solutions … If so, this may be the perfect role for you. We have an opportunity for a Data (Business) Analyst to join our Enterprise Data team, supporting the delivery of data solutions to our business and customers. In this role, we'd like you to help us deliver best practice and centre of excellence for all our data … their analytical needs. Understanding business requirements and converting them into technical requirements. Translating technical requirements, terminology and solutions into digestible updates and explanations for business stakeholders. Technical analysis of data sets to understand structure, quality and use of data to inform delivery of products. Plan, develop and update the complex modelling and analysis activities. Maintain functional and More ❯
DEPT/AI has a single mission: to make the best work in the industry using Data & AI to enhance everything we do. This role sits within our Data & AI practice, which has deep expertise in leveraging AI. The team includes data strategists, consultants, data scientists and analysts that work alongside DEPT teams around the world … hardest and most challenging problems facing some of the best loved brands in the world - and doing this alongside an experienced team. This role is part of our EMEA Data craft team, an integrated craft across Europe driving data engineering, data science, and AI initiatives. We combine our expertise in data architecture, analytics, and AI to … deliver exceptional data-driven solutions that build lasting relationships with our clients like Footlocker, Nikon, Rituals, and Philips ROLE OVERVIEW The Lead Data Engineer is responsible for building and leading our data engineering capabilities across EMEA and setting technical standards. This senior technical leadership role will drive the strategic vision for our data engineering practice, deliver More ❯
Wolverhampton, West Midlands (County), United Kingdom Hybrid / WFH Options
SF Recruitment
Business Intelligence Developer Location: West Midlands/Hybrid Salary: £50,000 - £55,000 per annum Contract Type: Permanent Department: Data & Insights About the Role An established public sector organisation is seeking a Business Intelligence Developer to help transform data into actionable insights that support strategic objectives. Working collaboratively across teams, the BI Developer will design and implement data-driven solutions that enhance both decision-making and operational efficiency. Key Responsibilities Develop and maintain robust SQL queries and stored procedures for ETL processes across varied data sources. Design and deploy interactive dashboards and reports using tools such as Power BI. Work with stakeholders to gather requirements and translate them into technical deliverables. Ensure high dataquality and integrity across reporting environments. Contribute to data governance efforts and uphold best-practice standards. Remain up to date on emerging trends and technologies within the BI space. Essential Qualifications and Experience Degree in Computer Science, Information Systems, or a related field. 2-3 years of experience with SQL, including complex query writing and performance optimisation. Skilled in More ❯
with Service Management leadership, Enterprise Problem Management, and our Service Providers. Contribute to product design and development of the TR Service Dashboards. Contribute to process and technical capabilities (e.g., Data Modeling, Data Visualizations, Artificial Intelligence (AI), Machine Learning (ML to enhance identification of service improvement opportunities. Complex data mining, trend analysis, metric and report production will be … on key service improvement initiatives. Be responsive to internal stakeholder needs and engage with stakeholders across multiple functions. Typical daily work may include but is not limited to complex data mining, trend analysis, metric and report production, process flow charting, and iterative service improvement activities (e.g. daily standups, dataquality checks, change reviews, tool enhancement design and … trends to enhance service reliability and availability. Support for Service Management activities to ensure a consistent standard of incident, problem, change and other practice areas for enhanced accuracy of dataquality, root cause analysis and identification of preventative measures. Support the recurring service performance reporting cycle (e.g., weekly, monthly, quarterly). About You: Experience in enterprise problem management More ❯