Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 15 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding client … status, civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process. Senior Data Engineer (Azure/Databricks Job Family Grouping: Chief Underwriting Officer Job Family: Data & Analytics Location: London How does this role contribute to our collective success? The Data & Analytics department transforms raw data into actionable insights to drive informed decision-making and optimize business operations. The Senior Azure Data Engineer will support these goals by designing, implementing, and managing scalable data solutions on the Azure platform, ensuring efficient data processing, storage, and retrieval. You will play a key role in modernizing our dataMore ❯
We are looking for an experienced Cloud Data Architect to join our Data (Migration) team and drive the architecture, design, and implementation of customers modern data platforms. The ideal candidate will have extensive experience migrating traditional data warehouse technologies, including Teradata, Oracle, BW, Hadoop to modern cloud data platforms like Databricks, Snowflake, Redshift, Bigquery, or … Microsoft fabric. You will be responsible for leading data platform migrations and the design and development of scalable data solutions that support our organization's strategic goals. Data Architecture and Strategy: Lead the development and implementation of data architecture strategies that align with business objectives. Design and oversee the architecture of enterprise data warehouses, data lakes, and big data platforms. Establish best practices and standards for data modeling, integration, and management. Platform Design and Implementation: Architect, design, and implement data warehouse solutions using platforms like Databricks, Redshift, BigQuery, Synapse, and Snowflake. Develop scalable big data solutions using cloud data technologies and services. Ensure the data architecture supports More ❯
Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with … large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within More ❯
Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with … large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within More ❯
Talan UK is a leading Data Management and Analytics consultancy, working closely with leading software vendors and top industry experts across a range of sectors, unlocking value and insight from their data. At Talan UK, innovation is at the heart of our client offerings, and we help companies to further improve their efficiency with modern processes and technologies, such … in each region to encourage engagement and network building. Job Description We are looking for looking for experienced and dynamic Consultants to join our existing team. As a SAS Data Engineering Consultant, you will engage with our clients daily, working to understand their challenges and to deliver solutions. You will be based from one of our regional offices or … think creatively and propose innovative solutions. Strong self-developer. Qualifications To qualify for this role, you must have: Multi-skilled experience in one or more of the following disciplines: Data Management, Data Engineering, Data Warehousing, Data Modelling, Data Quality, DataIntegration, Data Analytics, Data Visualisation, Data Science and Business Intelligence. More ❯
world-class opportunity to help shape our organisation for the next stage of its journey. To drive towards this ambition, we are seeking a motivated individual to join our Data Platform team and support Aztec's new technology strategy using Azure Databricks. You will lead our Data Engineering capability and collaborate with others passionate about solving business problems. … Key responsibilities: Data Platform Design and Architecture Design, develop, and maintain a high-performing, secure, and scalable data platform, leveraging Databricks Corporate Lakehouse and Medallion Architectures. Utilise our metadata-driven data platform framework combined with advanced cluster management techniques to create and optimise scalable, robust, and efficient data solutions. Implement comprehensive logging, monitoring, and alerting tools … to manage the platform, ensuring resilience and optimal performance are maintained. DataIntegration and Transformation Integrate and transform data from multiple organisational SQL databases and SaaS applications using end-to-end dependency-based data pipelines, to establish an enterprise source of truth. Create ETL and ELT processes using Azure Databricks, ensuring audit-ready financial dataMore ❯
world-class opportunity to help shape our organisation for the next stage of its journey. To drive towards this ambition, we are seeking a motivated individual to join our Data Platform team and support Aztec's new technology strategy using Azure Databricks. You will lead our Data Engineering capability and collaborate with others passionate about solving business problems. … Key responsibilities: Data Platform Design and Architecture Design, develop, and maintain a high-performing, secure, and scalable data platform, leveraging Databricks Corporate Lakehouse and Medallion Architectures. Utilise our metadata-driven data platform framework combined with advanced cluster management techniques to create and optimise scalable, robust, and efficient data solutions. Implement comprehensive logging, monitoring and alerting tools … to manage the platform, ensuring resilience and optimal performance are maintained. DataIntegration and Transformation Integrate and transform data from multiple organisational SQL databases and SaaS applications using end-to-end dependency-based data pipelines, to establish an enterprise source of truth. Create ETL and ELT processes using Azure Databricks, ensuring audit-ready financial dataMore ❯
London (1 Horse Guards Road), Greater London, England
Government Digital & Data
money is spent. We drive forward improved outcomes and efficiency in public services and make sure value for money is at the centre of decision-making through better evaluation, data and analysis. We advise on overall government policy on public sector pay and pensions, the biggest single driver of public spending. We collaborate with and directly support departments to … Model to share, improve and drive efficiency in the delivery of finance services. NOVA contains a full suite of functional design artefacts—Processes, KPIs, Business Glossary and a comprehensive Data Dictionary—to be adopted by all government organisations through the delivery of shared services and back-office systems. We are committed to enhancing finance performance by supporting the adoption … of the NOVA finance functional design and its data standards. Driving up finance data maturity, improving data architecture, and creating dataintegration solutions are central to our GFF 2030 Strategy and ambition for an Insightful and Data Driven finance function. The seventeen-person team works across a wide range of partners, providing the individual More ❯
Cardiff, South Glamorgan, United Kingdom Hybrid / WFH Options
Creditsafe
Join our Cardiff Bay team as a Data Warehouse Developer within the Cardiff office. You are expected, if successful, to work 50% of the week in the office. WHO ARE WE? Privately owned and independently minded, Creditsafe operates with the singular vision of powering business decisions. We do this by delivering valuable intelligence on customers, suppliers, and potential buyers … with a revolutionary dream to make business information accessible to all. Twenty-five years later, we've not only realised this dream, changed the market for the better, made data intelligence accessible to all businesses big and small but most importantly, opened up new avenues of data intelligence for businesses with machine learning, AI, and connected data. From … risk management through to opportunity identification, our industry-leading solutions power decisions for companies by turning their data into actionable insights that help them become stronger, grow faster, and thrive. THE TEAM Our team is responsible for designing, developing, and maintaining the company's internal Data Warehouse, ensuring high-quality, structured data for business intelligence and reporting. More ❯
Job Description: The Data Domain Lead plays a critical role in ensuring effective management and governance of core data assets within a specific data domain (e.g., Finance, Supply Chain/Purchasing, Demand B2B, Demand B2C, R&D) and the associated roadmaps towards unlocking these in alignment with the analytics product development strategy and priorities. The role bridges … str ategy, operations, and governance, focusing on enabling the organization to extract value from data while maintaining compliance and quality standards. What will be your Key Responsibilities? Strategic Data Management Execute the vision, strategy, and roadmap for the assigned data domain in alignment with organizational goals. Collaborate with business and IT stakeholders to prioritize data initiatives … based on business value and strategic alignment. Anticipate the data needs of product squads to unlock faster speed to value and insight. Promote data as a strategic asset within the domain and across the organization. Adherence to Data Governance & Compliance standards Ensure adherence to data governance frameworks, policies, and standards. Ensure data quality management is More ❯
will serve as a subject matter expert providing technical leadership guidance and best practices across the team. You will play a critical role in designing developing and implementing complex data solutions on cloud platforms (primarily AWS) ensuring they meet the highest standards of quality scalability and performance. Serve as a subject matter expert in cloud data engineering providing … technical guidance and mentorship to the team. Drive the design development and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (e.g. AWS Glue AWS Lambda AWS S3 AWS Redshift AWS EMR). Develop and maintain data quality checks data validation rules and data lineage documentation. Collaborate with data analysts … data scientists business stakeholders and product owners to understand their data needs and translate them into innovative and effective technical solutions. Troubleshoot and resolve complex data quality issues performance bottlenecks and production incidents. Participate in the evaluation selection and implementation of new data technologies and tools. Adhere to and champion best practices in data engineering More ❯
City of London, London, United Kingdom Hybrid / WFH Options
FairPlay Sports Media
along the way. So why not join us at FairPlay and be part of something bigger... What we are looking for: We are seeking a highly motivated and experienced Data Product Manager to own the strategy, roadmap, and execution of our Customer Data Platform (CDP) and Single Customer View (SCV). This is a critical role within our … rapidly growing data organization, and you will be instrumental in enabling data-driven decision-making across the business. You'll work closely with engineering, marketing, product, and other internal teams to ensure our CDP is a powerful tool for understanding and engaging our users. You will report to the Head of Core Product. You will be responsible for … for our CDP and SCV, aligning with overall business objectives and stakeholder needs. Requirements Gathering: Proactively gather, analyze, and prioritize requirements from internal stakeholders (marketing, product, analytics, etc.) for dataintegration, access, and utilization. Data Source Integration: Oversee the integration of various data sources into the CDP, ensuring data quality, consistency, and completeness. More ❯
along the way. So why not join us at FairPlay and be part of something bigger... What we are looking for: We are seeking a highly motivated and experienced Data Product Manager to own the strategy, roadmap, and execution of our Customer Data Platform (CDP) and Single Customer View (SCV). This is a critical role within our … rapidly growing data organization, and you will be instrumental in enabling data-driven decision-making across the business. You'll work closely with engineering, marketing, product, and other internal teams to ensure our CDP is a powerful tool for understanding and engaging our users. You will report to the Head of Core Product. You will be responsible for … for our CDP and SCV, aligning with overall business objectives and stakeholder needs. Requirements Gathering: Proactively gather, analyze, and prioritize requirements from internal stakeholders (marketing, product, analytics, etc.) for dataintegration, access, and utilization. Data Source Integration: Oversee the integration of various data sources into the CDP, ensuring data quality, consistency, and completeness. More ❯
Their integrated teams work across disciplines, applying digital innovation and best-in-class project delivery. Role Overview: We are seeking a talented and proactive Power BI Specialist to support data-driven decision-making on some of the most complex infrastructure programs in the region. You will be responsible for developing insightful dashboards and reports that drive operational performance, track … multi-billion-dollar infrastructure, energy, and transportation projects. Key Responsibilities: Develop and maintain interactive dashboards and visualisations using Power BI to support project teams, clients, and senior stakeholders. Integrate data from diverse systems including project management software (Primavera P6, MS Project), finance (SAP, Oracle), GIS, IoT, and Excel-based tools. Collaborate with multidisciplinary teams (engineering, project controls, digital delivery … and data governance) to understand reporting requirements and KPIs. Support real-time project monitoring and automated reporting solutions for cost, schedule, risk, safety, and sustainability metrics. Apply Power Query, DAX, and SQL for data modeling, transformation, and performance optimisation. Ensure compliance with data governance, security protocols, and company standards for digital delivery. Support the use of predictive More ❯
Their integrated teams work across disciplines, applying digital innovation and best-in-class project delivery. Role Overview: We are seeking a talented and proactive Power BI Specialist to support data-driven decision-making on some of the most complex infrastructure programs in the region. You will be responsible for developing insightful dashboards and reports that drive operational performance, track … multi-billion-dollar infrastructure, energy, and transportation projects. Key Responsibilities: Develop and maintain interactive dashboards and visualisations using Power BI to support project teams, clients, and senior stakeholders. Integrate data from diverse systems including project management software (Primavera P6, MS Project), finance (SAP, Oracle), GIS, IoT, and Excel-based tools. Collaborate with multidisciplinary teams (engineering, project controls, digital delivery … and data governance) to understand reporting requirements and KPIs. Support real-time project monitoring and automated reporting solutions for cost, schedule, risk, safety, and sustainability metrics. Apply Power Query, DAX, and SQL for data modeling, transformation, and performance optimisation. Ensure compliance with data governance, security protocols, and company standards for digital delivery. Support the use of predictive More ❯
Redbrain is a team full of tech-loving, results-driven data nerds who love helping retailers achieve kickass results (and we really mean that). Our people thrive on applying their tech smarts to the online retail space. We've been shaking up the online affiliate business for years, investing millions into technical solutions to transform online shopping as … seek a highly skilled Business Intelligence (BI) Developer with expertise in Google BigQuery, Looker Studio, and PostgreSQL. The ideal candidate will be responsible for designing, developing, and optimising our data pipelines and reporting solutions to drive data-driven decision-making across the organisation. KEY RESPONSIBILITIES This role demands a deep understanding of data modelling, SQL, and performance … tuning in BigQuery and PostgreSQL, along with a proven ability to create insightful and visually appealing reports and dashboards in Looker Studio. BigQuery Development & Optimization: Design and implement efficient data models in BigQuery to support business reporting needs. Write and optimise complex SQL queries for data extraction, transformation, and loading (ETL) processes. Improve query performance and reduce costs More ❯
Minimum Requirements A minimum of 10 years of experience as a Data Architect A minimum of 3 years of experience in the Financial Services sector Data Architecture framework, standards, principles and dataintegration patterns Software development, analysis and data modelling, databases, dataintegration Minimum 3 years of experience with any of the given … tools: Collibra, Solidatus, data.world, or any other data catalog tools in the industry. Minimum 5 years' experience working with cloud technologies: AWS, AZURE. Very strong in SQL, PL/SQL or T-SQL. Vast experience in data modelling using tools such as Erwin, Power Designer, SQLDBM or Sparx EA. Minimum 10 years experience in using databases such as … Oracle, SQL Server, Snowflake or any other OLTP and OLAP databases. Minimum 5 years experience with reporting tools: Power BI, Business Objects, Tableau or OBI. Understanding of Master Data Management technology landscape, processes and design principles. Minimum 3 years of experience with Informatica MDM or any other MDM tools (both customer and product domains). Understanding of established dataMore ❯
Description The Role We are looking for a Lead Data Engineer to join us on a permanent basis.We need talented individuals to apply their data engineering and software development skills for solving data challenges to support a major UK Government programme from locations throughout the UK. You will work closely with delivery managers, fellow technical specialists, external … partners and our customer's teams to support the discovery, design, delivery and operation of a wide range of data solutions. It is a great place to be able to use your skills, learn from others and form one of the best performing teams in the business. This position is a full time, permanent role and applicants must have … travel may be required to various customer and Leidos sites Your responsibilities will include: Lead and co-ordinate teams, setting best practice and standards Architect, develop, and maintain robust data pipelines and infrastructure across cloud platforms (AWS, Azure) Design and implementation of numerous complex data flows to connect operational systems, data for analytics and business intelligence (BI More ❯
About Us At Agile, we believe in the power of data to transform lives, and those our customers serve, and are dedicated to unlocking the full potential of data for our clients. We offer comprehensive services across various industries, including Data Strategy, Governance, Data Platform Engineering, Visualisation, Analytics, and Insights. Our goal is to deliver tangible … business benefits by helping our clients manage, monetise, and leverage their data effectively. As a trusted partner of Microsoft, Informatica, AWS, and Snowflake, we're poised for growth. We’re dedicated to fostering a diverse, equitable, and inclusive workplace. We believe that diversity drives innovation and fosters creativity. We actively promote diversity and inclusion through our hiring practices, employee … providing equal opportunities for all employees, regardless of race, ethnicity, gender, sexual orientation, age, ability, or background. About The Role We are looking for an experienced and solutions-focused Data Engineer with strong Power BI expertise. The role includes leading the delivery of scalable, high-quality data pipelines and analytics platforms that power business intelligence, visualisation, and reporting More ❯
We are seeking a Data Support Engineer (Level 3) to provide expert technical support and drive the performance and reliability of our data infrastructure. In this role, you will serve as the go-to expert for complex data issues, collaborate with data engineers, analysts, and IT teams to optimize data pipelines, and resolve integration and performance challenges. You will play a key role in ensuring data quality and supporting data-driven decision-making while leveraging your expertise in cloud and on-premises technologies. A snapshot of what you will be doing here Advanced Troubleshooting & Optimization : Diagnose and resolve complex dataintegration and processing issues, troubleshoot performance bottlenecks, and ensure … high availability of critical data services with minimal downtime. Data Pipeline Management & Optimization : Oversee and optimize data pipelines (ETL/ELT) across on-premise and cloud environments, ensuring seamless data flow while proactively enhancing data throughput, scalability, and resource efficiency. Platform & Tool Expertise: Provide expert support for data tools, platforms, and technologies, including relational More ❯
We are seeking a Data Support Engineer (Level 3) to provide expert technical support and drive the performance and reliability of our data infrastructure. In this role, you will serve as the go-to expert for complex data issues, collaborate with data engineers, analysts, and IT teams to optimize data pipelines, and resolve integration and performance challenges. You will play a key role in ensuring data quality and supporting data-driven decision-making while leveraging your expertise in cloud and on-premises technologies. A snapshot of what you will be doing here Advanced Troubleshooting & Optimization : Diagnose and resolve complex dataintegration and processing issues, troubleshoot performance bottlenecks, and ensure … high availability of critical data services with minimal downtime. Data Pipeline Management & Optimization : Oversee and optimize data pipelines (ETL/ELT) across on-premise and cloud environments, ensuring seamless data flow while proactively enhancing data throughput, scalability, and resource efficiency. Platform & Tool Expertise: Provide expert support for data tools, platforms, and technologies, including relational More ❯
the top trusted providers in Singapore and service a client base across banking and financial services, insurance, information technology, healthcare, retail and supply chain. We are currently looking for Data Architect who has proven track record in IT Industry. This is an exciting opportunity to expand your skill set, achieve job satisfaction and work-life balance. More details as … below. Role: Snowflake Architect Location: Basildon, UK/Dublin, Ireland Work from Client office 5 days weekly Responsibilities: -Design, develop, and maintain robust data pipelines and ETL processes using Snowflake on AWS. -Implement data warehousing solutions, ensuring efficient storage, retrieval, and transformation of large datasets. -Collaborate with data analysts, scientists, and other stakeholders to define and fulfill … data requirements. -Optimize performance and scalability of Snowflake data warehouse, ensuring high availability and reliability. -Develop and maintain dataintegration solutions, ensuring seamless data flow between various sources and Snowflake. -Monitor, troubleshoot, and resolve data pipeline issues, ensuring data quality and integrity. -Stay up-to-date with the latest trends and best practices More ❯
Head of Data & Analytics Architecture and AI page is loaded Head of Data & Analytics Architecture and AI Apply locations Chiswick Park time type Full time posted on Posted 30+ Days Ago job requisition id JR19765 Want to help us bring happiness to the world? Want to join an ambitious and fast growing global biscuits and confectionery business investing … pladis offers global ambition, a clear Vision and roadmap for success, challenge, and unrivalled opportunities to learn and make an impact Click "Apply" to get started. The Head of Data & Analytics Architecture and AI mission has three facets. 1) To own the D&A Architecture ensuring alignment with business objectives and the technology transformation agenda for D&A to … provide enabling Digital services such as Data as a Service via APIs and Insights as a Service 2) To own and deliver the technology capability for Data, Analytics and AI (D&A). Working closely with the Squads on a daily basis, the Lead Engineer will help the squads deliver maximum outputs for each sprint ensuring each sprint More ❯
We are looking for a hands-on, technically driven Data Engineer to join our expanding data team. This role is ideal for someone with a strong foundation in SQL and data management, who has recently graduated from a Data Science or Data Engineering programme and is eager to apply their skills in a modern, forward … thinking environment. You will be responsible for developing and maintaining robust data solutions that support reporting, automation, and strategic decision-making across the business. The successful candidate will have up-to-date knowledge of data tooling and methodologies, particularly in SQL, Power BI, and data automation, with an interest in modern data architecture such as cloud … As the role sits within a relatively new department, where methodologies and processes are still evolving, there is a significant opportunity to help shape the future of OEG’s data management practices. Key Responsibilities: Database and Data Engineering Design, develop, and maintain SQL-based solutions and data pipelines. Manage relational databases, ensuring data can be extracted More ❯
Role: Data Solution Architect Locations: London | Belfast | Manchester | Edinburgh | Birmingham | More in UK Job Type: Full-Time Job Description As a Data Solution Architect you will be expected to take an architecture lead role on our client’s solution delivery engagements, with high levels of customer engagement. This will involve ongoing analysis of business requirements throughout the lifetime … of the service. Candidates will have a strong understanding of data architecture and analytics design and project delivery life-cycles with an emphasis of working in client facing environments. Typically the role will involve the following: Translating Business requirements to technical solutions and the production of specifications, Designing and implementing business intelligence & modern data analytics platform technical solutions … Data architecture design and implementation Data modelling, ETL, dataintegration and data migration design and implementation Master data management system and process design and implementation, Data quality system and process design and implementation, Major focus on data science, data visualisation, AI, ML, Documentation of solutions (e.g. data modelling, configuration, and More ❯