76 to 100 of 147 Data Lake Jobs in London

of this role is to develop, maintain and, where necessary, provide support to end users for Infor Sun Systems and associated products (Bank Reconciliation, Q&A, Data lake, interfaces etc), You will work within the Financial Systems team and your stakeholder/s with be the wider finance functionYou will have design authority and be encourage to … Development and maintenance of existing processes requiring SQL or VBA expertise. Be team representative responsible for liaising with Group Technology on technical issues (e.g. Interface/Data Lake/SQL/Server/Database issues) Continually review and make recommendations for improvement tools, systems, and process. Co-ordinate the annual audit user reviews for Sun systems Support … the Finance Systems Accounting team where necessary. SKILLS/EXPERIENCE REQUIRED: Understanding of data structures and experience of extracting and utilising data to drive key strategic decisions, including the production of insightful analysis. Financial controls and an appreciation for financial/management accounting Strong communication and Stakeholder management skills. Systems development and change control. Sun Super More ❯

Social network you want to login/join with: Description About the Role Are you an avid technologist who enjoys solving complex data and technical consulting challenges? Are you eager to thrive in an entrepreneurial environment as part of a rapidly expanding and successful global engineering company? EPAM is seeking a Data Solutions Architect with a … in enterprise stacks, specializing in various platforms with a focus on back-end systems, high-load environments, analytics, and digitization. The ideal candidate will have comprehensive knowledge in Data Strategy, Management, Architecture, Governance, Technology Architecture, Data Product Lifecycle Management, and cross-industry experience, particularly in Pharma or Financial Services. This role is ideal for those eager … to contribute to our growth in Western Europe. Responsibilities Consult with business colleagues to identify requirements and unmet needs that can be addressed through Data Solutions Create and present solution architecture documents with detailed technical information to clients and implementation teams Lead the implementation of solutions from establishing project requirements to deployment Stay updated on technical solutions, architecture More ❯

A small and fast-growing Power Platform Consultancy is seeking a Microsoft Fabric Data Engineer/Consultant to join their dynamic team in London, and play a key role in expanding their Microsoft Fabric offering. This is a fantastic opportunity to join a collaborative and forward-thinking consultancy that is passionate about delivering cutting-edge data solutions. You'll be working closely with clients to help them unlock the full potential of their data using Microsoft Fabric, acting as a trusted advisor and technical expert. This role is ideal for someone currently working in a consultancy or someone eager to step into their first consulting role. In line with a hybrid working … you should have: Proven experience working with Microsoft Fabric or strong expertise in related technologies such as Power BI, Azure Synapse, Data Factory, Azure Data Lake etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Hands-on experience with Power More ❯

A small and fast-growing Power Platform Consultancy is seeking a Microsoft Fabric Data Engineer/Consultant to join their dynamic team in London, and play a key role in expanding their Microsoft Fabric offering. This is a fantastic opportunity to join a collaborative and forward-thinking consultancy that is passionate about delivering cutting-edge data solutions. You'll be working closely with clients to help them unlock the full potential of their data using Microsoft Fabric, acting as a trusted advisor and technical expert. This role is ideal for someone currently working in a consultancy or someone eager to step into their first consulting role. In line with a hybrid working … you should have: Proven experience working with Microsoft Fabric or strong expertise in related technologies such as Power BI, Azure Synapse, Data Factory, Azure Data Lake etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Hands-on experience with Power More ❯

Head of Data Science (hands on) - FinTech Head of Data Science role with a fast-growing B2B FinTech company, backed by multiple billionaires and a major global investment firm. You'll join an existing team of 2 Data Scientists within a wider business of 35 staff and report to the Chief Product Officer. The … CEO is a former Data Scientist, providing opportunities for knowledge exchange! The Head of Data Science will work on: Credit risk models: Collaborate with the Chief Risk Officer to develop advanced machine learning models. Affordability models: Utilize bureau and open banking data to create transaction classification models and determine safe borrowing limits for individual … services. Data analytics tech: Partner with the CTO and developers to establish optimal data and analytics environments, including rapid model deployment and data lake creation using AWS Lake Formation. Apply now for this Head of Data Science role with a rapidly growing FinTech. More ❯

A rapid growth gaming firm have created a new role for a Head of Data Engineering. The Head of Data Engineering will work in a Data Rich Testing environment, and be will be tasked with building their own team to help deploy cutting edge Machine Learning techniques in a number of different areas of … the company. Reporting into the Head of Data Science & working closely with the … CTO and Software Engineering team, the Head of Data Engineering in the first 18 months will also be responsible for: Building the Companies Big Data Lake Pushing out various cutting edge Data Science Models Infrastructure Management around the huge Volumes of Data being collected This role would suit an ambitious Data More ❯

Role: Senior/Principal Data Architect Salary: £115,000 - £118,000 + Bonus WFH: 3 Days/Week Onsite (Shoreditch) Overview Our client, a leading global technology and business consultancy focused on financial services, is hiring a Senior/Principal Data Architect to join their award-winning Data Practice. This is a hands-on … architecture and leadership role, supporting major banking and financial services clients with modernising data infrastructure, guiding cloud transformation, and shaping scalable, best-in-class data platforms. You'll join a team of 800+ data professionals in a collaborative, inclusive environment that encourages innovation and values individuality. If you're passionate about strategy, architecture, and … delivering meaningful impact in data-driven transformations, this is an opportunity to lead from the front. Key Responsibilities Lead complex agile consulting projects focused on data architecture design and delivery Advise technology leaders on modern best practices in data management Develop cloud-based enterprise data platforms using AWS, Azure, or GCP Define More ❯

Requirements Technical Expertise: Possessing in-depth knowledge of specific technologies, software, and products. Key strengths on the following areas are required: Cloud technologies - Azure Cloud, AWS. Data Lake & Data Warehouse: SparkDB, Azure Databricks Key accountability Consulting and Advisory: Analysing client needs, identifying technical challenges, and recommending solutions. Solution Design and Implementation: Developing and implementing technical More ❯

of and provide hands-on technical leadership in the delivery of proofs-of-concept or proofs-of-architecture for our customers. Collaborate with application engineers, product managers, and data scientists to deliver solutions that solve real-world problems Deeply embedded with our most strategic platform customers, serving as their technical thought partner in ideating and building novel applications … AI Solution Architects are data and analytics professionals with at least 5 years of experience with knowledge of Transformer (and other Deep Learning) Architectures, data lake architectures, data integration, and data governance, and at least 2 years of experience with cloud-based AI/ML technologies (such as tools from AWS … any POC to create SML Expertise in optimizing AI solutions for runtime cost. Expertise in conversational system architecture Extensive knowledge on APIs & Integrations, Patterns. Extensive knowledge of big data technologies Knowledge on Statistical Methods OTHER SKILLS WE'D APPRECIATE 1. Understanding of NLP engines, Artificial Intelligence, Machine Learning frameworks etc. EDUCATION QUALIFICATION Graduate in Engineering OR masters in More ❯

Job Title: Data Analytics Manager Location: London (3 Days in the office) Job Type: Full Time Company Overview Operating quietly at the intersection of community and commerce, this UK-based real estate investment trust specialises in essential-led retail that remains relevant through changing market cycles. Focused on underappreciated assets in resilient locations, the company balances disciplined asset … local needs. It offers employees the chance to work behind the scenes on places that genuinely matter. Role Summary We’re looking for a proactive and technically capable Data & Reporting Analyst to join the Strategy & Investment team at a pivotal moment in the company’s data journey. This newly created role is part of a broader … performance, credit risk, and strategic KPIs. Standardise and manage data inputs from systems such as Yardi , OnePower , and other internal platforms into a central data lake . Produce structured outputs and data matrices used for Board reports, investor updates, and ExCo presentations. Collaboration & Integration Work closely with the Finance , Asset Management , and Strategy More ❯

Job Title: Data Analytics Manager Location: London (3 Days in the office) Job Type: Full Time Company Overview Operating quietly at the intersection of community and commerce, this UK-based real estate investment trust specialises in essential-led retail that remains relevant through changing market cycles. Focused on underappreciated assets in resilient locations, the company balances disciplined asset … local needs. It offers employees the chance to work behind the scenes on places that genuinely matter. Role Summary We’re looking for a proactive and technically capable Data & Reporting Analyst to join the Strategy & Investment team at a pivotal moment in the company’s data journey. This newly created role is part of a broader … performance, credit risk, and strategic KPIs. Standardise and manage data inputs from systems such as Yardi , OnePower , and other internal platforms into a central data lake . Produce structured outputs and data matrices used for Board reports, investor updates, and ExCo presentations. Collaboration & Integration Work closely with the Finance , Asset Management , and Strategy More ❯

About The Role About The Role We are seeking a skilled and enthusiastic Business Intelligence Data Analyst to join our team in London. Pleas note this is a fixed-term- contract for 10months. Main skills will be to focus on SQL, DataBricks cloud and Tableau for visualisation. As a key member of our Business Intelligence team, you will … scheduled and ad hoc reporting to the business. Collaborate with our engineers to define and validate the web analytics required for GA streams into DataBricks (our data lake platform). Work with cross-functional teams to identify trends, patterns, and opportunities for website optimisation and user experience improvements. Conduct in-depth analysis of web analytics data … Preferred degree preferably in a Science, Technology, Engineering & Mathematics (STEM) field. Strong proficiency in SQL for data extraction, manipulation, and analysis. Knowledge of DataBricks cloud or similar datalake technology is a plus Experience in Tableau would be a plus Experience in Google Analytics 4/Adobe Analytics, or similar, Google Tag Manager, and Google Data Studio More ❯

like a startup environment but has the backing of our parent company? Thats what you would be doing if you joined Amex GBT. The team's responsibilities include data integration supporting customers and internal business areas, as well as ML platform development. We are seeking a talented individual with a diverse skill seta passionate technologist dedicated to solving … real-world business problems; to lead the excellence of Data/ML engineering practice. What Youll Do on a Typical Day Partner with technologists across the business to collaboratively solve problems. Mentor and identify rising talent within the team. Develop a clear vision for the domain they focus on. Demonstrate positive impact and leadership across the organization. Architect … Master's Development background, infrastructure (AWS) knowledge, Data awareness Experience in data modeling, schema design, data access patterns (API, streaming, data lake), and AWS Familiarity with cloud technologies and building data products supporting batch and real-time DS, ML, and Deep Learning applications. Ability to design and communicate architecture More ❯

CI&Ters around the world, we've built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality. Principal Architect (Data focused on Databricks), UK General Description We are looking for a Senior Architect with strong Data experience to be part of our team working for EMEA clients. … EU and other countries in Latin America. We are looking for someone who has: At least 3 years experience with Databricks data platform (setting up workspaces, delta lake, ingestion and transformation workflows, data catalogs, ) Solid experience in architecture design and technical leadership Solid experience designing, developing and deploying pipelines, data-lakes, data meshes and other data products Solid experience on understanding, questioning, prioritizing and translating business problems into data solutions (BI, Analytics, deterministic and statistical models, machine learning) Solid experience with Cloud (Azure or AWS) Experience on identifying, gathering and prioritizing Non Functional Requirements, Technical pain points and environment/client constraints Experience on scaling data More ❯

Senior Data Engineer Up to £95,000 + benefits | Hybrid (3 days a week in City of London) A global financial services firm is hiring a Senior Data Engineer to join their Brokerage technology team. You'll be building and maintaining the data pipelines that underpin their £1bn+ broking business - with a strong focus … on improving brokerage data quality, optimising commercial analysis, and supporting complex client agreements. This is a hands-on engineering role working closely with stakeholders and system owners. You'll be expected to code daily (Python), manage Airflow pipelines (MWAA), build ETL processes from scratch, and improve existing workflows for better performance and scalability. Key responsibilities Design and build … of systems, workflows, and configs Tech environment Python, SQL/PLSQL (MS SQL + Oracle), PySpark Apache Airflow (MWAA), AWS Glue, Athena AWS services (CDK, S3, data lake architectures) Git, JIRA You should apply if you have: Strong Python and SQL skills Proven experience designing data pipelines in cloud environments Hands-on experience with Airflow More ❯

authorized consultant, before you provide any personal details or other non-public information. If in doubt, please write to to seek clarification or report any abuse. Lead Architect - Data Engineering/Azure Apply locations: London Type: Full time Posted on: Posted Yesterday End Date: August 30, 2025 (30+ days left to apply) Job Requisition ID: SR-32098 Join … solve complex business problems with creative solutions, we want to hear from you. As a Lead Architect (Azure), you will work within our Technology team, delivering large-scale Data Engineering solutions to Fortune clients worldwide. Your role will involve innovating, building, and maintaining technology services. Responsibilities: Participate in large-scale client business development and delivery engagements. Develop software … PySpark) and frameworks. Expertise in relational and dimensional modeling, including big data technologies. Proficiency in Microsoft Azure components like Azure Data Factory, Data Lake, SQL, DataBricks, HD Insights, ML Service. Good knowledge of Python and Spark. Experience in ETL & ELT processes. Understanding of cloud analytics and ML Ops. Azure Infrastructure and Azure DevOps More ❯

s biggest credit management service and have begun the next phase in our growth - expansion into 17 European markets over the next two years. The Role - AI Automation & Data Engineer We're seeking a proactive, execution-focusedAI Automation & Data Engineer to join our fast-paced team focused on transforming manual processes into intelligent automation solutions. You … ll work at the intersection of data engineering and AI automation, building robust pipelines and systems that power our company-wide automation initiatives at scale, for a large enterprise operating across 17 markets. This isn't a traditional data engineering role - you'll be building the data foundation for cutting-edge AI automations while … using AI itself to code faster and smarter. You'll have the freedom to identify automation opportunities across the business and build the data infrastructure to support them. In this role, you'll get to: Design and build data pipelines that feed our AI automation systems Create end-to-end automation solutions using Python and Windmill More ❯

s biggest credit management service and have begun the next phase in our growth - expansion into 17 European markets over the next two years. The Role - AI Automation & Data Engineer We're seeking a proactive, execution-focusedAI Automation & Data Engineer to join our fast-paced team focused on transforming manual processes into intelligent automation solutions. You … ll work at the intersection of data engineering and AI automation, building robust pipelines and systems that power our company-wide automation initiatives at scale, for a large enterprise operating across 17 markets. This isn't a traditional data engineering role - you'll be building the data foundation for cutting-edge AI automations while … using AI itself to code faster and smarter. You'll have the freedom to identify automation opportunities across the business and build the data infrastructure to support them. In this role, you'll get to: Design and build data pipelines that feed our AI automation systems Create end-to-end automation solutions using Python and Windmill More ❯

CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and … or Master’s degree in Computer Science, Engineering, or related field. • 10+ years of experience in data engineering. • Strong hands-on experience with AWS services: S3, Glue, Lake Formation, Athena, Redshift, Lambda, IAM, CloudWatch. • Proficiency in PySpark, Python, DBT, Airflow, Docker and SQL. • Deep understanding of data modeling techniques and best practices. • Experience with CI More ❯

CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and … or Master’s degree in Computer Science, Engineering, or related field. • 10+ years of experience in data engineering. • Strong hands-on experience with AWS services: S3, Glue, Lake Formation, Athena, Redshift, Lambda, IAM, CloudWatch. • Proficiency in PySpark, Python, DBT, Airflow, Docker and SQL. • Deep understanding of data modeling techniques and best practices. • Experience with CI More ❯

Director for Technology for Group and Operations The Enterprise Solution Architect for Technology plays a critical role in shaping Aztec Groups technology landscape, ensuring that systems, integrations, and data architectures align with business objectives and market needs. Reporting to the Director for Group and Operations, you will define and govern enterprise-wide technology strategies, focusing on scalability, security … eFront, Yardi, Viewpoint, Fenergo, and Aztec Connect (Client Portal). You will also play a key role in evaluating emerging technologies and establishing best practices for system architecture, data management, and cloud adoption. As a key advisor to senior stakeholders, the Enterprise Solution Architect will bridge business needs with technology capabilities, contributing to the transformation of legacy systems … relevant to enhance scalability and performance. Ensure security, compliance, and resilience are embedded in all architectural designs, addressing key risks in financial services technology. Design and implement robust data management strategies, ensuring high-quality, secure, and accessible data across Aztecs ecosystem. Oversee the development of data pipelines, master data management (MDM), and More ❯

to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be … or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We're technology agnostic, and we're open minded when it More ❯

Architect (AWS) Shape the Future of Cloud Architecture at Verisk A Global Leader in Next-Gen Insurance Technology At Verisk, we empower businesses around the world with advanced data analytics and cloud-native solutions. As pioneers in technology and innovation, we help our clients make faster, smarter decisions using the most powerful tools in data science … Architect (AWS) Shape the Future of Cloud Architecture at Verisk A Global Leader in Next-Gen Insurance Technology At Verisk, we empower businesses around the world with advanced data analytics and cloud-native solutions. As pioneers in technology and innovation, we help our clients make faster, smarter decisions using the most powerful tools in data science … Kubernetes), and microservices Background in secure API development and identity protocols like OAuth, JWT, and OpenID Connect Experience in big data, streaming (Kinesis), and data lake architectures Strong communication, leadership, and stakeholder management skills Bonus: AWS Solutions Architect certification, experience with CI/CD tools like Bamboo & Octopus Deploy Why Join Verisk? Work at the More ❯

Dev Sec Ops automation services, and system integrations using APIs, Webhooks, or other custom integrations of Veeva's infrastructure. Development of automated processes of security tools, coloration of data through analytics, and design of integrated dashboard tools across our multiple platforms. You will be working as a security expert supporting our product development teams on code quality issues … such as Jenkins or CI/CD Automation of security tools into the DevSecOps processes Create best practices, system troubleshooting, or process documentation Write code supporting data lake and data warehouse collection and data transformation processes Maintain security infrastructure, tools, and systems Integration of security tools through APIs, webhook, or other custom integration … based application/service assessment Knowledge of fuzzing, memory corruption, and exploit development Familiar with Jenkins, Bamboo, CI/CD Pipelines, and other automation tools Experience with Big Data technologies such as Elastic, Cloudera, Hadoop, Datadog, or others Experience maintaining security tools and automation scripts to streamline security processes Veeva's headquarters is located in the San Francisco More ❯

Principal Solution Architect Job Summary We are seeking a highly skilled Principal Solution Architect with deep expertise in IT Architecture, AWS Cloud Technologies, and data platform implementation. The ideal candidate will have strong networking knowledge and hands-on experience designing and developing scalable data platforms. This role requires leadership skills, cross-functional collaboration, and the ability … to drive the development of a new global data platform. Key Responsibilities Architectural Design in cloud based environments: Develop and implement robust IT architecture strategies for cloud and hybrid environments, leveraging AWS best practices. Design scalable, secure, and high-availability solutions tailored to business needs. Architect and optimize data platforms to enable efficient data … Route 53, and CloudFront. Configure and troubleshoot complex networking scenarios, including hybrid cloud setups. Manage network performance and security standards, including SLAs, bandwidth, latency, and IPSec VPN configurations. Data Platform Implementation: Lead the design and development of a new global data platform (PaaS) Ensure scalable storage solutions (data lakes, data warehouses) to More ❯