101 to 125 of 149 Data Lake Jobs in London

Director for Technology for Group and Operations The Enterprise Solution Architect for Technology plays a critical role in shaping Aztec Groups technology landscape, ensuring that systems, integrations, and data architectures align with business objectives and market needs. Reporting to the Director for Group and Operations, you will define and govern enterprise-wide technology strategies, focusing on scalability, security … eFront, Yardi, Viewpoint, Fenergo, and Aztec Connect (Client Portal). You will also play a key role in evaluating emerging technologies and establishing best practices for system architecture, data management, and cloud adoption. As a key advisor to senior stakeholders, the Enterprise Solution Architect will bridge business needs with technology capabilities, contributing to the transformation of legacy systems … relevant to enhance scalability and performance. Ensure security, compliance, and resilience are embedded in all architectural designs, addressing key risks in financial services technology. Design and implement robust data management strategies, ensuring high-quality, secure, and accessible data across Aztecs ecosystem. Oversee the development of data pipelines, master data management (MDM), and More ❯

to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be … or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We're technology agnostic, and we're open minded when it More ❯

Architect (AWS) Shape the Future of Cloud Architecture at Verisk A Global Leader in Next-Gen Insurance Technology At Verisk, we empower businesses around the world with advanced data analytics and cloud-native solutions. As pioneers in technology and innovation, we help our clients make faster, smarter decisions using the most powerful tools in data science … Architect (AWS) Shape the Future of Cloud Architecture at Verisk A Global Leader in Next-Gen Insurance Technology At Verisk, we empower businesses around the world with advanced data analytics and cloud-native solutions. As pioneers in technology and innovation, we help our clients make faster, smarter decisions using the most powerful tools in data science … Kubernetes), and microservices Background in secure API development and identity protocols like OAuth, JWT, and OpenID Connect Experience in big data, streaming (Kinesis), and data lake architectures Strong communication, leadership, and stakeholder management skills Bonus: AWS Solutions Architect certification, experience with CI/CD tools like Bamboo & Octopus Deploy Why Join Verisk? Work at the More ❯

Dev Sec Ops automation services, and system integrations using APIs, Webhooks, or other custom integrations of Veeva's infrastructure. Development of automated processes of security tools, coloration of data through analytics, and design of integrated dashboard tools across our multiple platforms. You will be working as a security expert supporting our product development teams on code quality issues … such as Jenkins or CI/CD Automation of security tools into the DevSecOps processes Create best practices, system troubleshooting, or process documentation Write code supporting data lake and data warehouse collection and data transformation processes Maintain security infrastructure, tools, and systems Integration of security tools through APIs, webhook, or other custom integration … based application/service assessment Knowledge of fuzzing, memory corruption, and exploit development Familiar with Jenkins, Bamboo, CI/CD Pipelines, and other automation tools Experience with Big Data technologies such as Elastic, Cloudera, Hadoop, Datadog, or others Experience maintaining security tools and automation scripts to streamline security processes Veeva's headquarters is located in the San Francisco More ❯

Principal Solution Architect Job Summary We are seeking a highly skilled Principal Solution Architect with deep expertise in IT Architecture, AWS Cloud Technologies, and data platform implementation. The ideal candidate will have strong networking knowledge and hands-on experience designing and developing scalable data platforms. This role requires leadership skills, cross-functional collaboration, and the ability … to drive the development of a new global data platform. Key Responsibilities Architectural Design in cloud based environments: Develop and implement robust IT architecture strategies for cloud and hybrid environments, leveraging AWS best practices. Design scalable, secure, and high-availability solutions tailored to business needs. Architect and optimize data platforms to enable efficient data … Route 53, and CloudFront. Configure and troubleshoot complex networking scenarios, including hybrid cloud setups. Manage network performance and security standards, including SLAs, bandwidth, latency, and IPSec VPN configurations. Data Platform Implementation: Lead the design and development of a new global data platform (PaaS) Ensure scalable storage solutions (data lakes, data warehouses) to More ❯

About Monte Carlo As businesses increasingly rely on data + AI for competitive advantage, reliability has become a non-negotiable. Named a CBInsights AI100 company and described by Forbes as the "New Relic for data", Monte Carlo supports some of the world's most prestigious companies, including Fox, Roche, Honeywell, and CreditKarma to deliver trustworthy data + AI at scale. Backed by Accel, Redpoint Ventures, Notable Capital, ICONIQ Growth, and Salesforce Ventures, Monte Carlo is powering the future of reliable data + AI. About the role: We're looking for an experienced customer-facing Solutions Architect who loves helping people, solving problems, and wants to be a major factor in the success … scope based on the customer's needs and requirements, guide clear outcomes, and communicate technical and value propositions. Deliver implementations of Monte Carlo, including on complicated data lake environments. Define "best practice" approaches for achieving a desired technical capability through Monte Carlo. Deliver training and enablement on advanced technical concepts to technical customers. Create collateral, documentation, and More ❯

We're hiring a Senior Data Engineer (Genetics) to join us on 12 months FTC to support Maternity Cover. This role will be working within our Bioinformatics Team working on genetic data and building pipelines to process, control and create data releasees for Researchers. Our Future Health is the UK's largest ever health … new discoveries about human health and diseases. So future generations can live in good health for longer. What You'll Be Doing: Support the build of production-level data pipelines from data providers to our primary data store and Trusted Research Environment. Work closely with the Lead Data Engineer on key designs … and features. Build and maintain pipelines which meets the requirements for our end users and builds well curated, accessible and quality controlled data for analysis. Keep abreast of best practice in data engineering across industry, research and Government and facilitating the adoption of standards. Work to promote the adoption of best practises across the squad (unit More ❯

CDP implementation projects, from discovery and requirements gathering to go-live and post-implementation support. Translate business goals into scalable CDP use cases, ensuring alignment with marketing, CRM, data governance, and IT teams. Design and implement integration flows between CDP and various systems (Web, mobile, ad tech, analytics, etc.). Guide clients on data ingestion, identity … teams and maintain detailed implementation documentation. Essential skills and experience: Experience working in a consulting environment and/or digital agency, ideally in MarTech, Digital analytics implementation or data-related roles. Strong problem-solving skills and ability to think critically in complex technical environments. Demonstrated experience with technologies and processes related to marketing automation, personalisation, and data … and tag managers such as Google Analytics (GA) and Google Tag Manager (GTM). Proven experience in web and mobile app tracking implementation and optimization. Solid understanding of data analysis and reporting, with an ability to translate insights into actionable recommendations. Ability to translate business requirements into high-level solution design, aligning technical capabilities with strategic objectives. Familiarity More ❯

Senior Python Software Engineer (Senior Architecture Programmer Developer Python Java Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services FX Fixed Income Equities Commodities Derivatives Hedge Fund) required … Trading, Front Office finance Spark Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Python Software Engineer (Senior Architecture Programmer Developer Python Java Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front … used across the Front Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Python, Java and AWS. If you have any experience in Iceberg, Dremio More ❯

At Gorilla , we're building the data infrastructure that powers energy companies on their journey to net-zero. As a Lead/Staff Data Platform Engineer, you'll play a key role in defining and scaling our data platform to meet the increasing complexity and volume of data-driven use cases in … designing the architecture, improving the developer experience, and guiding our platform strategy with a strong focus on performance, security, and scalability. Your Role SaaS experience in high-load, data-intensive environments. Lead the technical vision and strategy of our internal data platform, influencing architectural decisions and establishing best practices across the engineering organization. Design, implement, and … infrastructure, monitoring key systems, and leading incident response and root cause analysis for platform-related issues. Evaluate and introduce new technologies and practices (e.g., container orchestration, data lake solutions, workflow orchestration tools) based on evolving business needs. What You'll Need Proven experience designing, building, and scaling data platforms or backend infrastructure in production environments. More ❯

Principal Data Engineer/Architect (Snowflake AWS SQL Python) London/WFH to £140k Opportunity to progress your career in an impactful Principal Data Engineer role at a growing technology company as they scale their UK presence. As a Principal Data Engineer you will lead the architecture and design of the Data Platform using Snowflake and AWS. Collaborating with product and engineering colleagues as well as internal business stakeholders on the product backlog for the Data Platform, you'll ensure solutions are secure and scalable and promote best practices in CI/CD, IaC and DataOps. Location/WFH: You'll be bale to work from home most … of the time, meeting up with colleagues in the London office once or twice a week. About you: You are a highly technical Data Engineer/Architect with experience of designing data lakes, data pipelines and meta data management You have strong Snowflake and AWS data services experience You have More ❯

daily to our panel of over 24 million registered members to understand opinion and behaviors around the world. We have a strong reputation as a source of accurate data and were trusted by the worlds biggest brands to get it right, making us the most quoted market research source in the world. With operations in the UK, North … East, India and Asia Pacific, YouGov has one of the worlds largest research networks. About Brandindex BrandIndex is YouGov's flagship brand intelligence platform that transforms consumer survey data into insights for businesses: it monitors thousands of brands globally to deliver a comprehensive view of brand health. Through continuous data collection and analysis, BrandIndex enables customers … and MySQL Exposure to Docker, Kubernetes, AWS, Helm, Terraform, Vault, Grafana, ELK Stack, New Relic Relevant experience in the maintenance of data APIs and data lake architectures, including experience with Apache Iceberg, Trino/Presto, Clickhouse, Snowflake, BigQuery. Master's degree in Computer Science or Engineering-related field #LI-PM1 Get to know us better... More ❯

daily to our panel of over 24 million registered members to understand opinion and behaviors around the world. We have a strong reputation as a source of accurate data and we're trusted by the world's biggest brands to get it right, making us the most quoted market research source in the world. With operations in the … India and Asia Pacific, YouGov has one of the world's largest research networks. About Brandindex BrandIndex is YouGov's flagship brand intelligence platform that transforms consumer survey data into insights for businesses: it monitors thousands of brands globally to deliver a comprehensive view of brand health. Through continuous data collection and analysis, BrandIndex enables customers … and MySQL Exposure to Docker, Kubernetes, AWS, Helm, Terraform, Vault, Grafana, ELK Stack, New Relic Relevant experience in the maintenance of data APIs and data lake architectures, including experience with Apache Iceberg, Trino/Presto, Clickhouse, Snowflake, BigQuery. Master's degree in Computer Science or Engineering-related field Get to know us better YouGov is More ❯

Architect role at Verisk 4 days ago Be among the first 25 applicants Principal Software Architect At Verisk Analytics, were driving the future of insurance with world-class data analytics and risk assessment solutions. As a global tech leader, we empower insurers to make faster, smarter decisions through the power of advanced AI, machine learning, and cutting-edge … Architecture & Solution Design: Oversee the technical architecture of our solutions, ensuring they meet performance, scalability, and security requirements. Design and develop scalable AWS architectures for API-based and data-centric applications. Define data pipelines, ETL processes, and storage solutions using AWS services such as S3, OpenSearch, Redshift, Step Functions, Lambda, Glue, and Athena. Architect RESTful APIs … of networking, security, authentication, and authorization (OAuth, JWT, OpenID Connect, IAM roles, etc.). Familiarity with big data technologies, streaming platforms like Kinesis, and data lake architectures. Proficiency in C#, Python, or Node.js for backend development and scripting. Strong problem-solving, analytical, and communication skills. AWS certification (e.g., AWS Certified Solutions Architect Professional) is a More ❯

Involvement in school improvement initiatives. Familiarity with school/trust Financial Management Systems (FMS). Knowledge of school/trust budget planning. Ability to manage a data lake, including data ingestion, storage, governance, and integration with analytics tools. Advanced proficiency in Microsoft Office suite. Strong customer relationship management skills. Skilled in technical writing. Competence in More ❯

as specialist practices Publicis Media Exchange (PMX), Performics, Publicis Sport & Entertainment, Publicis Media Content and NextTECHnow. Together they combine deep expertise in media investment, strategy, insights and analytics, data and technology, commerce, performance marketing and content. Publicis Media is part of Publicis Groupe and is present in more than 100 countries with over 23,500 employees worldwide. Our … engineering talent, and contribute to the growth of our business Responsibilities Guide a team of engineers in developing applications that empower our clients to optimize marketing campaigns through data-driven insights and automated actions, with a specific focus on leveraging LLMs and AI Own the technical roadmap for your team, aligning it with the overall product strategy and … asynchronous queues (e.g., Kafka, RabbitMQ) and asynchronous APIs Deep understanding of cloud infrastructure (AWS, GCP) and experience deploying and managing applications at scale. Strong understanding of data lake architectures, including experience with data ingestion, storage, processing, and retrieval of large volumes of structured and unstructured data Familiarity with containerization technologies like Docker and More ❯

trading platforms, and/or IBA systems). Architecting solutions with Microsoft Azure technologies, Sales force (including Force.com) technologies and modern data platforms (e.g. Data lake house architecture) and Business Intelligence (e.g. Microsoft Power BI) technologies Knowledge of Enterprise Architecture tools (experience in BizzDesign) Good knowledge and awareness of enterprise-grade CRM, HR and Finance More ❯

trading platforms, and/or IBA systems). Architecting solutions with Microsoft Azure technologies, Sales force (including Force.com) technologies and modern data platforms (e.g. Data lake house architecture) and Business Intelligence (e.g. Microsoft Power BI) technologies Knowledge of Enterprise Architecture tools (experience in BizzDesign) Good knowledge and awareness of enterprise-grade CRM, HR and Finance More ❯

trading platforms, and/or IBA systems). Architecting solutions with Microsoft Azure technologies, Sales force (including Force.com) technologies and modern data platforms (e.g. Data lake house architecture) and Business Intelligence (e.g. Microsoft Power BI) technologies Knowledge of Enterprise Architecture tools (experience in BizzDesign) Good knowledge and awareness of enterprise-grade CRM, HR and Finance More ❯

goals are met in a powerful combination of relevant solutions. Hereworks' business is growing internationally as a "Full-Stack" Smart Building Contractor. This "full-stack approach" encompasses the data layer, where we leverage our expertise as a Master Systems Integrator (MSI). The company's installation team manages hardware integration, deploying smart technologies like Indoor Environmental Quality (IEQ … What do you need? (Requirements) Good understanding of networking principles Experience working in AWS, GCP, Azure and migration of data from building outputs to data lake an advantage Previous experience working with a Master Systems Integrator is an advantage Experience with secure MQTT Must have excellent verbal and written communication skills Strong interpersonal skills and More ❯

SQL, ETL, Azure Senior Data Engineer is required to join a forward-thinking data team within a thriving city-based insurance group. This role will see you playing a critical role in delivering reliable, scalable and business-focused data solutions. With a strong focus on Microsoft technologies and cloud-based tools, you’ll work … through data. The ideal candidate here will have a strong background in insurance MI or reporting—experience within an MGA or insurance carrier is essential. Key Responsibilities Deliver data solutions and changes that support evolving business requirements. Build and maintain robust, scalable data pipelines using SQL and ETL best practices. Collaborate with stakeholders to analyse, define … and implement solutions to complex data challenges. Proactively assess the impact of changes on the broader data model and ensure integrity is maintained. Work alongside the MI/reporting team to ensure data is accurately reflected in dashboards and reporting tools. Consult with business analysts, system owners and architects to align technical delivery with More ❯

Our Data Services Team offers a variety of data products with a strong focus on engineering, including data science and data analytics, to help our business users, mainly trading teams, make data-driven decisions and improve their business operations. At Macquarie, our advantage is bringing together diverse people and empowering … profitability. You'll be part of a friendly and supportive team where everyone - regardless of role - contributes ideas and drives outcomes. What role will you play? As a Data Platform Engineer, you will join our dynamic Engineering team developing cutting-edge data product solutions. You will build and maintain applications ranging from cloud infrastructure automation, APIs … technologies. What you offer A dynamic individual with a strong DevOps and Engineering background who loves solving problems and building automation and CI/CD pipelines in the data space and cloud infrastructure. Proficiency in writing infrastructure as code for public cloud environments. Experience with Python coding/testing or any cloud-based technology (AWS preferred). Experience More ❯

in alignment with business priorities. Support the launch of new products and streamline maintenance of existing products. Technical Skills & Knowledge: Proven experience in technical architecture, including UIs, microservices, data lakes, APIs, RDBMS, and NoSQL databases. Strong understanding of Agile and SAFe methodologies. Experience designing solutions in distributed, resilient environments and integrating enterprise applications. Cloud architecture expertise (AWS preferred More ❯

in alignment with business priorities. Support the launch of new products and streamline maintenance of existing products. Technical Skills & Knowledge: Proven experience in technical architecture, including UIs, microservices, data lakes, APIs, RDBMS, and NoSQL databases. Strong understanding of Agile and SAFe methodologies. Experience designing solutions in distributed, resilient environments and integrating enterprise applications. Cloud architecture expertise (AWS preferred More ❯

ambiguity environment. Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools, and … ambiguity environment. Build, train, and deploy state-of-the-art models (e.g., deep learning, NLP, computer vision, reinforcement learning, or relevant domain-specific architectures). Design infrastructure for data ingestion, annotation, experimentation, model versioning, and monitoring. Collaborate closely with product, design, and DevOps to integrate AI features into our platform. Continuously evaluate new research, open-source tools, and … and grow an AI/ML team as we scale beyond our seed round. Key Responsibilities Architecture & Hands-On Development Define and implement end-to-end AI pipelines: data collection/cleaning, feature engineering, model training, validation, and inference. Rapidly prototype novel models (e.g., neural networks, probabilistic models) using PyTorch, TensorFlow, JAX, or equivalent. Productionize models in cloud More ❯