1 to 25 of 102 Data Lake Jobs in London

Bristol, Cardiff, Edinburgh, London, Manchester Overview We are seeking to hire experienced Data Solution Architects in the Data & AI Architecture team of Deloitte's AI & Data offering. Data is the key enabler for the rapid growth journey across the Energy Resources & Industrials industries. Our team delivers transformational data solutions to … benefit our clients, their customers and any relevant government agencies or regulators. The Energy Resources & Industrial industry is undergoing a significant transformation, driven by the increasing importance of data and analytics. Enterprises are turning to decentralised data management approaches such as Data Mesh and disruptive technologies to build innovative and domain-oriented data … designing and implementing complex data solutions across areas such as data integration, data modelling, data management and governance, data Lake/Lakehouse/Data Mesh, data engineering, analytics, AI/GenAI, observability, cloud, security. Experience aligning data architecture blueprints across business units and More ❯

that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … re underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP More ❯

Join our rapidly expanding team as a hands-on Cloud Data Analytics Platform Engineer and play a pivotal role in shaping the future of data at Citi. We're building a cutting-edge, multi-cloud data analytics platform that empowers our users with secure, scalable, and efficient data insights. This role sits … like S3/GCS, Glue, BigQuery, Pub/Sub, SQS/SNS, MWAA/Composer, and more to create a seamless data experience. (Required) Data Lake , Data Zone, Data Governance: Design, build, and manage data lakes and data zones within our cloud environment, ensuring data … Infrastructure Automation Cloud Expertise: Proven hands-on experience with AWS and/or GCP, including a deep understanding of their data analytics service offerings. Data Lake/Zone/Governance Experience: Demonstrable experience designing, building, and managing data lakes and data zones. Familiarity with data governance tools and frameworks. More ❯

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to … a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. You will collaborate with stakeholders to understand their strategic … approaches and can apply data security and privacy strategy to solve business problems. You have experience with different types of databases (i.e.: SQL, NoSQL, data lake, data schemas, etc.). Professional Skills You understand the importance of stakeholder management and can easily liaise between clients and other key stakeholders throughout projects, ensuring buy More ❯

London - Lead Solutions Data Architect, Data Engineering Ekimetrics UK Job Description About Ekimetrics Ekimetrics is a leader in data science and AI, specialising in Marketing Effectiveness, Customer Analytics and business optimisation since 2006. We have pioneered the use of AI to drive sustainable growth, helping companies across industries like retail, banking, luxury fashion, insurance … and many more to maximise their data potential. Our goal: Combine high-impact AI and data science solutions for sustainable business performance. Our approach combines cutting-edge technology with a deep understanding of business challenges, ensuring that our solutions not only meet current needs but also pave the way for future innovations. At Ekimetrics, your work … will directly contribute to shaping the future of data-driven decision-making in a sustainable, ethical manner. About the Role Based in London and reporting to our Head of Data Engineering, you will lead large-scale digital transformations, building bespoke analytics solutions to answer clients' key questions, develop solutions around Geni AI, and consult on the More ❯

As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of their data assets through robust data … a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables … analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's AI transformation agenda, seeking skilled data specialists to architect and implement advanced analytics solutions for critical public sector and defence organisations. As part of More ❯

This newly created Data Engineer Managers position is an excellent opportunity for a hands-on Senior Data Engineer/Technical Lead/Engineering Team Lead etc looking to move into a management position. The postholder will lead and mentor a team of 3 Data Engineers whilst overseeing data platform development and optimisation. … Our client is a well-established and rapidly growing global ecommerce business with its headquarters based in London. The Data Engineer Manager will play a pivotal role at the heart of our clients data & analytics operation. Having implemented a new MS Fabric based Data platform, the need is now to scale up and meet … the demand to deliver data driven insights and strategies right across the business globally. Therell be a hands-on element to the role as you'll be troubleshooting, doing code reviews, steering the team through deployments and acting as the escalation point for data engineering. This is a hybrid role based in Central/West London More ❯

up of product, development, commercial, operations, marketing, partnerships and more - all focused together on making Octopus the go-to name in EV charging. We are seeking a passionate data professional to drive the electrification of transport by transforming complex information into strategic assets. You will work with a rich variety of datasets, including charge point telemetry, user behaviour … we can teach that), but a passion for the transition to net zero is an excellent start What We Work With dbt for data modelling Databricks Delta Lake for data lake and warehouse storage and querying Python as our main programming language Jupyter and Jupyter Hub for notebook analytics and collaboration Circle CI for … task orchestration Google Analytics, Amplitude and Firebase for client applications event processing Airflow for job scheduling and tracking Parquet and Delta file formats on S3 for data lake storage Streamlit for data applications Why else you'll love it here Wondering what the salary for this role is? Just ask us! On a call with More ❯

with GenAI consulting specialist? Do you have real-time Data Analytics, Data Warehousing, Big Data, Modern Data Strategy, Data Lake, Data Engineering and GenAI experience? Do you have senior stakeholder engagement experience to support pre-sales and deliver consulting engagements? Do you like to solve the most … complex and high scale (billions+ records) data challenges in the world today? Do you like leading teams through high impact projects that use the latest data analytics technologies? Would you like a career path that enables you to progress with the rapid adoption of cloud computing? AWS Professional Services Public Sector ANZ are hiring a highly … learn and use services such as AWS Glue, Amazon S3, Amazon DynamoDB, Amazon Relational Database Service (RDS), Amazon Elastic Map Reduce (EMR), Amazon Kinesis, Amazon Redshift, Amazon Athena, AWS Lake Formation, Amazon DataZone, Amazon SageMaker, Amazon Quicksight and Amazon Bedrock. Solutions: Support pre-sales and deliver technical engagements with partners and customers. This includes participating in pre-sales visits More ❯

Overview We're seeking a Senior Data Scientist to lead the development of advanced analytics and AI/ML solutions that unlock real value across our business. This is a contract role for 6 months . In this contract role, you'll work with proprietary and B2B research datasets to design, deliver, and scale data-driven … Research, and Technology, you'll help turn strategic ideas into working MVPs-ensuring high standards of methodology, quality, and business relevance throughout. You'll also help shape the data science environment by working alongside our tech teams to support a robust and flexible infrastructure, including sandbox environments for onboarding and evaluating new data sources. This is … analytics "products" could be refined and productionized in the future. Work with Tech colleagues to improve the Data Science workspace, including providing requirements for Data Lake, Data Pipeline, and Data Engineering teams. Expand on the tools and techniques already developed. Help us understand our customers (both internal and external) better so More ❯

Data Services Manager, Must live within 2 hours of London and be able to come in for ad-hoc meetings when required. Primarily home based though. Role 90% management and 10% technical and you will manage a team of 6. Salary £ 80000 - 85000 + good benefits. Expanding financial services client are looking for a Data Services … years and is looking to further develop their management career. Guiding a team of 6 you will be responsible for supporting the day to day operations of the data function, with a focus on leading and mentoring data engineers to deliver high quality, scaleable data solutions. Working across the business with multiple stakeholders you … mentoring, coaching, team development etc) Very strong technical skills that will include - SQL, SSIS, SSRS, SAS, Power BI, Power Platform, Azure Data Factory, Azure Data Lake, Databricks A good understanding of dimensional modelling techniques, including Kimball's Business Development Lifecycle Ability to design hybrid data solutions across on-prem and cloud data More ❯

Senior Data Architect Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to Be Yourself At Work. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we recruit and develop as diverse a range of talent … Focused on maintaining our nimble, agile and entrepreneurial culture. Your Capco Day/Key Responsibilities You will accompany and lead complex agile consulting projects supporting our clients with data architecture design and delivery. You will work with technology leaders across Financial Services to provide best practice guidance for data management and data architecture development … . Knowledge of the relevant procedures, architectures and technologies in one or more of the following topics: Contextual Datamodelling, Entity Relationship Modelling, Logical & Physical Datamodelling and Data Lake design. Experience designing and implementing cloud data migration and storage patterns on one or more of AWS, GCP and Microsoft Azure Experience implementing and integrating data More ❯

been turning down headhunters for years. Whatever your priorities - work/life balance, career progression, sustainability, volunteering - you'll find like-minded people driving change at Howden. Lead Data Business Partner We are looking for a talented Data Business Partner to help pro-actively drive data and AI strategy supporting both our DUAL MGA … operating efficiencies, capturing benefit and ROI. Scoping out landscape, baseline and country health-check comparisons within the region. Understanding what data is in the Data Lake and how this can be leveraged, including looking for common opportunities and supporting prioritisation of the data ingestion roadmap. Stakeholder management directly managing relationships with the commercial … understand the costs/benefits and managing business expectations on delivery. Enabling regional colleagues to complete reporting tasks with PowerBI using data from the Data Lake, understanding content and how to get value out of it. Being the point person for Data Quality and remediation, working with the Group Data Quality More ❯

Data Services Manager, Must live within 2 hours of London and be able to come in for ad-hoc meetings when required. Primarily home based with occasional office meetings. Role 90% management and 10% technical and you will manage a team of 6. Salary £ 80000 - 85000 + good benefits. Expanding financial services client are looking for a Data … years and is looking to further develop their management career. Guiding a team of 6 you will be responsible for supporting the day to day operations of the data function, with a focus on leading and mentoring data engineers to deliver high quality, scaleable data solutions. Working across the business with multiple stakeholders you … and then into a management Very strong technical skills that will include - SQL, SSIS, SSRS, SAS - Power BI, Power Platform - Azure Data Factory, Azure Data Lake, Databricks A good understanding of dimensional modelling techniques, including Kimball's Business Development Lifecycle Ability to design hybrid data solutions across on-prem and cloud data More ❯

Data Engineer - Azure/Microsoft Fabric City of London - Hybrid Working Circa £60k-70k + Bonus & Benefits Our client, a forward-thinking and globally connected staffing & consulting organization is seeking a skilled and driven Data Engineer to join their growing Data & Analytics team. Based in the City of London, this role presents a fantastic … a data engineering or similar technical role Hands-on experience with key Microsoft Azure services: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Azure SQL Database Solid understanding of data modeling, ETL/ELT, and warehousing concepts Proficiency in SQL and one or more programming languages (e.g., Python, Scala … with software testing methodologies and development team collaboration Experience working with Power BI and DAX Strong documentation, communication, and stakeholder engagement skills Preferred Qualifications: Experience with Lakehouse architecture, Delta Lake, or Databricks Exposure to Agile/Scrum working practices Microsoft certifications (e.g., Azure Data Engineer Associate) Background in consulting or professional services Understanding of data More ❯

As a Senior Data Engineer specializing in Natural Gas and Power, you will support the design, development, and optimization of advanced data infrastructure and products that support critical trading, risk, and market analytics functions. You will collaborate closely with traders, quantitative analysts, risk managers, and IT stakeholders to ensure data systems are scalable, secure … ETL/ELT frameworks and orchestration tools (e.g., Airflow, Azure Data Factory, Dagster). Proficient in cloud platforms (preferably Azure) and services such as Data Lake, Synapse, Event Hubs, and Functions. Authoring reports and dashboards with either open source or commercial products (e.g. PowerBI, Plot.ly, matplotlib) Programming OOP DevOps Web technologies HTTP/S REST … with time-series databases (e.g., InfluxDB, kdb+, TimescaleDB) and real-time data processing. Familiarity with distributed computing and data warehousing technologies (e.g., Spark, Snowflake, Delta Lake). Strong understanding of data governance, master data management, and data quality frameworks. Solid grasp of web technologies and APIs (REST, JSON, XML More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver … data solutions and integration pipelines in accordance with agreed organizational standards that ensure services are resilient, scalable and future-proof Collaborate with cross-functional teams to define and implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data … of traditional and distributed computing paradigm. Experience in designing and building scalable data pipelines. Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have More ❯

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, youll not only be part of a creative and open work culture focused on innovation and … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … workflows with Composer or Vertex Pipelines. Data Architecture & Modelling: Ability to translate diverse business requirements into scalable data models and architect a data lake/lakehouse environment on GCP. Engineering Best Practices: Proficiency with Git, CI/CD for data systems, and robust testing methodologies. Highly desirable skills include: Domain Experience More ❯

it is deeply rooted throughout our work, to elevate and bring to life our differences throughout the platform world Overview We are seeking an experienced and highly skilled Data Engineering Technical Lead to drive the design, development, and optimization of our cloud-based data platforms and solutions. This role will be a blend of hands on … and strategy decisions. Initially there will be a focus on GCP but will also involve working extensively with Snowflake and Databricks, as well as other modern cloud and data engineering tools. As the technical leader for the data engineering function, you will define architectural standards, mentor engineers, and collaborate with cross-functional teams to ensure scalable … enterprise-grade data platforms on GCP, AWS, or Azure Deep expertise in data modeling, data warehousing, distributed systems, and modern data lake architectures Advanced proficiency in Python (including PySpark) and SQL, with experience building scalable data pipelines and analytics workflows Strong background in cloud-native data infrastructure More ❯

Sr. Delivery Consultant - Data Analytics, Professional Services Job ID: Amazon Web Services Colombia S.A.S. - E40 The Professional Services (ProServe) team is seeking a skilled Sr. Delivery Consultant - Data Analytics to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS solutions that … through their cloud journey, providing technical expertise and best practices throughout the project lifecycle. Possessing a deep understanding of AWS products and services, as a Sr. Delivery Consultant - Data Analytics you will be proficient in architecting complex, scalable, and secure solutions tailored to meet the specific needs of each customer. You'll work closely with stakeholders to gather … processing. Key job responsibilities As an experienced technology professional, you will be responsible for: - Help the customer to define and implement data architectures (Data Lake, Lake House, Data Mesh, etc). Engagements include short on-site projects proving the use of AWS Data services to support new distributed computing More ❯

Shape the Future of Data - Azure Data Architect - Hybrid - London SE1 Job Title: Data Architect - Azure Platform Specialist Location: Hybrid - 1-2 days per week in London (SE1). 3-4 days remote Salary: £90 - £115K OTE including bonus Start: ASAP The Client: A Microsoft-focused digital consultancy at the forefront of AI, Cloud … and Data transformation. As a Microsoft Fabric Featured Partner, they design and deliver cutting-edge data solutions to clients in sectors including finance, pharma, energy, insurance, and retail. The Candidate: Were looking for a confident and technically strong Azure Data Architect with experience shaping modern, scalable data platforms. The role would suit … more of the following platforms: Azure Synapse Analytics and Azure Databricks, and supporting data technologies like Power BI, Microsoft Purview, Azure SQL Database, Azure Data Lake, etc. Excellent stakeholder engagement and communication skills. Able to consult, advise, architect and estimate project work. Strong analysis, requirements gathering and data modelling. Solid data More ❯

Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Description: We are looking for a seasoned AWS Data Engineer to join our team and contribute to the development of scalable, secure, and high-performance data solutions. This role involves modernizing mainframe legacy systems, building robust … data pipelines, and enabling advanced analytics using AWS-native technologies. You’ll collaborate with cross-functional teams and play a key role in shaping our data strategy. Skills Must have : Proven experience in designing and maintaining scalable data lakes using AWS S3, with strong understanding of data lifecycle, access control, and performance … AWS CloudFormation and Terraform to automate and manage cloud resources. Experience developing ETL workflows using AWS Glue, querying data with Athena, and managing access and governance with Lake Formation. Strong command of AWS Lambda for serverless data processing and Boto3 for programmatic interaction with AWS services. Demonstrated experience working with GDPR-compliant architectures and handling More ❯