1 to 25 of 30 Data Lake Jobs in the City of London

clearance required £860 per day inside IR35 Role purpose The Data Architect will specify the target design for the data lake, data ingestion, integration, transformation, governance and security architecture. The role acts as the design authority, ensuring the solution is secure, scalable, auditable … operating environments with multiple security classifications. Key responsibilities Define the target data architecture and design principles for the AWS data lake and associated ingestion patterns. Design secure data integration patterns across multiple security classifications and operating environments. Specify API-based, file-based, legacy ...

Data Engineering Lead Department: CSG - Operations Hub (Data/Intelligence/Support) Employment Type: Permanent Location: London - Woolgate Description We are looking for an experienced Data Engineering Lead to play a pivotal role in shaping and delivering our enterprise data platform. This … experience with Microsoft Azure data technologies, including: Azure Data Factory Azure Synapse Analytics Microsoft Fabric Azure Data Lake Advanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable ...

Talan Data x AI is a leading Data Management and Analytics consultancy, working closely with leading software vendors and top industry experts across a range of sectors, unlocking value and insight from their data. At Talan Data x AI, innovation is at the heart … with PySpark and Apache Spark including the fundamentals of how it works. Experience with cloud platforms (e.g., AWS, Azure, GCP) and data lake architectures. Strong experience and programming skills in languages such as Python and SQL and the ability to write complex SQL queries. Use of GitHub ...

Data Architect – Leading Investment Bank – London/Hybrid (Tech stack: Data Architecture, Enterprise Data Strategy, Data Warehouse, Master Data Management, ERP, CRM, BI, ETL/ELT, Azure Data Factory, Data Lakes, RDBMS, NoSQL, AWS Glue … Capital Markets Data) Our client is a leading global investment bank with a strong presence across financial markets and commodities. They are now looking for an experienced Data Architect to help shape and deliver their enterprise-wide data strategy, working across business and technology ...

trusted data models, reusable datasets, reporting foundations and self‐service analytical capabilities. Bring the team onto a centralized snowflake data lake, starting from scratch and ensuring best practices for data stewardship are implemented (data modelling, quality and governance, for example). … analytics solutions. Act as the senior link between Ad Sales and central data platform teams, ensuring that the Snowflake data lake, ingestion patterns and governance controls support the division's current and future BI needs. Collaborating with engineers, analysts and technical teams across the BBC. ...

Contract Business Analyst | Data Lake Migration | Outside IR35 | 6 Months Role: Business Analyst Day rate: £550 p/d (Outside IR35) Location: London – 1 day in the office every fortnight Duration: 6 months Start: ASAP We’re looking for a Business Analyst to join a data lake migration/carve-out project on an initial 6-month contract. You’ll be working between the technical teams and business stakeholders, helping to make sure the right data, reports and applications are identified, tested and signed off as part of the data ...

businesses are the backbone of the economy, and we’re here to help them win. We’ve built a platform that uses clever data to get them the funding they need in minutes, not weeks. At Funding Circle, we have the restless energy of a fintech start … everyone and prioritise work within the engineering team. Experience of working with data platforms (data warehouse/data lake) and understanding the core elements that make up these platforms. Experience of working with Data Scientists, Analysts and/or BI teams ...

Contract Business Analyst | Data Lake Migration | Outside IR35 | 6 Months Role: Business Analyst Day rate: £550 p/d (Outside IR35) Location: London – 1 day in the office every fortnight Duration: 6 months Start: ASAP We’re looking for a Business Analyst to join a data lake migration/carve-out project on an initial 6-month contract. You’ll be working between the technical teams and business stakeholders, helping to make sure the right data, reports and applications are identified, tested and signed off as part of the data ...

Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data‐lead, by equipping them with robust data platforms. You'll also join a data team on its mission … data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. Key responsibilities Define, shape and perfect data strategies in central and local government. Help public sector teams understand the value of their data ...

excellent opportunity for an engineer with strong Python and SQL skills who wants to build broader expertise across software engineering, cloud, data engineering and AI-enabled applications . Rather than focusing on one part of the technology stack, you'll work across backend services, APIs, databases, data … applications and contributing to client projects. Why this role? You’ll gain hands‐on exposure to: AWS cloud & migration Python development SQL, databases & data platforms Data pipelines & ETL/ELT APIs & backend engineering CI/CD & production systems Analytics & modern data platforms AI/ ...

excellent opportunity for an engineer with strong Python and SQL skills who wants to build broader expertise across software engineering, cloud, data engineering and AI-enabled applications . Rather than focusing on one part of the technology stack, you'll work across backend services, APIs, databases, data … applications and contributing to client projects. Why this role? You’ll gain hands-on exposure to: ☁️ AWS cloud & migration 🐍 Python development 🗄️ SQL, databases & data platforms 🔄 Data pipelines & ETL/ELT 🔌 APIs & backend engineering 🚀 CI/CD & production systems 📊 Analytics & modern data platforms 🤖 AI/ ...

CLEARED*** Data Engineer 6 Month contract initially + Extensions Based: Hybrid - Max 2 days p/w onsite. Flexible on location: Newcastle, London, Leeds, Manchester, Blackpool or Sheffield Rate: £400 - £450 p/d - (via Umbrella company) We have a great opportunity with a world leading organisation where … Hive, Impala, Spark) to AWS Cloud. Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon Redshift. Develop and maintain SQL-based data integration, transformation, validation, and reconciliation processes. Integrate and support data services ...

Data Migration Specialist Location: Sheffield, UK (Hybrid/Onsite) Contract Duration: 6 Months Start Date: Immediate Are you a senior Data Migration Specialist with deep expertise in Azure data engineering and enterprise-scale transformations? We are looking for a hands-on technical lead … advanced analytical queries, and reconciliation). Strong Azure Cloud Stack Experience: Azure Data Factory (ADF) Azure SQL DB Azure Data Lake/Lakehouse architectures Python for data manipulation & automation Proven experience across all migration phases: Strategy, Discovery, Cleansing, Mapping, Execution, and Post-migration ...

Data Architect 6 months Hybrid working with 2 to 3 days per week on site in either London or Corsham. Active … clearance required £860 per day inside IR35 Role purpose The Data Architect will specify the target design for the data lake, data ingestion, integration, transformation, governance and security architecture click apply for full job details ...

Summary Our corporate activities are growing rapidly, and we are currently seeking a full-time, office-based Data Engineerto join our AI team. This position will work on a team to accomplish tasks and projects that are instrumental to the company’s success. If you want an exciting … Large Language Models (LLMs) in the Extract, Transform, and Load (ETL) of large corpus of data into a data lake; Participate in the Natural Language Processing (NLP) extract of unstructured data into structured meta-data through the use of tools such ...

About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers, and other engineering teams to ensure seamless data flow and accessibility, supporting … concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelor or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering ...

place of high expectations, integrity, innovation and a willingness to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers, and other … concurrent, high‐throughput, low‐latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering ...

Data Engineer – Consultant/Sr. Consultant Our talented Data Engineering team is made up of globally recognised experts – and there’s room for more analytical, innovative, client‐driven data professionals. If you’re passionate about helping clients make better data‐driven decisions … large‐scale projects Experience in working with the latest Azure technologies, such as Databricks, Microsoft Fabric, Data Factory, Azure Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, AzureML, AIFoundry, Kubernetes Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database ...

Experis - ManpowerGroup is seeking a Data Architect for a 6-month hybrid role, with 2–3 days on site in London … Corsham. Active DV clearance is required, and the daily rate is £860 inside IR35. You will specify target designs for the data lake, ingestion, governance and security architecture, acting as the design authority to ensure secure, scalable, auditable solutions across classified environments. The position requires extensive experience ...

Burns Sheehan is seeking a hands-on Contract Business Analyst to support a data lake migration project in London. You will bridge between technical teams and business stakeholders to ensure the right data, reports and applications are defined, tested and signed off as part ...

North St, Horsham RH12 1RD Role Summary The Alation Technical Consultant is responsible for the implementation, configuration, and ongoing support of the Alation Data Intelligence Platform. The role focuses on onboarding data sources, enabling metadata management and governance capabilities, and ensuring the platform operates effectively … support data discovery, cataloging, and stewardship initiatives. Key Responsibilities Platform Setup & Deployment Install, deploy, and upgrade Alation platform components across cloud and/or on-premises environments. Configure integrations with enterprise infrastructure, authentication services, and security frameworks. Configuration & Administration Configure Alation platform settings, user roles, permissions, workflows, stewardship ...

North St, Horsham RH12 1RD Role Summary The Alation Technical Consultant is responsible for the implementation, configuration, and ongoing support of the Alation Data Intelligence Platform. The role focuses on onboarding data sources, enabling metadata management and governance capabilities, and ensuring the platform operates effectively … support data discovery, cataloging, and stewardship initiatives. Key Responsibilities Platform Setup & Deployment Install, deploy, and upgrade Alation platform components across cloud and/or on-premises environments. Configure integrations with enterprise infrastructure, authentication services, and security frameworks. Configuration & Administration Configure Alation platform settings, user roles, permissions, workflows, stewardship ...

SSML-tuned voice interactions Amazon Connect Platform Engineering Build contact flows that integrate AI agents, Lambda-backed business logic, Customer Profiles, and dynamic data-driven routing Implement Amazon Connect Cases and Tasks solutions: case templates, queue-based work allocation, SLA/TAT monitoring, approval workflows, and migrations from … detection and compliance controls), and workforce management (WFM) integrations for forecasting, scheduling, and adherence (FCS) Build out the Amazon Connect analytics data lake (Glue, Lake Formation, Athena) and QuickSight dashboards for real-time operations and executive reporting Support legacy platform migrations (Avaya, Genesys, Cisco, Oracle, Salesforce ...

Summary Our corporate activities are growing rapidly, and we are currently seeking a full-time, office-based Data Engineer to join our AI team. This position will work on a team to accomplish tasks and projects that are instrumental to the company’s success. If you want … develop and grow your career even further, then this is the opportunity for you. Responsibilities Utilize skills in handling of more unconventional data such as unstructured content from web-based sites and varying content (documents, images etc) into different data lakes and with different software solutions ...

Data Migration Engineer/Data Engineer London (minimum 3 days per week onsite) Outside IR35 Approx. £450/day Contract running through to end of year A Lloyd's of London reinsurer is commencing a major cloud migration programme and is seeking contractors with proven, hands … experience delivering Azure to GCP migrations. Essential Experience Must have delivered a migration of data platforms, pipelines, or workloads from Azure to Google Cloud Platform (GCP). Demonstrable experience mapping and migrating Azure services to their GCP equivalents. Experience migrating data warehouses, data lakes ...