1 to 25 of 31 Data Lake Jobs in Central London

clearance required £860 per day inside IR35 Role purpose The Data Architect will specify the target design for the data lake, data ingestion, integration, transformation, governance and security architecture. The role acts as the design authority, ensuring the solution is secure, scalable, auditable … operating environments with multiple security classifications. Key responsibilities Define the target data architecture and design principles for the AWS data lake and associated ingestion patterns. Design secure data integration patterns across multiple security classifications and operating environments. Specify API-based, file-based, legacy ...

every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake to a modern dimensional model, finish the rollout of a principle-of-least-privilege security model across a multi-server SQL estate, and continue … personally delivering target architecture for the ECP data estate the data warehouse, data hub, data lake, raw/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. Hands-on T-SQL, stored procedure ...

Talan Data x AI is a leading Data Management and Analytics consultancy, working closely with leading software vendors and top industry experts across a range of sectors, unlocking value and insight from their data. At Talan Data x AI, innovation is at the heart … with PySpark and Apache Spark including the fundamentals of how it works. Experience with cloud platforms (e.g., AWS, Azure, GCP) and data lake architectures. Strong experience and programming skills in languages such as Python and SQL and the ability to write complex SQL queries. Use of GitHub ...

businesses are the backbone of the economy, and we’re here to help them win. We’ve built a platform that uses clever data to get them the funding they need in minutes, not weeks. At Funding Circle, we have the restless energy of a fintech start … everyone and prioritise work within the engineering team. Experience of working with data platforms (data warehouse/data lake) and understanding the core elements that make up these platforms. Experience of working with Data Scientists, Analysts and/or BI teams ...

Contract Business Analyst | Data Lake Migration | Outside IR35 | 6 Months Role: Business Analyst Day rate: £550 p/d (Outside IR35) Location: London – 1 day in the office every fortnight Duration: 6 months Start: ASAP We’re looking for a Business Analyst to join a data lake migration/carve-out project on an initial 6-month contract. You’ll be working between the technical teams and business stakeholders, helping to make sure the right data, reports and applications are identified, tested and signed off as part of the data ...

Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data‐lead, by equipping them with robust data platforms. You'll also join a data team on its mission … data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. Key responsibilities Define, shape and perfect data strategies in central and local government. Help public sector teams understand the value of their data ...

excellent opportunity for an engineer with strong Python and SQL skills who wants to build broader expertise across software engineering, cloud, data engineering and AI-enabled applications . Rather than focusing on one part of the technology stack, you'll work across backend services, APIs, databases, data … applications and contributing to client projects. Why this role? You’ll gain hands-on exposure to: ☁️ AWS cloud & migration 🐍 Python development 🗄️ SQL, databases & data platforms 🔄 Data pipelines & ETL/ELT 🔌 APIs & backend engineering 🚀 CI/CD & production systems 📊 Analytics & modern data platforms 🤖 AI/ ...

CLEARED*** Data Engineer 6 Month contract initially + Extensions Based: Hybrid - Max 2 days p/w onsite. Flexible on location: Newcastle, London, Leeds, Manchester, Blackpool or Sheffield Rate: £400 - £450 p/d - (via Umbrella company) We have a great opportunity with a world leading organisation where … Hive, Impala, Spark) to AWS Cloud. Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon Redshift. Develop and maintain SQL-based data integration, transformation, validation, and reconciliation processes. Integrate and support data services ...

Contract Delivery Manager – Global Data Strategy 📍 Location: London/Hybrid 💼 Contract: 6 months+ 💰 Rate: c£400 per day Are you an experienced Delivery Manager with a strong background in data initiatives and technical delivery We’re looking for a Contract Data Delivery Manager … join a Global Data Strategy function, helping multiple engineering teams deliver high-quality data products, programmes and projects aligned to strategic business objectives. This is an opportunity to step into a complex data environment and make an immediate impact — bringing teams together, managing dependencies ...

Senior Data Engineer (Python SQL AWS) London/WFH to £120k Do you have experience of building data pipelines within finance/Fintech environments? You could be progressing your career in a senior, hands-on Data Engineer role at a scaling Investment Research tech … company in an impactful role with great benefits and perks. As a Senior Data Engineer you will be at the intersection of data engineering, database management and platform delivery. You will help build and evolve a modern, scalable AWS cloud based data platform. Your ...

Data Architect 6 months Hybrid working with 2 to 3 days per week on site in either London or Corsham. Active … clearance required £860 per day inside IR35 Role purpose The Data Architect will specify the target design for the data lake, data ingestion, integration, transformation, governance and security architecture click apply for full job details ...

Summary Our corporate activities are growing rapidly, and we are currently seeking a full-time, office-based Data Engineerto join our AI team. This position will work on a team to accomplish tasks and projects that are instrumental to the company’s success. If you want an exciting … Large Language Models (LLMs) in the Extract, Transform, and Load (ETL) of large corpus of data into a data lake; Participate in the Natural Language Processing (NLP) extract of unstructured data into structured meta-data through the use of tools such ...

Permanent Location: London, UK/Hybrid Number of hours: 40 hours per week – full time Ready to utilize your experience and expertise in Data Product Management? We have an exciting role for you – Senior Product Manager. Careers at TCS: It means more TCS is a purpose-led transformation … prioritize effectively. Passion for innovation, collaboration, and continuous improvement. Desirable Skills: Experience with data platforms such as Snowflake, Azure Data Lake, or similar cloud-based technologies. Understanding of model monitoring, observability, and performance tracking practices. Exposure to AI/ML-enabled products and data ...

About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers, and other engineering teams to ensure seamless data flow and accessibility, supporting … concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelor or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering ...

place of high expectations, integrity, innovation and a willingness to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers, and other … concurrent, high‐throughput, low‐latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering ...

Data Engineer – Consultant/Sr. Consultant Our talented Data Engineering team is made up of globally recognised experts – and there’s room for more analytical, innovative, client‐driven data professionals. If you’re passionate about helping clients make better data‐driven decisions … large‐scale projects Experience in working with the latest Azure technologies, such as Databricks, Microsoft Fabric, Data Factory, Azure Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, AzureML, AIFoundry, Kubernetes Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database ...

Experis - ManpowerGroup is seeking a Data Architect for a 6-month hybrid role, with 2–3 days on site in London … Corsham. Active DV clearance is required, and the daily rate is £860 inside IR35. You will specify target designs for the data lake, ingestion, governance and security architecture, acting as the design authority to ensure secure, scalable, auditable solutions across classified environments. The position requires extensive experience ...

work on innovative projects and make a real impact on their lives. Right from the start you'll become part of our digital & data strategy, joining us on our journey and developing yourself along the way. Join our team as a Senior Platform Engineer, where you'll contribute … Azure-based data solutions. Expert-level knowledge of Azure and/or Snowflake services, including Data Factory, Data Lake, Azure ML, and Power BI/Fabric. Proven experience with infrastructure-as-code using Terraform and building CI/CD pipelines via Azure DevOps ...

North St, Horsham RH12 1RD Role Summary The Alation Technical Consultant is responsible for the implementation, configuration, and ongoing support of the Alation Data Intelligence Platform. The role focuses on onboarding data sources, enabling metadata management and governance capabilities, and ensuring the platform operates effectively … support data discovery, cataloging, and stewardship initiatives. Key Responsibilities Platform Setup & Deployment Install, deploy, and upgrade Alation platform components across cloud and/or on-premises environments. Configure integrations with enterprise infrastructure, authentication services, and security frameworks. Configuration & Administration Configure Alation platform settings, user roles, permissions, workflows, stewardship ...

North St, Horsham RH12 1RD Role Summary The Alation Technical Consultant is responsible for the implementation, configuration, and ongoing support of the Alation Data Intelligence Platform. The role focuses on onboarding data sources, enabling metadata management and governance capabilities, and ensuring the platform operates effectively … support data discovery, cataloging, and stewardship initiatives. Key Responsibilities Platform Setup & Deployment Install, deploy, and upgrade Alation platform components across cloud and/or on-premises environments. Configure integrations with enterprise infrastructure, authentication services, and security frameworks. Configuration & Administration Configure Alation platform settings, user roles, permissions, workflows, stewardship ...

London, UK . Bachelor's degree in Computer Science, a related field, or equivalent practical experience. 7 years of experience in software or data engineering, including one or more programming languages (e.g., Python, Go, Java), and with design patterns, testing frameworks, and API contract design. Experience using machine … critical user journeys (CUJs) and success metrics. Evaluate and integrate AI solutions with modern data foundations, including relational databases, data lake houses, and real-time streaming architectures. Ensure all prototypes are built with a "production-first" mindset. Implement basic CI/CD pipelines and utilize ...

extend) We're seeking an experienced reporting professional to take ownership of a critical business reporting environment, with a particular focus on data integrity, KPI governance, and performance insight. This is a high-impact opportunity to shape how operational and corporate teams define, manage and use performance information. … strong analytical and problem-solving capability. Understanding of data governance, stewardship and ownership principles; data warehouse or data lake experience is desirable. Why You’ll Love It Take ownership of a major reporting and KPI governance agenda. Make a measurable difference to data ...

SSML-tuned voice interactions Amazon Connect Platform Engineering Build contact flows that integrate AI agents, Lambda-backed business logic, Customer Profiles, and dynamic data-driven routing Implement Amazon Connect Cases and Tasks solutions: case templates, queue-based work allocation, SLA/TAT monitoring, approval workflows, and migrations from … detection and compliance controls), and workforce management (WFM) integrations for forecasting, scheduling, and adherence (FCS) Build out the Amazon Connect analytics data lake (Glue, Lake Formation, Athena) and QuickSight dashboards for real-time operations and executive reporting Support legacy platform migrations (Avaya, Genesys, Cisco, Oracle, Salesforce ...

Summary Our corporate activities are growing rapidly, and we are currently seeking a full-time, office-based Data Engineer to join our AI team. This position will work on a team to accomplish tasks and projects that are instrumental to the company’s success. If you want … develop and grow your career even further, then this is the opportunity for you. Responsibilities Utilize skills in handling of more unconventional data such as unstructured content from web-based sites and varying content (documents, images etc) into different data lakes and with different software solutions ...

Power Apps and Power Pages Creating integrations between Dynamics 365 and other business systems Working with APIs, Azure services, and cloud technologies Supporting data and reporting solutions using Microsoft tools Contributing to release management, deployments, and DevOps processes Collaborating with architects, project teams, and business stakeholders … large-scale transformation programmes Microsoft Fabric Power BI Dual Write and Dynamics integrations SharePoint integrations Microsoft Entra ID Azure Function Apps, Data Lake, or Key Vault BENEFITS Flexible working options 33 days holiday including bank holidays Holiday purchase scheme Enhanced family friendly benefits (maternity, adoption, paternity ...