1 to 25 of 27 Data Lake Jobs in Central London

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute … operations for the worlds leading corporations. EXL was founded on the core values of innovation, collaboration, excellence, integrity and respect, creating value from data to ensure faster decision-making and transforming operating models. Key industries include Insurance, Healthcare, Banking and Financial Services, Media, and Retail, among others. Headquartered ...

Data Engineer – Manager Location: London Salary: Competitive salary package depending on experience Career Level: Manager (Level 7) About Accenture Accenture is a leading global professional services company, providing a broad range of services in strategy and consulting, interactive, technology and operations, with digital capabilities across all of these … transformation roadmaps. Architect modern data platforms using Microsoft Fabric, Azure Databricks, Azure Synapse, Azure Data Factory, Azure Data Lake and Power BI. Design scalable data lake, lakehouse, data warehouse and data integration solutions. Establish data ...

clearance required £860 per day inside IR35 Role purpose The Data Architect will specify the target design for the data lake, data ingestion, integration, transformation, governance and security architecture. The role acts as the design authority, ensuring the solution is secure, scalable, auditable … operating environments with multiple security classifications. Key responsibilities Define the target data architecture and design principles for the AWS data lake and associated ingestion patterns. Design secure data integration patterns across multiple security classifications and operating environments. Specify API-based, file-based, legacy ...

Data Engineering Lead Department: CSG - Operations Hub (Data/Intelligence/Support) Employment Type: Permanent Location: London - Woolgate Description We are looking for an experienced Data Engineering Lead to play a pivotal role in shaping and delivering our enterprise data platform. This … experience with Microsoft Azure data technologies, including: Azure Data Factory Azure Synapse Analytics Microsoft Fabric Azure Data Lake Advanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable ...

every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake to a modern dimensional model, finish the rollout of a principle-of-least-privilege security model across a multi-server SQL estate, and continue … personally delivering target architecture for the ECP data estate the data warehouse, data hub, data lake, raw/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. Hands-on T-SQL, stored procedure ...

Data Architect – Leading Investment Bank – London/Hybrid (Tech stack: Data Architecture, Enterprise Data Strategy, Data Warehouse, Master Data Management, ERP, CRM, BI, ETL/ELT, Azure Data Factory, Data Lakes, RDBMS, NoSQL, AWS Glue … Capital Markets Data) Our client is a leading global investment bank with a strong presence across financial markets and commodities. They are now looking for an experienced Data Architect to help shape and deliver their enterprise-wide data strategy, working across business and technology ...

NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute … integration , ideally in enterprise-scale environments. Deep expertise in Azure Databricks , Azure Data Factory , Azure Synapse , and Azure Data Lake . Hands-on experience with Spark (PySpark/SparkSQL) , ETL/ELT design, and data pipeline orchestration . Strong data modelling ...

OneLake Developing data models and analytics solutions Power BI development ETL/ELT SQL and SQL Server Azure Data Lake Internal and third-party API integrations Azure DevOps and Git CI/CD and production deployments Supporting existing Synapse solutions during the transition The client … experience across several of the following: SQL Data modelling ETL/ELT development Azure data platforms Azure Data Lake API integrations Git/source control Azure DevOps CI/CD Developing, deploying and supporting production solutions Azure Synapse would be useful but isnt ...

Contract Business Analyst | Data Lake Migration | Outside IR35 | 6 Months Role: Business Analyst Day rate: £550 p/d (Outside IR35) Location: London – 1 day in the office every fortnight Duration: 6 months Start: ASAP We’re looking for a Business Analyst to join a data lake migration/carve-out project on an initial 6-month contract. You’ll be working between the technical teams and business stakeholders, helping to make sure the right data, reports and applications are identified, tested and signed off as part of the data ...

Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data‐lead, by equipping them with robust data platforms. You'll also join a data team on its mission … data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. Key responsibilities Define, shape and perfect data strategies in central and local government. Help public sector teams understand the value of their data ...

excellent opportunity for an engineer with strong Python and SQL skills who wants to build broader expertise across software engineering, cloud, data engineering and AI-enabled applications . Rather than focusing on one part of the technology stack, you'll work across backend services, APIs, databases, data … applications and contributing to client projects. Why this role? You’ll gain hands‐on exposure to: AWS cloud & migration Python development SQL, databases & data platforms Data pipelines & ETL/ELT APIs & backend engineering CI/CD & production systems Analytics & modern data platforms AI/ ...

CLEARED*** Data Engineer 6 Month contract initially + Extensions Based: Hybrid - Max 2 days p/w onsite. Flexible on location: Newcastle, London, Leeds, Manchester, Blackpool or Sheffield Rate: £400 - £450 p/d - (via Umbrella company) We have a great opportunity with a world leading organisation where … Hive, Impala, Spark) to AWS Cloud. Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon Redshift. Develop and maintain SQL-based data integration, transformation, validation, and reconciliation processes. Integrate and support data services ...

Data Migration Specialist Location: Sheffield, UK (Hybrid/Onsite) Contract Duration: 6 Months Start Date: Immediate Are you a senior Data Migration Specialist with deep expertise in Azure data engineering and enterprise-scale transformations? We are looking for a hands-on technical lead … advanced analytical queries, and reconciliation). Strong Azure Cloud Stack Experience: Azure Data Factory (ADF) Azure SQL DB Azure Data Lake/Lakehouse architectures Python for data manipulation & automation Proven experience across all migration phases: Strategy, Discovery, Cleansing, Mapping, Execution, and Post-migration ...

Senior Data Engineer Department: Engineering Employment Type: Full Time Location: London Compensation: £95,000 - £115,000/year Description TL;DR Kharon is seeking a full-time London-based Senior Data Engineer. Location: London, UK Annual Remuneration : £95,000 - £115,000 salary and discretionary annual bonus … Frequency : Monthly Probationary Period : 180 days Work Arrangement : Hybrid, 3-days per week RESPONSIBILITIES: Help build large-scale distributed automated data processing systems and data lakes, while optimizing for both computational and storage efficiency on AWS Databricks. Create data pipelines, infrastructure, and overall workflow ...

Summary Our corporate activities are growing rapidly, and we are currently seeking a full-time, office-based Data Engineerto join our AI team. This position will work on a team to accomplish tasks and projects that are instrumental to the company’s success. If you want an exciting … Large Language Models (LLMs) in the Extract, Transform, and Load (ETL) of large corpus of data into a data lake; Participate in the Natural Language Processing (NLP) extract of unstructured data into structured meta-data through the use of tools such ...

maximise on the power of its data. The successful candidate would be: Working in an agile scrum team to design and build data feeds and related applications Writing, testing and peer review of ETL code in Oracle ODI, dbt, Snowflake and AWS. … Working with business users to design and configure self-serve data environments within our data warehouse and data lake Analysing, developing, delivering, and managing BI reports Assisting in the design of the data processes, including data quality, reconciliation, testing ...

Data Engineer – Consultant/Sr. Consultant Our talented Data Engineering team is made up of globally recognised experts – and there’s room for more analytical, innovative, client‐driven data professionals. If you’re passionate about helping clients make better data‐driven decisions … large‐scale projects Experience in working with the latest Azure technologies, such as Databricks, Microsoft Fabric, Data Factory, Azure Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, AzureML, AIFoundry, Kubernetes Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database ...

Experis - ManpowerGroup is seeking a Data Architect for a 6-month hybrid role, with 2–3 days on site in London … Corsham. Active DV clearance is required, and the daily rate is £860 inside IR35. You will specify target designs for the data lake, ingestion, governance and security architecture, acting as the design authority to ensure secure, scalable, auditable solutions across classified environments. The position requires extensive experience ...

Burns Sheehan is seeking a hands-on Contract Business Analyst to support a data lake migration project in London. You will bridge between technical teams and business stakeholders to ensure the right data, reports and applications are defined, tested and signed off as part ...

Summary Our talented Microsoft Fabric team is made up of globally recognised experts and there’s room for more analytical, innovative, client driven data professionals. If you’re passionate about helping clients make better, data driven decisions to tackle their most complex business challenges … including large‐scale projects Experience working with modern Microsoft Fabric and Azure technologies, such as Synapse, Data Factory, Azure Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, Azure ML, and AI Foundry Solid understanding of software engineering concepts, with hands‐on experience using Python, Scala ...

SSML-tuned voice interactions Amazon Connect Platform Engineering Build contact flows that integrate AI agents, Lambda-backed business logic, Customer Profiles, and dynamic data-driven routing Implement Amazon Connect Cases and Tasks solutions: case templates, queue-based work allocation, SLA/TAT monitoring, approval workflows, and migrations from … detection and compliance controls), and workforce management (WFM) integrations for forecasting, scheduling, and adherence (FCS) Build out the Amazon Connect analytics data lake (Glue, Lake Formation, Athena) and QuickSight dashboards for real-time operations and executive reporting Support legacy platform migrations (Avaya, Genesys, Cisco, Oracle, Salesforce ...

Summary Our corporate activities are growing rapidly, and we are currently seeking a full-time, office-based Data Engineer to join our AI team. This position will work on a team to accomplish tasks and projects that are instrumental to the company’s success. If you want … develop and grow your career even further, then this is the opportunity for you. Responsibilities Utilize skills in handling of more unconventional data such as unstructured content from web-based sites and varying content (documents, images etc) into different data lakes and with different software solutions ...

within financial services. Hands-on experience implementing Potential Future Exposure (PFE) analytical solutions. Strong understanding of: Counterparty Credit Risk, Collateral and Netting, Market Data within Credit Risk pricing, Regulatory-driven risk change initiatives Solid knowledge of pricing and risk management across: Derivatives, Mortgage-Backed Securities, Repos, Stock Borrow … solutions within software engineering environments Desirable Experience with cloud-based risk platforms and pricing engines Azure Kubernetes Service (AKS) Azure Data Lake Microservices and event-driven architectures Kafka, Redis, Spark, HBase, and HDFS Market Risk platforms covering VaR, Stress Testing, and FRTB Risk exposure reconciliation and reporting ...

Motability Operations Limited is seeking a skilled BI/ETL specialist to join the D&A team in delivering data integration, transformation and visualisation across the organisation. You will work in an agile scrum team to design data feeds, develop ETL code using Oracle … Snowflake and AWS, and enable self-serve BI environments for business users within our data warehouse and data lake. #J-18808-Ljbffr ...