76 to 100 of 229 Data Lake Jobs in London

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business … technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business … technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot … with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience ...

crucial role in supporting a significant ledger migration and data clean-up initiative. This involves meticulous work across the data lake, reporting systems, and downstream feeds, ensuring data integrity and operational efficiency. Key responsibilities include engaging in large-scale batch processing, robust data … impactful financial services projects. Collaborative and supportive work environment in London. Professional development and growth opportunities. Exposure to cutting-edge data lake technologies and methodologies. Visa Sponsorship & Foreigner Eligibility Visa sponsorship is NOT advertised for this Data Engineer position. The Photon Group prefers UK-based ...

excellent opportunity for an engineer with strong Python and SQL skills who wants to build broader expertise across software engineering, cloud, data engineering and AI-enabled applications . Rather than focusing on one part of the technology stack, you'll work across backend services, APIs, databases, data … applications and contributing to client projects. Why this role? You’ll gain hands‐on exposure to: AWS cloud & migration Python development SQL, databases & data platforms Data pipelines & ETL/ELT APIs & backend engineering CI/CD & production systems Analytics & modern data platforms AI/ ...

excellent opportunity for an engineer with strong Python and SQL skills who wants to build broader expertise across software engineering, cloud, data engineering and AI-enabled applications . Rather than focusing on one part of the technology stack, you'll work across backend services, APIs, databases, data … applications and contributing to client projects. Why this role? You’ll gain hands-on exposure to: ☁️ AWS cloud & migration 🐍 Python development 🗄️ SQL, databases & data platforms 🔄 Data pipelines & ETL/ELT 🔌 APIs & backend engineering 🚀 CI/CD & production systems 📊 Analytics & modern data platforms 🤖 AI/ ...

Role Description The Technical Analyst – Data Lineage will support a Data Governance, Controls, and Reporting program for a top-tier banking client. Responsible for establishing and validating end-to-end lineage across critical datasets used in operational and regulatory reporting. Translate governance and reporting requirements into … actionable lineage deliverables (source-to-target mapping, lineage diagrams, metadata standards, and audit evidence). Work with Data Platform, Data Engineering, Architecture, Risk, Compliance, and Security teams to define lineage standards, metadata capture, and control points. Maintain lineage artifacts for Critical Data Elements (CDEs ...

Data & Analytics Solution Architect SC Cleared - London (Hybrid) - Up to £80,000 + Bonus Data Strategy - Cloud Transformation - AWS/Azure - Databricks - Data Platforms I'm working with a leading technology consultancy that delivers large-scale data and cloud transformation programmes across … central government, public sector and enterprise organisations. Due to continued growth, they are looking to appoint a Data & Analytics Solution Architect to help clients shape data strategy, modernise legacy platforms and deliver business-critical transformation initiatives. This is a highly consultative role where you'll work ...

crucial role in supporting a significant ledger migration and data clean-up initiative. This involves working across the data lake, reporting systems, and various downstream feeds to ensure data integrity and system functionality. Key responsibilities include large-scale batch processing, meticulous data … salary of £48,478.22. Opportunity to work on critical data migration projects within financial services. Exposure to cutting-edge data lake technologies and reporting systems. Collaborative work environment in London, a global tech hub. Professional development opportunities in data engineering and financial tech. ...

Analyst, you will play a crucial part in supporting a ledger migration and data clean-up initiative across the data lake, reporting, and downstream feeds. This involves working on large-scale batch processing, ensuring data validation, conducting regression testing, and preparing for migration … services data projects. Competitive salary of £48,478.22. Professional development within a leading financial group. Exposure to cutting-edge data lake technologies and migration strategies. Collaborative and supportive team environment in London. Visa Sponsorship & Foreigner Eligibility Visa sponsorship is NOT advertised for this position. ...

Recruiter Ltd seeks an experienced Data Engineer to support a data migration and integration programme in a relatively low maturity Azure … environment. You will design, build and maintain data pipelines, migrating data from diverse legacy systems to Azure Data Lake and Databricks. You will also integrate data into a proprietary transformation solution and work with a range of source systems including Oracle ...

Data Idols, we are working with a large-scale, data-driven organisation investing heavily in its data platform, analytics and AI capabilities. They are now looking for a Data Solutions Architect to provide design and architecture guidance across a broad portfolio … data platforms Experience with Databricks or similar modern data platforms Good understanding of data warehouse, data lake or lakehouse architectures If you are looking for a new challenge and want to help shape data solutions across a large-scale ...

experience working with SQL Server Strong experience working with Azure Data Factory and Azure DevOps Hands-on experience with data lake platforms, Azure Synapse, Databricks, or equivalent experience/skills Experience with tooling such as CI/CD pipelines and version control The ability … will be responsible for the design, build, and maintenance of Python-based ETL pipelines Accounting and leading the SQL development Data lake development within Azure Synapse, working to the organisation’s architecture standards Meeting with business stakeholders to define requirements and translate them into solution designs Keeping ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data … analytics and reporting. Develop ETL/ELT workflows to move data efficiently into data warehouses, data lakes and lake houses using open-source and AWS tooling. Apply DevOps practices, including CI/CD, infrastructure as code and automation, to improve and streamline data ...

Data Engineer/Data Analyst to support a ledger migration and data-cleanup across the data lake, reporting, and downstream feeds. The role focuses on large-scale batch processing, data validation, and regression testing within a dynamic financial services … environment. Key tasks include data extraction, transformation and reconciliation to ensure data integrity throughout migration, contributing to migration readiness and timely delivery in a fast-paced #J-18808-Ljbffr ...

innovative solutions to life. Your visionary leadership and pursuit of excellence makes a lasting impact on the firm and industry. As a Principal Data Engineer at JPMorganChase within the [insert LOB or sub LOB], youprovide expertise and data engineering excellence as an integral part … analytics, and collaborative development, as well as proficiency in managing large datasets using Apache Iceberg for efficient, reliable table management and data lake optimization Experience architecting and implementing enterprise-scale data warehouses on cloud platforms (e.g., AWS, Azure, GCP), including migration from legacy systems Advanced ...

shape the future of prediction markets with cutting-edge technology and a customer-first philosophy, Smarkets is where you belong. The Team The Data Team is responsible for taking the wealth of data that Smarkets generates and using it to drive insights which improve the business. … understand and drive business direction. Data components can also be user facing e.g. sending notifications to users; Ensuring our data lake is kept in a healthy state, particularly our data warehouses: Redshift and Bigquery; Developing and maintaining Flask services and Postgres databases within ...

CLEARED*** Data Engineer 6 Month contract initially + Extensions Based: Hybrid - Max 2 days p/w onsite. Flexible on location: Newcastle, London, Leeds, Manchester, Blackpool or Sheffield Rate: £400 - £450 p/d - (via Umbrella company) We have a great opportunity with a world leading organisation where … Hive, Impala, Spark) to AWS Cloud. Design, develop, and optimise data ingestion, transformation, and loading processes into Amazon S3 Data Lake and Amazon Redshift. Develop and maintain SQL-based data integration, transformation, validation, and reconciliation processes. Integrate and support data services ...

high‐performing connectivity across a global footprint. Experience with Palo Alto's extended security suite, including GlobalProtect, Prisma Access, Panorama, Cortex Data Lake, and DLP, is essential. Key Responsibilities Architect, deploy, and manage Azure‐based network infrastructure, including VNets, Azure Firewall, Application Gateway, NSGs, Load Balancers, Private … Panorama and security extension through Prisma Access. Deploy and administer GlobalProtect for secure remote access across endpoints and locations. Leverage Cortex Data Lake for threat visibility and log analytics; implement and monitor Data Loss Prevention (DLP) policies. Collaborate with cloud, application, and infrastructure teams ...

Work—reflecting our commitment to our people and our culture. For more details, visit: Website or LinkedIn Page Role: Associate Technical Architect - Data Experience Level: 8+ years Employment type: Full Time Location: Remote (UK) Basic Qualifications: 8+ years of experience in designing and implementing data warehouses … distributed teams in collaborative delivery environments. Deep working knowledge across key AWS Data & Analytics services, including: Building large-scale data lake architectures on Amazon S3 and open table formats Implementing governance and cataloging through AWS Lake Formation. Developing ETL and metadata frameworks using ...

Photon Group in London, UK is seeking a Data Engineer/Data Analyst … support a major ledger migration and data clean-up in a financial services setting. You will work across the data lake, reporting systems, and downstream feeds to ensure data integrity and robust processes. The role focuses on large-scale batch processing, data ...

Elevate your career by steering multi-faceted technology programs, integrating innovative solutions, and driving impact across global operations. The Chief Data & Analytics Office (CDAO) at JPMorganChase is responsible for accelerating the firm’s data and analytics journey. This includes ensuring the quality, integrity, and security … data platforms such as Databricks and Snowflake Good understanding of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns, with demonstrated experience architecting end-to-end data solutions Experience navigating complex ...

Engineer/Data Analyst to support ledger migration and data clean-up initiatives across the data lake, reporting systems and downstream feeds. You will engage in large-scale batch processing, data validation, regression testing and migration readiness. Applicants must ...

strategic, sustainable decisions by bringing transparency to markets across the world. We create a comprehensive view of commodities markets, providing companies with the data and intelligence to successfully navigate across global value chains every day. Our customers benefit from instant access to price assessments, reports and forecasts … link below. https://www.icis.com/explore About the role: To provide dedicated analytical capability within Customer Intelligence, connecting customer research, CRM data, product usage data and business performance metrics into clear, actionable insight. This role is designed to build future data science ...

About UBDS Digital UBDS Digital, part of UBDS Group, helps organisations solve complex technology challenges across cloud, data, AI, cyber security and digital transformation. We work with clients operating in complex, secure and highly regulated environments, with a significant focus on the public sector and defence. … highly governed environments Experience with Azure data and integration technologies such as Data Factory, Synapse Analytics, Data Lake Storage, Functions, Logic Apps or API Management Experience with Azure Databricks in large-scale enterprise environments Knowledge of enterprise application and data integration ...