17 of 17 Data Lake Jobs in Central London

every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake to a modern dimensional model, finish the rollout of a principle-of-least-privilege security model across a multi-server SQL estate, and continue … personally delivering target architecture for the ECP data estate the data warehouse, data hub, data lake, raw/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. Hands-on T-SQL, stored procedure ...

Join us and build for travelers everywhere. Expedia Group seeks a motivated and results-oriented Senior Software Engineer to join our Data Lake and Catalog team. As a Senior Software Engineer on an industry-leading data platform, you will build the core of Expedia Group … with tools like Circus Train, a Hive dataset replication tool, and Waggle Dance, a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg, a high-performance open table format for large analytic datasets that underpins many ...

Senior Data Engineer Market Data 5 day onsite We are looking for a Senior Data Engineer to build and operate a high-performance market data platform supporting quantitative research and production trading systems. You'll design scalable data pipelines, process … actions. Implement automated data quality, reconciliation and monitoring frameworks. Optimise data storage using Parquet, Arrow and modern data lake technologies. Partner with quantitative researchers, traders and engineering teams to deliver trusted datasets. Essential Skills Strong Python and SQL. Experience building scalable, production data ...

considering: We are looking for an experienced AWS Databricks Engineer with strong hands-on expertise in Databricks, AWS cloud services, PySpark, Spark SQL, Delta Lake, Python, SQL, and data engineering. The candidate will be responsible for designing, developing, optimizing, and supporting scalable data pipelines … maintain scalable data pipelines using Databricks on AWS. Build and optimize data processing frameworks using PySpark, Spark SQL, Python, Delta Lake, and Databricks notebooks. Develop end-to-end ETL/ELT pipelines for ingestion, transformation, validation, and consumption. Work with AWS services such ...

utilizing Azure Data Factory (ADF). ETL/ELT Development: Build and maintain seamless pipelines across SQL Server, Azure Data Lake Storage (ADLS), and Snowflake ecosystems. Automation & Frameworks: Build reusable frameworks for data onboarding, schema deployment, and validation. Automate operational processes using … role, you must have strong hands-on experience in the following areas: Core Technologies: Azure Data Factory (ADF), Azure Data Lake (ADLS), Azure SQL, and core ETL concepts. SQL Server Mastery: Advanced SQL Server development and administration skills, including hands-on experience managing SQL Server ...

strategic, sustainable decisions by bringing transparency to markets across the world. We create a comprehensive view of commodities markets, providing companies with the data and intelligence to successfully navigate across global value chains every day. Our customers benefit from instant access to price assessments, reports and forecasts … link below. https://www.icis.com/explore About the role: To provide dedicated analytical capability within Customer Intelligence, connecting customer research, CRM data, product usage data and business performance metrics into clear, actionable insight. This role is designed to build future data science ...

leading managed service provider client of ours is seeking an experienced AI & Data Technical Trainer to deliver engaging learning experiences that help organisations unlock the full value of their data ecosystems. This is an exciting opportunity to play a pivotal role … forward-thinking AI & Data Practice and Training Academy. You'll work with cutting-edge technologies including Starburst, Dell Data Lake solutions, cloud-native analytics platforms, and modern data warehouse architectures, helping clients and internal teams build the skills required to drive meaningful business ...

Data Engineer - 6 Month FTC Location: Central London Contract: 6 month fixed-term contract Hours: 35 hours per week Salary: £50,000 pro rata Working arrangement: Hybrid, 1-2 days per week in the office Start date: ASAP A well-established London-based organisation is looking … integrate data from core systems and APIs Supporting the technical setup and day-to-day maintenance of a central data lake Carrying out validation checks to keep data accurate and synchronised across systems Building and maintaining data architecture to support strategic ...

businesses are the backbone of the economy, and we’re here to help them win. We’ve built a platform that uses clever data to get them the funding they need in minutes, not weeks. At Funding Circle, we have the restless energy of a fintech start … Trustpilot The role London (Hybrid) | 2 days in the office | Competitive Salary + Benefits We’re looking for an Analytics Engineer/Data Quality Engineer to join our team and help shape our approach to Data Quality and work on the data foundations ...

London (Hybrid - 1-2 days per week onsite) Salary: £90,000 - £100,000 + Excellent Benefits Job Type: Permanent Are you an experienced Data Architect looking to shape the future of enterprise data platforms? We're working with a leading global organisation that is investing heavily … cloud, data and AI transformation. As part of this growth, they're looking for a Senior Data Architect to design and deliver enterprise-scale data platforms that power advanced analytics, machine learning and AI solutions. This is an opportunity to work on large-scale ...

place of high expectations, integrity, innovation and a willingness to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers, and other … concurrent, high‐throughput, low‐latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering ...

Applied Data Scientist – Fraud Detection Contract: 6 months Engagement: Inside IR35 Location: Fully remote, with occasional travel to the London office. The Role We're looking for an experienced Applied Data Scientist to help improve the performance of our production fraud detection models. Working within … Data Scientist or Applied Data Scientist. Strong Python and Pandas. Advanced SQL. Experience working with Azure Data Lake or similar cloud data platforms. Experience working with very large datasets. Strong feature engineering experience. Experience improving production classification models. Excellent understanding ...

exciting opportunity has arisen to join a well-established tier one main contractor as an IT Data & Platform Engineer, working within a collaborative Group IT team responsible for delivering modern data engineering and business intelligence solutions across the business. This permanent position is based in Canary … working arrangement following probation period, where employees will be expected to work full-time from the office. About the Role As an IT Data & Platform Engineer, you will play a key role in the design, development and maintenance of modern data platform solutions. Working closely with ...

Senior Databricks Technical Engineer Up to £111,500 + 10% Bonus | UK Wide Hybrid | SC Clearance Ready to build data platforms that actually make an impact? We're looking for an experienced Senior Databricks Technical Engineer to join a growing enterprise data team where … platforms from the ground up Designing robust data pipelines using Databricks and SQL Working with modern Lakehouse/Data Lake architectures Delivering analytics and insight solutions that drive business decisions Improving platform performance, scalability and data quality Providing technical leadership within ...

Group is a tech-enabled professional services business with two service engines and a product arm that incubates and owns its software and data assets. Services, software, and data compounding together. Wave Talent. UK recruitment and staffing. Permanent and contract technology and digital professionals … Wave Talent's proprietary candidate universe. A quality-controlled alternative to pure AI hiring tools. The ARR engine. Mothership. Internal data lake with LLM copilot capability. Powers Iron Man Suits, candidate matching, financial reporting, and group intelligence. The infrastructure that compounds every year the group exists. Wave ...

Expedia, Inc. is seeking a motivated Senior Software Engineer for their Data Lake and Catalog team. In this role, you'll build core data discoverability capabilities that help product and analytics teams find and trust the data they need. You will collaborate closely … systems, a solid background in Kotlin/Java, and knowledge of the AWS ecosystem, you will play a key role in improving our data platform for travelers everywhere. #J-18808-Ljbffr ...

Role: GCP Data Engineer Location: Hybrid; 2 days per week onsite in either Bristol, London, or Manchester Salary: £65,000 to £85,000 (Dependent on Experience) + Benefits Security Clearance: Due to the sensitive nature of the client's programme, candidates must hold active SC Clearance … process. Please note that specific client security restrictions mean this role is strictly restricted to Sole British Nationals. We are seeking experienced GCP Data Engineers at both Senior and Principal levels to help lead, design, and deliver high-impact cloud data platforms for our clients. Whether ...