13 of 13 Data Lake Jobs in the City of London

Senior Data Engineer Market Data 5 day onsite We are looking for a Senior Data Engineer to build and operate a high-performance market data platform supporting quantitative research and production trading systems. You'll design scalable data pipelines, process … actions. Implement automated data quality, reconciliation and monitoring frameworks. Optimise data storage using Parquet, Arrow and modern data lake technologies. Partner with quantitative researchers, traders and engineering teams to deliver trusted datasets. Essential Skills Strong Python and SQL. Experience building scalable, production data ...

utilizing Azure Data Factory (ADF). ETL/ELT Development: Build and maintain seamless pipelines across SQL Server, Azure Data Lake Storage (ADLS), and Snowflake ecosystems. Automation & Frameworks: Build reusable frameworks for data onboarding, schema deployment, and validation. Automate operational processes using … role, you must have strong hands-on experience in the following areas: Core Technologies: Azure Data Factory (ADF), Azure Data Lake (ADLS), Azure SQL, and core ETL concepts. SQL Server Mastery: Advanced SQL Server development and administration skills, including hands-on experience managing SQL Server ...

Developer to design, build, and maintain data-driven applications. You'll play a pivotal role in integrating with data lakes, lake house architectures, and enterprise databases, all while working with large-scale data systems that drive our analytics and business-critical applications. What … Develop and maintain pipelines for ingesting, transforming, and serving data across systems. Integration: Seamlessly integrate applications with data lakes and lake house platforms. Data Models: Design and implement data models for structured, semi-structured, and unstructured data. APIs & Services: Develop APIs ...

strategic, sustainable decisions by bringing transparency to markets across the world. We create a comprehensive view of commodities markets, providing companies with the data and intelligence to successfully navigate across global value chains every day. Our customers benefit from instant access to price assessments, reports and forecasts … link below. https://www.icis.com/explore About the role: To provide dedicated analytical capability within Customer Intelligence, connecting customer research, CRM data, product usage data and business performance metrics into clear, actionable insight. This role is designed to build future data science ...

Opportunity We are seeking an experienced Lead Technical Architect to take ownership of the technical strategy and architecture for a major national-scale data andanalytics transformation programme. This position represents the highest level of technical authority within the delivery organisation and will be responsible for shaping the long … Capacity Planning Multi-workspace governance Strong understanding of modern Azure data services, including: Azure Data Factory Azure Data Lake Storage Gen2 Azure Databricks Azure Synapse Analytics Delta Lake Extensive experience implementing enterprise data governance solutions and metadata management frameworks. Strong ...

businesses are the backbone of the economy, and we’re here to help them win. We’ve built a platform that uses clever data to get them the funding they need in minutes, not weeks. At Funding Circle, we have the restless energy of a fintech start … Trustpilot The role London (Hybrid) | 2 days in the office | Competitive Salary + Benefits We’re looking for an Analytics Engineer/Data Quality Engineer to join our team and help shape our approach to Data Quality and work on the data foundations ...

London (Hybrid - 1-2 days per week onsite) Salary: £90,000 - £100,000 + Excellent Benefits Job Type: Permanent Are you an experienced Data Architect looking to shape the future of enterprise data platforms? We're working with a leading global organisation that is investing heavily … cloud, data and AI transformation. As part of this growth, they're looking for a Senior Data Architect to design and deliver enterprise-scale data platforms that power advanced analytics, machine learning and AI solutions. This is an opportunity to work on large-scale ...

place of high expectations, integrity, innovation and a willingness to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers, and other … concurrent, high‐throughput, low‐latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering ...

Applied Data Scientist – Fraud Detection Contract: 6 months Engagement: Inside IR35 Location: Fully remote, with occasional travel to the London office. The Role We're looking for an experienced Applied Data Scientist to help improve the performance of our production fraud detection models. Working within … Data Scientist or Applied Data Scientist. Strong Python and Pandas. Advanced SQL. Experience working with Azure Data Lake or similar cloud data platforms. Experience working with very large datasets. Strong feature engineering experience. Experience improving production classification models. Excellent understanding ...

exciting opportunity has arisen to join a well-established tier one main contractor as an IT Data & Platform Engineer, working within a collaborative Group IT team responsible for delivering modern data engineering and business intelligence solutions across the business. This permanent position is based in Canary … working arrangement following probation period, where employees will be expected to work full-time from the office. About the Role As an IT Data & Platform Engineer, you will play a key role in the design, development and maintenance of modern data platform solutions. Working closely with ...

Senior Databricks Technical Engineer Up to £111,500 + 10% Bonus | UK Wide Hybrid | SC Clearance Ready to build data platforms that actually make an impact? We're looking for an experienced Senior Databricks Technical Engineer to join a growing enterprise data team where … platforms from the ground up Designing robust data pipelines using Databricks and SQL Working with modern Lakehouse/Data Lake architectures Delivering analytics and insight solutions that drive business decisions Improving platform performance, scalability and data quality Providing technical leadership within ...

Group is a tech-enabled professional services business with two service engines and a product arm that incubates and owns its software and data assets. Services, software, and data compounding together. Wave Talent. UK recruitment and staffing. Permanent and contract technology and digital professionals … Wave Talent's proprietary candidate universe. A quality-controlled alternative to pure AI hiring tools. The ARR engine. Mothership. Internal data lake with LLM copilot capability. Powers Iron Man Suits, candidate matching, financial reporting, and group intelligence. The infrastructure that compounds every year the group exists. Wave ...

Role: GCP Data Engineer Location: Hybrid; 2 days per week onsite in either Bristol, London, or Manchester Salary: £65,000 to £85,000 (Dependent on Experience) + Benefits Security Clearance: Due to the sensitive nature of the client's programme, candidates must hold active SC Clearance … process. Please note that specific client security restrictions mean this role is strictly restricted to Sole British Nationals. We are seeking experienced GCP Data Engineers at both Senior and Principal levels to help lead, design, and deliver high-impact cloud data platforms for our clients. Whether ...