11 of 11 Data Lake Jobs in Central London

data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established … communicate clearly with technical and non-technical stakeholders. Data Engineer (New Technology/Microsoft) Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous). Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous ...

This is a rare opportunity to apply serious data engineering in a domain where latency, correctness, and reliability carry direct commercial weight. * Requirements * 6+ years data engineering in production environments; Python expertise - idiomatic, well-tested, production-grade code, not notebook scripts * ETL/ELT pipeline design … retry, and exactly-once semantics * Azure data platform - Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage; infrastructure as code for data workloads (Terraform or Bicep) * Databricks - Delta Lake, Unity Catalog, job cluster vs interactive cluster trade ...

critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed processing. ...

Office.Full time hours. We are happy to discuss flexible working! Top 3 skills needed for this role: Expert in building scalable, high-quality data pipelines Hands-on experience with cloud data platforms The ability to optimise, automate, and deliver reliable data solutions independently What … this role is all about: Join us as a Data Engineer and become a driving force behind high-impact, high-performance data solutions. Youll take ownership of designing and supercharging data pipelines that keep our business moving, bringing fresh thinking and technical flair ...

Data Engineer Contract Duration: 4 months Location: Farringdon, London Job Type: Contract, Hybrid (3 days a week onsite) We are seeking a Data Engineer to our client's ambitious technology transformation. This role is crucial in implementing the end-to-end delivery of data strategies, working closely with Data Analytics and Data Science teams to ensure best practices and standards are met. Day-to-day of the role: Source, map, and extract data from various business and cloud-based source systems. Design, develop, test, optimise, scale ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. Aker builds and operates ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary … Platforms designing modern data platforms with appropriate architecture coving Data Mesh, Data Fabric, Data Lake etc. Data/Analytics - solving enterprise data and analytics problems using technology Cloud - hands-on Public Cloud experience in either ...

successful multinational technology business is looking for a Data Reliability Engineer to join its growing data team in Central London. This role is hybrid youll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. Youll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. Youll take ownership of data reliability end-to-end, designing and implementing ...

companies globally – with offices in New York, London, Madrid and Singapore. We are at an early and exciting stage of embedding AI and data capabilities across the firm. This hire is central to that effort. The Role: We are looking for a commercially minded AI and data … into the business in a practical, considered way Data Infrastructure and Reporting Help maintain and extend our Snowflake-based data lake, supporting data quality and accessibility across the business Build and maintain Power BI dashboards and reports that drive commercial decision-making across ...

Entry-level Data & AI Consultant role for individuals looking to build a career in data engineering and AI. You will work on real client projects, supporting the design and delivery of data pipelines, models, dashboards, and AI-driven solutions. This is not a passive … Support development of Power BI dashboards Assist in AI use cases (automation, simple models, insights) Work within Azure-based environments (Databricks, Data Lake, etc.) Test, validate, and document solutions Training Possible promotion within the organisation Moving onto a higher level apprenticeship Apprenticeship Standard Data technician ...

design, configuration, and implementation within an international investment-banking environment. Systems Expertise: Deep practical knowledge of Oracle ERP/EPM modules, financial data integration, reporting tools, API-based integrations, ETL technologies, data lakes, accounting rules engines, and reference data. This is a fascinating role with ...

design, configuration, and implementation within an international investment-banking environment. Systems Expertise: Deep practical knowledge of Oracle ERP/EPM modules, financial data integration, reporting tools, API-based integrations, ETL technologies, data lakes, accounting rules engines, and reference data. This is a fascinating role with ...