Permanent Data Lake Jobs in London

76 to 100 of 116 Permanent Data Lake Jobs in London

Senior Developer

London Area, United Kingdom
Mastek
Write high-quality, maintainable code using languages such as Python and SQL Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2 Utilize PowerBI, Tableau, or similar tools to design and create interactive and visually appealing dashboards and reports. Work closely with … PoCs to validate new technologies, frameworks, or solutions. Drive the development of MVPs, ensuring timely delivery and alignment with business goals. Azure and Data Engineering: Leverage your Azure expertise to design and implement cloud-based solutions. Collaborate with data engineers to build robust data pipelines and ensure data quality. FAME (Financial Analysis Made Easy): Familiarity with financial systems, including FAME , will be advantageous. Use your knowledge to enhance banking processes and systems. Agile Methodologies: Apply agile practices such as DevOps (including CI/CD), Test-Driven Development, and Infrastructure as more »
Posted:

Senior Data Engineer

Chiswick, England, United Kingdom
Square One Resources
Job Description: I am currently looking to hire for a Lead/Senior Data Engineer to lead modernisation efforts for a client of ours who are a leading company at the top of their game in their respective field. Duties and responsibilities: Develop and refine ETL and data integration solutions leveraging a variety of technologies and data sources. Maintain and enhance the Data Engineering Architecture. Gather and process raw data from various sources. Investigate methods to improve data quality and reliability. Identify and implement internal process enhancements, such … as automating manual tasks and optimising data delivery. Utilise cloud-based infrastructure (Azure) for hosting data solutions and applications. Collaborate with architects, data analysts, and data scientists to achieve business objectives. Requirements: Demonstrated expertise in developing and maintaining ETL/ELT processes more »
Posted:

Data Team Lead

Greater London, England, United Kingdom
Shawbrook Bank
have created is unique and difficult to replicate, with our ‘best of both’ approach combining deep human expertise with advanced digital, tech and data capabilities. This combination not only allows us to deliver excellent customer experiences, but to do so efficiently and at scale. We are proud of … of a business that cares too Want to continue to grow professionally and be the best version of yourself Job Description The Lead Data Engineer is a key role to ensure Shawbrook unlocks the value contained in its data across the organisation in a well-governed … and table formats (Delta etc) This is an incredibly exciting role that rarely becomes available. You will own a well-designed data lake serving a 50+ user community who run '000s of queries across TBs of data each month with a mandate to take it more »
Posted:

Lead Data Engineer - £100K - Hybrid

City of London, London, United Kingdom
Hybrid / WFH Options
Develop
Lead Data Engineer - up to £100K - Hybrid London Our client a global brand based out of lovely offices in West London are looking for a Lead Data Engineer to work on a business-critical, brand new, innovative high availability application which will be used by thousands … who is looking to take their next step in their career and wants to take on more responsibility. Technical Skillset: Experience as a data engineer developing and maintenance of ETL/ELT processes Good experience in Data Modeling within a cloud … based data platform Strong experience with SQL Server Azure data engineering stack, including Azure Synapse and Azure Data Lake Python, PySpark and T-SQL In return you will be offered a competitive salary and benefits package, remote working options and an opportunity to more »
Employment Type: Permanent
Salary: £80000 - £100000/annum
Posted:

Artificial Intelligence Engineer

London Area, United Kingdom
Computer Futures
specific business challenges. Implement and maintain scalable and efficient AI systems, ensuring they meet business requirements and performance benchmarks. Collaborate with business analysts, data scientists, and IT teams to integrate AI solutions into existing systems and workflows, enhancing their capabilities and impact. Stay abreast of advancements in AI … efforts. Conduct data analysis and feature engineering to prepare data for use in AI models, utilizing Azure Data Lake and other data storage solutions. Develop robust testing and validation processes to ensure the accuracy and reliability of AI models and solutions. … Open AI Service, Azure Cognitive Services, and Azure Machine Learning. Familiarity with Azure Databricks is a plus. Solid background in machine learning algorithms, data pre-processing, feature engineering, and model evaluation. Experience with deep learning frameworks like TensorFlow or PyTorch is desirable. Proficiency in handling large datasets, experience more »
Posted:

Lead Azure Data Engineer - London/Hybrid - GBP90,000

London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
Job descriptionLead Azure Data Engineer - London/Hybrid - GBP90,00005122023APNFI4_1701855804Lead Azure Data Engineer - London/Hybrid - 90,000I am working with a well-established high street retailer based who are looking for a Lead Data Engineer to join their team. In this role … you will be hands on leading on the development of the organisations Azure data platform whilst also managing the close-knit data engineering team.You will join the organisation at a significant point in their data journey and a time of significant investment in its … data function. They are looking to revolutionise the way they use data, and you will have the opportunity to implement best practice across the department. You will be responsible for designing and implementing the technical roadmap as the business look to develop their Azure Data more »
Salary: £ 80 K
Posted:

Customer Data Platform Product Manager

London, United Kingdom
Hybrid / WFH Options
Datatech Analytics
Customer Data Platform (CDP) Product Manager- London Office/Hybrid working 2 days PW in office 12 Month FTC - - Salary negotiable dep on experience Up to £80,000 - J12776 To work in a team who manage all aspects of market research, customer segmentation, first part data build up and consumer activation along the customer journey for all brands across this companies' group. Fuelling the ambition to put data at the heart of decision making and investing in our data platform to create a trusted single view of the customer and … understand, analyse and leverage customer data to create a truly connected customer experience. Seeking an experience Customer Data Platform Product Manager to join and lead the development of the customer data platform. The ideal candidate will understand customer facing businesses, have ROI driven digital more »
Employment Type: Permanent, Work From Home
Salary: £80,000
Posted:

Data Product Owner - London - Hybrid

London, United Kingdom
Hybrid / WFH Options
IQ Assurance & Testing
Data Product Owner London Hybrid – 3 days pw onsite £50,000 - £65,000 We have an exciting opportunity for a Data Product Owner working for a unique customer centric within the financial services industry, which is undergoing the biggest transformation it has ever seen. The Data Product Owner will join a newly formed data team. This role will ensure systems are fit for purpose today and ready for the challenges of the future, providing a bridge between operational teams and the technology department and facilitating better data decision making for … acting on user feedback and effectively communicating on updates and issues. Collaborate with key business stakeholders from a variety of teams, including Analytics, Data Engineering, Pricing, Risk, and Economic Capital to develop backlog and priorities in-line with business requirements. Proactively investigate and understand issues and pain points more »
Employment Type: Permanent
Salary: £65,000
Posted:

Lead Product Manager

Greater London, England, United Kingdom
3Search
informed and clearer financial decisions to create better financial well-being. The company has created a new role in the company focused on data to reimagine how data is utilised in the organised About the Lead Product Manager role We are looking for a very data-centric Lead Product Manager, who will report to the Chief Data Officer and have 1 direct report which may grow to two. You will support and lead the team acting as a servant leader while working closely with data, engineering and the wider business … to ensure that data is used, ingested and provided to all company areas. This role sits horizontally across the entire company and is pivotal in the success of multiple teams and the wider company. Skills Required for this role: Product Leader who has managed and scaled successful product more »
Posted:

Customer Data Platform Product Manager - 12 month FTC

London Area, United Kingdom
Hybrid / WFH Options
Datatech Analytics
Customer Data Platform (CDP) Product Manager- London Office/Hybrid working 2 days PW in office 12 Month FTC - - Salary negotiable dep on experience Up to £80,000 - J12776 Please note all applicants require full and indefinite right to work in the UK as this client is unable … to provide sponsorship To work in a team who manage all aspects of market research, customer segmentation, first part data build up and consumer activation along the customer journey for all brands across this companies’ group. Fuelling the ambition to put data at the heart of … decision making and investing in our data platform to create a trusted single view of the customer and understand, analyse and leverage customer data to create a truly connected customer experience. Seeking an experience Customer Data Platform Product Manager to join and lead the more »
Posted:

Senior Python Software Engineer AWS Java Data Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Senior Python Software Engineer (Senior Architecture Programmer Developer Python Java Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial … Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Python Software Engineer (Senior Architecture Programmer Developer Python Java Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Python, Java and AWS. If you have more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Chief Information and Data Officer - CIDO

London Area, United Kingdom
Spencer Group
Chief Information and Data Officer (CIDO/CDIO) - Australia based, will sponsor. Summary: We are proud to offer an exceptional opportunity for a Chief Information and Data Officer, CIDO within an esteemed and well-recognized Education Services provider known globally for enhancing the mobility of learners. … This transformational role is crucial for steering the technology strategy to empower digital and data enablement as the organization advances through a period of dynamic growth and scaling. Basen in Australia, and directly reporting to an innovative CEO, the role involves a significant leadership presence, managing a technology … team of c.40, and driving the digital transformation, data optimisation, product digitisation, and expansion into new international markets. You will join a profitable business that is not only established but experiencing exponential growth with the aim to double its revenue in the next three to five years. This more »
Posted:

Python Solutions Architect Engineering Trading Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager Financial Services … appreciation of asset classes such as Fixed Income, equities, FX or commodities Role: Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
La Fosse
Data Engineer Location: London, UK Hybrid: 3x a week in office Salary: £63,000 About the Client Our client is a top-tier professional services firm known for its exceptional workplace culture and some of the most sought-after office spaces in London. Role Overview Our client is … in search of a skilled Data Engineer to manage and engineer the data warehouse. The opportunity will be amazing for a Data Engineer who is happy to work in a small team. Incredible opportunity to mentor/lead a small Data Engineering … team within a year! Main Responsibilities Build scalable data pipelines on a daily basis Code on a daily basis with Azure SQL and python Develop and maintain the logical and technical architecture to fulfil the client’s information, insights, and reporting needs. Stay informed on the latest developments more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Velocity Tech
with one of the best leading insurance companies, in collaboration with a prestigious bank in London. We're actively seeking a talented Senior Data Engineer to enrich our … dynamic team. Responsibilities: Experience designing data models and developing industrialized data pipelines. Strong knowledge of database and data lake systems, with proficiency in Python and SQL (any flavor). Comfortable with shell scripting (e.g., Bash) and provisioning new infrastructure in leading cloud providers more »
Posted:

Software Engineer (Rust/HPC/Real Time Data) - Up to £200k 1st Year Compensation

London Area, United Kingdom
Hunter Bond
Job Title: Software Engineer (Rust/HPC/Real Time Data) Client: Elite Tech Firm Salary: Up to £200k 1st Year Compensation Location: London Sells: Cutting-edge tech, ownership of multiple greenfield projects, no red tape, a friendly/collaborative environment, beautiful offices, personal projects on Fridays! An … as part of a team of engineers looking after and building a zero-down time low latency solutions for multi petabyte/exabyte data sets Working heavily in Rust Building/Optimising some of the world's most advanced data pipelines Collaborating with ML Engineers, Data … experience working as a Software Engineer ideally using Rust Outstanding CompSci Fundamentals needed! Knowledge of data engineering principles/data lake architectures - Arrow/Parquet etc. Excellent knowledge of low-level concepts (e.g. compilers, x86, LLVM etc. more »
Posted:

Python Team Lead Software Engineer Developer Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Python Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset Manager … asset classes such as Fixed Income, equities, FX or commodities Role: Python Software Engineer Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with AWS, Glue, Dremio, Snowflake, Python and Java. more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Azure Data Engineer - London - Up to £800 P/D

London Area, United Kingdom
Hybrid / WFH Options
Hunter Bond
Title: Azure Data Engineer Rate: Up to £800 P/D Length: 12 month rolling Location: London (Hybrid) Description (Full spec avail): To work with an established team on developing a new strategic big data platform for our customer, we are searching for a Senior Azure … Engineer. The current Oracle and Java stack will be replaced with a new platform that is an Azure-based data lake with APIs and events to enable data consumption by analytics teams. The needs for this multi-year migration project include engineering to … facilitate the transfer of data masters from the old platform to the new one. Key requirements : CompSci or equivalent degree from a top global university Awareness of and comprehension of Agile approaches, including TDD and BDD knowledge. familiarity with working in agile development teams Excellent written and verbal more »
Posted:

Data Architect

London, United Kingdom
Harnham
000HYBRID - LONDONThis scale-up telecom group is looking for someone to be hands-on when driving forward their platform's expansion to incorporate data from all business areas as they become more digitally driven...THE COMPANY This group is already one of the UK's largest telecom companies who … to grow into other areas. They aren't just localised to this area though as they've expanded into a global presence. Their data function has undergone extreme change over the two years and they are now in a good position for you to join the team!THE … AND EXPERIENCETo be a successful Data Architect in this area you should be proficient in the following:Expertise in Data Lake migrationAzure experience is going to be beneficial Experience with big dataPrevious python & engineering experience will be useful to understand the end-to-end aspectsHave more »
Salary: £ 100 K
Posted:

Software Engineer

London
Hybrid / WFH Options
Nexus Jobs Limited
include design and development experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to MSFT suites, Azure tools, integration, and data is required. Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Experience with healthcare industry regulations, data … experience using Azure integration tools like Data factory, Logic Apps, etc. Along with knowledge of utilizing Azure SQL Server, Data lake, etc. In-depth knowledge & experience using Visual Studio, with one of the programming languages: C#/Java/JavaScript/Python, and PowerShell. Thorough … Queries, Datatype conversions, etc.). Experience working with APIs, Postman/SOAPUI tools, MS D365, ServiceNow, Azure Analytics tools, Azure Synapse, Azure BYOD & Data verse, Azure DevOps, Informatica, BI tools, etc. is a big plus. General business skills: Excellent communication to translate and explain business requirements to technology more »
Employment Type: Permanent
Salary: £60,000 - £90,000
Posted:

Cloud Data Engineer

London, United Kingdom
LinuxRecruit
can lead to driving innovation. Your experience working with Big Data technologies will be key to creating a new data lake, hub or warehouse. In this role, you will act as a subject matter expert in GCP data technologies and work with stakeholders … to determine complex data relationships and requirements. You will also support the wider analytics/ML/assurance team and business by building and supporting ETL pipelines and processes. This is with a Google Cloud Premier Partner that provides services in cloud strategy and migration, cloud hosting, big … data, machine learning and many more to support business-critical applications. They have a base location in Victoria and have adopted a hybrid stance of 2 days a week in the office with flexibility to the extent that some weeks there will be fewer days. There is a more »
Salary: £ 80 K
Posted:

Lead Data Engineer

London Area, United Kingdom
Understanding Recruitment NFP
Lead Data Engineer A brand new and exciting opportunity has recently arisen for a Lead Data Engineer with an excellent knowledge in ETL, Azure Data Factory, Azure Databricks and CRM Implementations to join one of the UK's Largest Charity based in London. As … the Lead Data Engineer you will be implementing a new CRM (Salesforce) and also leading the migration to Azure. This is an excellent opportunity for an Lead Data Engineer who is looking to work for the Largest UK Charity who are working on exciting projects and … this is the perfect opportunity for you! Skills that are required for a Lead Data Engineer are: Experience in Azure (ADF and Datalake) Experience working with ETL pipelines Previous experience Managing or Mentoring Engineers CRM Implementation experience Lead Data Engineer/Senior Data Engineer more »
Posted:

Senior Machine Learning Engineer

London Area, United Kingdom
Higher - AI recruitment
time to join this ambitious team!! WHAT YOU'LL BE DOING As Senior Machine Learning Engineer, you will sit within the company's Data Science team and report to the Director of Engineering. Their Machine Learning stack runs on on-demand containerised infrastructure – ranging from sub-second latency … TECH STACK: Python, Flask, Redis, Postgres, React, Plotly, Docker. Temporal; AWS Athena SQL, Athena & EMR Spark, ECS Fargate; Azure Synapse/Data Lake Analytics, HDInsight. KEY RESPONSIBILITIES Lead the productionisation of Monolith’s ML models and data processing pipelines, both mid-low-level system and … design and exemplary hands-on implementations using Spark and other tech stacks Shape the ML engineering culture and practices around model & data versioning, scalability, model benchmarking, ML-specific branching & release strategy Concisely break down complex high-level ML requirements into smaller deliverables (epic à task) Proactively identify blockers more »
Posted:

Cube Developer

London Area, United Kingdom
Hybrid / WFH Options
Lorien
Develop and optimize MS SSAS cubes (tabular and dimensional) Develop and improve solutions spanning data processing activities from the data lake (stage) to star schemas and reporting view’s/tables and finally into SSAS. Desired Skills and Experience: You have 5 years experience building … domain understanding, Ideally in finance, marketing, CRM, compliance. You should have a strong understanding of data. Have experience working with large volumes of data (millions or records per day). Can build tabular (or OLAP) cubes properly (with DAX or MDX). Advanced SQL knowledge and ability to … write performance optimized queries. You should have industry standard Data Modelling skills (i.e. Kimball) Whats in it for you? A regular bonus. Competitive salary. Healthcare support, including dental, private medical, and health screening. Wellbeing support And so much more... If the above sounds like it could be you more »
Posted:

Java Solution Architect

Greater London, England, United Kingdom
Response Informatics
of cloud platforms (AWS, Azure). Experience with microservices architecture, APIs, and integration patterns. Proficiency in security architecture and best practices. Familiarity with data architecture, including data warehousing, data lakes, and big data technologies. Full Stack Development: Strong background in both front more »
Posted:
Data Lake
London
10th Percentile
£62,500
25th Percentile
£81,250
Median
£115,000
75th Percentile
£142,500
90th Percentile
£161,266