31 to 55 of 105 Data Lake Jobs in London

Data Analyst Location: Hybrid - London Package: Negotiable + Benefits The Data Analyst for Data Operations will be responsible for gathering, collating and analysing data issues and translating them into data and reporting needs, using technical expertise to ensure data accuracy and high-quality, whilst ensuring delivery deadlines meet business requirements. Working closely with the data operations team, business stakeholders and the wider data team in resolving operational and data issues. The day to day: You will be an experienced analyst who … communication and collaboration skills Experience with data warehousing Experience in the Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL Server, Azure Power Platform, Power BI. The rewards: negotiable basic salary and all the normal benefits you’d expect (Holiday, company more »

Azure Data Architect - Databricks - London I'm currently working with a global organisation that are going through an awesome period of transformation. As an company, they're very people centric and love the culture and environment that they've created not just in their UK offices but also … the most exciting projects across the world. For this role, they're looking for someone to come in and take ownership of the Data Architecture and strategy. They've recently implemented a Modern Data Platform along side Databricks so the successful applicant is expected to come … and engineering initiatives Experience of Azure Data Technologies such as Data Warehousing, Data Factory, Purview, Data Lake and Data bricks Experience in data modelling, database design, data integration and best practices Extensive experience with cloud more »

Contract Data Engineer: Fintech | AWS | Airflow | Glu This dynamic FinTech are looking to add to their already strong DataOps team. As a Data Engineer, you will be working closely with devOps and analytics teams building out and supporting the Data Warehouse (Redshift, migrating to … Snowflake), core data pipelines, and supporting our data infrastructure, and analytics capabilities. The role will also have DBA responsibilities for databases across our estate on Aurora MySQL, RDS MySQL, PostgreSQL, MSSQL. You will be responsible for (not limited to): Contributing to the data architecture … and evolution of our Data technology stack Working and communicating effectively with other data engineers, DevOps engineers, data modellers, data scientists and analysts Designing and building new data pipelines as well as maintenance and support of existing data more »

Data Architect - Consulting - FS A leading global consulting firm is looking for a Data Architect to join their team! As the successful candidate, you will be in charge of designing and implementing scalable architecture and lead a global rollout of the client's digital content platform. … office and it is offering up to £155,000 + bonus + excellent benefits! Required skills: More than 5 years of experience in Data Architecture implementing data migrations to at least one cloud platform including AWS, GCP and/or Azure Data … modernisation and data ingestion experience Experience leading at least one implementation of Databricks and/or Snowflake is required Data Lake and data storage design experience for both structure and unstructured data Experience working for a consultancy or for a financial more »

𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫 - 𝐌𝐚𝐜𝐫𝐨 𝐇𝐞𝐝𝐠𝐞 𝐅𝐮𝐧𝐝 - 𝐋𝐨𝐧𝐝𝐨𝐧 - 𝐔𝐩 𝐭𝐨 £𝟏𝟓𝟎𝐤 + 𝐁𝐨𝐧𝐮𝐬 Note: I have a plethora of live Data Engineering opportunities. Therefore, even if you don't feel your profile is relevant for the role mentioned below, we encourage you to apply anyway to discuss one of the … other positions. A well established Quant Fund we are working with is looking to develop a new high frequency data platform to support the development and deployment of new strategies. The sort of work you would get exposure to includes … building greenfield market data processing systems that will handle very large amounts of market/exchange data, data lake development using AWS Glue, Apache Kafka/Airflow and dbt, and more traditional end-to-end Data Pipeline development. Lastly, part of more »

Our client, a leading global consultancy, are looking for a Senior Data Analyst. The role is based in central London, with hybrid working, on an initial 12-month basis. The Analyst will be the glue for product and data analytics to help derive decisions for Engineering … teams, Business and Product groups, and utilising technical expertise in handling constraints, improving data quality. ROLE: SENIOR DATA ANALYST LOCATION: CENTRAL LONDON (2 x per week in office) RATE: £400 PER DAY INSIDE IR35 LENGTH: 12 MONTHS WITH SCOPE TO EXTEND Key responsibilities: Work with the … scientists and product management teams to understand product roadmap and, establish analytics framework wherever required. Analyze data from data lake and other sources to answer business questions. Understand and build relevant metrics and visualizations which would help business analyze their initiatives and take data more »

We are looking for Senior Data Solution Architect Below are details Data Solution Architect Proven experience as architect and engineering lead in Data & Analytics stream In-depth understanding of data structure principles and data platforms Problem-solving attitude, solution mindset … with implementation expertise Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Well-versed with the end2end data management philosophies and governance processes Has pre-sales experience and have involved in RFP/RFI/RFQ processes Creative problem-solver with … strong communication skills Excellent understanding of traditional and distributed computing paradigm Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write more »

About the job Role: Data Platform Product Manager Location: Central London (2 days per week in office) Harmonic is delighted to partner with a high-growth research and insights scale-up, undergoing a phase of rapid expansion. They have grown 20% YoY for the past 5 years, and … following recent investment are continuing to scale. Being a data-led organisation carrying out some extremely interesting work, the data team has a significant role to play in aiding the growth and success of the organisation and offers the opportunity to work on cutting-edge technologies … such as AI and ML. The Data Platform team currently sits at a headcount of 4 but will double to 8 before the end of the year, offering amazing progression opportunities! Job Responsibilities: Directly lead and manage a team of 2 Data Analysts Embrace a visionary more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients … in the development of disaster recovery and business continuity plans. Preferred Qualifications: 3-5 years working in Azure cloud environments, Azure Data Lake, Azure Data Factory Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. Experience working in healthcare … or pharmaceutical industry. Proficiency in Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Additional certifications in relevant areas such as Azure Security, Azure Networking, or Azure AI/ML. Experience more »

cloud. Performing routine database administration tasks, including backups (where needed), restores, and monitoring. Evaluating and monitoring the performance of the cloud data lake system. Identifying and resolving performance bottlenecks and ensuring optimal database performance. Conducting regular performance tuning and optimization activities. Implementing and enforcing security policies to … for database configurations, procedures, and best practices. Providing training and support for other team members as needed. Contributing to the Cloud Data Lake SharePoint page and building internal content Essential Skills Required: Proven experience as a Database Administrator, with a solid track record and focus on cloud … experience Experience with cloud platforms such as AWS, Azure, or Google Cloud. SQL Server and Microsoft stack. Strong stakeholder management skills Data Lake experience Proficiency in database performance tuning and optimization. Familiarity with database security best practices. Excellent problem-solving and communication skills. This represents an amazing more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … Factory Strong experience with Azure Databricks Some knowledge of the Azure tech stack would be beneficial but not essential: Databricks, Azure Data Lake, Azure Data Factory, Azure Synapse Analytics Benefits: Salary up to £70,000 depending on experience Please Note: This is a permanent role more »

Azure Data Operations Analyst - Data Platform, Investment Management London, Inside IR35 A global investment management firm operating in a multitude of different markets are looking for an Azure Data Operations Analyst to join their IT Production team. The company has quickly grown and really … business what technology can really do. The ideal candidate will have experience liaising with technical and non-technical stakeholders and previously transformed raw data into meaningful reporting and analytical solutions. The successful candidate will focus on the flow of data across the business and the Azure … years of Data Analysis and Dimensional Data Modelling. Strong skills in Azure Data Factory, Azure Data Lake, Azure SQL and Power BI and related services across the data platform services and securing data channels. Working knowledge of more »

BI Developer that has a strong background in Python and Power BI to join the Software Delivery team to strengthen the power of data within the business. The company is moving its data from legacy stores to a strategic data warehouse and data … coding standards, and tools, while also working collaboratively with the team by utilising communication and problem solving skills. Key responsibilities: Ability to build data pipelines that will allow optimal extraction, transformation, and incorporation of data from various data sources. Be able to utilise Power … BI to build dashboards and reports. Understand the Data Virtualisation layer and partner with the Business for continued deployment and Business enhancements. Improve solutions and be able to anticipate where the demand is for the business. Build analytics tools that utilise the data pipeline to provide more »

extensive array of digitally enhanced products and services, tailored to satisfy the diverse needs of their customers who are looking for a lead data and analytics specialist to join their team. Responsibilities: Lead the upskilling, coaching, and mentoring of fellow data engineers. Establish and reinforce data engineering best practices and guidelines. Conceptualize, build, and sustain data pipelines for the efficient extraction, transformation, and loading of data from various sources into our data warehouse and data lakes. Uphold data integrity, quality, and consistency throughout the … entire process. Create and enhance ETL/ELT workflows capable of handling substantial data volumes. Collaborate with data analysts, data scientists, and other stakeholders to comprehend their data needs. Develop and implement appropriate data models to support efficient data more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … Factory Strong experience with Azure Databricks Some knowledge of the Azure tech stack would be beneficial but not essential: Databricks, Azure Data Lake, Azure Data Factory, Azure Synapse Analytics Benefits: Salary up to £70,000 depending on experience Please Note: This is a permanent role more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … Factory Strong experience with Azure Databricks Some knowledge of the Azure tech stack would be beneficial but not essential: Databricks, Azure Data Lake, Azure Data Factory, Azure Synapse Analytics Benefits: Salary up to £70,000 depending on experience Please Note: This is a permanent role more »

Contract Relevant context A fast growing Energy & Commodities trading company is embarking on a transition from a CTRM-centric technology architecture to a data-centric model, termed as the Digital Data Hub (DDH), to enhance scalability and stability. The first phase involves the integration of a … Allegro to Topaz derivatives integration project. Engage in the development of various test automation frameworks targeting web applications, thin client, microservices, real-time data processors, data analytics/visualizations reports. Ensure the automation test frameworks and tests are aligned with the existing programme test automation strategy … experience, backend test experience. Exposure/experience in cosmos dB and azure event hub. in data quality assurance around Data Lake, Data bricks and ETL. Exposure working with Power BI. Knowledge and experience of implementing test best practice. This is an Outside IR35 more »

Data Tech Lead – AWS/OBIEE/EDW/ETL/ELT/Media – London - Up to £750 inside IR35 … A global media organisation based in London is looking to recruit a Data Tech Lead with a focus on data lake platforms. This role is within an existing team in the business and is looking for someone who can design and develop the business data … demonstrable experience with OBIEE and EDW is required. Previous experience as a Technical Lead or Architect is preferred. Having knowledge of Data Lake, Virtualization, and experience with cloud data platforms is essential. Prior experience leading a team and migrating data warehouses to big more »

years of design and development. experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to Azure tools, integration, and data is required. Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Experience with healthcare industry regulations, data … and connectivity & security configurations (certificates, encryptions, etc.). In-depth knowledge and experience with Azure data storage (SQL Server, Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, and ETL processes. Knowledge and some experience of MS Office/MS Office 365 suite, SharePoint Online … DevOps and CI/CD pipeline. Experience working with APIs, Postman/SOAPUI tools, MS D365, ServiceNow, Azure Analytics tools, Azure Data lake, Azure Synapse, Azure BYOD & Data verse, Informatica, BI tools, etc. is a big plus. General business skills: Clear communication to translate and more »

more liquid world. The more we share, the more we all gain. Responsibilities Sharegain is currently in the process of seeking a dedicated Data Engineer to become an integral member of our innovative R&D team. You will play a vital role in managing the entirety of our … data processing framework and infrastructure. Your valuable contributions will not only steer data-centric decision-making but also actively contribute to the evolution of Data monitoring and management solutions across our organization. Within this role, your tasks will encompass the design and execution of … teams (R&D, architects, business) to devise and actualize tailored solutions for their unique operational needs Expand the capabilities of the Data Lake by seamlessly incorporating different data sources Requirements "Can do attitude" Bring over 3 years of hands-on experience in the realms of more »

Lead Data Engineer - Azure/Spark/Databricks Role: Lead Data Engineer Location: London (3 days a week) Salary: £85k - £90k A leading technology firm, renowned for connecting people globally, is looking for a skilled Lead Data Engineer to join their expanding team. In … engineering stack. Key Responsibilities: Lead the design, development, and implementation of data solutions using Azure services such as Spark, Data Lake, Synapse, and Databricks. Code in Spark and oversee the technical design aspects of projects, ensuring adherence to engineering best practices. Lead and mentor a … with remote teams, leveraging your experience in leading distributed teams to drive success. Requirements: Extensive experience with Azure services, including Spark, Data Lake, Synapse, and Databricks. Proficiency in coding with Spark and a strong understanding of design aspects. Deep understanding of engineering best practices and the ability more »

Senior Data Engineer– Databricks/Azure/SQL * Sponsorship is not available with this position * Role – Senior Data Engineer Salary - £70k-£85k DoE Location – Manchester (Hybrid) A well established and award-winning Data consultancy are looking to add a Senior Data Consultant … to rapidly to join their talented data team. You’ll be at the centre of everything they do as a business, supporting a range of top tier clients. The position is offering a basic salary up to £85,000 depending on experience as well as a discretionary bonus … Scheme The Successful Senior Data Engineer will have: · Databricks experience · Skilled across Azure; Azure Data Factor, Azure Data Lake and Azure Synapse. · Advanced knowledge in SQL and good knowledge of Python · Project experience of data warehousing and data modelling more »

Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £60,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great opportunity … to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely with … be up to?: Data Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as more »

Data Engineer - London/Hybrid - £70,000 I am currently working with a market-leading organisation in the legal industry who are looking for a Data Engineer to join their team. The organisation are currently focused on the development of their Azure data platform … and you will play a key part in this project alongside other data driven Data Engineers. You will play a vital role in helping implement the organisations data strategy and transformation roadmap and will become the organisations SME on data related projects … Data Engineering role. Excellent understanding of Azure Databricks Strong coding experience with SQL and Python Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

Data Engineer - London/Hybrid - £70,000 I am currently working with a market-leading organisation in the legal industry who are looking for a Data Engineer to join their team. The organisation are currently focused on the development of their Azure data platform … and you will play a key part in this project alongside other data driven Data Engineers. You will play a vital role in helping implement the organisations data strategy and transformation roadmap and will become the organisations SME on data related projects … Data Engineering role. Excellent understanding of Azure Databricks Strong coding experience with SQL and Python Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »