1 to 25 of 27 Data Lake Jobs in London

An industry-leading insights organisation are looking for a Data Architect who is well-versed in Microsoft SQL Server, Data Lake technologies, and has experience implementing solutions around Azure including Databricks, as they look to strengthen and build upon their modern data estate. … team, the focus of your role will be designing and implementing effective solutions to store and retrieve data, including data lake and data warehousing solutions - ensuring that these are flexible, and able to be extended to accommodate future project needs. Working purely on … or similar Strong experience with SQL Server databases and data modelling Strong experience with Data Warehouse and Data Lake technologies Experience architecting and implementing solutions around Azure technologies including Databricks, Data Factory, Azure SQL, Synapse etc. Knowledge of Agile methodology Excellent more »

An industry-leading insights organisation are looking for a Data Architect who is well-versed in Microsoft SQL Server, Data Lake technologies, and has experience implementing solutions around Azure including Databricks, as they look to strengthen and build upon their modern data estate. … team, the focus of your role will be designing and implementing effective solutions to store and retrieve data, including data lake and data warehousing solutions - ensuring that these are flexible, and able to be extended to accommodate future project needs. Working purely on … or similar Strong experience with SQL Server databases and data modelling Strong experience with Data Warehouse and Data Lake technologies Experience architecting and implementing solutions around Azure technologies including Databricks, Data Factory, Azure SQL, Synapse etc. Knowledge of Agile methodology Excellent more »

An industry-leading insights organisation are looking for a Data Architect who is well-versed in Microsoft SQL Server, Data Lake technologies, and has experience implementing solutions around Azure including Databricks, as they look to strengthen and build upon their modern data estate. … team, the focus of your role will be designing and implementing effective solutions to store and retrieve data, including data lake and data warehousing solutions - ensuring that these are flexible, and able to be extended to accommodate future project needs. Working purely on … or similar Strong experience with SQL Server databases and data modelling Strong experience with Data Warehouse and Data Lake technologies Experience architecting and implementing solutions around Azure technologies including Databricks, Data Factory, Azure SQL, Synapse etc. Knowledge of Agile methodology Excellent more »

Azure Databricks Data Engineer - UK Wide - Hybrid Salary: £85,000 - £95,000 - Bonus + Pension + Private Healthcare Location: London/UK Wide Location - Hybrid working The Role: As a Databricks Data Engineer with an Azure focus, you will be an integral part of our team … high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Develop and maintain secure data warehouses and data lakehouses: Implement data models, data … pipeline development. Strong understanding of data warehousing concepts and practices. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks, and Azure Data Factory. Knowledge of SQL and scripting languages like Python or Scala. Hands-on experience with AI/ more »

Title: Data Platform Manager Location: Hybrid - One day per week in London office Salary: Up to £90,000 + Package Our client, a prominent player in the retail sector, is seeking a highly skilled Data Platform Manager to lead their data management and analytics … initiatives. The ideal candidate will have extensive experience with ERP systems (preferably Dynamics 365), data governance, data visualization tools (Tableau and PowerBI), and the design and management of data lakes and data warehouses. Proficiency in advanced SQL and scripting languages (such as … Strong background in data governance, data visualization (Tableau and PowerBI), and data architecture. Experience with data lake and data warehouse design and management. Proficiency in data management tools and platforms (e.g., Azure, AWS, MsSQL). Advanced SQL more »

Principal Data Architect The Company Cognizant (NASDAQ:CTSH) is a leading provider of information technology, consulting, and business process outsourcing services, dedicated to helping the world's leading companies build stronger businesses. Headquartered in Teaneck, New Jersey (U.S.), Cognizant has over 350,000 employees as of January 2024. … elevate the unique abilities and business aspirations of customers and employees and build relationships based on trust and value. Role Overview The Principal Data Architect will have following responsibilities: Transformational Leadership: Lead and guide the development of cloud data platforms, leveraging your extensive experience to drive … innovation and change. Effective Communication: Collaborate seamlessly with C-suite executives, translating business vision into actionable data initiatives that deliver tangible value. Data Strategy Expertise: Shape robust data strategies that align with organizational goals, emphasizing business intelligence (BI) and AI/ML capabilities. Team more »

per week - flexible options considered Contract Type: Permanent Join our growing team at one of LinkedIn's Top Companies for 2024! As a Data Engineer, you'll design, develop, and maintain the infrastructure that drives Clarion's data-focussed initiatives. Your main tasks include building efficient … data pipelines, ensuring data quality, and optimising workflows. You'll work closely with Business Intelligence Analysts and stakeholders to meet data requirements and deliver solutions such as data marts and evolve the Enterprise Data Warehouse. About You Alongside your natural … data transformation, and data integration. You'll have a broad understanding of data warehousing concepts, data lake architectures, and cloud-based data storage solutions (e.g., AWS, Azure) and be familiar with data orchestration and workflow management tools more »

Data Architect La Fosse are partnered with a research & insights firm to recruit a Data Architect to support the company's growth. The successful candidate will craft, refine, and manage data systems and models, ensuring they align with the strategic vision, while prioritizing security … regulatory compliance. This individual will join a small architecture team (currently have a Solution and Technical Architect) and work closely with the wider data engineering team, in addition to engaging with senior CxO level stakeholders including the COO and CTO. Main Duties and Responsibilities: Design and implement database … Architect, from a Data Engineering background Knowledge of database structures Hands-on experience with Data Warehouse and Data Lake technologies, (preferably Azure) Experience with DataBricks, Azure Data Factory, Azure SQL, CosmosDB Understanding of Microsoft SQL Server and data modeling more »

My Client a leading powerhouse within London are looking to add an New Lead Data Engineer to their team. The Data Engineer will support our software developers, PowerBI developers, data analysts and data scientists on data initiatives and will ensure … optimal data delivery architecture is consistent throughout ongoing projects. Job Title: Lead Data Engineer Location: London (Hybrid 3 Days in Office a week) Salary: £80,000 - £100,000 (Dependent on experience) Job Type: Permanent Start: ASAP Experience Building Data Pipelines Designed and managed data … data modelling Technical Skills Proficient in SQL Server and relational database management Experience with cloud platforms like Azure (Synapse, Data Lake) Programming in Python, PySpark, and T-SQL Additional Skills Familiarity with data analysis tools and workflows Strong communication and collaboration skills Experience more »

My Client a leading powerhouse within London are looking to add an Azure Data Engineer to their team. The Azure Data Engineer will support our software developers, PowerBI developers, data analysts and data scientists on data initiatives and will ensure … optimal data delivery architecture is consistent throughout ongoing projects. Job Title: Lead Data Engineer Location: London (Hybrid) Salary: £60,000 - £70,000 (Dependent on experience) Job Type: Permanent Start: ASAP Experience Building Data Pipelines Designed and managed data pipelines for complex systems … data modelling Technical Skills Proficient in SQL Server and relational database management Experience with cloud platforms like Azure (Synapse, Data Lake) Programming in Python, PySpark, and T-SQL Additional Skills Familiarity with data analysis tools and workflows Strong communication and collaboration skills Experience more »

Data Architect - London - £90,000 I am working with a hugely reputable and successful organisation within the legal industry who are looking for a Data Architect to join their growing team. In this role your primary responsibility will be the design, development and implementation of data … one of the leaders within the industry and have invested heavily in their digital transformation projects. They have recently implemented a Modern Azure Data Platform along side Databricks and in this role you will be responsible for the ongoing architectural design of the data platform. You … an Azure cloud environment Experience implementing solutions based around Databricks and other Azure based technologies Strong Data Warehouse and Data Lake technology experience Experience managing full project lifecycles on data driven projects This is just a brief overview of the role. For the more »

Job Title: Lead Data Engineer Location:Chiswick Salary/Rate: £90,000 - £110,000 Start Date: 01/09/2024 Job Type: Permanent We're looking for an experienced Data Engineer to join our Engineering team within the Digital & Product Department. This role is hands … on and will involve leading a team of talented data engineers to design and build scalable data pipelines. You'll be responsible for transforming raw data into valuable insights and working closely with cross-functional teams, including Product, Engineering, Data, and Business …/ELT processes and medallion architecture Strong skills in SQL Server, Python, PySpark, and T-SQL Familiarity with Azure Synapse, Azure Data Lake, and Azure ML Studio Experience with Azure DevOps and CI/CD processes Excellent analytical and communication skills. If you are interested in this more »

be responsible on a daily basis for: Oversee the BI Support and BAU activities of the team Define and defend the company's data standards and principles. Ensure the flow of data within Chaucer is as efficient as possible. Ensure data is organised and … business. Support BAU team members on prioritizing tasks, managing changes, and allocating resources. Identify improvements in the run processes and work with the Data and Analytics teams to streamline and improve the processes. To be considered for this role the BI Support Lead should have most of the … between systems to provide a comprehensive data architecture. Knowledge of Cloud based big data frameworks such as data lake, relational, Graph and other no-SQL databases. Familiar with cloud and data management trends Experience in the use of data more »

About the roleA Payments FinTech are currently seeking a Data Engineering Lead (Python, Hadoop & SQL) to lead and mentor a talented team of data engineers and scientists as they look to simplify the bank through developing innovative data driven solutions, allowing them to be … business-critical platforms.Desirable skills & experienceWorking to an Agile methodology and familiarity with Azure DevOpsDeep automation knowledge with PythonSkilled in Pyspark and SynapseExperience with data modelling and visualisation in … Power BI (or alternative)A strong understanding of architecting data platforms, BI, MI, or analytics solutionsStrong experience using Azure Data Lake, Azure Data FactoryDeliver the automation data pipelines and building of a scalable data architecture. more »

financial backbone of the nation. Inspire People is working with the Bank of England to seek an experienced Solution Architect with expertise in data analytics and cloud-based solutions (Azure) to play a key role in the development and enhancement of the architecture strategy and roadmaps for data … financial system, to collaborate with industry experts and thought leaders and contribute to the shaping of national financial policies and practices through effective data analytics. Key Responsibilities: * Lead pivotal programmes and projects, crafting data solutions that align with business and technology strategies. * Translate business goals into … enterprise-wide technology and data strategies. * Design and produce architectural artefacts for data platforms, migration strategies, and analytics solutions. * Drive the development and enhancement of data and analytics architecture strategy. * Guide the implementation of data governance standards and best practices. * Represent and more »

and how different services impact products. This role involves collaborating with stakeholders to ensure the successful build and deployment of a data lake that meets the needs of users and enhances data-driven decision-making. This is a brilliant opportunity to work on a project … years of experience as a Business Analyst Active SC clearance Conducting in-depth analysis to identify how insights are currently measured Data Lake Development Support Facilitating workshops, interviews, and surveys Engaging with users and stakeholders to gather requirements Overview: £500 Inside IR35 SC Cleared Hybrid- London Start more »

Senior Java Software Engineer (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial … Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Java Software Engineer (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Java, Python and AWS. If you have more »

Lead Data Engineer - up to £100K - Hybrid London Our client a global brand based out of lovely offices in West London are looking for a Lead Data Engineer to work on a business-critical, brand new, innovative high availability application which will be used by thousands … who is looking to take their next step in their career and wants to take on more responsibility. Technical Skillset: Experience as a data engineer developing and maintenance of ETL/ELT processes Good experience in Data Modeling within a cloud … based data platform Strong experience with SQL Server Azure data engineering stack, including Azure Synapse and Azure Data Lake Python, PySpark and T-SQL In return you will be offered a competitive salary and benefits package, remote working options and an opportunity to more »

Senior Azure Data/AI Consultant Remote 65-75k Base + Great Benefits Our firmly established, award-winning and highly regarded MSP client requires a Senior Azure Data/AI Consultantt to be based remotely in the UK. This amazing company has doubled in size … set to continue over the next 3-5 years. This presents an amazing development opportunity for the right candidate. As a Senior Azure Data/AI Consultant, you will: Play a pivotal role in the design, development, and implementation of AI solutions - accelerating AI adoption Lead a growing … experience Experience in co-developing AI solutions in various industries Hands-on experience with Azure Machine Learning, Azure Cognitive Services, Azure Data Lake, and other relevant Azure services Generative and conversational AI-centric applications and embedding models knowledge of Power Platform and/or CoPilot DevOps practices more »

work with outstanding digital talent across disciplines to innovate and create great solutions for iconic brands.We are seeking a dynamic and skilled Salesforce Data Cloud Solution Architect with a unique blend of technical expertise and strategic acumen. The ideal candidate should possess profound knowledge in Salesforce Data … solver who is passionate about delving into intricate details, raising pertinent questions, making informed recommendations, and driving impactful results.Develop, build, and implement Salesforce Data Cloud instances in conjunction with Salesforce Marketing Cloud.Drive end-to-end project execution, encompassing analysis, documentation, solution development, testing, and performance, to meet client … expectations.Identify technical design and data model risks, confirm their validity, and devise strategies to mitigate them.Actively participate in technical design and data model workshops alongside Engineering Teams and business stakeholders.Clearly translate and communicate technical requirements and solutions to the business using story-based narratives, and present more »

000HYBRID - LONDONThis scale-up telecom group is looking for someone to be hands-on when driving forward their platform's expansion to incorporate data from all business areas as they become more digitally driven...THE COMPANY This group is already one of the UK's largest telecom companies who … to grow into other areas. They aren't just localised to this area though as they've expanded into a global presence. Their data function has undergone extreme change over the two years and they are now in a good position for you to join the team!THE … AND EXPERIENCETo be a successful Data Architect in this area you should be proficient in the following:Expertise in Data Lake migrationAzure experience is going to be beneficial Experience with big dataPrevious python & engineering experience will be useful to understand the end-to-end aspectsHave more »

Position: AWS Data Engineer Location: Remote Contract Duration: 6 months Pay Rate: 300 Outside IR35 We are seeking a skilled AWS Data Engineer with a focus on data lakes to join our London office and play a crucial role in building robust data pipelines from the ground up. Key Responsibilities: Design, develop, and implement scalable and efficient data pipelines on AWS, with a focus on data lakes. Extensive experience building pipelines from the ground up, ensuring efficiency and scalability. Collaborate with cross-functional teams to understand data requirements and deliver optimal solutions. Ensure data quality, security, and compliance with best practices. Troubleshoot and optimize existing data infrastructure. Required Skills: Proven experience as a Data Engineer with a focus on AWS technologies. Strong proficiency in AWS services such as S3 more »

enterprise systems. Develop and maintain architectural blueprints, integration patterns, and best practices for seamless data integration. Design and manage data lake solutions that integrate data from multiple sources, ensuring scalability, performance, and security. Propose and implement improvements to existing integration processes and systems … Work closely with cross-functional teams including data engineers, business analysts, and project managers to deliver integrated solutions. Projects: Setting up 4 legal entities across Netherlands and Scandinavia (experience of what good looks like from project perspective in an FMCG environment across Western Europe) (experience of using data more »

Good understanding of networking principles Experience working in AWS, GCP, Azure and migration of data from building outputs to data lake an advantage Previous experience working with a Master Systems Integrator is an advantage Experience with secure MQTT Must have excellent verbal and written communication more »

advisory experience in Security OperationsOperational level experience in some of these domains (not all): security engineering, alert triaging, rule writing, incident response, DFIR, Data Leakage Prevention, Threat Intelligence, Vulnerability … and Patch Management, Deception Technologies, Identity Management and security control testingIn-depth knowledge of at least one SIEM platform or security data lake and related processesKnowledge of various security tools, their functions and comparisons such as XDR, Vulnerability Management solutions, MITRE ATT&CK, SOAR tools, CASB, Email more »