1 to 25 of 70 Data Lake Jobs in London

Data Platform Manager Location: dmg::media Headquarters – London Position: Permanent Package Description Our benefits package increases the longer you’ve been with us. Here’s what to expect: 25 days’ holiday (increasing by 1 per year up to a total of 30) Upon joining you will be automatically … many other benefits…. Job Introduction DMG:Media own some of the world’s biggest news brands, and as such processes billions of data points every month in order to provide insights and targeting criteria for teams and stakeholders as part of our ambition to be the world … Required Demonstrable experience of working with Databricks Demonstrable experience with and knowledge of Azure components - Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure Synapse etc. Demonstrable experience in Azure Devops/any relevant tools. Experience in any IAC tools. Bachelor's degree in more »

Technologies: Enterprise Data Architect Data Engineer Financial Services Insurance Our client, one of the worlds largest commercial insurance companies with operations in 54 countries and territories has a need for a skilled Data Architect/Data Engineer to join its London based … team. The role is 3 days onsite and 2 days remote. The role: Do you have data engineering or architecture experience within the financial services industry? If you are interested in growing your skills and career within one of the largest commercial insurers in the world, then we … functional data management solutions Hands-on experience architecting and implementing large scale multi field master data management, data lake, business intelligence, data warehouse, and data quality solutions are a must have. Experience in architecting enterprise knowledge graph capability from more »

for designing, developing, and maintaining data pipelines and systems in Azure Cloud environments, with a strong emphasis on Azure Data Lake, Azure Data Factory, and Microservices architecture. Key Responsibilities: Develop and maintain data pipelines in Azure Cloud environments, leveraging Azure Data Lake, Azure Data Factory, and Microservices architecture. Design and implement scalable and efficient data processing solutions using technologies such as ServiceBus, REST API, App Service, SQL Data Warehouse, and Data Mart. Utilize Vector Databases, Cosmos DB, Redis, and Elasticsearch … engineering. Bachelor s Degree or higher in Computer Science or a related field. Proficiency in Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Experience with Vector Databases, Cosmos DB, Redis, Elasticsearch. Strong programming skills in Python, Spark, Databricks, Pyspark, SQL more »

Are you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that transcend … data solutions aligned with business requirements. Design and fine-tune data storage and retrieval systems using Azure Data Lake Storage, Azure SQL Database, and other Azure DB services. Develop, optimize, and maintain data pipelines for automated data integration from … and/or BI Developer. Proficiency in Azure data tools such as Data Factory, Synapse, Databricks, SQL, Data Lake or Delta Lake. Strong data engineering and data modeling skills, with the ability to craft complex data models. more »

will be invaluable. Main Responsibilities: Design and implement effective database solutions and models to store and retrieve data including Data Lake and Data Warehousing Assess database implementation procedures to ensure they comply with GDPR and data compliance Design conceptual and logical … the benefits, pros and cons of solution options. Skills & experience required: Strong hands-on experience in Data Warehouse and Data Lake technologies preferably around Azure Extensive experience in implementing solutions around DataBricks, Azure Data Factory, Azure SQL, CosmosDB, Cognite Services, Storage Accounts, Azure … of working with structured and unstructured datasets Able to design a range of architectural solutions Data models and ETL Data lake and data warehouse end to end architecture Experience within media, publishing, research, or a similar consumer focused industry is highly desirable, but more »

ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure … ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure … Purview or another governance tool experience. Familiar with building Catalogs and lineage Lead Azure Data Engineer PySpark (Python), Synapse, Data Lake Tech for Good/Charity more »

Data Architect We are searching for an experienced Data Architect About RSM Consulting brings together multiple teams across Transactions, Risk & Consulting, ABA, and Outsourcing to provide client-centric solutions for RSM s current and future clients within the middle market. Our Consulting team has a major … empower our people to make an impact and develop their own unique career path. About the team and your role Our Digital and Data Advisory practice, as part of our broader Business Transformation client offering, consists of three teams: Digital Finance team working with clients to understand how … Data Tools (SSDT), SQL Server Reporting Services (SSRS), Azure Data Resources, Azure Data Factory, Azure Data Lake, Azure Data Bricks and Azure Analysis Services. Able to support clients and prospects in their evaluation of Business Intelligence solutions providing information more »

Job Title: AWS Data Architect Location: United Kingdom (U.K.) - Hybrid The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy dedicated to delivering exceptional value to our clients in the public sector. Our company culture promotes collaboration, autonomy, and rapid learning, empowering our … work environment focused on deliverable outcomes, along with a range of benefits to support our employees well-being and professional development. Key Responsibilities: Data Architecture Design: Collaborate with stakeholders to understand data requirements and design scalable and secure data architectures on AWS. Develop data models, data flow diagrams, and architectural documentation to support financial applications. Cloud Data Management: Design, implement, and manage cloud-based data solutions on AWS, including data lakes, data warehouses, and analytics platforms. Ensure the scalability, performance, and cost more »

Role: Data Modelling Job Type: Permanent Location: London (Hybrid) Ready to utilize your Data analysis and Investigatory skills ? Are you passionate about RDBMS systems and converting data requirements into logical models and physical solutions? We have an exciting role for you as a Data … the future of technology. with some of the brightest global minds in the industry. access to endless learning opportunities. The Role As a Data Modeler, you will utilise your analytical skills to design, implement and create conceptual, logical, and physical data models. Key responsibilities: modelling standards … to convert data requirements into logical models and physical solutions. with data warehousing solutions (e.g. Snowflake) and data lake architecture, Azure Databricks/Pyspark & ADF. retail data model standards - ADRM. communication skills, organisational and time management skills. to innovate, support change more »

a successful, dynamic, and creative global business then we want to hear from you. The Opportunity: We have an exciting opportunity for a Data Warehouse Architect to join a rapidly growing data team in Clarion. The role will report into the Senior Architect, with responsibility to … overcome complex challenges, and grow your design through developing skills with the new initiatives we are looking to explore. Key Responsibilities: Analyse existing data design and suggest improvements that promote performance, stability, and interoperability. Work with product management and business subject matter experts to translate business requirements into … Analytics platform including Azure Synaps Azure Logic Apps, Azure Functions, Azure Storage Azure SQL Data Warehouse, Azure Data Lake, Azure Databricks Azure Cosmos DB, Azure Data Factory, Azure Search, Azure Stream Analytics Delta Lake and Data Lakes Apache more »

html Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? Position: Lead Data Engineer Lead Data Management and Architecture: Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable and robust data … efficiency, and quality. Proficiency in Microsoft Azure Data Services, including Azure SQL Database, Azure Data Factory, Azure Data Lake Storage, and Azure HDInsight. Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases. Strong experience in more »

or Contract Pay Range: Based on experience level GENERAL DESCRIPTION & RESPONSIBILITIES The Azure AI Solution Architect will lead the creation of high-value data driven solutions leveraging Cyclotron s proven implementation methodology and solutions for enterprise projects, as well as contributing to technical pre-sales activities as required. … and implementing Retrieval Augmented Generation (RAG) Information Architecture Data Modeling principles for relational and dimensional data structures Data Lake design principles, Data Virtualization Strong knowledge of data warehouse concepts and T-SQL relational/non-relational databases for data … SQL/SQL Server 2016+ (SQL, Structure, Stored Procs, Tuning) ETL/ELT, (ADF, SSIS) Data governance (Purview, Unity Catalogue) Databricks Delta Lake Storage Azure Dev OPS DESIRED SKILLS Advanced Analytics Data Technologies Databricks, Delta Lake, Synapse Spark SQL, Pyspark Azure Data more »

Azure Data & AI Solution Architect - Hybrid - Once a week in London, Reading, Manchester, Sheffield, Cardiff or Milton Keynes! Are you an experienced Data & AI Solution Architect with a strong understanding of the Azure Data tech stack? If so, this role might be for you … As an Azure Data & AI Solution Architect, you will take a founding role in a newly formed Data & AI team, where you'll have say on the vision and strategic decision … making of this exciting journey! Experience with the below is required: Azure Data skills - Databricks, Data Factory, Data Lake, Data Sync, Data Gateway, Data Services, Fabric etc AI knowledge - experience with Copilot/GenAI (desirable) A proven more »

Data Architect (fully remote) Salary: £85,000 + company benefits Full time - Permanent Must be able to gain SC Clearance Job Purpose: To work within a team of architects providing support to core infrastructure and business led projects, providing specific data architecture expertise to solution and … The person appointed will be an integral member of the Architecture Team and will be responsible for ensuring that all initiatives explicitly consider data as part of their approach, and that all elements of the data lifecycle are adequately provisioned. They will also be expected to … and data transformation (extract, transform and load) processes and the supporting technologies such as Azure Data Factory, Data Lake, other analytics products Experience of architecting data solution across hybrid (cloud, on premise) data platforms Experience implementing data more »

elevate the unique abilities and business aspirations of customers and employees and build relationships based on trust and value. Role Overview The Principal Data Architect will have following responsibilities: Transformational Leadership: Lead and guide the development of cloud data platforms, leveraging your extensive experience to drive … innovation and change. Effective Communication: Collaborate seamlessly with C-suite executives, translating business vision into actionable data initiatives that deliver tangible value. Data Strategy Expertise: Shape robust data strategies that align with organizational goals, emphasizing business intelligence (BI) and AI/ML capabilities. Team … Building: Assemble and nurture high-performing data teams, fostering a culture of excellence and driving multi-million-pound benefits. Solution Implementation: Successfully drive complex, large-scale data solutions from concept to execution. Continuous Learning: Demonstrate a commitment to personal and team growth, staying abreast of industry more »

Data Migration Developer (SC Cleared) London (Hybrid) Permanent £7 0,000 - £90,000 (DOE) + Benefits An experienced Data Migration Developer wanted with active SC clearance. This fantastic opportunity will involve playing a dual role as a Migration Specialist and Developer. Hybrid working with the expectation … to write high-quality, maintainable code using languages such as Python, SQL Server. PC, PowerShell, Sharepoint, Azure, Desktop Support , Snowflake, Azure Data Lake services (ALA) Gen 2. Expertise in development, testing Proof of Concepts (PoCs), delivering Minimum Viable Products (MVPs) is essential for achieving project success. Develop … Plan, design, and execute PoCs to validate new technologies, frameworks, or solutions. Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2. Utilize PowerBI, Tableau, or similar tools to design and create interactive and visually appealing dashboards and reports. Familiarity with data more »

and work with key stakeholders across the firm to prioritise and resource delivery activities in line with business priorities. * Define and implement a Data Governance Framework and associated quality metrics and ensure ownership is unambiguous for all core data sets and systems. * Identify data gaps or data acquisition needs and ensure they are clearly aligned to business imperatives and priorities. * Work with internal and third-party technology teams to ensure development activity is conducted to the expected level of quality and timeliness, providing constructive feedback and coaching where appropriate. Technical … Services: Hands-on experience with Azure data services like Azure SQL Database, Azure Data Factory, Azure Data Lake, and Azure Synapse Analytics. * SQL Database Experience: Proficiency in SQL databases with the ability to write complex queries and procedures. Experience with Azure SQL more »

Senior Databricks Migration Consultant Remote This role demands in-depth knowledge of data engineering, cloud technologies (preferably AWS), and a successful record in enterprise level data migrations into Databricks. You will ensure the efficient and secure transition of our data assets to the Databricks … Lakehouse Platform, working closely with our external vendors. You will - Analyze data requirements, migration impacts, and project dependencies. - Develop detailed data migration strategies, including architectural plans, data quality evaluations, testing, and creating robust data pipelines and workflows for Databricks best practices. - Maintain … data integrity, security, and compliance with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, and ETL tools to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and more »

aspirations for strategic expansion and growth to be achieved through both organic and acquisitive means. The Role: We are currently hiring for a Data Architect, who will be accountable for architecting, enhancing, managing, and supporting a highly available, distributed, cloud data platform for Sysco International business … units and enterprise data. The Architect will collaborate with the International business units, US architecture team and Sysco 3rd party Vendors to create data solution andl ensure alignment between the international businesses in the deployment of initiatives. The role will also be the point of escalation for the … architecting enterprise-level comprehensive data management strategies, data architecture for large systems, and with the modernization of data lake/warehouse environments. Expertise in both leading and hands-on experience in data engineering and management activities such as Data more »

Role: Data Architect Location: Remote Salary: £85,000 + flexible working, 27 days holiday, pension contributions, annual training budget just for you, profit share scheme & more! *Need to be eligible for SC Clearance iO Associates are working with a successful and growing Defence company who are looking for … a Data Architect to join them on a permanent basis They are an international defence, aerospace and security company operating in many different countries, delivering engineering, support and critical systems to defence and civil markets. They design and manufacture a range of defence and civil specialist equipment, from … and data transformation (extract, transform and load) processes and the supporting technologies such as Azure Data Factory, Data Lake, other analytics products Experience of architecting data solution across hybrid (cloud, on premise) data platforms Experience implementing data more »

consulting services elevate the unique abilities and business aspirations of customers and employees and build relationships based on trust and value. The Lead Data Architect will design and implement solutions using a range of AWS infrastructure, including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, RDS, Athena, Kinesis … Quicksight. We also widely use other tech such as Snowflake, DBT, Databricks, Informatica, Matillion, Airflow, Tableau, Power BI etc. The Lead Data Architect will liaise with clients to define requirements, refine solutions and ultimately hand over to our own Managed Service Teams or to our clients own technical … learn new things and share our ideas, so that clients get the best return on their investments. Essential experience: Shaping & designing solutions (notably data analytics, data integration, data platform) Driving the performance of assurance activity to delivery appropriate quality Leading the production of solutions more »

Data Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established organisation within the education sector who are looking for a Data Engineer to join their established IT team. Their current project is based around the creation and implementation of a … brand new Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. This is an opportunity to join a team who are serious about the way that they use data … Excellent understanding of Azure Databricks Experience creating data pipelines using Azure Data Factory Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … Factory Strong experience with Azure Databricks Some knowledge of the Azure tech stack would be beneficial but not essential: Databricks, Azure Data Lake, Azure Data Factory, Azure Synapse Analytics Benefits: Salary up to £70,000 depending on experience Please Note: This is a permanent role more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … Factory Strong experience with Azure Databricks Some knowledge of the Azure tech stack would be beneficial but not essential: Databricks, Azure Data Lake, Azure Data Factory, Azure Synapse Analytics Benefits: Salary up to £70,000 depending on experience Please Note: This is a permanent role more »

SC Cleared) London (Hybrid) Permanent £70,000 - £90,000 (DOE) Software Developer needed with active SC Security Clearance and strong Python, SQL + Data Visualisation tools (PowerBI/Tableau). Working in London on a hybrid remote basis (typically 2-3 days/week in the office). … + implementing innovative banking applications and systems. Python and SQL programming/development experience. Developing high-quality, maintainable Python and SQL code. Developing data interfaces to connect multiple banking systems including: SQL queries, data retrieval, data manipulation, data modelling + data … web applications. Azure Cloud: designing + implementing Azure cloud based solutions + using data tools like Snowflake and Azure Data Lake Services (ADLS). Developing solutions for Proof of Concept (POC) + Minimum Viable Products (MVP). Advantageous: Banking, JavaScript, HTML, CSS + front-end more »