101 to 125 of 164 Permanent Data Lake Jobs in England

My Client a leading powerhouse within London are looking to add an New Lead Data Engineer to their team. The Data Engineer will support our software developers, PowerBI developers, data analysts and data scientists on data initiatives and will ensure … optimal data delivery architecture is consistent throughout ongoing projects. Job Title: Lead Data Engineer Location: London (Hybrid 3 Days in Office a week) Salary: £80,000 - £100,000 (Dependent on experience) Job Type: Permanent Start: ASAP Experience Building Data Pipelines Designed and managed data … data modelling Technical Skills Proficient in SQL Server and relational database management Experience with cloud platforms like Azure (Synapse, Data Lake) Programming in Python, PySpark, and T-SQL Additional Skills Familiarity with data analysis tools and workflows Strong communication and collaboration skills Experience more »

Are you a data-focused professional ready for your next challenge in a fast-paced and innovative environment? A leading UK company is looking for a Data Scientist to join their team and play a pivotal role in using data to drive smarter decision … maintaining weekly KPI dashboards, providing actionable insights, and automating processes to increase efficiency. You will be central to ensuring the company leverages its data to gain a competitive edge and make informed, data-led decisions. Responsibilities: Collaborate with stakeholders to understand business goals and utilise data … mining, wrangling, and open-source big-data technologies (e.g. Microsoft Azure). Experience with data warehouses and data lake structures/visualisation tools like Power BI or Tableau. Proficiency in programming languages such as SQL, Python (PySpark), R, and Scala is advantageous. Solid more »

Senior Data Engineer Manchester – Hybrid Up to £85,000 per annum + benefits A fast-scaling financial company is seeking a Senior Data Engineer to join their expanding tech and analytics teams. The company is looking to become more cross-functional, with a strong focus on … team members to enhance their problem-solving skills. This role is perfect for someone passionate about upskilling and developing others while tackling complex data challenges. The specific technologies used are important, but the real focus is on how problems are approached and solved. Responsibilities : Design and implement scalable … innovative tools and methodologies. Engage with cloud-based technologies, particularly within Microsoft Azure , using tools like Azure Data Factory , Data Lake , and Azure Functions . Utilize Infrastructure as Code (IaC) , leveraging Terraform for efficient, scalable infrastructure management. Build and manage ETL/ELT workflows for more »

Head of Enterprise Data Architecture Velocity Tech is partnered with a leading global risk management firm, we are seeking a Head of Enterprise Data Architecture. This role is integral to shaping how data is ingested, managed, and utilized across the organization, supporting a future … focused approach to risk and data management. What You’ll Be Doing: The Head of Enterprise Data Architecture will be responsible for defining and evolving the organization’s data architecture … working closely with business, technology, and data stakeholders. This role is crucial in managing data across operational, data lake, and analytics landscapes. The goal is to ensure the architecture supports value creation across various areas, including underwriting, financial reporting, portfolio management, and operational more »

I hub has an end- to-end portfolio of market leading services and develops integrated technology solutions to accelerate digital transformation through: Cloud, Data & AI (Adatis), Enterprise Applications (Incremental), Workplace Services and Cyber Security & Networking. Values: Open, Trusted and Bold Trusted Partners: Microsoft: Top 3 Service Providers, Azure … role will vary depending on the project but will primarily focus on the delivery of enterprise-level applications in the Business Intelligence and Data Analytics arena. This is a client-facing position, so the ideal candidate must be comfortable speaking with clients and some occasional travel. Our offices … either of the offices either a Wednesday or a Friday. RESPONSIBILITIES Working on projects that utilise products within the Microsoft Azure and SQL Data analytics stack Satisfying the expectations and requirements of customers, both internal and external Supporting others in their development Contributing to the internal and external more »

SENIOR AZURE DATA ENGINEER UK BASED - HYBRID WORKING OCCASIONAL TRAVEL TO BATH, LEEDS OR MANCHESTER OFFICE SALARY = £65,000 + BONUS AND BENEFITS My client is a global manufacturing organisation who provide critical equipment to various industries including; Oil and Gas, Water and Power and Chemical producers. They … are moving their data services from on-premis to Azure and are looking for a Senior Data Engineer who can help to lead and deliver this change. Job Description: This role will drive the maturity of the Business Intelligence function by leading the efficient and reliable … as a Data Engineer with a focus on Azure services. • Expert across Azure; Azure Data Factory, Azure Data Lake and Azure Synapse and the Microsoft BI stack • Strong proficiency in SQL and database management systems For more information, please apply with your latest more »

MUST HAVE DV CLEARANCE: PLEASE DO NOT APPY IF YOU DONT MEET THIS REQUIREMENT Job Title: AWS Infrastructure/Data Engineer (Hybrid, UK) Hybrid: Remote + 1 days a week in West Midland area JobID: 02 Company Overview: Atreides helps organizations transform large and complex multi-modal datasets … into information-rich, geo-spatial data subscriptions used across various use cases. We focus on providing defense intelligence professionals with high-fidelity data solutions to derive insights quickly. As a fast-growing, high-performance early-stage company, we value diversity and inclusion, trust, and autonomy. A … with Postgres, GraphQL, and other data manipulation tools. Knowledge of big data tools and environments, including Apache Iceberg and other datalake concepts. Familiarity with geospatial data formats such as Parquet/GeoParquet, GeoJSON, and Shapefiles. Experience with DevOps tools such as Git, Docker, Jenkins more »

I have partnered with a dynamic insurance company who are hiring for a Head of Enterprise Data … Architecture. You'll be responsible for how they ingest, manage and move data across the organisation through the operational, data lake & analytics landscape. You’ll also be responsible for defining and evolving the overall data architecture, working closely with Business, technology & data … an excellent team player with a positive attitude. This role will play a critical part in supporting my clients journey to develop its data & AI capabilities on next-generation technology. In this role, you’ll lead on and ensure the Data Architecture underpins value creation for more »

Lead Data Engineer – Hybrid – Central London (Azure, Pyspark, T-SQL) As a skilled Lead Data Engineer, who is confident working with Python, Pyspark, Azure and T-SQL you will be working as part of a small but well skilled team, reporting into the Head of Data. … days working from home. You can look forward to a starting salary of £90,000 You will work closely with the Head of Data with opportunities to upskill. *Benefits including Wellness, Discounted Gym Membership, Career growth plans, 25 days Holiday. About them The company are an award winning … Engineer, working with Azure Infrastructure and Cloud. Familiar with ETL/ELT processes within a medallion architecture. Azure Synapse, Aure Data Lake Programming Python, Pyspark and T-SQL *Candidates must be UK based and be fully eligible to work in the UK without sponsorship. What’s more »

of the following domains: Microsoft Dynamics 365/CRM solutions Microsoft Modern Workplace solutions (e.g. Sharepoint) Microsoft Data solutions (Data Lake, Power BI analytics solutions) Microsoft Cloud solutions (Azure compute, identity, access) Partner Experience : Proven success of co-selling with strategic partners, preferably Microsoft. more »

machine-powered detection, enrichment, correlation, prioritization, triage, and investigation, freeing analysts to proactively protect their organizations. Hunters utilizes an open security data lake architecture, ensuring complete and cost-effective coverage of the entire security stack. Enterprises like Booking.com, Snowflake, and ABInBev leverage Hunters SOC Platform to empower more »

looking for a talented and motivated individual to take ownership of all the processes across their engineering teams, including software development, digital, and data platforms. You'll work closely with the engineering teams, managers, and architects to establish baselines and implement effective methodologies for measuring and improving developer … to really make your mark in the organisation. The following skills/experience is required: Proven track record in business analysis, organising workshops, data analysis, and process engineering within technical environments. Proficiency in BPML, UML, Flow Diagrams, and tools such as Confluence, PowerPoint, Lucidchart, and … Visio. Experience in designing and implementing surveys for process efficiency and productivity measurement. Strong knowledge of e-commerce, microservices, CRM, and data lake architectures. Good communication skills. Salary: Up to £80,000 + bonus + package Location: London (good work from home options available) If you are more »

their rapidly growing team as MLOps/DevOps Engineers - for which there are 2 roles available. Within the role, you'll be: Analysing data from their DAS sensor hardware. Applying signal processing techniques to enhance algorithm … performance. Understanding machine learning models and the computational resources needed for real-time inferencing. Managing big data storage and processing in a Datalake/Datawarehouse and ETL context. Implementing CI/CD pipelines to train, validate, and deploy ML models to the cloud and edge devices. Supporting the … years of experience with CI/CD deployment, ETL pipelines Excellent documentation and data presentation skills. Strong Data warehouse/Datalake skills Ability to collaborate with cross-functional teams to implement and optimise DevOps practices. Nice to Have: Experience with real-time inferencing using Kubernetes or more »

architecture is aligned to the firm's technology roadmap. You will be heavily involved in defining, designing and leading the implementation of new data and application integrations and data-led initiatives to support circa 4k users across 20 offices. We have recently migrated the majority of … heads, and end users to proactively assist in the direction of future projects and programmes of work. • Demonstrate the delivery of complex application, data and integration services • Ability to provide a vision and strategy for data and application services • Ability to act as a technical lead … selection of technology product standards, as well as the design of standard technology configurations • Define transition steps and strategy as required from legacy data integration to modern scalable platforms • Manage and oversee internal and external technology resources in the delivery of agreed solutions • Align services to support global more »

Our utilities client is going through a large IT transformation and currently seeking an experienced Azure Data Engineer, if you are looking for a new opportunity with a diverse team and new technology this is the role for you! Key Responsibilities Design, develop, and maintain robust data pipelines and ETL processes using Azure Data Factory, Azure Databricks, and other relevant tools. Manage and optimise Azure Storage for efficient data storage and retrieval. Collaborate with data analysts and business stakeholders to understand reporting requirements and translate them into effective data … on data integration and reporting. Proficiency in Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Data Lake Storage. Strong expertise in SQL, data modelling, and ETL processes. Experience with Power BI or similar reporting tools, including dashboard creation and more »

are looking for A Data Engineer who will be responsible for implementing the changes and improvements required within the Data lake and the Data catalogue products. You will be delivering items ranging from large scale changes linked to business transformative programmes, to minor … Warehouse team and other departments, ensuring a high quality of work whilst always looking to improve the performance of the Data lake and Data warehouse to satisfy the ever-changing demands of the Business. The day to day work is interesting, challenging and fast … BigLake. Experience with data catalogue solutions. Experience with relational set based processing through SQL queries. Commercial experience working with Data lake and Data warehouse platforms. Data warehouse dimensional modelling. Ability to work as part of a team. Ability to work in more »

Role : AWS Cloud Data Platform Solution Architect. Job Type : Fix term Contract Location: Peterborough (Hybrid) Are you looking for an exciting opportunity in Solution Architecture ? Are you passionate about everything cloud and data ? Join us as an AWS Cloud Data Platform Solution Architect. Careers …/knowledge/experience: Experience of AWS Data platform including AWS-EMR Cluster Platform, Glue, EC2, S3, VPC, IAM, RDS, Redshift, Sagemaker, Lake formation and Glue catalogue. Data Storage Fundamentals. Cloud specific patterns and technologies. AWS Service Selection, Container design. Experience Designing DevSecOps pipelines. Experience … Pyspark. Good to have: Experience in Databricks platform. Insurance domain knowledge (Pensions & Annuity.) Understand the data platform solutions like data lake, data warehouse, data marts. AWS solution architect certifications. Rewards & Benefits: TCS is consistently voted a Top Employer in the UK more »

As a Data Manager/Lead, your responsibilities will include, but are not limited to: Leading the data team to achieve their objectives and key performance indicators, including work scheduling and maintaining high-quality performance. Designing, developing, and maintaining scalable data pipelines using Python … Azure Data Factory, and other relevant … tools. Collaborating with business stakeholders to understand data requirements and integrate various data sources into a unified data lake or warehouse, ensuring data quality and consistency through cleansing, transformation, and enrichment. Monitoring and optimizing data pipelines for performance, scalability more »

Data Engineer London, remote, hybrid Up to £70,000 per annum + Bonus An excellent opportunity has arisen for an experienced and engaging Data Engineer, to join a well-known organisation within the legal/tech sector. The successful applicant will join a well established team … as a point of expertise for all data related projects. They will design, build and deploy high quality solutions across company platforms and ensure they meet the required standard. Main duties include: Write clean and testable code using SQL and Python Scripting languages, to enable our customer data … role Excellent understanding of Databricks and Pyspark Strong knowledge of Azure Cloud Services Excellent understanding of SQL Good exposure to Azure Data Lake technologies such as ADF, HDFS and Synapse Good knowledge of Data Governance, Data Catalog, Master Data Management Excellent more »

Xpertise is looking for an experienced Data Engineer with a strong background in Microsoft SQL Server and a passion for building scalable data solutions. You will play a key role in developing and optimizing enterprise-level BI and Data Warehousing systems, using cutting-edge … Warehousing solutions for large enterprises. Work with Azure Data Services, including Azure Data Factory, Azure Data Lake Store, Azure SQL Database, Azure Synapse Analytics, Fabric and Azure Analysis Services (DAX). Implement CI/CD pipelines through Azure DevOps. Collaborate effectively … agile development practices. Preferred Qualifications: Hands-on experience with Databricks. Knowledge of NoSQL databases. Python programming This is a fantastic opportunity for a data professional who is passionate about leveraging data to drive business insights and has expertise in Microsoft and Azure technologies. If this sounds more »

000HYBRID - LONDONThis scale-up telecom group is looking for someone to be hands-on when driving forward their platform's expansion to incorporate data from all business areas as they become more digitally driven...THE COMPANY This group is already one of the UK's largest telecom companies who … to grow into other areas. They aren't just localised to this area though as they've expanded into a global presence. Their data function has undergone extreme change over the two years and they are now in a good position for you to join the team!THE … AND EXPERIENCETo be a successful Data Architect in this area you should be proficient in the following:Expertise in Data Lake migrationAzure experience is going to be beneficial Experience with big dataPrevious python & engineering experience will be useful to understand the end-to-end aspectsHave more »

business. Having just secured Series C funding, they are in a hugely exciting period of growth as a business and growing out their data function. In this position, you will play a key role in developing and maintaining advanced analytics, dashboards and other solutions within Tableau. This will … support the business in data driven decision making ensuring high quality data is available to the business stakeholders. The position is offering a basic salary up to £75,000 depending on experience as well as, 25-day annual leave plus 1 extra day per year of … with a range of stakeholders Desirable A Bachelors or Master’s Degree in Computer Science or a relevant field Knowledge of data lake and pipeline development Again, with a salary on offer of between £55,000 - £75,000 depending on experience, this position would be ideal for more »

unique chance to be part of an innovative group that tackles complex technical challenges, pushing the boundaries of trading system performance by refining data flows and optimizing algorithmic environments. The ideal candidate will thrive on collaboration, working closely with global teams across trading, operations, treasury, and technology. You … managers, and researchers to align priorities and deliver high-impact solutions. Define and lead the technical vision for core system components, such as data lakes, job schedulers, reporting systems, and dynamic analysis platforms. Drive the scaling and optimization of data and reporting pipelines to support rapid … and microservice infrastructures (e.g. Kubernetes, Docker, Helm) Experience working with distributed systems and messaging technologies (Kafka, Kinesis, or similar Experience in building robust data pipelines at scale (DBT, Airflow, or similar) Proficiency in data manipulation (Pandas, Polars). Strong programming skills in at least one other more »

brand which has established its name in the market over the last 30 years who are now on the lookout for their next Data & PowerBI specialist to join their team. As a retailer, they have gained a reputation as one of the leading suppliers in the UK and … are now actively looking to leverage their data to take the business to the next step. The main purpose of this role will be to transform data into insights that drive business value using Power BI however you will also be responsible for analysing data from multiple sources and consolidating it into data lakes. This is a real opportunity to grow out a data function in an established industry, helping the business leverage their data to improve sales and performance. What you’ll need: PowerBI Power automate more »

As an IT Data Engineer, you will play a crucial role in designing, building, and maintaining our data movement pipelines using Microsoft tools and platforms. Working within an agile environment, you will be responsible for project based and IT day-to-day data development … week split between time in the office and home working. Responsibilities Work with Microsoft Azure services (e.g., Data Factory, Data Lake Storage, Databricks, Synapse Analytics) to orchestrate data loading and workflows and manage data pipelines. Collaborate with analysts, and business stakeholders … to understand data requirements and translate them into technical solutions. Develop and implement data validation and reconciliation processes to ensure data accuracy and consistency across all data sets. Implement data quality checks and validation rules to ensure data more »