101 to 125 of 214 Data Lake Jobs in the UK

Scalexperts are partnered with a VC backed education group who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function. They are looking for a Senior Data Engineer to join them to work on building a … brand new data platform which is still in early stage development. They are looking to combine all the data into one common data platform heavily on Azure so that reporting & insight/analytics becomes much clearer and more consistent. This role will require someone … years experience in Data Engineering Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etc Experience with SQL is a must, some Python is a bonus Confident in providing technical leadership Able to gather requirements for a variety more »

A global leading commodities trading firm have partnered with Referment to find a skilled Data Engineer to join their London team on a contract basis. This organisation has some exciting Greenfield projects focussed on modernisation of data warehouse, data lakes and data streaming services. This is critical role, which will require designing, implementing, and enhancing data solutions to support the businesses trading operations. This role will involve building out data pipelines, ETL processes and data warehouses and will require a well-rounded data … engineer with deep experience in Python and other OO languages like Java. Delivery is vital within this role so experience in scaling up data systems using the best data engineering processes is required. Due to the nature of commodities trading, there is exciting problems to solve more »

Lead Data Engineer (Contract/ASAP Start) Location| Workplace policy: Fully Remote (Must be based in the UK without visa/sponsorship requirements ) Day Rate: up to £600 (outside IR35) Contract Length: 6-month term initially An exciting market-leading tech-savvy organization that works directly alongside some … of the biggest brands in the retail sector is seeking a contract Lead Data Engineer with hands-on experience working directly with C-Suite execs. Technical Expertise Needed At least 4 years recent Databricks (must have) At least 10+ years experience in a Lead Data Engineer … Educated to degree level in a QS top 100 university Proven experience delivering scalable data pipelines PySpark SQLDevOps/DataOps/CICD Expertise in designing, constructing, administering, and maintaining data warehouses and data lakes Data Modelling/Data Architecture Data more »

this organisation now, all have said glowing reviews about it, they're the leader in legal representation comparison and have rather interesting, unique data to work with. They are using modern Azure tools and have some very exciting initiatives! They are looking for an additional Snr Data Engineer to join a well established team, this could possibly suit a mid weight Data Engineer who has mentored others. Salary is circa 75K with a 5% bonus There is no sponsorship for this role, sorry. Responsibilities: Guiding a team of developers in the creation, optimization … warehouses and data lakes. Familiarity with Azure Cloud Services. Sound understanding of T-SQL programming. Exposure to Azure Data Lake technologies, including ADF, HDFS, and Synapse. Solid knowledge of Data Governance, Data Catalog, and Master Data Management. Understanding more »

SME underwriting decisions per month. Responsibilities include: To perform data extraction , manipulation and cleansing techniques within a data lake environment. Support the delivery of strategic initiatives into Credit SME to build scale, reduce manual touchpoints and enhance the controls environment. Providing Portfolio analysis through the … use of analytical methods. Implementation and design of risk management & changes within 3rd party tools i.e. CRM/UD portal etc Utilise customer data to build risk segmentation and mitigation strategies Lead role for supporting SME commercial strategy and input into key working groups across pricing, system development … you have experience in, or comfortable with: Experience in the extraction and cleansing techniques of data held within a data lake environment Develop Credit Risk Strategies supported by Decision Engine Rules, and Scorecards (Nice to have) Working knowledge of other automating solutions (implementation and maintenance more »

Lead Data Project Manager | Data | Data Lakes | Data Warehouse | Azure Lead Data Project Manager needed on a Permanent basis. Gravitas continue their support for a leading non for profit organisation on their search for a Lead Data Project … company is rolling out a new delivery focused function, the successful candidate will need to take ownership for all things Data. Role: Lead Data Project Manager Location: London - Minimum of once a week in the office. Salary: £58,000 - £63,000 Type: Permanent. The essential skills needed for … a project manager. Ability to provide programme/project management expertise to help support the workstream delivery. Previous experience with end to end Data project. Good communication and stakeholder management. An ability to be a self-starter/autonomous worker who deep dives into detail. MSP/Prince2 more »

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … it can improve business performance. The role: Data Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on … be responsible for the day to day maintenance and enhancement of the data quality, security and performance of the Data Lake/Warehouse Assisting your Data Analyst colleagues to generate impactful business insights and analysis Support the Senior Data Engineer in more »

the future of Azure solutions with Ascent? If so, we are looking for you. We are looking for Cloud Solution Architects with a Data and AI specialism who are eager to be a part of the team—you'll be instrumental in our mission to leverage technology accelerators … and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data … experience in Azure data and AI technologies, like Fabric, Synapse, Databricks, Spark, Python, GitHub, Data Factory, Azure Data Lake, Power BI, Cognitive Services, Purview, etc. Strong data analysis and modeling skills. High-level understanding of Azure infrastructure. Experience with CI/ more »

Database, Azure App Services, Azure virtual networks, Exchange Online, and Intune Azure security best practices, and Microsoft Defender products and services Protect sensitive data and ensure compliance with data governance standards Work closely with … Data and AI teams to ensure their Azure-based solutions are designed, implemented, and maintained correctly and securely Azure Data Lake, Azure Data Factory and Azure Open AI Participate in joint projects to integrate Data and AI solutions On Prem Infrastructure more »

Data Analyst | 100% Remote |£35,000-£45,000 KDR is excited to be partnering with a leading Commodities Data Analytics company who are on the lookout for their next Data Analyst. The Company Our client, a global software company providing innovative solutions in data management, data analysis, and business automation within the energy/commodity trading space. Due to ongoing success, they’re seeking a talented Data Analyst to join their dynamic Consulting team focusing on their bluechip clients within energy/commodity trade or risk management operations. … The Role As a Data Analyst you will play a pivotal role in driving the successful delivery of high-quality data projects. Here's what you'll be doing: Become an expert in our client’s data management/analytics platform, in support of more »

About The Role We are recruiting for a Senior Technical Data Analyst to join our team. Our Technical Data Analysts work in multi-disciplinary teams that build, support, and maintain user-centered digital solutions that offer real value and work for everyone. Our Technical Data Analysts are involved in creating data-specific solutions to ensure we have the right information and data to make informed decisions. Stakeholder engagement is key, and collaborating within your technical squad and alongside colleagues from other professions is fundamental. Your role in a nutshell … Draw actionable insights from multiple, large sources of data and communicate these effectively through reports, dashboards, and presentations. Engage with client stakeholders to understand their business and organizational needs and translate these into clear requirements for your analysis. Identify opportunities for the use of advanced analytics techniques (e.g. more »

A leading Energy & Commodities client is seeking a Senior Data Engineer to join their growing IT team on an initial 6 month contract basis with high chance of extension thereafter to over 12 months. The role requires the individual to work with Solution and Data Architects … to design the next generation Big Data platform to support the digital marketing platform. The role, therefore, doesn't necessarily require Energy or Trading experience. The role is Inside IR35 and will be a couple of days per month onsite in London. Skills Required: Essential experience in Databricks … design and coding skills (e.g. Python, Scala, JavaScript). Experience with Microsoft or AWS data stack e.g. Microsoft Azure Data Lake, Hadoop (preferably with Spark), Cosmos DB, HDInsight/HBase, MongoDB, Redis, Azure Table/Blob stores etc. Exposure to tools like SAP technologies and more »

Job Title: Software Engineer (Rust/HPC/Real Time Data) Client: Elite Tech Firm Salary: Up to £200k 1st Year Compensation Location: London Sells: Cutting-edge tech, ownership of multiple greenfield projects, no red tape, a friendly/collaborative environment, beautiful offices, personal projects on Fridays! An … as part of a team of engineers looking after and building a zero-down time low latency solutions for multi petabyte/exabyte data sets Working heavily in Rust Building/Optimising some of the world's most advanced data pipelines Collaborating with ML Engineers, Data … experience working as a Software Engineer ideally using Rust Outstanding CompSci Fundamentals needed! Knowledge of data engineering principles/data lake architectures - Arrow/Parquet etc. Excellent knowledge of low-level concepts (e.g. compilers, x86, LLVM etc. more »

Chief Information and Data Officer (CIDO/CDIO) - Australia based, will sponsor. Summary: We are proud to offer an exceptional opportunity for a Chief Information and Data Officer, CIDO within an esteemed and well-recognized Education Services provider known globally for enhancing the mobility of learners. … This transformational role is crucial for steering the technology strategy to empower digital and data enablement as the organization advances through a period of dynamic growth and scaling. Basen in Australia, and directly reporting to an innovative CEO, the role involves a significant leadership presence, managing a technology … team of c.40, and driving the digital transformation, data optimisation, product digitisation, and expansion into new international markets. You will join a profitable business that is not only established but experiencing exponential growth with the aim to double its revenue in the next three to five years. This more »

Title: Azure Data Engineer Rate: Up to £800 P/D Length: 12 month rolling Location: London (Hybrid) Description (Full spec avail): To work with an established team on developing a new strategic big data platform for our customer, we are searching for a Senior Azure … Engineer. The current Oracle and Java stack will be replaced with a new platform that is an Azure-based data lake with APIs and events to enable data consumption by analytics teams. The needs for this multi-year migration project include engineering to … facilitate the transfer of data masters from the old platform to the new one. Key requirements : CompSci or equivalent degree from a top global university Awareness of and comprehension of Agile approaches, including TDD and BDD knowledge. familiarity with working in agile development teams Excellent written and verbal more »

Unit Testing. Experience with PostgresSQL and NoSQL databases like MongoDB. Knowledge of Powershell. Linux experience is a plus. Familiarity with Azure data lake and data pipelines. Experience with Java or Kotlin (JVM 11+). Knowledge of the Spring Framework, including Spring Boot, Spring Cloud, and more »

Job Title: Data Analyst Location: Devon (2 days per week in the office - this is not fully remote role) Salary: up to £40k About Us: If you are passionate about data, this is an incredibly exciting time to join our team. We are in a period … of transformation as we build our all-new Azure data lake. Leveraging the vast amounts of data captured from our tech, we deliver cutting-edge analytics that drive change across the businesses we serve. We are seeking a dynamic Data Analyst/Scientist to … join our team and help shape the future of our data capabilities. Role Overview: As a Data Analyst/Scientist, you will work as part of our data team, reporting to our Lead Data Analyst/Scientist. You will be responsible for more »

Lead Data Engineer A brand new and exciting opportunity has recently arisen for a Lead Data Engineer with an excellent knowledge in ETL, Azure Data Factory, Azure Databricks and CRM Implementations to join one of the UK's Largest Charity based in London. As … the Lead Data Engineer you will be implementing a new CRM (Salesforce) and also leading the migration to Azure. This is an excellent opportunity for an Lead Data Engineer who is looking to work for the Largest UK Charity who are working on exciting projects and … this is the perfect opportunity for you! Skills that are required for a Lead Data Engineer are: Experience in Azure (ADF and Datalake) Experience working with ETL pipelines Previous experience Managing or Mentoring Engineers CRM Implementation experience Lead Data Engineer/Senior Data Engineer more »

SENIOR DATA ENGINEER (EU Remote Opportunity) Xcede are delighted to be working with a very exciting Web3/Blockchain organisation with a remote working culture. Their company makes life easier for organisations in the Web3 space by providing managed services across a range of operational tasks and responsibilities … in one space. As a Senior Data Engineer in the company, you will have several clear tasks that are essential to the smooth running of processes that make this Product so unique. Responsibilities Design and implement both batch & stream Data Pipelines around the data stores & data lake. Lead by example, always aiming to work towards software engineering best practice and disaster prevention (rather than recovery). Maintain and optimise the infrastructure across the company. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years more »

time to join this ambitious team!! WHAT YOU'LL BE DOING As Senior Machine Learning Engineer, you will sit within the company's Data Science team and report to the Director of Engineering. Their Machine Learning stack runs on on-demand containerised infrastructure – ranging from sub-second latency … TECH STACK: Python, Flask, Redis, Postgres, React, Plotly, Docker. Temporal; AWS Athena SQL, Athena & EMR Spark, ECS Fargate; Azure Synapse/Data Lake Analytics, HDInsight. KEY RESPONSIBILITIES Lead the productionisation of Monolith’s ML models and data processing pipelines, both mid-low-level system and … design and exemplary hands-on implementations using Spark and other tech stacks Shape the ML engineering culture and practices around model & data versioning, scalability, model benchmarking, ML-specific branching & release strategy Concisely break down complex high-level ML requirements into smaller deliverables (epic à task) Proactively identify blockers more »

Innovative music client now requires a Data Administrator to join their team and support the day-to-day management of their data processes. This role will support critical functions, ensuring the accuracy and efficiency of our client’s data operations. Key Responsibilities: Oversee the … management of data ensuring daily files are delivered and processed. Monitoring the availability of data within our client’s data lake. Timely analysis and reporting in reference to our client’s data processes. Maintenance of data tables, ensuring they are … ad hoc basis. Identify and analyse where processes can be improved/additional checks could be made. Key Requirements: Strong experience as a Data Administrator working with complex data lakes. Solid SQL experience. (Tableau experience is desirable). Experience with Cloud technologies is desirable (AWS/ more »

Innovative music client now requires a Data Administrator to join their team and support the day-to-day management of their data processes. This role will support critical functions, ensuring the accuracy and efficiency of our client’s data operations. Key Responsibilities: Oversee the … management of data ensuring daily files are delivered and processed. Monitoring the availability of data within our client’s data lake. Timely analysis and reporting in reference to our client’s data processes. Maintenance of data tables, ensuring they are … ad hoc basis. Identify and analyse where processes can be improved/additional checks could be made. Key Requirements: Strong experience as a Data Administrator working with complex data lakes. Solid SQL experience. (Tableau experience is desirable). Experience with Cloud technologies is desirable (AWS/ more »

CENTRAL LONDON – HYBRID (3 DAYS A WEEK) £50,000 - £70,000 A great opportunity for a BI Engineer to bridge the gap between Data Engineering and BI reporting at an asset management firm expanding their data and analytics team. THE COMPANY Join a forward-thinking asset … returns. With a focus on secured loans, high-yield bonds, and structured credit, they operate at the forefront of the financial markets, leveraging data and analytics to drive informed decision-making. THE ROLE AND RESPONSIBILITIES As a BI Engineer, you will be responsible for supporting data … fast-paced environment, working with cutting-edge technologies such as Alteryx, Tableau, SQL, and Python. Responsibilities: Contribute to the setup and maintenance of data infrastructure, including data lakes, warehouses, and SQL Server databases. Utilize your technical expertise in SQL and Python to extract, transform, and analyse more »

AWS, Azure). o Experience with microservices architecture, APIs, and integration patterns. o Proficiency in security architecture and best practices. o Familiarity with data architecture, including data warehousing, data lakes, and big data technologies. o Full Stack Development: Strong background in both more »

of cloud platforms (AWS, Azure). Experience with microservices architecture, APIs, and integration patterns. Proficiency in security architecture and best practices. Familiarity with data architecture, including data warehousing, data lakes, and big data technologies. Full Stack Development: Strong background in both front more »