Permanent Data Lake Jobs in the UK

126 to 150 of 215 Permanent Data Lake Jobs in the UK

Data Engineer

Runcorn, England, United Kingdom
Protein Works
business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … it can improve business performance. The role: Data Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on … be responsible for the day to day maintenance and enhancement of the data quality, security and performance of the Data Lake/Warehouse Assisting your Data Analyst colleagues to generate impactful business insights and analysis Support the Senior Data Engineer in more »
Posted:

Database Administrator

Edinburgh, Scotland, United Kingdom
Hybrid / WFH Options
Primis
Job Title: Data Platform Administrator Location: Edinburgh (hybrid) Company: Primis is currently partnered with a leading technology company dedicated to delivering innovative solutions that empower businesses in the UK. Their team is comprised of talented individuals who thrive in fast paced environments and are passionate about pushing the … boundaries of technology and creating meaningful impact. Position Overview: We are looking for an Data Platform Administrator, someone who can deliver operational excellence and stability in our data platforms that underpin the services we deliver for our customers. As well as the day-to-day you … database administration team. Essential skills : Experienced in design, implementation and day-to-day running of enterprise level data platforms, data lake concepts and data handling Solid monitoring and tuning skills in highly available transactional or API-centric environments Working with large-scale, uptime more »
Posted:

Data Architect

London, England, United Kingdom
Hybrid / WFH Options
Data Idols
Data Architect Salary: £90,000 - £110,000 Location: Remote/Hybrid Data Idols are working with a fast-growing technology company who are disrupting the software engineering industry. They are looking for a Data Architect with strong experience in data engineering and … experience in delivering innovative solutions. The Opportunity In this role as a Data Architect, you will play a pivotal role in ensuring the efficiency of their data architecture while heading the migration from legacy systems to modern cloud solutions. You will design and build scalable database and data lake solutions, implement CICD pipelines and automate the deployment of data products into production environments. Skills and Experience Proficiency in AWS Great communication more »
Posted:

BI Architect

Olney, Buckinghamshire, United Kingdom
Hybrid / WFH Options
Nigel Frank International
to the implementation. They are looking for someone who can not only deliver on the technical aspect (having knowledge in Azure Synapse and Data Factory is essential due to the organisation being a purely Microsoft house), but they also pride themselves on building a strong close knit team … Engineers. * Work in an Agile Scrum team with the potential for occasional Waterfall project delivery. Skills & Qualifications * Strong Azure knowledge, specifically within Azure Data Factory, Azure Synapse and Azure Data Lake. * Experience delivering some aspect of leadership/mentoring whilst still working in a hands on … environment. * Good data platform development skills: ETL development, Data Warehousing, SQL database development.Benefits * Car allowance of 5,500. * Hybrid work pattern - weekly visits to the office in Banbury. * Private health and dental care + personal health assessments and critical illness cover for you and your partner. more »
Salary: £ 70 K
Posted:

CDP Engineer

London Area, United Kingdom
The Change Partners - Global talent specialists for a connected world
The Change Partners are currently partnered with a Tier 1 Consumer Electronics brand who are hiring for a Solution Architect/Data Engineer on a 12 month FTC (up to £95K) or day rate (Up to £350) contract. You will be responsible for developing software and data … on business needs Identify opportunities for improvement in existing solutions and recommend changes to be implemented Perform system security assessments to ensure that data is safe from unauthorized access Review all customer data sources and conduct data mapping required for use cases for deeper … models and Entity Relationship Diagrams (ERD) to review & sign-off with HQ & DDMC Utilize CDP to automate all customer schema data lake & profile design setups within each sandbox environment Configure within CDP all necessary identities & privacy settings Setup BI connections and coordinate with the BI developer more »
Posted:

Cloud Solution Architect - Data and AI

London Area, United Kingdom
Ascent
the future of Azure solutions with Ascent? If so, we are looking for you. We are looking for Cloud Solution Architects with a Data and AI specialism who are eager to be a part of the team—you'll be instrumental in our mission to leverage technology accelerators … and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data … experience in Azure data and AI technologies, like Fabric, Synapse, Databricks, Spark, Python, GitHub, Data Factory, Azure Data Lake, Power BI, Cognitive Services, Purview, etc. Strong data analysis and modeling skills. High-level understanding of Azure infrastructure. Experience with CI/ more »
Posted:

Data & Analytics Lead

Lancashire, North West, United Kingdom
Hybrid / WFH Options
JLA Resourcing Ltd
a business who have made great strides in investing in their IT function and who have stated that being led and driven by data is one of their core business aims. You will be integral to this and will be responsible for establishing and building the Data & Analytics function from scratch - you'll design, own and implement the Data Science/Data Analytics strategy as well as selecting and implementing the tools that will enable them to improve the performance of the business. The Role: The role sits within the core … work with. The Tech stack is new and investment within the business is there to enable you to establish and build a successful Data/Analytics functions. Key responsibilities include: - Lead the development and execution of the roadmap for Data and Analytics - Work closely with key more »
Employment Type: Permanent, Work From Home
Salary: £65,000
Posted:

Lead Data Engineer

London, United Kingdom
LinuxRecruit
Join a team of Google Cloud experts, using your knowledge of data to thrive in a fast paced and innovative environment. You’d drive out the cloud transformation, taking a lead on all things data related in a Google Premier Partner. You will actively engage with … clients, gathering requirements, creating the appropriate structure for data in ERA data warehouses and develop … robust ETL processes - thus ensuring the integrity of the data. Your role will be instrumental in the creation of a new data lake/warehouse/hub built in GCP. You are confident using the full suite of Google data products, IAC, CI/CD more »
Salary: £ 80 K
Posted:

Senior Infrastructure Engineer – Azure Specialist

London Area, United Kingdom
Intellect Group
Database, Azure App Services, Azure virtual networks, Exchange Online, and Intune Azure security best practices, and Microsoft Defender products and services Protect sensitive data and ensure compliance with data governance standards Work closely with … Data and AI teams to ensure their Azure-based solutions are designed, implemented, and maintained correctly and securely Azure Data Lake, Azure Data Factory and Azure Open AI Participate in joint projects to integrate Data and AI solutions On Prem Infrastructure more »
Posted:

Python Technical Lead AWS Iceberg Data Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Python Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Python Technical Lead (Senior Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Python, Java, AWS and Iceberg. If you more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Python Software Engineer AWS Iceberg Data Finance London

London, United Kingdom
Hybrid / WFH Options
Joseph Harry Ltd
Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC protobuf TypeScript Finance Trading Front Office Investment Banking Asset Manager Financial Services … DBT Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Python Software Engineer (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Snowflake Apache Iceburg Iceberg Arrow DBT gRPC … Office. The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily with Python, Java, AWS and Iceberg. If you more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Analytics Engineer

London Area, United Kingdom
Hybrid / WFH Options
Unmind
s biggest brands, including Uber, Major League Baseball, NHS, Disney, Standard Chartered, Mediacom and British Airways. Our services support the whole organisation with data-driven performance insights for leaders, training for managers, wellbeing tools for all employees, as well as access to a global network of accredited mental … hiring process more accessible, just let us know when you apply, or email talent@unmind.com. The Role – Analytics Engineer The core mission of data analytics is to provide actionable insights to all Unmind Teams that drive product and business decisions that build the best version of Unmind. As … within reports that surface relevant trends. In this role you'll get to: Own - You will take the architectural lead for the key data models in the company, and guide your team in finding the right balance between technical excellence and delivery of value that brings you closer more »
Posted:

Lead Data Engineer

London Area, United Kingdom
Tredence Inc
About Tredence: - Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision … methodology; think strategically and execute methodically. Develop and manage capacity and growth projection forecasts of the environment within budgets. Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional/non-functional business requirements. Drive optimization, testing and tooling to improve … in Data bricks Experience managing distributed teams preferred. Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project management skills: financial/budget management, scheduling and resource management experience with medium and large-scale projects Comfortable working with ambiguity more »
Posted:

Data & Reporting Lead

England, United Kingdom
RX Global
and enables the rapid deployment of innovation and standard methodologies across the global business About the Role We are looking for an experienced Data & Reporting Technical Lead to join the team working on our Global Business Systems (GBS) platform. You will lead data and reporting architecture … and initiatives across the GBS program, including the RX Data Lake. You will manage the engineering team throughout the development life cycle to implement functionality to cost, quality and schedule. Responsibilities Designing and developing RX's data and reporting systems which form part of our Global … and significant development experience Have excellent experience of AWS cloud data platforms and attendant technologies and concepts such as Data Lake, Virtualization, ETL, ELT. Have substantial Powe BI hands on experience Demonstrate experience with Oracle Business Intelligence Enterprise Edition (OBIEE), Oracle Enterprise Data more »
Posted:

Database Architect

Leeds, England, United Kingdom
HCLTech
Define Architecture standards and principals • Translation for business requirements into Data Design, technical specifications • Data migration, strategy, mapping/lineage, quality, standards across multiple projects and solutions • Work closely with the development team to design and implement data solutions • Being able to recommend the … best place to source data sets, both internal and external to the organisation • Ability to capture and document standards and designs that can be easily understood for all stakeholders (DBAs through to CIO) • Data migration and the ability to be consulted … with data movements for data performance and optimisation • Microsoft experience (SQL DW/Cosmos DB/Azure Data Lake) • Working collaboratively with stakeholders, colleagues, and strategic partners across a portfolio of projects more »
Posted:

Senior Developer

London Area, United Kingdom
Mastek
Write high-quality, maintainable code using languages such as Python and SQL Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2 Utilize PowerBI, Tableau, or similar tools to design and create interactive and visually appealing dashboards and reports. Work closely with … PoCs to validate new technologies, frameworks, or solutions. Drive the development of MVPs, ensuring timely delivery and alignment with business goals. Azure and Data Engineering: Leverage your Azure expertise to design and implement cloud-based solutions. Collaborate with data engineers to build robust data pipelines and ensure data quality. FAME (Financial Analysis Made Easy): Familiarity with financial systems, including FAME , will be advantageous. Use your knowledge to enhance banking processes and systems. Agile Methodologies: Apply agile practices such as DevOps (including CI/CD), Test-Driven Development, and Infrastructure as more »
Posted:

Data Architect

United Kingdom
Hybrid / WFH Options
Oliver Bernard
Data Architect/Cloud Data Architect (GCP) Google Cloud/GCP, Machine Learning/Generative AI Remote-based or Hybrid should you prefer (London) £100k-£140k basic salary + bonus Benefits: 25 days holiday + bank holidays Private Healthcare Discounted Gym Membership (Nuffield + Hussle) Life … Insurance, Income Protection, Employee Assistance Program Pension Scheme (max 10%) We are working with an AI/Data Consultancy with core clients within the Retail, Financial Services, Gaming, SaaS sectors. The successful Cloud Architect will work with an array of technologies with clients from several industries & sectors meaning … devising innovative solutions to address their needs, defining project parameters, and supervising the execution of these projects. Role of the Cloud Architect/Data Architect: Utilising advanced data processing and cloud technologies effectively to stimulate innovation. Engaging with clients to create top-notch solutions tailored to more »
Posted:

Senior Technical Data Analyst

Greater Bristol Area, United Kingdom
DiverseJobsMatter
About The Role We are recruiting for a Senior Technical Data Analyst to join our team. Our Technical Data Analysts work in multi-disciplinary teams that build, support, and maintain user-centered digital solutions that offer real value and work for everyone. Our Technical Data Analysts are involved in creating data-specific solutions to ensure we have the right information and data to make informed decisions. Stakeholder engagement is key, and collaborating within your technical squad and alongside colleagues from other professions is fundamental. Your role in a nutshell … Draw actionable insights from multiple, large sources of data and communicate these effectively through reports, dashboards, and presentations. Engage with client stakeholders to understand their business and organizational needs and translate these into clear requirements for your analysis. Identify opportunities for the use of advanced analytics techniques (e.g. more »
Posted:

Senior Data Engineer

Chiswick, England, United Kingdom
Square One Resources
Job Description: I am currently looking to hire for a Lead/Senior Data Engineer to lead modernisation efforts for a client of ours who are a leading company at the top of their game in their respective field. Duties and responsibilities: Develop and refine ETL and data integration solutions leveraging a variety of technologies and data sources. Maintain and enhance the Data Engineering Architecture. Gather and process raw data from various sources. Investigate methods to improve data quality and reliability. Identify and implement internal process enhancements, such … as automating manual tasks and optimising data delivery. Utilise cloud-based infrastructure (Azure) for hosting data solutions and applications. Collaborate with architects, data analysts, and data scientists to achieve business objectives. Requirements: Demonstrated expertise in developing and maintaining ETL/ELT processes more »
Posted:

Data Team Lead

Greater London, England, United Kingdom
Shawbrook Bank
have created is unique and difficult to replicate, with our ‘best of both’ approach combining deep human expertise with advanced digital, tech and data capabilities. This combination not only allows us to deliver excellent customer experiences, but to do so efficiently and at scale. We are proud of … of a business that cares too Want to continue to grow professionally and be the best version of yourself Job Description The Lead Data Engineer is a key role to ensure Shawbrook unlocks the value contained in its data across the organisation in a well-governed … and table formats (Delta etc) This is an incredibly exciting role that rarely becomes available. You will own a well-designed data lake serving a 50+ user community who run '000s of queries across TBs of data each month with a mandate to take it more »
Posted:

Java Data Engineer

United Kingdom
Amber Labs
Java Data Engineer - 6 Month FT Contract About us Amber Labs was born out of the recognition that many organisations require support on their data maturity journey. Our team is passionate and experienced in delivering cutting-edge data capability. Amber Labs was established with … a vision to provide specialist services, automation, accelerators competitively to organisations across EMEA. The Project The Java Data Engineer needs to be able to programme in Java as the … project uses Java to ingest the data into the platform. The Consultant would be helping to build out the Data Lake and Lakehouse on Databricks, working with AWS. Skill Priority: AWS, Java (to support ingestion), Databricks - experience in PowerBi would also be useful. You will more »
Posted:

Lead Data Engineer - £100K - Hybrid

City of London, London, United Kingdom
Hybrid / WFH Options
Develop
Lead Data Engineer - up to £100K - Hybrid London Our client a global brand based out of lovely offices in West London are looking for a Lead Data Engineer to work on a business-critical, brand new, innovative high availability application which will be used by thousands … who is looking to take their next step in their career and wants to take on more responsibility. Technical Skillset: Experience as a data engineer developing and maintenance of ETL/ELT processes Good experience in Data Modeling within a cloud … based data platform Strong experience with SQL Server Azure data engineering stack, including Azure Synapse and Azure Data Lake Python, PySpark and T-SQL In return you will be offered a competitive salary and benefits package, remote working options and an opportunity to more »
Employment Type: Permanent
Salary: £80000 - £100000/annum
Posted:

Data Engineer

Dorset, England, United Kingdom
In Technology Group
Role: Data Engineer Salary: £40,000 - £50,000 Location: Dorset (1 day a week onsite) Overview The Data Engineer will work closely with IT, Finance and Operations to deliver the business reporting requirements within a timely and consistent manner. They are required to develop and provide … trusted data on performance, financial positions to aid decision making across the business. They also to provide tactical information to end users to support process. Benefits • Up to 10% matched pension scheme with Standard Life • Death in Service: 4 x salary • Annual Car Parking permit • Purchase monthly during … Children under the age of 24 can be covered free of charge. Skills • Hold qualifications in related disciplines such as Statistics, Mathematics and Data Sciences • Experienced in working Microsoft Cloud Data and Automation technologies • Experienced working with Tableau and or Power BI • Experienced in data more »
Posted:

Data Engineer

Bournemouth, Dorset, South West, United Kingdom
In Technology Group Limited
Role: Data Engineer Salary: £40,000 - £50,000 Location: Dorset (1 day a week onsite) Overview The Data Engineer will work closely with IT, Finance and Operations to deliver the business reporting requirements within a timely and consistent manner. They are required to develop and provide … trusted data on performance, financial positions to aid decision making across the business. They also to provide tactical information to end users to support process. Benefits Up to 10% matched pension scheme with Standard Life Death in Service: 4 x salary Annual Car Parking permit Purchase monthly during … Children under the age of 24 can be covered free of charge. Skills Hold qualifications in related disciplines such as Statistics, Mathematics and Data Sciences Experienced in working Microsoft Cloud Data and Automation technologies Experienced working with Tableau and or Power BI Experienced in data more »
Employment Type: Permanent
Salary: £40,000
Posted:

Artificial Intelligence Engineer

London Area, United Kingdom
Computer Futures
specific business challenges. Implement and maintain scalable and efficient AI systems, ensuring they meet business requirements and performance benchmarks. Collaborate with business analysts, data scientists, and IT teams to integrate AI solutions into existing systems and workflows, enhancing their capabilities and impact. Stay abreast of advancements in AI … efforts. Conduct data analysis and feature engineering to prepare data for use in AI models, utilizing Azure Data Lake and other data storage solutions. Develop robust testing and validation processes to ensure the accuracy and reliability of AI models and solutions. … Open AI Service, Azure Cognitive Services, and Azure Machine Learning. Familiarity with Azure Databricks is a plus. Solid background in machine learning algorithms, data pre-processing, feature engineering, and model evaluation. Experience with deep learning frameworks like TensorFlow or PyTorch is desirable. Proficiency in handling large datasets, experience more »
Posted:
Data Lake
10th Percentile
£42,888
25th Percentile
£61,000
Median
£87,500
75th Percentile
£122,500
90th Percentile
£148,750