26 to 50 of 86 Permanent Data Lake Jobs in the UK excluding London

Azure is our main offering, but experience with AWS/GCP is a strong plus! Containerization: Docker and/or Kubernetes Bonus: Big Data processing (BI systems, Data lakes) Excited to learn more? 🤔 Feel free to reach out, and I'll happily share all the details. more »

This is an exciting opportunity for a Data Architect to join a growing Data & AI team. The successful applicant will work alongside architects and consultants to deliver high-quality data solutions to help customers become more successful in becoming a data-guided … platforms and data solutions using a wide range of Azure Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse, Azure Cosmos DB, Azure Data Factory and Azure Blob storage Building conceptual, logical and physical data models … in Data Warehouse methodologies Experience working across Azure Data Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, Azure Data Factory, Azure Blob storage and Power BI Strong experience in SQL Good understanding of Azure infrastructure more »

including integration with third party systems. Architecture Development: Define the overall solution architecture for D365 CE/Power Platform projects, including system integrations, data models, security, and scalability considerations. Technical Leadership: Provide technical leadership and guidance to development teams throughout the project lifecycle, ensuring adherence to best practices … Conduct detailed requirement analysis, identify gaps, and propose appropriate d365 CE/Power Platform components and customizations to meet client needs. Integration and Data Management: Design and implement integrations between D365/Power Platform/LOB systems, leveraging connectors, APIs, and data manipulation techniques to ensure … D365/Power platform/integration. Deep understanding of relevant Azure services such as Azure logic apps, API service, Web Jobs , Data Lake, Data Factory, Synapse, and Azure Functions. Lead experience working with MS SQL Server, SSRS, SSIS, KingswaySoft and/or other prominent data more »

working on a Remote first basis (once a month in the office on average). Senior Data Engineer - Remote First (offices in lake district) - Up to £65,000 + Great Benefits Purpose of Job Advise on and ensure the maximum return of value from the company's … Engineers. Providing Technical guidance to Data Engineers Knowledge, Experience and qualifications Excellent level of knowledge & experience in Azure Data, including DataLake, Data Factory, DataBricks, Azure SQL (Indicative experience = 5yrs+) Build and test processes supporting data extraction, data transformation, data structures, metadata, dependency and workload management. Knowledge on Spark architecture and modern Datawarehouse/Data-Lake/Lakehouse techniques Build transformation tables using SQL. Moderate level knowledge of Python/PySpark or equivalent programming language. PowerBI Data Gateways and DataFlows, permissions. Creation, utilisation more »

Lead Database & ETL Developer looking for an exciting opportunity? Our Technology team at Southern Housing is searching for someone who can expertly manage data across our technology estate, optimising and developing source data systems to the highest quality standards. In this role, you'll take full … ownership of data management, ensuring its consistency throughout our ecosystem. Collaboration is key, as you will work alongside the data community of practice/guild to uphold consistent data practices and set the bar for organisational best practice and lead fellow Data … used to develop new functionality. What youll need Experience with various Data Management architectures like Data Warehouse, Data Lake, Data Hub and the supporting processes like Data Integration, Governance, Metadata Management Experience in working with large, heterogeneous datasets in more »

Principal GCP Data Engineer Remote Up to £85,000 VIQU are seeking Principal GCP Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a … numerous specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal GCP Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will … database performance. Minimum of 3 years hands-on and expert proficiency in GCP (Google Cloud Platform) Deep expertise in SQL and Data Lake/Warehouse solutions Advanced skills in programming languages such as SQL, Python, Java, or Scala Extensive knowledge of query optimisation techniques and a proven more »

Data Architect/Data/Azure/Permanent/Lincoln/Hybrid Vivo Talent are engaged with an organisation who is going through a huge transformation in how their data is used and managed. They require a Data Architect who is passionate … utilising their understanding of Azure data tools to implement and maintain an effective platform. Skills Azure Stack (SQL, Synapse, Data Lake) Power Bi Demonstrated experience in a similar position Strong stakeholder management skills both internal and external If you are interested in hearing more about … this opportunity, please get in touch. Data Architect/Data/Azure/Permanent/Lincoln/Hybrid Data Architect/Data/Azure/Permanent/Lincoln/Hybrid Data Architect/Data/Azure/Permanent more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … you can grow your career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data lakes more »

Previous experience working in a Data Engineering role * Experience working with Azure Technologies - Azure Data Factory, Synapse, Data Lake, Data Bricks * Experience working with SQL and Python * Experience designing and implementing ETL solutions This is a unique opportunity for a data … to d.moore1@nigelfrank.com or alternatively, give me a call on 0191 338 7577 Key Skills:Microsoft, Azure, Data Factory, Data Lake, Synapse, Data bricks, PySpark, Python, Scala, Data modelling, Data ingestion, Delta Lake, SQL, ETLJob SummaryUp to … GBPDeveloper/Programmer RoleSkills: Microsoft, Azure, Data Factory, Data Lake, Synapse, Data bricks, PySpark, Python, Scala, Data modelling, Data ingestion, Delta Lake, SQL, ETLLevel: Senior more »

provide data and analytics to the business.They work on a modern Delta Lakehouse tech stack built on Databricks, Azure Data Lake, SQL and Python. This role is very much a hands-on role, and the leadership team are all still very hands-on.The ideal candidate … reporting. * Plus more...Main Skill-Set We are looking for a good mix of the below skills, (not necessarily all of the below): * Azure Delta Lake * Databricks * Azure Data Lake * SQL * PythonMust HavesTo be successful, it is essential you have the following: * 3+ years' experience in a … to successful background checks including a DBS and Credit Check.Job Summary65,000 to 90,000 GBPOther RoleSkills: Delta Lakehouse, Databricks, Azure Data Lake, SQL, Python, Data WarehouseLevel: Senior more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £65,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … for this role, you will need to be a sole British national, eligible to work on secure client sites. We're seeking a Data Engineer with a … focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including but not limited to Azure Data Factory more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

crucial role in the Trust.The Trust has made a significant investment in BI because it recognises the impact that the intelligent use of data makes to the delivery of high quality and efficient health services. Having developed most of the infrastructure, our focus is now two-fold. Not … in community events. Relevant training in the use of elements of Microsoft Azure Technologies (Azure Analysis Service, Data Factory, Data Lake Storage/Analytics, Databricks, Synapse, Purview, Fabric etc.) Experience Essential Significant experience in two or more of the following: Designing and Building Data … and data warehouse design principles. Knowledge of latest Microsoft Cloud based technologies (Azure Analysis Service, Data Factory, Data Lake Storage/Analytics, Databricks, Synapse, Purview, Fabric etc.) Desirable Knowledge of cloud technologies and concepts Knowledge of NHS Information requirements, datasets, data more »

Azure Data Engineer | Cheltenham | £50,000-£70,000 Locke & McCloud are working with a leading Cyber Security Consultancy that is home to over 4000 specialists who support clients across manufacturing, defence and security, energy and utilities, financial services and many other industries. They have offices globally and are … requirements. Design and implement scalable data solutions on the Azure platform, leveraging services such as Azure SQL Database, Azure Data Lake, and Azure Synapse Analytics. Develop and maintain ETL pipelines to ingest, transform, and load data from various sources. Optimize data … SQL, T-SQL, and data modelling concepts. Hands-on experience with Azure services such as Azure SQL Database, Azure Data Lake, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. Familiarity with data governance, security, and compliance frameworks. Excellent communication and more »

Azure Data Engineer (SC Cleared) Location: Bristol Salary: £50,000 - £60,000 We're seeking Azure Data Engineer with active SC Clearance. This is a fantastic opportunity to join one of the most reputable digital solution provider's in the United Kingdom providing exposure to the … biggest and most ambitious programmes undertaken to keep our country safe. The SC Cleared Azure Data Engineer will be joining the Defence & Security arena, where you will help digitise defence with new thinking on technology capabilities and adoption processes, so we need someone who is sensitively able to … have Active SC Clearance* Role requirements Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including but not limited to Azure Data Factory more »

Data Engineering Lead Salary - Circa £65,000 Are you someone with a proven track record in data engineering, ready to lead and innovate? We have an exciting opportunity for an experienced Data Engineering Manager to manage a data development team who are … responsible for delivering IT data solutions across Aviva. As demand for data continues to grow across the organisation, we are in need of an experienced team lead from a technology … background to manage development projects through the full project life cycle with specific focus on ETL/data store (data lake/warehouse) in an Amazon Web Services environment. A bit about the job: This is a great opportunity for the right technology-aware individual more »

Define Architecture standards and principals • Translation for business requirements into Data Design, technical specifications • Data migration, strategy, mapping/lineage, quality, standards across multiple projects and solutions • Work closely with the development team to design and implement data solutions • Being able to recommend the … best place to source data sets, both internal and external to the organisation • Ability to capture and document standards and designs that can be easily understood for all stakeholders (DBAs through to CIO) • Data migration and the ability to be consulted … with data movements for data performance and optimisation • Microsoft experience (SQL DW/Cosmos DB/Azure Data Lake) • Working collaboratively with stakeholders, colleagues, and strategic partners across a portfolio of projects more »

on an exciting journey and there couldn’t be a better time to join us. The investments we’re making in our people, data, and technology are leading to innovative projects, fresh possibilities, and countless new ways for our people to work, learn, and thrive.What you’ll needDigital … front-end and back-end technologies, responsive design, and mobile app development frameworks.APIs: Understanding of API design principles, RESTful APIs.Data Management: Experience with data storage and processing technologies, including databases (SQL and NoSQL), data warehousing, and data lakes.Test Automation: Experience with toolsets such as … the future, whilst the scale and reach of our Group means you'll have many opportunities to learn, grow and develop.We keep your data safe. So, we'll only ever ask you to provide confidential or sensitive information once you have formally been invited along to an interview more »

that help us achieve our objectives. So each team leverages the technology that fits their needs best. You’ll see us working with data processing/streaming frameworks like Apache Flink and Spark; Database technologies like MySQL, PostgreSQL, DynamoDB and Redis; and breaking things using in-house chaos … working with some of the following to build high throughput, low latency, near real-time products: Java and Scala based Web Services, Databricks Data Lakes (Delta Lakes), AWS Kinesis and MSK, AWS ElasticSearch, AWS RDS, Apache Flink & Spark, scripting using Python, Terraform’s infrastructure as a code. The … disability & neurodiversity focused group - ENABLED, and our Mental Health & Wellbeing Group, TRUST. The Teams Acceleration The Acceleration (aka AXL) team builds critical user data focused services that are shared across all experiences on the streaming platforms: Disney+, Hulu, ESPN+ and Star+. We implement highly reliable, extremely high-throughput more »

Their goal is to deliver maximum value for every expenditure, ensuring efficiency and effectiveness in every project. In this role, you will transform data into valuable insights and models that drive business growth. Your contributions will be essential in analysing historical performance, ensuring regulatory compliance, forecasting future trends … Partner with stakeholders to conduct thorough research into business challenges and deliver iterative solutions. Report Generation: Develop comprehensive reports from structured and unstructured data within the Data Warehouse and Data Lake. Regulatory Compliance: Support regulatory and compliance efforts through detailed data analysis … and reporting. Data Visualisation: Design, prototype, and maintain Power BI reports using SQL and DAX to meet business needs. Agile Workflow: Operate within an Agile Kanban framework, reviewing, testing, and deploying solutions with source control. Product Team Collaboration: Collaborate with product teams to prioritise requests, define requirements, and more »

Principal Data Engineer Do you want to grow, mentor, nurture and develop a specialist team of Data Engineers in Belfast? How about leading this team to solve complex, technical challenges for businesses across multiple industries in both the private and public sectors? If you’ve answered … many more. Your team will look to you for guidance and support. You’ll get the chance to firmly establish and build the data practice within the Northern Ireland office. The sky is the limit in terms of where this role can go! Your New Company: This specialist … clients/stakeholders and manage these relationships Experience with a range of different tools and technologies, including but not limited to AWS (ETL, Data Lakes, DWH), Azure, Open Source (Redshift, Lambda, MongoDB) Proven ability to design, build and deliver enterprise-scale data solutions Big Data more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … you can grow your career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data lakes more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … you can grow your career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data lakes more »

Digital with Purpose. Are you ready to join a dynamic team at the forefront of digital transformation? DWP Digital is seeking Data Engineers who are passionate about utilising cutting-edge technologies to deliver impactful data products. DWP is the UK's largest department, every year we … you can grow your career and make a real difference. Essential criteria: Commercial experience of Databricks, PySpark and Pandas Commercial experience of Azure data engineering tools such as Azure Data Factory, dedicated SQL pools and ADSL Gen 2 Experience of working with data lakes more »