18 of 18 Permanent Data Lake Jobs in the North of England

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

Data Architect (DV) £Up to £100,000 GBP Transport Allowance Onsite WORKING Location: London; Manchester; Bristol, Manchester, North West - United Kingdom Type: Permanent The Role - Data Architect (DV Cleared) Join a consultancy recognised as a UK Great Place to Work year after year - a distinction that … data architecture for complex programmes, including ingestion, orchestration, governance, security, cost-optimisation, and observability Architect and implement multi-cloud, data lake, and data warehouse platforms Design scalable data pipelines, integration workflows, and analytics solutions Apply ML/AI frameworks, semantic models ...

make a significant impact from day one. Role Responsibilities Design and build a modern Azure-based data platform (Data Lake, ingestion pipelines, modelling, transformation). Lead data-driven projects across the organisation, ensuring timely delivery. Automate ingestion from ERP, CRM, bespoke operational systems … experience as a Data Engineer or in a similar role. Strong Azure background, ideally including Data Factory, Data Lake, Databricks, Synapse (or similar). Solid understanding of SQL, Python, ETL/ELT, data warehousing, and data modelling. Experience integrating ...

Data Engineer Permanent £70 - £80k plus annual bonus scheme (up to 10%) Hybrid working (typically 2 days working from home) Wigan Sellick Partnership are delighted to be supporting a growing manufacturing organisation with the recruitment of a Data Engineer - a brand new role to the business … ensuring effective project management and delivery on time. Design and build a scalable, modern cloud-based data platform, including data lake, data ingestion pipelines, transformation and data modelling. Evaluation of current data setup to identify gaps and improvements ...

Databricks Architect Role Overview We are seeking a S enior Databricks Architect to lead the design and delivery of scalable, high-performance data platforms built on Databricks. This is a strategic role requiring strong architectural experience, hands-on design capability, and a deep understanding of modern data … platform migrations , modernisation, or large-scale data transformations. Strong understanding of data architecture principles, including: Data lakes/lake house architectures. Data modelling and data integration patterns Performance optimisation and scalability Experience working with cloud-based data ...

Databricks A rchitect Role Overview We are seeking a S enior Databricks Architect to lead the design and delivery of scalable, high-performance data platforms built on Databricks. This is a strategic role requiring strong architectural experience, hands-on design capability, and a deep understanding of modern data … platform migrations , modernisation, or large-scale data transformations. Strong understanding of data architecture principles, including: Data lakes/lake house architectures. Data modelling and data integration patterns Performance optimisation and scalability Experience working with cloud-based data ...

Data Engineer - SC Cleared/SC Eligible Location: Newcastle upon Tyne About the Role We are working with a leading organisation who are building a brand-new engineering and data function in Newcastle. They are looking to hire multiple Data Engineers across Junior … modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures General: • Strong problem-solving skills • Experience working in agile environments • Good communication and stakeholder engagement • Understanding of secure ...

Title: Lead Data Engineer Location: Leeds, 2x per week Salary: Up to £80,000 per annum Why Apply? This is an exciting opportunity to work as a Lead Data Engineer delivering scalable, high quality data solutions for a leading client in the technology sector. … This position offers professional growth, challenging projects, and access to cutting edge cloud data technologies. Lead Data Engineer Responsibilities: Design, develop, and optimise robust, scalable data pipelines and architectures to support business intelligence and analytics initiatives. Manage and maintain cloud-based data ...

embark on a significant growth spurt as the leading omni-channel baby & nursery brand, with significant investment into IT and Data, as part of the catalyst for this growth plan, we are looking to recruit ay DATA ANALYTICS ENGINEER on (Microsoft Fabric) to be based … (bespoke internal systems + 3rd party applications covering, Retail and Wholesale Sales, Stock, Customer, Supply Chain and Finance) into the data lake environment. • Apply good practice in star-schema modelling, incremental refresh, and DAX/M query optimisation. • Work with software developers, analysts and self-serve ...

Market Data Analyst – Competitive Salary – Newcastle upon Tyne, United Kingdom We are working with a newly established and fast-growing organisation formed through a joint venture between a globally recognised management consultancy and a leading international investment manager. The business has been created to attract high-calibre talent … deliver innovative, data-driven solutions to complex financial and market-led challenges. Based in Newcastle upon Tyne, the firm operates in a collaborative, intellectually rigorous environment, combining institutional-grade standards with the agility of a growing business. This is an opportunity to join at an early stage ...

Microsoft Data Solution Architect Remote based. Paying up to 80k basic + 20-30k commission A leading Microsoft Consultancy is looking for a Data & AI Presales Solution Architect to join the business on a permanent basis. This is a key role within their growing Data … technical role within the Microsoft ecosystem. Deep understanding of Azure Data Services , including Data Factory, Synapse, Databricks, Data Lake, Microsoft Fabric and related analytics tools. Knowledge of AI and machine learning capabilities within Azure, such as Cognitive Services and Azure OpenAI. Ability ...

Data Engineer Hybrid/UK (DV Clearance Required) We are working with a leading global consultancy to hire a DV-cleared Data Engineer who will turn complex data into actionable insights. In this role, youll collaborate with multidisciplinary teams to design, build, and optimise … professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing large-scale structured and unstructured datasets ...

Role – Azure Data Engineer Technology – MS Fabric, Azure, PowerBI Location – Leeds, UK Job Description Today, the corporate landscape is dynamic, and the world ahead is full of possibilities! None of the amazing things we do at Infosys would be possible without an equally amazing culture, the environment where … high‐quality delivery of modern analytics platforms. Required •Strong hands-on expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, Azure SQL, Synapse. •Proven experience designing and developing solutions using Microsoft Fabric: o Lakehouse o Data Pipelines o Dataflows Gen2 ...

Next.JS, React, any web development experience would be a plus) Bonus points for Knowledge of asynchronous messaging patterns Experience with Azure Data Lake, Data Factory, and Logic Apps Exposure to AI, machine learning, or data engineering CI/CD experience with Azure DevOps ...

Data Engineering Lead- Manchester (hybrid) - up to £80K DOE We are working with a fast-growing fintech business in Manchester who are looking for a Data Team Lead. They have new PE investment behind them and a major transformation programme underway. This … strongest data leadership opportunities in the Northwest right now! If you are a data engineering leader who has worked at scale, knows their way around modern cloud platforms, and wants to shape something rather than just run it, read on... THE ROLE PURPOSE This ...

RBAC) NUnit (backend and mobile testing) Vitest & Playwright (frontend and E2E testing) Desirable Experience: Power BI report templating Azure Fabric/Data Lake familiarity Geospatial or mapping APIs (Google Maps preferred) iOS exposure (ARKit/LiDAR/sensor APIs) Experience in regulated or security-sensitive environments What … Associates (UK) Limited is acting as an Employment Agency in relation to this vacancy. To understand more about what we do with your data please review our privacy policy in the privacy section of the Oscar website. ...

claims portals and integrating CRM solutions. You will also get involved in a huge overhaul of their reporting solution and data lake, transitioning it to a modern data platform. About You You are a Business Analyst who has worked in General Insurance (ideally motor insurance ...

implement automation opportunities. · Develop and deploy SOAR automations for detection and response. · Serve as a subject matter expert in security automation and data analytics. · Produce system analytics and document changes per Change Management best practices. · Recommend, develop, and release new use cases to optimize SOAR capabilities. · Mentor junior … understanding of security incident response and security frameworks (MITRE ATT&CK, NIST) · Experience with scripting/programming (Python, Java, Perl, etc.) and big data analytics. · Familiarity with Windows, Linux/UNIX systems, databases, and multi-petabyte data lakes. · Excellent analytical, communication, and organizational skills. ...