1 to 25 of 27 Data Lake Jobs in the North of England

Data Engineer This role is largely remote with the occasional travel. … seeking an experienced Data Engineer who is skilled in all toolsets in data platforms including Azure SQL, data lake, Databricks and data factory, and specialised in building high performance, highly scalable and cost-effective data solution within time ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

Data Architect (DV) £Up to £100,000 GBP Transport Allowance Onsite WORKING Location: London; Manchester; Bristol, Manchester, North West - United Kingdom Type: Permanent The Role - Data Architect (DV Cleared) Join a consultancy recognised as a UK Great Place to Work year after year - a distinction that … data architecture for complex programmes, including ingestion, orchestration, governance, security, cost-optimisation, and observability Architect and implement multi-cloud, data lake, and data warehouse platforms Design scalable data pipelines, integration workflows, and analytics solutions Apply ML/AI frameworks, semantic models ...

Data Engineer Permanent £70 - £80k plus annual bonus scheme (up to 10%) Hybrid working (typically 2 days working from home) Wigan Sellick Partnership are delighted to be supporting a growing manufacturing organisation with the recruitment of a Data Engineer - a brand new role to the business … ensuring effective project management and delivery on time. Design and build a scalable, modern cloud-based data platform, including data lake, data ingestion pipelines, transformation and data modelling. Evaluation of current data setup to identify gaps and improvements ...

software engineering in a data context. You'll work across the modern Azure data stack - ADF, ADLS Gen2, PySpark, Delta Lake - with increasing exposure to Microsoft Fabric as the platform matures. You'll collaborate closely with customers and internal teams to ensure data … Event Hubs, Kafka), and legacy databases into ADLS Gen2 and OneLake Develop structured data models aligned to Lakehouse, Medallion Architecture, and Delta Lake patterns Continuously profile, debug, and optimise Spark jobs, SQL queries, and Python scripts for maximum performance and cost-efficiency at scale Champion DevOps best ...

Data Architect Salary: Circa 80k Working arrangement: flexible, travel to Durham once or twice a week, remaining WFH Overview We are supporting a large, values-driven organisation to recruit a Data Architect. This is a senior role responsible for shaping and delivering enterprise data strategy across a complex technology environment. You will act as the technical authority for data and AI, ensuring data is secure, high quality and effectively used to support business outcomes. Key Responsibilities Define and deliver data strategy aligned to organisational goals Design ...

Data Engineer - SC Cleared/SC Eligible Location: Newcastle upon Tyne About the Role We are working with a leading organisation who are building a brand-new engineering and data function in Newcastle. They are looking to hire multiple Data Engineers across Junior … modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures General: • Strong problem-solving skills • Experience working in agile environments • Good communication and stakeholder engagement • Understanding of secure ...

Data Architect Up to £90,000 (Dependant on Experience) This is a hybrid position, combining the best of both worlds - working from home and spending 1-2 days a week in ourHalifaxoffice. We have an exciting opportunity to join us here atCovéa Insuranceas a Data Architect … Data Vault, Kimball, Inmon, and medallion design patterns Broad experience with cloud and on-prem Data Warehouse, Data Lake, and Lakehouse architectures Relevant cloud/data architecture certifications (Databricks, AWS, Azure) preferred Confident working with stakeholders at all levels, including partners ...

Director of Data & Analytics Manchester (3 days per week onsite) Forward Role are thrilled to be partnering exclusively with a high-growth, PE-backed technology organisation in Manchester. As the business continues to scale, they are investing heavily in their data capability, and as part … this next phase, they are hiring a Director of Data & Analytics to centralise, elevate and grow the function. This senior leadership role sits at the heart of a fast-moving, data-driven technology business, where data underpins product development, customer experience, operational performance ...

embark on a significant growth spurt as the leading omni-channel baby & nursery brand, with significant investment into IT and Data, as part of the catalyst for this growth plan, we are looking to recruit ay DATA ANALYTICS ENGINEER on (Microsoft Fabric) to be based … (bespoke internal systems + 3rd party applications covering, Retail and Wholesale Sales, Stock, Customer, Supply Chain and Finance) into the data lake environment. • Apply good practice in star-schema modelling, incremental refresh, and DAX/M query optimisation. • Work with software developers, analysts and self-serve ...

Cleared Data Architects & Data Platform Engineers UK | Hybrid | Multiple Levels Datatech Analytics is supporting a leading UK technology and consulting organisation delivering mission-critical data and AI platforms across defence and national security programmes. We are particularly keen to speak with DV-cleared Data … Typical environments include: • Python and SQL • Spark, Databricks and distributed data processing platforms • AWS, Azure and Google Cloud • Modern data lake, lakehouse and warehouse architectures Who we’re keen to speak with Active DV clearance is essential. We are particularly interested in: • Data ...

Data Architect * listen to the needs of technical and business stakeholders, and interpret them * effectively manage stakeholder expectations * manage active and reactive communication * support or host difficult discussions within the team or with diverse senior stakeholders * understand and help teams to apply a range of techniques for data … Skills/Tech Stack * AWS: S3, Lambda, EMR, SMS, SQS, and additional services related to data infrastructure * Terraform * Databricks * Data Lake, Warehouse, Lakehouse architecture and design * Python/Pyspark * Data platforms and notebooks: Jupyter, Databricks, Azure * Gitlab: repository and CI/CD * Java ...

Interim Head Of Data & Digital Architecture 3-6-Month Contract | Inside IR35 | £600-£800 per dayRemote First with Occasional National TravelStart: ASAP Your New Organisation A large, national, mission-driven organisation is undergoing significant digital, data and technology modernisation. To maintain momentum during a period … transition, they are seeking an Interim Head of Data & Digital Architecture to provide technical leadership, delivery assurance and stability across their data and digital transformation portfolio.This is an ideal role for an experienced interim who can quickly embed, guide teams, and take ownership of critical data ...

Delivery Manager - Data Engineering Manchester (Hybrid) We're working with a leading global investment firm looking to hire a Delivery Manager - Data Engineering to lead a team of Data, DataOps and MLOps engineers. This is a great opportunity to take ownership … Engineering/DataOps background Experience with AWS, Python/PySpark, ETL/ELT pipelines Strong understanding of data platforms (Data Lake/Lakehouse/EDW) Hybrid working (3 days in office) + strong bonus and benefits package. ...

Delivery Manager - Data Engineering Have you got what it takes to succeed The following information should be read carefully by all candidates. Manchester (Hybrid) We're working with a leading global investment firm looking to hire a Delivery Manager - Data Engineering to lead a team … Engineering/DataOps background Experience with AWS, Python/PySpark, ETL/ELT pipelines Strong understanding of data platforms (Data Lake/Lakehouse/EDW) Hybrid working (3 days in office) + strong bonus and benefits package. ...

Microsoft Data Solution Architect Remote based. Paying up to 80k basic + 20-30k commission A leading Microsoft Consultancy is looking for a Data & AI Presales Solution Architect to join the business on a permanent basis. This is a key role within their growing Data … technical role within the Microsoft ecosystem. Deep understanding of Azure Data Services , including Data Factory, Synapse, Databricks, Data Lake, Microsoft Fabric and related analytics tools. Knowledge of AI and machine learning capabilities within Azure, such as Cognitive Services and Azure OpenAI. Ability ...

Data Engineer Hybrid/UK (DV Clearance Required) We are working with a leading global consultancy to hire a DV-cleared Data Engineer who will turn complex data into actionable insights. In this role, youll collaborate with multidisciplinary teams to design, build, and optimise … professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing large-scale structured and unstructured datasets ...

Delivery Manager If your skills, experience, and qualifications match those in this job overview, do not delay your application. - Data Engineering Manchester (Hybrid) We're working with a leading global investment firm looking to hire a Delivery Manager - Data Engineering to lead a team of Data … Engineering/DataOps background Experience with AWS, Python/PySpark, ETL/ELT pipelines Strong understanding of data platforms (Data Lake/Lakehouse/EDW) Hybrid working (3 days in office) strong bonus and benefits package. ...

Role – Azure Data Engineer Technology – MS Fabric, Azure, PowerBI Location – Leeds, UK Job Description Today, the corporate landscape is dynamic, and the world ahead is full of possibilities! None of the amazing things we do at Infosys would be possible without an equally amazing culture, the environment where … high‐quality delivery of modern analytics platforms. Required •Strong hands-on expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, Azure SQL, Synapse. •Proven experience designing and developing solutions using Microsoft Fabric: o Lakehouse o Data Pipelines o Dataflows Gen2 ...

Raytheon UK have a full time, permanent opportunity for a Data Engineer to join our team on our Manchester, Gloucester or London sites working onsite. Our Data Engineering role will be responsible for building and maintaining data processing pipelines and also the transformation … Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL databases and storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices We appreciate you may not be an expert in every area ...

Next.JS, React, any web development experience would be a plus) Bonus points for Knowledge of asynchronous messaging patterns Experience with Azure Data Lake, Data Factory, and Logic Apps Exposure to AI, machine learning, or data engineering CI/CD experience with Azure DevOps ...

Data Engineering Lead- Manchester (hybrid) - up to £80K DOE We are working with a fast-growing fintech business in Manchester who are looking for a Data Team Lead. They have new PE investment behind them and a major transformation programme underway. This … strongest data leadership opportunities in the Northwest right now! If you are a data engineering leader who has worked at scale, knows their way around modern cloud platforms, and wants to shape something rather than just run it, read on... THE ROLE PURPOSE This ...

have an exciting opportunity for a Senior DataOps Engineer to join the Group and take responsibility for inspiring and coaching our Data Engineering teams. The full job description covers all associated skills, previous experience, and any qualifications that applicants are expected to have. The person in post will … working alongside domain-oriented, multi-disciplinary data product teams to design, develop, and test high-quality data solutions that serve as the backbone of our decision-making and digital services. Driving automation and CI/CD practices across data pipelines and infrastructure, the Senior ...

within the Trust/Organization. B. Technical Sprint Planning (Azure & Epic) Backlog Grooming: Translate complex Epic infrastructure requirements (e.g., setting up the Cogito Data Warehouse on Azure) into digestible Agile user stories. Sprint Execution: Lead the 'Tech-Build Squad' in the deployment of ODBA environments, ensuring high-availability … with the Epic 3nd-tier architecture (Caché/IRIS, Clarity, Caboodle). Azure Infrastructure: Understanding of Azure SQL Managed Instances, Azure Data Lake Storage (ADLS), and Synapse Analytics. Agile Proficiency: Expert level in Jira/Azure DevOps (ADO) for tracking technical delivery. 4. Critical Success Factors ...

RBAC) NUnit (backend and mobile testing) Vitest & Playwright (frontend and E2E testing) Desirable Experience: Power BI report templating Azure Fabric/Data Lake familiarity Geospatial or mapping APIs (Google Maps preferred) iOS exposure (ARKit/LiDAR/sensor APIs) Experience in regulated or security-sensitive environments What … Associates (UK) Limited is acting as an Employment Agency in relation to this vacancy. To understand more about what we do with your data please review our privacy policy in the privacy section of the Oscar website. ...