13 of 13 Data Lake Jobs in the North West

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

Data Architect (DV) £Up to £100,000 GBP Transport Allowance Onsite WORKING Location: London; Manchester; Bristol, Manchester, North West - United Kingdom Type: Permanent The Role - Data Architect (DV Cleared) Join a consultancy recognised as a UK Great Place to Work year after year - a distinction that … data architecture for complex programmes, including ingestion, orchestration, governance, security, cost-optimisation, and observability Architect and implement multi-cloud, data lake, and data warehouse platforms Design scalable data pipelines, integration workflows, and analytics solutions Apply ML/AI frameworks, semantic models ...

Data Engineer Permanent £70 - £80k plus annual bonus scheme (up to 10%) Hybrid working (typically 2 days working from home) Wigan Sellick Partnership are delighted to be supporting a growing manufacturing organisation with the recruitment of a Data Engineer - a brand new role to the business … ensuring effective project management and delivery on time. Design and build a scalable, modern cloud-based data platform, including data lake, data ingestion pipelines, transformation and data modelling. Evaluation of current data setup to identify gaps and improvements ...

software engineering in a data context. You'll work across the modern Azure data stack - ADF, ADLS Gen2, PySpark, Delta Lake - with increasing exposure to Microsoft Fabric as the platform matures. You'll collaborate closely with customers and internal teams to ensure data … Event Hubs, Kafka), and legacy databases into ADLS Gen2 and OneLake Develop structured data models aligned to Lakehouse, Medallion Architecture, and Delta Lake patterns Continuously profile, debug, and optimise Spark jobs, SQL queries, and Python scripts for maximum performance and cost-efficiency at scale Champion DevOps best ...

Director of Data & Analytics Manchester (3 days per week onsite) Forward Role are thrilled to be partnering exclusively with a high-growth, PE-backed technology organisation in Manchester. As the business continues to scale, they are investing heavily in their data capability, and as part … this next phase, they are hiring a Director of Data & Analytics to centralise, elevate and grow the function. This senior leadership role sits at the heart of a fast-moving, data-driven technology business, where data underpins product development, customer experience, operational performance ...

Delivery Manager - Data Engineering Manchester (Hybrid) We're working with a leading global investment firm looking to hire a Delivery Manager - Data Engineering to lead a team of Data, DataOps and MLOps engineers. This is a great opportunity to take ownership … Engineering/DataOps background Experience with AWS, Python/PySpark, ETL/ELT pipelines Strong understanding of data platforms (Data Lake/Lakehouse/EDW) Hybrid working (3 days in office) + strong bonus and benefits package. ...

Data Engineer Hybrid/UK (DV Clearance Required) We are working with a leading global consultancy to hire a DV-cleared Data Engineer who will turn complex data into actionable insights. In this role, youll collaborate with multidisciplinary teams to design, build, and optimise … professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing large-scale structured and unstructured datasets ...

Raytheon UK have a full time, permanent opportunity for a Data Engineer to join our team on our Manchester, Gloucester or London sites working onsite. Our Data Engineering role will be responsible for building and maintaining data processing pipelines and also the transformation … Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL databases and storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices We appreciate you may not be an expert in every area ...

Next.JS, React, any web development experience would be a plus) Bonus points for Knowledge of asynchronous messaging patterns Experience with Azure Data Lake, Data Factory, and Logic Apps Exposure to AI, machine learning, or data engineering CI/CD experience with Azure DevOps ...

Data Engineering Lead- Manchester (hybrid) - up to £80K DOE We are working with a fast-growing fintech business in Manchester who are looking for a Data Team Lead. They have new PE investment behind them and a major transformation programme underway. This … strongest data leadership opportunities in the Northwest right now! If you are a data engineering leader who has worked at scale, knows their way around modern cloud platforms, and wants to shape something rather than just run it, read on... THE ROLE PURPOSE This ...

Senior Data Engineer Hybrid-working (Manchester + Home-based) c£60,000 to £75,000 per year (DOE) Plus an excellent company benefits package (including Private Healthcare, Bonuses, Professional Accreditations and Subscriptions, 25 days Annual Leave + Bank Holidays, etc.) The Opportunity: We are supporting a leading … Consultancy operating at the forefront of digital services and transformation across the UK public sector are seeking an experienced Senior Data Engineer to play a key role in designing and delivering modern, scalable data platforms that support critical national services. Working within collaborative, multi-disciplinary teams ...

RBAC) NUnit (backend and mobile testing) Vitest & Playwright (frontend and E2E testing) Desirable Experience: Power BI report templating Azure Fabric/Data Lake familiarity Geospatial or mapping APIs (Google Maps preferred) iOS exposure (ARKit/LiDAR/sensor APIs) Experience in regulated or security-sensitive environments What … Associates (UK) Limited is acting as an Employment Agency in relation to this vacancy. To understand more about what we do with your data please review our privacy policy in the privacy section of the Oscar website. ...

Opportunity As a business - they monitor, preserve and analyse their clients sensitive data to ensure that important documents are securely stored that are not needed for the businesses day to day operations so realistically you would be working on the build of intricate security software which helps protect … legacy databases. Requirements... Strong commercial experience working with SQL Databases. Experience working with Azure technologies or migrating to them (experiene with Azure Functions, Azure Datalake, Azure Fabric would be great)! Any experience using Octopus Deploy or Azure functions/DevOpS is ideal. Experience working with big datasets. Develop and maintain ...