1 to 25 of 40 Permanent Data Pipeline Jobs in the North West

years) as a Data Engineer in high-volume, high-transactional environments. Strong Python (or Scala) skills for data processing and pipeline development. Hands-on experience with AWS, particularly Glue, Lambda, and S3. Strong SQL skills and experience working with data warehouses. Solid understanding …/ELT design and data pipeline optimisation. Experience with big data frameworks such as Apache Spark, and exposure to streaming technologies like Kafka. Strong problem-solving skills and the ability to collaborate effectively across teams. What's on offer: Opportunity to influence the architecture ...

Senior Data Engineer Northwest/Remote (UK-based) £65,000-£75,000 We are partnering with a leading organisation to recruit an experienced Senior Data Engineer to play a key role in the design, development, and optimisation of modern data platforms. This position sits … change initiatives and driving adoption of new technologies Skills & Qualifications Strong expertise in data modelling, database design, and data pipeline development Experience with both SQL and NoSQL technologies Hands-on experience with at least one major cloud platform (Azure, AWS, or GCP) Experience with ...

Microsoft Fabric Data Engineer - Senior/Principal Location: Hybrid - 2-3 days onsite in Warrington (travel/expenses will be covered) Permanent Salary: Depending on experience Our client is seeking a highly skilled Microsoft Fabric Data Engineer at Senior or Principal level to lead the design … Collaboration Act as a technical authority for Microsoft Fabric, championing best practice and platform adoption. Mentor engineers, providing guidance on data modelling, pipeline optimisation and Fabric capabilities. Collaborate with BI developers, product managers and business teams to create data products that are accessible, scalable ...

Data Engineer Preston (Hybrid working) £50,000 Reliable, high-quality data underpins effective decision-making across the organisation. This Data Engineer role plays a critical part in ensuring that trusted data flows seamlessly from operational systems through to reporting and analytics platforms. … Implement robust error handling, logging, and monitoring across ETL/ELT processes. Develop and maintain test plans to validate data accuracy and pipeline performance. Monitor pipeline health and apply tuning techniques to optimise performance. Create and maintain dimensional and relational data models to support ...

Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Manchester Manchester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing … Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data ...

documentation, and quality improvement initiatives. Participate in DevOps practices such as CI/CD, automated testing, and version control. Operational Support Troubleshoot and resolve pipeline issues, ensuring stability and data accuracy. Monitor pipeline performance and help implement improvements. Support continuous optimisation and lifecycle management. Does this … sound like you? Essential 3+ years T SQL including joins, transformations, stored procedures, and performance basics 3+ years Azure Data Factory, including pipeline development, parameter usage, and basic templates 3+ years Databricks experience (PySpark, Delta Lake, notebooks) 2+ years Python Experience Experience working with data ...

Data Engineer Manchester (hybrid, 2 days in the office) £70,000 to £90,000 This is an opportunity to join a scaling SaaS business where data sits at the heart of the product. You will play a key role in shaping modern data infrastructure … learning systems, real time decision making, and measurable commercial outcomes. The role offers high ownership, greenfield projects, and the chance to influence how data is used across the organisation as it continues to grow. The Company They are a UK based technology scale up building a privacy first ...

Data Engineer (Microsoft Fabric) Manchester/Birmingham/Nottingham (Hybrid - 2 days onsite) £50,000 Permanent - Full-time About the Opportunity SF Partners are partnering with a leading UK law firm to hire a Data Engineer with Microsoft Fabric experience to support a major data transformation programme. The business is moving away from SAP BW and building a modern data platform on Microsoft Fabric, and this role will be central to that journey. This is an opportunity to work hands-on with Fabric in a real enterprise environment - helping shape ...

Data Engineer; Python, PySpark - Salford, Manchester, Onsite. We are seeking an experienced Data Engineer to join a growing Data Team within a fast-paced, e-commerce-led business that is growing at an astonishing rate. The company operates in the direct-to-consumer retail … space, and the role will require you to work on-site, 5 days a week. As an experienced Data Engineer, you will join a Data Team that is on an exciting journey from legacy reporting to a cloud-based data solution, hosted within ...

client is a fast-growing e-commerce business, rapidly expanding. The role: Data Analyst Skillset: Must haves; Power BI report development (including DAX, Power Query, Parameters) Semantic model development Advanced Excel skills, including Data Connections, Power Query, and Power Pivot Intermediate or advanced T-SQL Debugging … Peoplevox or Google Analytics 4 (GA4) is beneficial, though transferable skills from similar systems are equally valued. Desirable; Microsoft Fabric or other cloud data services incorporating data lake, data warehouse, data pipelines, analytics & business intelligence Power BI calculation groups, bookmarks, semantic model ...

Work Pattern: Office-based About the Role A well-established and expanding organisation is seeking a SQL Developer to join its data function. This position offers exposure across database administration, data engineering, and business intelligence, providing a varied and hands-on workload. It’s a great … across both production and test environments Data Engineering (DE) Build and maintain SQL-driven ETL/ELT processes Support data pipeline development and scheduled workflows Transform raw data into structured, analysis-ready formats Assist with data modelling, including fact and dimension ...

work to directly improve people’s lives and health Here’s your chance. This is an opportunity for a Lead BI Developer/Data Analyst to take the lead in shaping the company’s data strategy and analytics platform . This isn’t just about dashboards … design the pipelines, warehouses, and processes that turn complex, multi-source data into clear insights that influence decisions across the business and help improve health and wellbeing outcomes for the communities we serve. In this role, you will: Own the design and implementation of data pipelines ...

RealityMine has been a pioneer in delivering data driven insights to the world's largest brands for over a decade. Our platform provides unique data solutions to our clients enabling them to make strategic, informed decisions powered by data from real people, collected … Data Platform Engineer professional excited to work on impactful projects and shape the future of our data pipeline, we’d love to hear from you. Please email your CV with the heading ‘Data Platform Engineer’ to recruitment@realitymine.com ...

Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via chelsea.hackett@searchability.com ABOUT THE CLIENT Due to continued growth, we’re seeking a skilled … role in enabling business intelligence through high-performance data models and integrations with reporting tools. You’ll monitor and optimise pipeline performance, implement CI/CD processes for data workflows, and maintain strong governance and security standards across the data platform. Documentation, observability ...

Data Engineer Hybrid (2 – 3 days per month in the office) Greater Manchester £38,000 - £40,000 DOE Only candidates within a commutable distance of Greater Manchester will be considered. About the Role Our legal client is seeking a Data Engineer to join their Data Team to design, build, and maintain an Azure-based data environment. Within this role you will architect and manage the data ecosystem, develop pipelines, oversee the data lake and enable high-performance reporting through Power BI. You’ll collaborate with Stakeholders ...

partner with intimate knowledge of your industry and first-hand experience of defining its future.Glasgow, Manchester, London# Managing Consultant/Senior Manager- Data & AI Architecture## Managing Consultant/Senior Manager - Data & AI ArchitectureAt Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend … today and tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose.Join our Data & AI Strategy team and be part of the future of AI consulting, where we’re not just advising clients, we’re actively disrupting traditional ...

Data Manager - GCP We are looking for an experienced Data Manager to lead a high-performing Data Engineering team building scalable data and reporting platforms used by global stakeholders. In this role, you will guide the development of high-throughput, database-centric … applications that process and deliver critical operational data at scale. Working within a cloud-first architecture on Google Cloud Platform (GCP), you will play a key role in designing and delivering modern data solutions using BigQuery and distributed systems. You will lead a geographically distributed team ...

have demonstrable experience using Power BI and SQL Are you motivated by autonomy, ownership and turning data into meaningful insight? Consider the role of Business Intelligence Analyst at Reed in Partnership in Liverpool. Please note, internal applications for this role close on 17th April. What is the role … about? The Business Intelligence Analyst plays a critical role in transforming data into insight that drives performance, decision-making and impact across the RinP Network. You will maintain and develop scalable, secure data architecture and analytics solutions, while owning end-to-end insight projects that investigate ...

Senior Data & Machine Learning Engineer (MS Fabric focus) - Warrington (hybrid) We're working with a well-established business that's investing heavily in its data and AI capability and is now looking for a Senior Data & Machine Learning Engineer to play a key role … shaping their modern data platform. This is a senior, hands-on role where you'll take ownership of a Fabric-centric data estate, lead technical decisions, and work closely with BI teams, data scientists and senior stakeholders. They're looking for someone who enjoys ...

Senior Data Engineer £70,000-£90,000 Manchester (Hybrid) This is an exciting opportunity to join a growing tech scale-up where data is at the heart of their product. You will play a key role in shaping their data infrastructure, enabling large-scale … through advanced analytics, real-time behavioural insights and machine learning. With a collaborative engineering culture and strong investment backing, they are building scalable data systems to support rapid product expansion. THE ROLE As a Data Engineer you will take ownership of the company's core data ...

Data Engineer (Mid-Level) – Manchester (Hybrid, 2 Days Onsite) Morson Edge have partenered with an incredible, life changing Health-Tech organisation, in their search for a talented Mid-Level Data Engineer to join their growing team in Manchester. This is a permanent opportunity for someone … passionate about building scalable data solutions and enjoys working in a collaborative, fast-paced environment. The Role As a Data Engineer, you will play a key role in designing, developing, and maintaining data pipelines and infrastructure. You'll work closely with analysts, data ...

Senior Data Engineer 📍 Manchester, UK (Hybrid – 2 days per week onsite, Tuesdays & Thursdays) 💷 £70,000 – £80,000 + up to 10% bonus Are you a technically strong Senior Data Engineer who enjoys solving complex data challenges and working directly with clients to deliver real … commercially minded engineer to join a growing team in Manchester. This is an exciting opportunity to design, build and maintain scalable data platforms and pipelines that power analytics and AI-driven decision-making for leading UK organisations. This role is ideal for someone who thrives at the intersection ...

Senior Data Engineer Remote UK, £90,000 to £100,000 This is an opportunity to join a fast scaling, digital first consumer platform at a pivotal point in its data journey. They are investing heavily in their data infrastructure and are building a high … performing, software led data engineering team to support real time, high volume analytics across the business. You will have genuine influence over how data engineering is done, working on modern tooling and best practice from day one. The Company They are a UK based, consumer facing ...

Senior Data Engineer Up to £100,000 + Benefits Remote - UK This is a great opportunity to join a high-growth organisation where you can take ownership of end-to-end data engineering projects and play a key role in shaping a modern, scalable data … wave of players. Combining sharp product thinking, bold branding and fast execution. THE ROLE: You will take ownership of the full data engineering lifecycle. Key responsibilities include: Owning end-to-end data engineering projects across the platform Designing, building and optimising scalable data pipelines ...

look out for a skilled Databricks Engineer to join my client's data team whilst they are in a period of driving growth & effiency. This role is outside IR35 & will require some onsite presence in either Birmigham or Manchester. Responsibilities: Work closely with cross-functional teams to design … Desirable Skills & Experience: Certification in Databricks or related technologies. Familiarity with machine learning and data analytics. Previous experience in data pipeline development. Knowledge of DevOps principles. Please note this role unfortunately is not able to accomodate visas & due to volume of expected candidates, plus those ...