1 to 25 of 26 Data Pipeline Jobs in Manchester

years) as a Data Engineer in high-volume, high-transactional environments. Strong Python (or Scala) skills for data processing and pipeline development. Hands-on experience with AWS, particularly Glue, Lambda, and S3. Strong SQL skills and experience working with data warehouses. Solid understanding …/ELT design and data pipeline optimisation. Experience with big data frameworks such as Apache Spark, and exposure to streaming technologies like Kafka. Strong problem-solving skills and the ability to collaborate effectively across teams. What's on offer: Opportunity to influence the architecture ...

Permanent Opportunity available with a leading National Security Organisation for an eDV cleared Data Engineer in Manchester Manchester location – hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing … Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that help keep the nation safe, secure, and prosperous. You’ll work with cutting-edge technologies including AI/Data ...

documentation, and quality improvement initiatives. Participate in DevOps practices such as CI/CD, automated testing, and version control. Operational Support Troubleshoot and resolve pipeline issues, ensuring stability and data accuracy. Monitor pipeline performance and help implement improvements. Support continuous optimisation and lifecycle management. Does this … sound like you? Essential 3+ years T SQL including joins, transformations, stored procedures, and performance basics 3+ years Azure Data Factory, including pipeline development, parameter usage, and basic templates 3+ years Databricks experience (PySpark, Delta Lake, notebooks) 2+ years Python Experience Experience working with data ...

Data Engineer Manchester (hybrid, 2 days in the office) £70,000 to £90,000 This is an opportunity to join a scaling SaaS business where data sits at the heart of the product. You will play a key role in shaping modern data infrastructure … learning systems, real time decision making, and measurable commercial outcomes. The role offers high ownership, greenfield projects, and the chance to influence how data is used across the organisation as it continues to grow. The Company They are a UK based technology scale up building a privacy first ...

Data Engineer (Microsoft Fabric) Manchester/Birmingham/Nottingham (Hybrid - 2 days onsite) £50,000 Permanent - Full-time About the Opportunity SF Partners are partnering with a leading UK law firm to hire a Data Engineer with Microsoft Fabric experience to support a major data transformation programme. The business is moving away from SAP BW and building a modern data platform on Microsoft Fabric, and this role will be central to that journey. This is an opportunity to work hands-on with Fabric in a real enterprise environment - helping shape ...

Data Engineer; Python, PySpark - Salford, Manchester, Onsite. We are seeking an experienced Data Engineer to join a growing Data Team within a fast-paced, e-commerce-led business that is growing at an astonishing rate. The company operates in the direct-to-consumer retail … space, and the role will require you to work on-site, 5 days a week. As an experienced Data Engineer, you will join a Data Team that is on an exciting journey from legacy reporting to a cloud-based data solution, hosted within ...

client is a fast-growing e-commerce business, rapidly expanding. The role: Data Analyst Skillset: Must haves; Power BI report development (including DAX, Power Query, Parameters) Semantic model development Advanced Excel skills, including Data Connections, Power Query, and Power Pivot Intermediate or advanced T-SQL Debugging … Peoplevox or Google Analytics 4 (GA4) is beneficial, though transferable skills from similar systems are equally valued. Desirable; Microsoft Fabric or other cloud data services incorporating data lake, data warehouse, data pipelines, analytics & business intelligence Power BI calculation groups, bookmarks, semantic model ...

work to directly improve people’s lives and health Here’s your chance. This is an opportunity for a Lead BI Developer/Data Analyst to take the lead in shaping the company’s data strategy and analytics platform . This isn’t just about dashboards … design the pipelines, warehouses, and processes that turn complex, multi-source data into clear insights that influence decisions across the business and help improve health and wellbeing outcomes for the communities we serve. In this role, you will: Own the design and implementation of data pipelines ...

RealityMine has been a pioneer in delivering data driven insights to the world's largest brands for over a decade. Our platform provides unique data solutions to our clients enabling them to make strategic, informed decisions powered by data from real people, collected … Data Platform Engineer professional excited to work on impactful projects and shape the future of our data pipeline, we’d love to hear from you. Please email your CV with the heading ‘Data Platform Engineer’ to recruitment@realitymine.com ...

Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via chelsea.hackett@searchability.com ABOUT THE CLIENT Due to continued growth, we’re seeking a skilled … role in enabling business intelligence through high-performance data models and integrations with reporting tools. You’ll monitor and optimise pipeline performance, implement CI/CD processes for data workflows, and maintain strong governance and security standards across the data platform. Documentation, observability ...

Title: Data Engineer (HealthTech) Location: Manchester (Hybrid/Remote options available) Day Rate: £500–£550 per day (Outside IR35) Contract Length: 6 months initial (extensions likely) Overview Chapman Tate Associates are seeking an experienced Contract Data Engineer to join an innovative HealthTech organisation delivering data … platforms (e.g. Snowflake, Databricks, BigQuery, Redshift) Experience working with cloud technologies (AWS, Azure, or GCP) Solid understanding of data modelling, warehousing, and pipeline development Experience handling sensitive or regulated data Desirable Experience Experience working with healthcare data standards (e.g. FHIR, HL7) Exposure ...

partner with intimate knowledge of your industry and first-hand experience of defining its future.Glasgow, Manchester, London# Managing Consultant/Senior Manager- Data & AI Architecture## Managing Consultant/Senior Manager - Data & AI ArchitectureAt Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend … today and tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose.Join our Data & AI Strategy team and be part of the future of AI consulting, where we’re not just advising clients, we’re actively disrupting traditional ...

Senior Data Engineer £70,000-£90,000 Manchester (Hybrid) This is an exciting opportunity to join a growing tech scale-up where data is at the heart of their product. You will play a key role in shaping their data infrastructure, enabling large-scale … through advanced analytics, real-time behavioural insights and machine learning. With a collaborative engineering culture and strong investment backing, they are building scalable data systems to support rapid product expansion. THE ROLE As a Data Engineer you will take ownership of the company's core data ...

Data Engineer (Mid-Level) – Manchester (Hybrid, 2 Days Onsite) Morson Edge have partenered with an incredible, life changing Health-Tech organisation, in their search for a talented Mid-Level Data Engineer to join their growing team in Manchester. This is a permanent opportunity for someone … passionate about building scalable data solutions and enjoys working in a collaborative, fast-paced environment. The Role As a Data Engineer, you will play a key role in designing, developing, and maintaining data pipelines and infrastructure. You'll work closely with analysts, data ...

Senior Data Engineer 📍 Manchester, UK (Hybrid – 2 days per week onsite, Tuesdays & Thursdays) 💷 £70,000 – £80,000 + up to 10% bonus Are you a technically strong Senior Data Engineer who enjoys solving complex data challenges and working directly with clients to deliver real … commercially minded engineer to join a growing team in Manchester. This is an exciting opportunity to design, build and maintain scalable data platforms and pipelines that power analytics and AI-driven decision-making for leading UK organisations. This role is ideal for someone who thrives at the intersection ...

Senior Data Engineer Remote UK, £90,000 to £100,000 This is an opportunity to join a fast scaling, digital first consumer platform at a pivotal point in its data journey. They are investing heavily in their data infrastructure and are building a high … performing, software led data engineering team to support real time, high volume analytics across the business. You will have genuine influence over how data engineering is done, working on modern tooling and best practice from day one. The Company They are a UK based, consumer facing ...

Senior Data Engineer Up to £100,000 + Benefits Remote - UK This is a great opportunity to join a high-growth organisation where you can take ownership of end-to-end data engineering projects and play a key role in shaping a modern, scalable data … wave of players. Combining sharp product thinking, bold branding and fast execution. THE ROLE: You will take ownership of the full data engineering lifecycle. Key responsibilities include: Owning end-to-end data engineering projects across the platform Designing, building and optimising scalable data pipelines ...

look out for a skilled Databricks Engineer to join my client's data team whilst they are in a period of driving growth & effiency. This role is outside IR35 & will require some onsite presence in either Birmigham or Manchester. Responsibilities: Work closely with cross-functional teams to design … Desirable Skills & Experience: Certification in Databricks or related technologies. Familiarity with machine learning and data analytics. Previous experience in data pipeline development. Knowledge of DevOps principles. Please note this role unfortunately is not able to accomodate visas & due to volume of expected candidates, plus those ...

Data Engineer (Python) 6 months initial 2 days a week onsite in Manchester Outside IR35 This organisation delivers data-driven insights to media and market research clients. Its platform provides actionable data solutions to global brands, helping them make informed, strategic decisions. The Role … will join the Data Products team and take ownership of building and evolving behavioural data products. You will turn raw data signals into structured, high-quality datasets. You will use Python and SQL to define schemas, apply business logic, enforce quality checks, and deliver ...

/3 days onsite) IR35: Inside IR35 Rate: £450-£500 per day Start: ASAP Overview The business is investing heavily in its data capabilities, particularly across claims and pricing, with a focus on improving customer journey insights and building more robust data foundations. … environment with a high level of autonomy, working closely with a small team of analysts to enhance reporting, identify gaps, and improve how data is structured and used across the business. Role Focus * Support key initiatives across claims and pricing * Improve data structures and pipelines ...

excellent opportunity for someone at the start of their analytics career to develop strong technical and commercial skills in a supportive, data-driven environment. You will gain hands-on experience working with modern data platforms, building robust analytics solutions, and translating data into insights … that influence real business decisions. The Company They are a large, well-established organisation with a strong focus on using data and analytics to drive smarter decision-making. With a collaborative culture and a clear investment in technology, they provide an environment where early-career analysts can learn ...

What We’re Looking For Proven track record designing or architecting distributed, high-volume systems Experience with event-driven architectures and high-throughput data pipelines (Kafka) Strong knowledge of at least one of: C#, .NET, Golang, or TypeScript , plus SQL/databases Ability to balance hands-on technical ...

Software Engineers (Java/Data Platform) Remote First (Must be UK based with full right to work with no sponsorship) £75,000–£95,000 **Monthly meetups in London - fully expensed/optional. Access to offices should you prefer I’m working with a global consumer platform processing millions … user events, building systems that turn raw behavioural data into real-time insights and recommendations. This is not a typical backend role. It sits at the intersection of data, distributed systems and product, working on one of the most unique user datasets in its space. They ...

real-world application. What you’ll be doing You’ll design and develop AI agent systems that can interact with tools, APIs, and data sources to complete complex tasks autonomously. You’ll work closely with product and engineering teams to translate clinical and operational requirements into scalable … agent frameworks (e.g. LangChain, LlamaIndex, AutoGen or similar) Understanding of prompt engineering, RAG pipelines, and tool-using AI systems Experience working with APIs, data pipelines, and cloud platforms (AWS, Azure or GCP) Strong software engineering fundamentals (testing, version control, scalable design) Bonus experience: Background in healthcare, life sciences ...

trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that … closely with researchers. This includes curating code examples, providing precise solutions, and making corrections — with a primary focus on Python across backend services, data pipelines, and ML infrastructure, alongside JavaScript (including ReactJS), C/C++, Java, Rust, and Go. You will evaluate and refine AI-generated code ...