1 to 25 of 26 Data Pipeline Jobs in Lancashire

Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Job Title: Data Engineer Job Location: Preston – Hybrid- 1 day a week onsite. We offer a range of hybrid and flexible working arrangements – please speak to your recruiter about … modelling practices Designing and implementing ETL pipelines using SSIS for data integration to ensure ETL processes performs optimally Troubleshooting; identifying and fixing pipeline bottlenecks and data issues Understanding of data governance, data quality, and best practices The Data Management ...

belonging for all our colleagues is central to our journey as a global business. Who You Are/Your Next Challenge The Data Engineer plays a critical role in enabling Finance & Treasury to deliver accurate, timely, and insight driven reporting by building scalable data solutions, maintaining … core data infrastructure, and supporting the modernisation of Finance systems. This role is responsible for engineering robust data pipelines, managing datasets across the Microsoft Fabric platform, and ensuring Finance has reliable, consistent, and governed data to support transformation, automation, and improved operational efficiency. ...

business expands, we are looking for ambitious, talented people to join us. We are looking for a technically proficient Senior Data Engineer to join our growing Data team. Your primary focus will be on ensuring data quality, stability, and reliability — from the moment data arrives in its rawest form to when it is used in decision-making dashboards and customer-facing reports. You will optimise the transformation pipeline from start to finish, guaranteeing that datasets are robust, tested, secure, and business-ready. Our data platform is built using Databricks, with ...

Data Engineer Join a growing data engineering function and help build scalable, cloud-based data products that support data-driven decision making across the organisation. The Opportunity This is an exciting opportunity for a Data Engineer to work with modern … cloud technologies while contributing to the design, development, and delivery of enterprise data products. Working alongside Product Managers, Architects, Principal Engineers, and fellow Data Engineers, you will help create robust, high-performing data solutions that transform raw data into valuable business insights. ...

Apprentice Data Engineer Location: Bristol, Nottingham, Birmingham, Leeds, Oldham, Newcastle, Uxbridge Salary: £30,485 per annum Vacancy Type: Fixed term apprenticeship, 2 years Closing Date: 12th of July 2026 This Apprenticeship combines working and learning, in a great opportunity where you’ll earn a salary, get workexperience … finish the apprenticeship with a Level 5 Qualification in Data Engineering – which you won’t have to pay a penny for! We will provide a fully paid 24 month Apprenticeship to help you gain a Level 5 qualification specialising in Data Engineering and provide hands ...

Data Engineer Manchester £45,000 About the Company A fast-growing, family-oriented organisation operating across multiple locations in the UK with a strong focus on people, development and long-term career growth are looking for a Data Engineer to join their growing team. As their … business continues to expand, they are investing heavily in data and technology to support smarter decision-making and innovation across the organisation. This is an excellent opportunity for someone with some hands-on experience who is eager to further develop their career in data engineering, with ...

Data Warehouse Architect £75,000+ benefits Bury (Hybrid) We are seeking a Data Warehouse Architect to design, establish, and govern a modern enterprise data platform. This role will bridge complex raw data and business insights by creating scalable, high-performance lakehouse … data warehouse architectures. You will play a key role in consolidating data assets, eliminating silos, and ensuring a single, source of truth to support advanced analytics and AI. Data Warehouse Architect Responsibilities: Design and implement enterprise-wide data architecture across Microsoft Fabric ...

Data Engineer Remote Working/London circ £60,000 - £70,000 Experienced Data Engineer required for this remote working/hybrid position based in West London (near Feltham, Hanworth, Hounslow etc). Ideally the successful candidate will be able to work on site once or twice … client would also consider candidates looking for a remote working role as long as they can be onsite once a month. The Data Engineer will join a small team and play a key role in developing and managing data integration projects as our client transitions data ...

people across the globe. Join us on this journey to redefine resource management and change lives along the way. The Role As a Data Analyst at Air Apps, you will be responsible for analyzing and interpreting data to drive business insights and optimize product performance. … Experience working with large datasets and cloud-based data warehouses (BigQuery, Redshift, Snowflake). Familiarity with ETL processes and data pipeline optimization is a plus. Ability to work in a fast-paced, data-driven environment and manage multiple projects. What benefits ...

hiring a Senior Data Engineer to help shape the future of data-driven transformation for our clients. At TEKenable, a multi-award-winning Microsoft partner and one of Deloitte s Fastest 50, you ll work with cutting-edge technologies like Microsoft Azure Synapse, Microsoft Fabric … Power BI. In this customer-facing role, you ll collaborate directly with clients to solve complex data challenges, delivering scalable solutions that drive real business value. This role is open to applicants across Ireland and the UK but we are unable to provide visa sponsorship. ...

Senior Data Engineer Location: Manchester (Hybrid 1 day per month on-site) My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment … passionate about leveraging data to deliver tangible business value. This is not a role for someone just moving data from A to B with Python it s for someone who understands how to model, optimise, and apply data to support better business decisions. ...

Sparta Global are hiring a Senior Data Engineer - this is a role that combines hands-on engineering with technical leadership, including mentoring junior engineers and driving best practice across an organisation's data engineering function. This is a 12-Month Fixed Term Contract , requiring 3 days … week on-site in Blackpool. Role Summary: Designing, building, and optimising scalable data pipelines that support analytics, reporting, and operational use cases. You will play a key role in shaping the organisations data architecture, ensuring data is reliable, accessible, and performant across multiple systems ...

lands real impact for millions of people - helping anyone create with confidence. We're looking for a Machine Learning Engineer to own the data foundations that power our multimodal agent research building the pipelines, datasets, and tooling that turn ambitious research ideas into trainable reality. About the team … partner closely with product and platform teams to turn breakthroughs into delightful product features. About the role You'll be responsible for the data lifecycle that fuels our agent research: from collection and curation through to preprocessing, quality assurance, and delivery into training pipelines. You'll work closely ...

Support & Customer Value Quantification Provide the technical evidence base and build business cases for renewals and expansions, translating platform telemetry and incident response data into clear customer outcomes. Proactively health-check environments, close technical gaps, and resolve visibility issues ahead of renewal conversations. Collaborate with Sales Engineering … optimise security operations workflows. Work confidently across backend languages (Python preferred; Go, JavaScript, and Bash valued) utilising RESTful APIs, webhooks, and data pipeline patterns. Detection Engineering & SIEM Development Write, tune, and maintain high-fidelity, low-noise SIEM detection rules by translating threat intelligence and attacker behaviour. ...

Senior Data Engineer in our new Central Data Engineering team in the Platform Mission, you will be leading work that is mission-wide in terms of scope. Our new Central Data Engineering team will inform data quality standards, access standards, create templatised … solutions, assist in managing mission-level datasets/dashboards, and prepare our mission s data for the AI Future that expected to impact every squad and product area. As the Senior engineer on the team, you will deal with bringing structure to ambiguity and be the bridge between ...

know-how Bonus Points If You Have built complex workflow orchestration systems Know your way around cloud infra Have experience building integrations or data pipelines Love mentoring and growing teams Why Join Saris AI? Join us in building the future of work for the trillion-dollar banking industry ...

using Terraform, ECS, and Lambda while maintaining multi-tenant security and ISO 27001 standards. Develop and optimize hybrid search capabilities and data pipelines, integrating LLMs to automate complex research tasks for dealmakers. The ideal candidate: 7+ years of experience building and shipping production-grade systems in startup ...

manual techniques of yesteryear even as demand accelerates for copper, lithium, and other metals to build electric vehicles, renewable energy, and data centers. KoBold builds AI models for mineral exploration and deploys those models alongside our novel sensors to guide decisions on KoBold-owned-and-operated exploration programs. … exploration success rates by making mineral exploration data broadly accessible to humans and machines. Past projects have included SIP (the Structured Ingest Pipeline), DataKit generation (producing curated sets of data on demand), and RAG (Retrieval Augmentation Generation, utilizing natural language processing on unstructured data ...

rapidly growing company that specialises in delivering high-intent, high-quality leads while maintaining strict compliance with Financial Conduct Authority (FCA) and General Data Protection Regulation (GDPR) standards. Leveraging advanced APIs, their platform focuses on enhancing eligibility criteria and creating frictionless customer journeys to maximise conversion rates … generation platforms. The successful candidate will be passionate about automation, API integrations, and building conversion-focused user experiences, with a strong awareness of data privacy, security, and compliance. Responsibilities: Develop and maintain full-stack web applications focused on lead generation workflows. Optimise and scale platform performance to manage ...

Sardine is the leading agentic risk platform for fighting financial crime. Our integrated solution unifies data across risk teams to help organizations stop fraud in real time, prevent AI-driven attacks, and automate fraud and AML operations. Sardine s platform is strengthened by one of the fastest-growing … Engineer, you ll do more than build models - you ll design the systems that make fraud detection possible. You ll work across modeling, data pipelines, and backend systems (Go) to ensure ML models run reliably, efficiently, and at scale. This is a chance to combine applied ML with ...

systems that power VulnCheck s vulnerability intelligence platform. This is a high-impact, hands-on role where you ll own critical services and data pipelines end-to-end from design through production. You ll play a key role in shaping architecture, improving system performance and reliability, and delivering … primarily looking for candidates based in Cheltenham, United Kingdom. What You ll Do Design and build scalable backend systems, APIs, and data pipelines Own services end-to-end, including architecture, development, deployment, and operation Lead technical design discussions and contribute to system architecture decisions Write high-quality, maintainable ...

month fixed term contract Sanderson are partnered with a leading real estate provider who are seeking a skilled Tableau Developer to join their Data & Insight team for a six-month fixed-term contract. This is a fantastic opportunity to contribute to a major data transformation initiative … that drive commercial performance and strategic decision-making, working closely with stakeholders across the business to translate requirements into actionable insights and ensure data solutions are robust, accurate, and user-friendly. Key Responsibilities Design, build, and enhance Tableau dashboards to support commercial and operational teams. Collaborate with stakeholders ...

Powerhouse Behind Next-Gen iGaming Platforms! Are you a seasoned backend engineer ready to tackle the complex world of real-time, high-frequency data exchange Our client, a fast-growing B2B iGaming platform provider in Malta, is building the future of Sports Exchange services and they need … these backend languages ; Go, Java, Node.js, Rust, RoR Experience with microservices and event-driven design Familiarity with message queues and real-time data pipelines Comfortable working in a fast-paced, agile environment Excellent problem-solving and communication skills Proficient in English Global Talent Welcome Relocation support to Malta ...

making models trainable, deployable, observable, and performant under real-world constraints. What You'll Do Own end-to-end ML system execution: data pipelines, training workflows, evaluation systems, inference architecture, and deployment. Fine-tune and adapt models using state-of-the-art methods such as LoRA, QLoRA … distillation. Architect and operate scalable inference systems, balancing latency, cost, and reliability. Design and maintain data systems for high-quality synthetic and real-world training data. Implement evaluation pipelines covering performance, robustness, safety, and bias, in partnership with research leadership. Own production deployment, including GPU optimization, memory efficiency ...