23 of 23 Permanent Data Pipeline Jobs in Lancashire

Engineer, Lead Data Engineer, Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Lead Data … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Job Title: Data Engineer Job Location: Preston – Hybrid- 1 day a week onsite. We offer a range of hybrid and flexible working arrangements – please speak to your recruiter about … modelling practices Designing and implementing ETL pipelines using SSIS for data integration to ensure ETL processes performs optimally Troubleshooting; identifying and fixing pipeline bottlenecks and data issues Understanding of data governance, data quality, and best practices The Data Management ...

business expands, we are looking for ambitious, talented people to join us. We are looking for a technically proficient Senior Data Engineer to join our growing Data team. Your primary focus will be on ensuring data quality, stability, and reliability — from the moment data arrives in its rawest form to when it is used in decision-making dashboards and customer-facing reports. You will optimise the transformation pipeline from start to finish, guaranteeing that datasets are robust, tested, secure, and business-ready. Our data platform is built using Databricks, with ...

Data Engineer Join a growing data engineering function and help build scalable, cloud-based data products that support data-driven decision making across the organisation. The Opportunity This is an exciting opportunity for a Data Engineer to work with modern … cloud technologies while contributing to the design, development, and delivery of enterprise data products. Working alongside Product Managers, Architects, Principal Engineers, and fellow Data Engineers, you will help create robust, high-performing data solutions that transform raw data into valuable business insights. ...

Title: AWS Data Engineer Contract: 6 Months Location: Remote, UK Skills: Advanced knowledge of data management tools including SQL/DBMS, MongoDB, Hadoop and/or other big data technologies. Advanced programming skills in Java, Python, R, C++, C#, etc. Knowledge of statistical … dynamics and corporate functions to help clients create the most value from data. Must Have: Enterprise Knowledge Data Management, Data pipeline, Python, SQL, AWS Centralising data stored in RDBMS, Data Ingestion, and Uploading data into the database. Education: Bachelor ...

complexity manageable and insight actionable supporting everything from premium and ads growth to forecasting, experimentation, and global reporting. As engineers in the Financial Data Platform team, we turn messy, fragmented realities into clean, reusable foundations. We build core datasets that represent key financial domains like Premium … Royalties. We create libraries and tools that empower others to produce and trust financial data at scale. We collaborate deeply with Finance, Product, and Data teams to unlock clarity and drive Spotify s ambitions forward. We are looking for engineers who are excited to shape ...

Data Engineer Manchester £45,000 About the Company A fast-growing, family-oriented organisation operating across multiple locations in the UK with a strong focus on people, development and long-term career growth are looking for a Data Engineer to join their growing team. As their … business continues to expand, they are investing heavily in data and technology to support smarter decision-making and innovation across the organisation. This is an excellent opportunity for someone with some hands-on experience who is eager to further develop their career in data engineering, with ...

Data Warehouse Architect £75,000+ benefits Bury (Hybrid) We are seeking a Data Warehouse Architect to design, establish, and govern a modern enterprise data platform. This role will bridge complex raw data and business insights by creating scalable, high-performance lakehouse … data warehouse architectures. You will play a key role in consolidating data assets, eliminating silos, and ensuring a single, source of truth to support advanced analytics and AI. Data Warehouse Architect Responsibilities: Design and implement enterprise-wide data architecture across Microsoft Fabric ...

Data Engineer Remote Working/London circ £60,000 - £70,000 Experienced Data Engineer required for this remote working/hybrid position based in West London (near Feltham, Hanworth, Hounslow etc). Ideally the successful candidate will be able to work on site once or twice … client would also consider candidates looking for a remote working role as long as they can be onsite once a month. The Data Engineer will join a small team and play a key role in developing and managing data integration projects as our client transitions data ...

Senior Data Engineer Location: Manchester (Hybrid 1 day per month on-site) My client is looking for a Senior Data Engineer to join their expanding data team. This is an excellent opportunity for someone who thrives in a collaborative, insight-driven environment … passionate about leveraging data to deliver tangible business value. This is not a role for someone just moving data from A to B with Python it s for someone who understands how to model, optimise, and apply data to support better business decisions. ...

Title: Senior Data Scientist Company Overview: Atreides helps organizations transform large and complex multi-modal datasets into information-rich geo-spatial data subscriptions that can be used across a wide spectrum of use cases. Currently, Atreides focuses on providing high-fidelity data solutions … enable customers to derive insights quickly. Atreides transforms the chaos of petabyte-scale, all-domain data land, air, sea, space, and cyber into real-time operational clarity. We are a fast-moving, high-performance international scale company. We trust our team with autonomy, believing it leads to better ...

Support & Customer Value Quantification Provide the technical evidence base and build business cases for renewals and expansions, translating platform telemetry and incident response data into clear customer outcomes. Proactively health-check environments, close technical gaps, and resolve visibility issues ahead of renewal conversations. Collaborate with Sales Engineering … optimise security operations workflows. Work confidently across backend languages (Python preferred; Go, JavaScript, and Bash valued) utilising RESTful APIs, webhooks, and data pipeline patterns. Detection Engineering & SIEM Development Write, tune, and maintain high-fidelity, low-noise SIEM detection rules by translating threat intelligence and attacker behaviour. ...

Senior Data Engineer in our new Central Data Engineering team in the Platform Mission, you will be leading work that is mission-wide in terms of scope. Our new Central Data Engineering team will inform data quality standards, access standards, create templatised … solutions, assist in managing mission-level datasets/dashboards, and prepare our mission s data for the AI Future that expected to impact every squad and product area. As the Senior engineer on the team, you will deal with bringing structure to ambiguity and be the bridge between ...

using Terraform, ECS, and Lambda while maintaining multi-tenant security and ISO 27001 standards. Develop and optimize hybrid search capabilities and data pipelines, integrating LLMs to automate complex research tasks for dealmakers. The ideal candidate: 7+ years of experience building and shipping production-grade systems in startup ...

read more about Veeva Link on our product pages at https://www.veeva.com/products/veeva-link/. As a data engineer, you focus on our data pipelines and take responsibility for a major part of the Link data processing platform. … value end-to-end ownership, which puts you into the sweet spot of finding, designing, and implementing improvements to the product's data pipelines and adjusting them to changing demands of the market. You take responsibility for features and innovation using SOLID and clean software principles, take part ...

Staff Machine Learning Engineer , you will play a key role in building and implementing features that empower lodging customers to make data-driven pricing decisions. Some of these features will use simple heuristic data, while others will leverage advanced machine learning techniques to optimize revenue strategies. … development to production. You ll be instrumental in establishing robust ML practices and rigorous testing processes across the entire ML lifecycle. From structuring data pipelines to implementing and validating ML models, you ll own the end-to-end development of our revenue management application ensuring hotels have ...

manual techniques of yesteryear – even as demand accelerates for copper, lithium, and other metals to build electric vehicles, renewable energy, and data centers. KoBold builds AI models for mineral exploration and deploys those models—alongside our novel sensors—to guide decisions on KoBold-owned-and-operated exploration programs. … exploration success rates by making mineral exploration data broadly accessible to humans and machines. Past projects have included SIP (the Structured Ingest Pipeline), DataKit generation (producing curated sets of data on demand), and RAG (Retrieval Augmentation Generation, utilizing natural language processing on unstructured data ...

rapidly growing company that specialises in delivering high-intent, high-quality leads while maintaining strict compliance with Financial Conduct Authority (FCA) and General Data Protection Regulation (GDPR) standards. Leveraging advanced APIs, their platform focuses on enhancing eligibility criteria and creating frictionless customer journeys to maximise conversion rates … generation platforms. The successful candidate will be passionate about automation, API integrations, and building conversion-focused user experiences, with a strong awareness of data privacy, security, and compliance. Responsibilities: Develop and maintain full-stack web applications focused on lead generation workflows. Optimise and scale platform performance to manage ...

Sardine is the leading agentic risk platform for fighting financial crime. Our integrated solution unifies data across risk teams to help organizations stop fraud in real time, prevent AI-driven attacks, and automate fraud and AML operations. Sardine s platform is strengthened by one of the fastest-growing … Engineer, you ll do more than build models - you ll design the systems that make fraud detection possible. You ll work across modeling, data pipelines, and backend systems (Go) to ensure ML models run reliably, efficiently, and at scale. This is a chance to combine applied ML with ...

concept through to a live product. What you'll do Design, build and scale geospatial systems. Collaborating with domain experts across Engineering, Product, Data, Bioinformatics and Nature Strategy, you will translate complex requirements into seamless user experiences. You will help define and run experiments, practice rigorous iteration … bioacoustics. Influence technical strategy and make decisions in ambiguity. You will drive foundational work across product and engineering, helping our teammates navigate various data engineering challenges, guiding technology choice and adoption of best practices. This includes designing and delivering scalable, cloud-based systems and leveraging AI to accelerate ...

systems that power VulnCheck s vulnerability intelligence platform. This is a high-impact, hands-on role where you ll own critical services and data pipelines end-to-end from design through production. You ll play a key role in shaping architecture, improving system performance and reliability, and delivering … primarily looking for candidates based in Cheltenham, United Kingdom. What You ll Do Design and build scalable backend systems, APIs, and data pipelines Own services end-to-end, including architecture, development, deployment, and operation Lead technical design discussions and contribute to system architecture decisions Write high-quality, maintainable ...

month fixed term contract Sanderson are partnered with a leading real estate provider who are seeking a skilled Tableau Developer to join their Data & Insight team for a six-month fixed-term contract. This is a fantastic opportunity to contribute to a major data transformation initiative … that drive commercial performance and strategic decision-making, working closely with stakeholders across the business to translate requirements into actionable insights and ensure data solutions are robust, accurate, and user-friendly. Key Responsibilities Design, build, and enhance Tableau dashboards to support commercial and operational teams. Collaborate with stakeholders ...

cross-functional reach. What You'll Do Design, build and maintain scalable backend services (Java/Python) and be active in shaping our data pipelines that power Spotify s internal Commerce platform Develop and enhance our user-facing layer and frontend SDKs (React/Typescript) Be an active … Product requirements Drive improvements to system architecture, performance, and developer experience Collaborate closely with a talented group of engineers, product managers, designers and data specialists across multiple teams Contribute to technical discussions and help shape platform decisions Who You Are You have experience building and maintaining backend services ...