351 to 375 of 525 Data Pipeline Jobs in England

Lead Data Engineer Tech Stack: Python | Spark | Kafka | Airflow | Vector DBs Location: London - office based Salary: Up to £140k + equity We’re partnering with a well-funded AI startup building a category-defining platform within a major UK industry undergoing rapid transformation. This is a first data hire and a genuinely high-impact role, owning and building the entire data infrastructure from the ground up. You’ll work closely with AI and engineering teams to design scalable data pipelines, support machine learning systems, and enable real-time, intelligent decision-making across ...

driving force within their industry. Your new role Deliver high-quality outputs from planning and BI systems. Analyse and interpret data to support business development and performance improvement. Write and optimise SQL stored procedures and design SQL Agent jobs. Build robust ETL pipelines using SSIS, including high-volume … transformations. Maintain data quality across key KPIs and core data sources. Create Power BI data models using Power Query and DAX. Develop Power BI dashboards and paginated reports. Maintain and enhance existing reporting models. Build and maintain Power Automate flows to streamline, automate ...

driving force within their industry. Your new role Deliver high-quality outputs from planning and BI systems. Analyse and interpret data to support business development and performance improvement. Write and optimise SQL stored procedures and design SQL Agent jobs. Build robust ETL pipelines using SSIS, including high-volume … transformations. Maintain data quality across key KPIs and core data sources. Create Power BI data models using Power Query and DAX. Develop Power BI dashboards and paginated reports. Maintain and enhance existing reporting models. Build and maintain Power Automate flows to streamline, automate ...

Overview We are seeking an experienced Data Platform Solution Architect to lead the design and implementation of scalable, cloud-native data platforms in Basildon . This role will focus on building modern lakehouse architectures leveraging AWS and Snowflake, ensuring high performance, reliability, and governance across enterprise … data ecosystems. Key Responsibilities Design and deliver end-to-end data platform architecture using Snowflake, AWS, and modern lakehouse principles Produce high-quality Architecture Design Documents (ADDs) and technical blueprints Architect and optimise data pipelines using Airflow/MWAA and dbt Define and implement ...

digital marketing function at a pivotal moment in their marketplace expansion. You will play a key role in shaping technical marketing capabilities, building data pipelines, and ensuring product and stock feeds power accurate, impactful customer targeting across major digital channels. The Company They are a well‐established consumer …/B tests. • Understanding how data flows through architecture and helping shape technical solutions. • Working with engineering teams on ETL processes and pipeline health. • Using tools such as Intelligent Reach, GCP, and Snowflake to support accurate data transformation. • Collaborating closely with digital marketing teams ...

forefront of the space sector, supporting systems and programmes that quite literally operate beyond Earth. They’re investing heavily in their data platform and need someone hands-on with Microsoft Fabric and Power BI to help bring structure, reliability, and clarity to how data is used … theory-heavy role or a “sit in meetings all day” position. It’s about getting stuck into the platform, improving data flows, and building reporting that engineers, finance teams, and operational staff actually rely on. What you’ll be doing Working within Microsoft Fabric (Lakehouse + Warehouse) Building ...

require a minimum of 3 days per week on site in central Cambridge. The key experience required for this Bioinformatician position is: CRISPR Data pipelines Python or R Support lab scientists If you do have the relevant skills for this Bioinformatician Engineer contract position, please do apply. ...

Have Experience with procedural workflows (Houdini, Substance, or similar DCC tools) Ability to create and optimize sprite sheets, textures, and mesh data pipelines Strong problem-solving mindset with a passion for innovation in real-time graphics What You’ll Get Work on visually stunning, globally recognized VR experiences ...

digital tools supporting flexible connections and DERMS. Perform power system studies (thermal, voltage, fault level) to identify network constraints. Develop Python-based tools, data pipelines, dashboards, and APIs . Use GitHub for version control and collaborative development. Work with teams across DSO, Planning, Operations, and IT , as well ...

technical side and build this alongside myself. You should be: • Strong full-stack engineer (Py, TypeScript, Next.js, Postgres, agent frameworks, scraping/data pipelines, cloud infra, search/ranking systems). • Excited by AI systems, agents, automation, marketplaces, or commerce • Able to move quickly and ship consistently • Commercially ...

great opportunities to combine foundational statistics with modern AI to find meaning in consumer finance data. We are looking for a hands-on Data Scientist to work alongside our lead data scientist to experiment, engineer, and deliver innovative predictive models into our modern AWS production environments. … Current Areas of Focus: Affordability, income and expenditure analysis, credit risk, and fraud detection, with excellence in Entity Resolution – tying together disparate consumer data into a holistic view. Your work will directly help traditionally underserved consumers to access the most suitable financial products, whilst supporting our customers ...

secure product delivery across all our global engineering and AI teams. You will be in the central seat across all our deliveries including data, ML, LLM, agentic AI, and applications. Responsibilities Own GCP infrastructure – Operate and evolve production and non-production environments; manage cost visibility, quotas, and alerts … secure HTTPS load balancers, Cloud Run, GKE, DNS, certificates, and domain routing; own ingress, WAF, rate-limiting, and auth integration Enable product, data, and ML teams – Translate product and data requirements into secure, scalable platform designs; provision tooling and environments for ML experimentation, data ...

responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor … products and services Design solutions for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs ...

Specialist - OUTSIDE IR35 - Contract - Partner I'm looking for an experienced D365 CE and Microsoft Fabric specialist to take ownership of both the data infrastructure and the delivery of a Copilot agent within our CRM environment. This is a dual-focus role: you'll be building the foundations … Microsoft Fabric ingesting and modelling the data sources that will power AI and then delivering that capability as a Copilot agent in D365 CE as the first live use case. The infrastructure you build will be designed for reuse, giving the organisation the ability to extend AI-driven ...

Data Engineer - Snowflake Cortex London (Hybrid) - £550/day - Outside IR35 | Retail 6-month contract (extendable) working on a cutting-edge Snowflake Cortex/GenAI data platform for a major retail organisation. What you’ll be doing: Building data pipelines on AWS Developing high … performance Snowflake data models Delivering Snowflake Cortex AI/LLM use cases Working with large-scale retail data (sales, customer, inventory) You’ll need: Strong AWS Data Engineering background Hands-on Snowflake experience Exposure to Snowflake Cortex/GenAI SQL + Python **ASAP start ...

with 20+ years of experience , combining deep hands‐on engineering capability with strategic advisory skills. You will sit at the intersection of AI, data, product, and business , translating ambiguous commercial objectives into deployable, production‐grade solutions that directly support transaction strategy, value creation, and post‐merger integration. … cases Translate complex business and transaction challenges into concrete technical and architectural solutions Forward Deployment & Solution Delivery Lead forward deployment of AI, data, and analytics solutions directly within client environments Design and implement end‐to‐end solutions covering data ingestion, modeling, orchestration, and deployment Rapidly prototype ...

Clearly is a fleet management intelligence platform on a mission to bring clarity to one of the most data-rich yet analytically underserved industries in the world. Fleet operators today are drowning in fragmented data, with little ability to turn that data into actionable … ground up. About the role As a Senior Software Engineer at Clearly, you will own and shape the full technical stack - from the data pipelines that ingest telematics streams at scale, through the processing and analytics layers that power our intelligence platform, to the APIs and interfaces that ...

office) TERM- Permanent SALARY- £70,000 to £100,000 per annum (plus benefits) My client is an innovative fintech company developing intelligent, data-driven products to improve financial services and decision-making. They are looking to expand their technology team by hiring an AI Engineer to work … solutions from their London office. The AI Engineer will ideally have the following attributes: Knowledge/experience in Artificial Intelligence, Machine Learning, or Data Science A degree qualification (BSc, MSc, PhD etc.) in Computer Science, Artificial Intelligence, Mathematics, Data Science or similar Strong programming skills ...

Months The Role In this role, you will build the intelligent systems and AI powered capabilities that enable customers in fast moving, data rich industries to operate, scale, and innovate. You will develop robust, production ready AI solutions that harness automation, advanced analytics, and machine learning to power … real time decision making across complex digital transformation programmes. With access to cutting edge AI frameworks, high performance compute, and modern data platforms, you will work closely with architects and data scientists to engineer secure, scalable, and ethical AI applications. This role empowers you to bring ...

opportunities Promoting the full portfolio of converged IP solutions, including new products Negotiating pricing and stock availability with suppliers Maintaining accurate CRM project data, pipelines and forecasts Overseeing price changes and ensuring correct administration Resolving pre- and post-sales issues through cross-functional collaboration Driving project reporting ...

Lead Data Engineer | London (5 days onsite) | £110k-£130k + equity Lead Data Engineer wanted for a high-growth AI company building a platform that is transforming how operational workflows are managed within the property sector. Their product is already live with customers and handling real … take full ownership of the data foundations that the entire platform will be built on. The role 0 1 build: pipelines, data infrastructure, ML/AI workflows Work directly with founders and shape technical direction High ownership, real impact from day one What they're looking ...

scratch. The Role You will work directly with the technical co-founders to bring structure, scalability, and best practices across their ML and data setup, ensuring it is ready to support multiple enterprise deployments. Key responsibilities: * Audit current ML architecture, pipelines, and MLOps practices * Identify gaps in documentation … clear structure across model development, versioning, and deployment * Improve training and retraining workflows * Strengthen model monitoring, evaluation, and performance tracking * Support productionisation and inference pipeline improvements * Ensure systems are maintainable for future hires * Provide a clear, pragmatic path from pilot to production You will also contribute to ongoing analytical ...

Implement monitoring using CloudWatch, Grafana, Prometheus, or OpenTelemetry. Enforce integration security practices: Authentication/Authorization IAM policies Encryption at rest/in transit Data governance & lineage Ensure solutions meet RPO, RTO, resiliency, disaster recovery, and failover requirements. Establish observability using tracing, logging, alerting, and dashboards. Collaborate with product … consumer groups Kafka Streams, ksqlDB Schema Registry & Avro/JSON/Protobuf Kafka Connect connectors Deep expertise in AWS streaming & messaging: Amazon Kinesis Data Streams, Firehose EventBridge (rules, event buses, routing) SQS/SNS with dead letter queues AWS Lambda event-based integrations Experience designing event-driven ...

work on cutting‐edge AI initiatives as organisations accelerate their adoption of artificial intelligence across industries. You will collaborate with experienced engineers and data scientists, leveraging modern AI, machine learning, and Generative AI technologies to build scalable, production‐ready solutions while continuously learning and experimenting with emerging tools … approaches. Your responsibilities: Assist in designing, building, and maintaining scalable data pipelines for structured and unstructured data. Develop, train, and evaluate machine learning and deep learning models, including neural networks. Work with Large Language Models (LLMs) for tasks such as text generation, summarisation, and semantic analysis. Contribute ...

Data Engineer Location: Surrey Salary: £50k - £60k + Benefits Type: Full-time/Permanent - Hybrid Data Engineer Overview I am hiring for my financial services client in Surrey who are looking for a Data Engineer to design, build, and support data solutions … reporting systems. You'll work closely with business stakeholders to deliver high-quality data pipelines, SQL solutions, and Power B click apply for full job details ...