1 to 25 of 26 Data Pipeline Jobs in Ipswich

Principal Data Engineer Location: Flexible UK Salary: £95,000 plus bonus of up to 17 per cent and a yearly equity gift worth 10 per cent of base I am working with a scaling technology organisation operating across multiple brands within the property and legal technology space. … business continues to grow and mature its data capability, they are now looking to hire a Principal Data Engineer to define and lead the technical direction of their data platform. This is a senior, highly influential role sitting above multiple engineering teams. While there ...

Databricks (including Delta Live Tables). Develop robust ETL/ELT workflows ingesting data from operational, telemetry, and third-party systems. Optimise pipeline performance, reliability, and cost efficiency in cloud environments. Ensure data quality, lineage, governance, and documentation across production systems. Collaborate cross-functionally with … analytics, product, and platform teams. Support CI/CD automation for data pipeline deployment. Contribute to reusable frameworks and engineering best practices within the team. Essential experience Candidates must have prior, hands-on experience working with at least one of the following APM platforms: Power Factors Bazefield ...

This role is fully remote in UK, with full work authorization already in effect. No Visa sponsorship is available. Job Description In a data-driven and AI-oriented environment, you will be responsible for the design, industrialization, and optimization of inter-application data pipelines. You will … Languages: Advanced SQL and Python for data manipulation, automation, and ML integration. Data Engineering: Proven experience in ETL/ELT pipeline design. AI/ML Integration: Ability to prepare data for model training and deploy AI models into production workflows (batch or real ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

title: AWS Data Engineer Location: Ipswich (Onsite- 5 days) Type of Employment- Permanent Job Overview: We are seeking an experienced AWS Data Engineer with strong expertise in ETL pipelines, Redshift, Iceberg, Athena, and S3 to support large-scale data processing and analytics initiatives … quality checks and validation across pipelines. 8. DevOps & CI/CD (Preferred) Use Git, CodePipeline, Terraform/CloudFormation for infrastructure and deployments. Automate pipeline deployment and monitoring. Required Skills 3 10 years experience in data engineering. Strong hands-on experience with: AWS S3, Athena, Glue, Redshift ...

Senior Data Engineer | Remote (UK or Europe) A leading prop trading firm is hiring a Senior Data Engineer to take ownership of their trading and market data infrastructure. Operating globally with connectivity to dozens of exchanges, the firm executes millions of trades daily with … checks Create tools and APIs for data access Collaborate with traders and developers on data needs Ensure 24/7 pipeline reliability What We're Looking For Strong Python and SQL Experience with trading/market data in production Proven work on real ...

Full Stack Engineer (Web & Data) Industry: Technology/Digital Products/Automation & Analytics Location: London, UK (Hybrid 1-2 days) Are you passionate about developing seamless, data-driven digital experiences? An established digital transformation and technology solutions provider is looking for a Full Stack Engineer … Data) to join its growing Automation & Analytics team in London. This hybrid role blends web development with data engineering, offering exposure to everything from dynamic front‐end interfaces and API development to cloud‐based data pipelines and analytics platforms. If you love combining creativity ...

continually refine the AI initiatives portfolio and roadmap for the group. Run a structured intake process for new ideas, assessing value, feasibility, data readiness, ethical risk, and compliance. Define clear success measures for every proof of concept (PoC) and MVP, including KPIs, leading indicators, and decision gates … weeks) using Agile methods (Scrum or Kanban) with regular demos and retrospectives. Build and lead cross-functional squads including Product Owner, Data Scientists, ML Engineers, Integration Engineers, Solution Architect, and domain experts from Admissions, Registry and Student Services. Design experiments, test hypotheses, and iterate quickly, ensuring human ...

market, and have deployed them in the UK, US, Canada, Australia, France and elsewhere. As we expand, we are building a dedicated data science function to refine and optimise our existing models, and to create new ones that help us to maintain our position as a leader … field of public opinion. We're looking for someone who's comfortable working with unstructured data, and can turn it into clear outputs that deliver actionable insight for clients. You'll be curious about public opinion and how a richer understanding of it can be of value ...

Data & Defence Engineering Roles Engineer to Managing Consultant | Defence, National Security & Critical Infrastructure London, Newcastle, Manchester, Glasgow We are supporting a leading UK technology and transformation consultancy delivering secure AI, data engineering, and advanced analytics solutions across Defence, National Security, and critical government programmes. The focus … technically hands-on, with scope for leadership depending on experience. The Role You will work as part of multidisciplinary engineering teams delivering AI, data platforms, and analytics solutions in secure environments. Depending on level, you will either contribute directly to engineering delivery or lead technical workstreams. Key responsibilities ...

assist tools Own end-to-end delivery of AI features: architecture, development, deployment, monitoring, and iteration Drive technical excellence across APIs, microservices, and data pipelines Oversee code quality, testing standards, release cycles, and CI/CD pipelines Work closely with product, infrastructure, and operations teams to ensure reliability ...

roadmap, combining leadership of architecture and engineering practice with hands-on development of prototypes and production features. You'll partner with Product, Data, and Platform Engineering to design and integrate AI-driven capabilities such as voice/chatbots, natural-language analytics, and predictive models. This role balances strategic … feasibility studies for emerging AI technologies. Collaborate with Product Management to scope AI features and align them with business goals. Partner with Data Engineering to operationalize models, manage training data, and implement monitoring and retraining pipelines. Work closely with Development, DevOps, and QA teams to ensure ...

pivot quickly when requirements change • Excellent problem-solving skills and attention to detail • A passion for live music Nice to Have: • Experience with data pipelines and ETL processes • Previous startup or early-stage company experience • Understanding of the live music industry • Experience as a sole or founding developer ...

model capabilities and protocols. Leadership & Collaboration - Collaborate on UI/UX integration, code reviews, architecture and roadmap decisions, and cross-functional work with data science, product, and commercial teams. Data Engineering - Design and maintain efficient data pipelines, ensuring smooth data flow between ...

Data Scientist | Fully Remote | Health and Wellbeing We're hiring an Data Scientist to help build and ship ML and LLM features in a regulated environment with sensitive data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn … Python for data science and ML Practical experience with LLM frameworks (e.g. LangChain) Familiar with Spark/Kafka and End-to-end pipeline experience Databricks, MLflow, Docker, Kubernetes Clear communication with technical and non-technical stakeholders If you are interested apply below or email me directly mmatysik ...

robust engineering, governance, and scalability. Responsibilities Design, build, and deploy machine learning models into production within a Financial Services environment Collaborate closely with Data Scientists, Software Engineers, Risk, and Product teams Build and maintain end-to-end ML pipelines (training, validation, inference, monitoring) Ensure models meet requirements around … skills and hands-on experience with ML libraries (TensorFlow, PyTorch, scikit-learn) Experience deploying and supporting ML models in production Solid understanding of data pipelines, versioning, testing, and software engineering best practices Experience working with cloud platforms (AWS, GCP, or Azure) Nice to Have Experience with fraud, risk ...

leverage artificial intelligence to drive smarter decisions. Their mission: to make enterprise AI accessible, actionable, and transformative, helping companies unlock insights from complex data in real-time. They're looking for a Founding AI Engineer to join the team, helping shape the product, technology, and AI strategy from … leadership team. What You'll Do: Design, build, and deploy AI/ML models powering the core platform. Create scalable AI infrastructure, data pipelines, and deployment workflows. Collaborate with product and engineering to turn business problems into AI solutions. Experiment with the latest AI techniques to innovate ...

assess, and respond to third-party and supply-chain risks through advanced AI-driven analytics and intelligence. Their mission is to deliver continuous, data-backed visibility into the extended enterprise — enabling organizations to identify vulnerabilities, map their digital ecosystems, and make informed decisions about vendor and partner risk. … Product to lead a world-class technical team, shape the architectural vision, and drive execution across multiple product streams — including large-scale data pipelines and real-time risk intelligence systems. Role Overview: As Head of Product you will be responsible for owning the product roadmap and execution ...

could get involved with: Developing and maintaining software and infrastructure for web applications. Integrating AI/ML components with frontend, backend, data, and compute infrastructure. Ensuring high-quality software delivery through automated testing, documentation, and adherence to best practices. Monitoring and improving key performance metrics for tools … services. Participating in code reviews, and contributing to continuous improvement of team standards and practices. Collaborating with data engineers and technical staff across teams to build end-to-end data pipelines. Supporting deployment workflows and contributing to the evolution of cloud architecture and infrastructure. Why Join ...

proof, and expand their revenue opportunities. Their product empowers lawyers and finance teams to maximise value from engagements through: Pricing agents that create data-driven, lawyer-friendly quotes. Management tools that predict overruns and help avoid costly late bills. Enrichment engines that clean and structure messy legal datasets … join. The Role: AI/ML Engineer – Agentic Systems You will design and deliver intelligent agentic workflows, leveraging frontier LLMs. Working with their data scientists and backend engineers, you'll be responsible for making unstructured legal data usable, scalable, and impactful. This is not a prototyping ...

growth, scaling the platform, and building a high-performing engineering team. About the Role You will take full ownership of the platform architecture, data pipelines, integrations, and multi-tenant SaaS infrastructure. This is a highly visible, strategic role where you will work closely with the founder and early … customers, ensuring the platform is scalable, secure, reliable, and enterprise-ready. Key Responsibilities Own the full platform architecture, including ingestion, scoring, data stores, APIs, and dashboards. Lead AI/ML-powered enrichment and scoring systems. Build and scale microservices, event-driven pipelines, and automated intelligence workflows. Harden cloud ...

Designing, developing, and maintaining Python-based trading and research infrastructure Building bespoke analytics and visualization tools in close collaboration with investment teams Optimizing data pipelines, automating complex workflows, and improving operational efficiency What You'll Bring Proven experience in Python development, ideally within high-performance or data ...

What You Might Be Doing As an Full-stack Engineer at GSK, you could get involved with: Developing front-end applications and interactive data visualizations. Integrating AI/ML components with backend systems and data pipelines. Building and maintaining cloud-based infrastructure for large-scale applications. … disease with vaccines, specialty and general medicines. We focus on the science of the immune system and the use of new platform and data technologies, investing in four core therapeutic areas (infectious diseases, HIV, respiratory/immunology and oncology). Our success absolutely depends on our people. While ...

based team, with opportunities to work from Newcastle, Aberdeen, Glasgow or London This role is ideal for someone who enjoys turning complex spatial data into smart, scalable web applications. The Geospatial Developer will design, build and maintain geospatial tools that support offshore wind and energy projects, working closely … with engineers, geoscientists and developers across disciplines. The role spans full-stack development, geospatial analysis and data engineering, from slick front ends to robust back ends, with plenty of opportunity to get involved in R&D, proposals and technical innovation What they'll be doing: Developing geospatial ...

journey, designing and delivering innovative solutions built on Azure's cutting-edge capabilities. You turn complex ideas into practical, scalable applications, bridging data, cloud services, and intelligent models. With your technical insight and clear communication, you empower customers to confidently adopt AI and drive meaningful impact across their … tool/agent orchestration, and fine-tuning where appropriate. Implementing MCP-based integrations between AI services and existing application components (web apps, APIs, data platforms) for seamless collaboration. Design and optimize data pipelines that prepare structured and unstructured data for model training ...