25 of 25 Data Pipeline Jobs in West Sussex

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £50,000 - £77,500 - depending on experience Department: Technology and Data We’re 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with … impressive! Are you ready for a thrilling new career in a fast-paced, dynamic workplace? If so, today might be your lucky day! We’re seeking a Senior Data Engineer to join our cutting-edge technology and data teams. This hands-on technical role involves building data solutions for various projects and persistent data products. You’ll design and implement complex data pipelines, manage database populations, and ensure your solutions align with technical designs and data platform standards. While this role doesn’t include direct people management, you will support, coach, and mentor data engineers and associate engineers, helping them develop their skills. Could you be More ❯

Lead Data Scientist (Equity Only) - 1% About Luupli Luupli is a social media app 'in development' that aims to provide opportunities for diverse creators from marginalized communities. The platform will highlight their work and offer access to social media opportunities. Job Description As a Lead Data Scientist at Luupli, you will leverage AWS analytics services to … analyze data and extract insights. Collaborating with cross-functional teams, you will develop data-driven solutions and shape our data strategy to support business growth. Responsibilities Work with teams to understand objectives, data needs, and analytics goals. Develop strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design data pipelines and ETL processes for diverse data sources. Apply statistical and machine learning techniques for analysis and pattern recognition. Create KPIs and dashboards to facilitate decision-making. Perform exploratory data analysis to identify trends and insights. Collaborate on data architecture, quality, and governance improvements. Requirements Bachelor’s or Master’s in Computer More ❯

Creative Assembly is looking for a Data Engineer to join the Data Platform Team in our studio based at our headquarters in Horsham, in the heart of West Sussex. This role is suitable for someone with at least two years of experience in a data engineering role. It offers the chance to grow technically … and work on cutting edge projects that improve player experiences through the use of data. Key Responsibilities The data platform team ensures consistent, timely, and accurate data delivery to consumers, while maintaining scalable and efficient pipelines. Our stack consists of: AWS Kinesis Databricks DLT PowerBI/Fabric SQL Server On a day-to-day basis, you … will: Develop and maintain new and existing data pipelines. Collaborate on the implementation and ingestion of game telemetry for new products. Work with analysts, data scientists, and other data consumers to produce useful data models and efficient pipelines. Empower high quality data governance by keeping accurate and clear documentation on More ❯

The AI Engineer is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business. With strong technical skills and business acumen to help turn millions of potential data points into actionable insights that can drive product improvements, make our customer acquisition more … efficient, improve our customer retention rates, and drive operating efficiencies across the business. The primary goals of the team are: To build and run a data platform which can create and deliver analytics to colleagues and deliver regulatory reporting Ingest and transform data from multiple systems, modelling data and engineering data marts … outliers Proficient in designing and implementing ELT pipelines using tools like dbt, with strong knowledge of data warehousing, data lake concepts, and data pipeline optimization Skilled in SQL for data manipulation, analysis, query optimisation, and database design Artificial Intelligence and Machine Learning Understanding of machine learning algorithms (classification, regression, clustering) and More ❯

The AI Engineer is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business. With strong technical skills and business acumen to help turn millions of potential data points into actionable insights that can drive product improvements, make our customer acquisition more … efficient, improve our customer retention rates, and drive operating efficiencies across the business. The primary goals of the team are: To build and run a data platform which can create and deliver analytics to colleagues and deliver regulatory reporting Ingest and transform data from multiple systems, modelling data and engineering data marts … outliers. Proficient in designing and implementing ELT pipelines using tools like dbt, with strong knowledge of data warehousing, data lake concepts, and data pipeline optimization. Skilled in SQL for data manipulation, analysis, query optimisation, and database design. Artificial Intelligence and Machine Learning Understanding of machine learning algorithms (classification, regression, clustering) and More ❯

Senior Machine Learning Operations Engineer Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £65,000 - £75,000 - depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they … our colleagues too; we won Insurance Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! We're big on data: it gives us the insights we need to give the right cover to the right customers at the right price. But it's the people inside and outside our … Deploying Infrastructure as Code (IAC) across various environments such as dev, uat and prod Handling large volumes of data in various stages of the data pipeline, from ingestion to processing Proven experience with feature stores, using them for both offline model development and online production usage Building integrations between cloud-based systems using APIs, specifically More ❯

We’re 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an excellent service. And that’s the same for our colleagues too; we won Insurance Employer of the Year at the British Insurance … design, through development and testing, to deployment, production, monitoring and continuous improvement optimising cutting-edge AI solutions across the business. One day you might be collaborating with our Data Scientists, Software Engineers and Architects on a new GenAI capability. The next, you’re fine-tuning prompts or experimenting with Computer Vision and Natural Language Processing (NLP). You … control, and continuous integration. Develop and maintain automated frameworks for testing, validation, and monitoring of AI model accuracy, performance, and reliability. Establish best practices for AI data pipeline development and integration with infrastructure to support scalable deployment. Collaborate closely with Data Scientists, Data Engineers, Software Developers, and Architects for seamless execution of AI More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: from £70,000 depending on experience Department: Technology and Data We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … design, through development and testing, to deployment, production, monitoring and continuous improvement optimising cutting-edge AI solutions across the business. One day you might be collaborating with our Data Scientists, Software Engineers and Architects on a new GenAI capability. The next, you're fine-tuning prompts or experimenting with Computer Vision and Natural Language Processing (NLP). You … control, and continuous integration. Develop and maintain automated frameworks for testing, validation, and monitoring of AI model accuracy, performance, and reliability. Establish best practices for AI data pipeline development and integration with infrastructure to support scalable deployment. Collaborate closely with Data Scientists, Data Engineers, Software Developers, and Architects for seamless execution of AI More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining – we provide the inspiration, insight and connections to power our customers’ success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company’s … and to work remotely for the rest of the week. Position Position: Full time – permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence’s data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and … food & drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you’ll More ❯

Social network you want to login/join with: Head of Data Engineering & Governance, crawley, west sussex col-narrow-left Client: Data Science Talent Location: crawley, west sussex, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: Head of Data … client began to focus solely on wealth management. But now? This company – a trusted name in the UK financial services sector – fully recognise this. They understand that embracing data and AI is what will continue to position them at the forefront of the UK’s investment management sector. This isn’t a dalliance with data. It’s a … debate about the direction, fighting for investment or dragging people with you. Now, following a recent acquisition, they’re ready to embark on the next phase – transforming the data and harnessing its power. And that’s where you come in. Where you fit in As one of three new leaders in the newly established Group Data More ❯

With a focus on applied machine learning, generative AI, and cloud-native tools, this is an opportunity to shape the future of the product and how they use data to solve real-world challenges. What You'll Be Doing: AI/ML Project Ownership Lead the delivery of machine learning initiatives from exploration through to deployment and monitoring. … Own the full development cycle for ML systems — including architecture, data pipelines, model training, and production deployment. Cross-functional Collaboration Work closely with Product, Engineering, and DevOps teams to embed intelligent features into our platform. Ensure smooth end-to-end integration of AI/ML functionality within broader product development efforts. Technical Leadership Define best practices for MLOps … of others through coaching, peer programming, and technical reviews. Share learnings and help foster a culture of innovation and experimentation. Problem Solving at Scale Tackle challenges related to data quality, interpretability, bias, and reliability. Build processes and infrastructure that make AI/ML workflows efficient, robust, and repeatable. Contribute to internal documentation and knowledge sharing resources. Refine and More ❯

Social network you want to login/join with: Data & AI Engineer, crawley, west sussex col-narrow-left Client: Bytes Software Services Location: crawley, west sussex, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Bytes is a top provider of premium … recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for an experienced Azure Data & AI Engineer with a strong focus on advanced analytics, machine learning, and applied AI - particularly Generative AI. This role will suit a technically capable professional who combines real-world … Vault), and telemetry via Application Insights or Log Analytics. KEY RESPONSIBILITIES: Have 5+ years of technical consulting or a similar chronology of demonstrable success in coding and deploying Data and AI models onto Azure environments. At least one year using Azure Fabric Create scalable and reliable data pipelines for data processing, transformation, and storage. More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

Social network you want to login/join with: Data/Business Analyst, crawley, west sussex col-narrow-left Client: Location: crawley, west sussex, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 15 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Job Title: Data/Business Analyst Location … Remote (UK-based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both remotely and on-site to lead analysis efforts and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. - Work closely with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops and discovery sessions to identify business and data More ❯

Social network you want to login/join with: Data Operations Engineer, crawley, west sussex col-narrow-left Client: North Scout Location: crawley, west sussex, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 2 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Data Operations Engineer ? Remote – UK-based … Standard Business Hours ? 18-Month Fixed-Term Contract North Scout are working in partnership with a major corporate client, we're looking to appoint a Data Operations Engineer to play a hands-on role within their established Data function. This is a great opportunity for someone with a solid foundation in Data Operations or … both technical colleagues and stakeholders across the business to support reliable, well-documented data processes. This will include; Monitoring and supporting daily data loads and pipeline activity. Writing and refining SQL queries to transform, validate and extract data. Investigating and resolving data quality issues and anomalies. Responding to internal data queries More ❯

Join to apply for the Senior/Lead Big Data Engineer (Scala/Spark) role at Grid Dynamics . Responsibilities Development of Spark jobs for data synchronization between different storage systems. Development of big data pipelines and infrastructure. Planning and deploying data schemas for data warehousing. Designing, developing, and maintaining … RESTful services and microservices. Managing real-time data streams using Kafka. Writing efficient backend code in Java/Scala. Optimizing Postgres databases and handling complex queries. Creating automated build processes using Gradle. Requirements Strong expertise in Spark and Scala. Hands-on experience with Hadoop. Proficiency with data processing frameworks like Kafka and Spark. Experience with database … engines such as Oracle, PostgreSQL, Teradata, Cassandra. Understanding of distributed computing technologies, approaches, and patterns. Nice to have Experience with Data Lakes, Data Warehousing, or analytics systems. We offer Opportunity to work on cutting-edge projects. Collaboration with a motivated and dedicated team. Flexible schedule. Opportunities for professional development. About Us Grid Dynamics (NASDAQ: GDYN) is More ❯

Social network you want to login/join with: Data & AI Solutions Deployment Architect, crawley, west sussex col-narrow-left Client: Bytes Software Services Location: crawley, west sussex, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 8 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Bytes is a top provider … foster a culture of innovation, collaboration, recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: The Data & AI Solutions Deployment Architect will be instrumental in architecting and deploying Azure Data & AI Solutions. A solid, technical, ‘hands-on’ (not just the theory) grasp of Azure … Fabric is essential as we navigate clients through all of the infrastructure, coding, and product development lifecycle challenges around successful Data and AI implementation and deployment. This customer-centric position involves delivering projects, conducting workshops and physically working on client’s environments via Python, and C#. This role would suit an experienced Data platform engineer or More ❯

A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager will come from a data engineering background and … have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role you will need the following: Experience designing, improving and maintaining robust data pipelines Strong SQL programming skills. Knowledge … of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data Engineers Strong experience working in a cloud environment and knowledge in the following very beneficial: Microsoft Azure, Azure Data Factory and Azure DevOps Experience working in fast-paced Agile environments Creativity and More ❯

dental practice, known for its innovative approach to patient care, advanced cosmetic treatments, and a commitment to excellence. As we continue to grow, we’re looking for a data-driven professional to help us make smarter business decisions through insightful analysis and strategic guidance. Role Overview We're looking for a proactive Data Scientist/Analyst … a key role in analysing performance across all areas of the business, with a strong focus on marketing campaigns, lead generation, and conversion rates. Using HubSpot and other data sources, you’ll be responsible for turning data into actionable insights that drive growth and optimise performance. Key Responsibilities Analyse data from day one to … journey. Develop dashboards and reports using HubSpot and other relevant tools. Identify trends, inefficiencies, and opportunities for optimisation. Work closely with marketing, sales, and operational teams to recommend data-driven strategies. Create and maintain data pipelines and ensure data integrity and consistency. Translate complex data into clear, actionable insights for non-technical More ❯

Social network you want to login/join with: Senior Backend Engineer – Distributed Reporting & Data Infrastructure, crawley, west sussex col-narrow-left Client: INDY Location: crawley, west sussex, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Location: Remote (Global) Core Stack … Ruby on Rails (API-only), Sidekiq, MySQL, AWS (EC2, RDS, EFS), Highcharts.js (data consumers) About INDY INDY powers every operational layer of a movie theater—from ticket sales and concessions to scheduling, accounting, and real-time business intelligence. Our platform handles tens of millions of tickets a year across cinemas worldwide, yet we remain a nimble team where … and serves the results back to cinema managers in seconds. As volume soars, we need a backend-focused engineer to: ●Own and harden this distributed reporting engine. ●Design data pipelines that can ingest years of transactional data and still answer ad-hoc questions quickly. ●You will partner with—but not be accountable for—front-end engineers More ❯

using an award-winning insurer-hosted rating platform. As a Pricing Manager, your responsibilities include: Managing pricing for motor and home products. Maintaining and enhancing behavioural models using data science techniques. Advancing data science and statistical methods adoption. Developing automated reporting structures for pricing performance monitoring. Creating innovative solutions to improve rating accuracy and efficiency. Collaborating … with pricing, underwriting, and data science teams to improve products and pricing strategies. Key Responsibilities Improve and maintain the pricing process to meet business needs. Develop behavioural models using traditional and data science techniques. Support the delivery of pricing and underwriting business plans for Motor & Home portfolios. Research and leverage new data sources; analyze … trends with innovative features. Communicate results and recommendations clearly to decision-makers. Automate reporting, data pipelines, and quality assurance processes. Manage, coach, and mentor team members, fostering development and excellence. Collaborate with peers across departments. Skills and Experience Experience managing general insurance products and/or pricing teams. Knowledge of current motor or home pricing trends and issues. More ❯

Social network you want to login/join with: Data Engineering Lead, crawley, west sussex col-narrow-left Client: Location: crawley, west sussex, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: We are seeking an experienced Principal Data Engineer … to lead a team in developing and maintaining robust, scalable data pipelines, bridging on-premises and cloud environments, and delivering real-time analytics systems. This role requires deep expertise in data engineering and streaming technologies, combined with strong leadership skills to drive the team towards achieving business objectives. You will collaborate with cross-functional teams including … architecture, product, and software engineering to ensure the delivery of high-quality data solutions aligned with company goals. Requirements: 5+ years of hands-on experience in data engineering, including expertise in Python, Scala, or Java. Deep understanding of Apache Kafka for stream processing workflows (required) Proficiency in managing and optimizing databases such as PostgreSQL, MySQL, MSSQL. More ❯

looking for a Legal AI Engineer who’s passionate about building intelligent systems at the intersection of law and machine learning. You’ll work closely with legal experts, data scientists, and product managers to develop AI features that tackle real legal challenges through the use of agentic GenAI. As Legal AI Engineer you will: Design and implement AI … data. Collaborate with legal SMEs to translate domain knowledge into scalable machine learning solutions. Continuously evaluate model performance, ensuring accuracy, fairness, and compliance. Help shape the data pipeline and MLOps practices for handling sensitive legal content securely. Required Experience: Solid experience with Python and ML/NLP libraries (e.g., spaCy, Hugging Face, TensorFlow/PyTorch). Experience More ❯

permit required: Yes col-narrow-right Job Views: 7 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Actian is transforming how enterprises discover, understand, and govern their data assets through our innovative data catalog and intelligence platform. Our customers rely on us to provide a seamless and scalable experience, and we’re looking for a … strategic thinking, and strong project management skills to ensure customers see long-term success with Actian solutions. Responsibilities: Technical Implementation & Onboarding Lead technical onboarding process for new Zeenea Data Intelligence Platform customers Develop and execute customer implementation plans ensuring smooth deployment and adoption Manage the technical setup, configuration, and deployment of Zeenea, ensuring seamless integration into customer environments … reinforce business impact Contribute to case studies showcasing innovative metadata implementations Skills and Expertise: 5+ years in technical implementation, consulting, professional services, or customer success in a SaaS, data management, or cloud-based environment Excellent ability to translate customer needs into actionable technical requirements Experience managing multiple concurrent implementation projects with enterprise customers Knowledge of APIs & software development More ❯

Social network you want to login/join with: Legal Data Analyst & Researcher, crawley, west sussex col-narrow-left Client: The Sponsor Legal Intelligence Platform Location: crawley, west sussex, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Legal Data … Sponsor The Sponsor is a legal intelligence platform designed to provide law firms, professionals, and business leaders with a comprehensive view of the legal industry. Through curated deal data, AI-generated firm rankings, and editorially enriched insights, we help users stay ahead of the legal market. Currently in pre-launch, The Sponsor is backed by industry relevant investors … and is in the early stages of product deployment. Our mission is to modernise legal intelligence with data transparency, intuitive design, and actionable insights. As we prepare to go to market, we’re looking for a part-time Legal Data Analyst & Researcher to support the accuracy and growth of our database, contribute to our proprietary rankings More ❯