1 to 25 of 26 Data Pipeline Jobs in East Sussex

Social network you want to login/join with: The Opportunity Join a forward-thinking Financial Services leader driving a groundbreaking Data Modernisation programme. We’re seeking talented Analytics Data Engineers to shape the future of data-driven decision-making in a fast-paced, innovative environment. This permanent role offers a competitive salary, flexible … working, and the chance to work with cutting-edge cloud technologies to deliver impactful data solutions. As an Analytics Data Engineer, you’ll design and build robust, scalable data pipelines and analytics platforms that empower business teams to unlock insights through self-service tools. You’ll work with modern cloud-native tools like Snowflake … Databricks, Python, and advanced visualisation platforms to create solutions that drive measurable business outcomes. Key Responsibilities Develop Scalable Data Pipelines : Design and implement ETL/ELT workflows using Python, SQL, and cloud-native tools to support analytics and reporting needs. Enable Business Insights : Build intuitive, optimised data models for platforms like Power BI, Tableau, or Looker More ❯

with curiosity, openness and a collaborative spirit driven by the passion of enhancing everyday experiences. How will you make an impact in this role? We are seeking a Data Engineer to help drive the design and development of a robust data infrastructure, through building databases and pipelines that will support our planning processes, Machine Learning use … cases and leadership reporting. As a Data Engineer, you will be part of a team responsible for the development and execution of world-class advanced analytics projects, leveraging automation and machine learning to enhance and streamline business processes. You will build scalable solutions that benefit our internal customers – from technical design, prototyping, testing, deploying and monitoring production data. … The ideal candidate will have the skills to collaborate in a cross-functional environment – planning, operations, finance, forecasting, data science – to test new ideas and challenge conventions. Responsibilities: Support GCCM colleagues migrating production-grade data and pipelines to the Google Cloud Platform Help define and apply data governance requirements for accurate and consistent storing More ❯

Lead Data Scientist (Equity Only) - Brighton Location: Brighton, United Kingdom Job Category: Other EU work permit required: Yes Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 Job Description Lead Data Scientist - Equity-Only role (1%) About Luupli Luupli is a social media app 'in development' that aims to provide opportunities for diverse creators from marginalized communities. … The platform will highlight their work and open access to social media opportunities. Responsibilities Collaborate with teams to understand business goals, data needs, and analytics objectives. Develop data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design and build data pipelines and ETL processes for diverse data sources … and machine learning techniques for predictive, prescriptive analyses, clustering, segmentation, and pattern recognition. Identify key metrics, develop KPIs, and create dashboards and visualizations with Amazon QuickSight. Perform exploratory data analysis to uncover trends and insights for product and engagement improvements. Work with data engineers to optimize data architecture, quality, and governance in AWS. Requirements More ❯

We are a global media group delivering exceptional content through events, digital, data & insight. From agribusiness, ingredients and food processing, to retail, hospitality & fine dining – we provide the inspiration, insight and connections to power our customers’ success. We have offices in Gatwick, Brighton and London, UK; Montpellier, France; Singapore and Chicago, US. In line with the Company’s … and to work remotely for the rest of the week. Position Position: Full time – permanent Location: London/Brighton/Crawley/Hybrid We are looking for a Data Scientist to lead Lumina Intelligence’s data team, providing an opportunity to shape and grow our data strategy. Lumina Intelligence is a highly ambitious and … food & drink consultancy providing insights for global markets and enabling its clients to understand their consumers, competitors, and markets in the way that facilitates growth. It provides subscription data products, maintaining the highest quality of data and continuously enhancing the way customers access and apply its insights. As the Data Science Lead, you’ll More ❯

Social network you want to login/join with: Head of Data Engineering & Governance, brighton col-narrow-left Client: Data Science Talent Location: brighton, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Head of Data Engineering & Governance … client began to focus solely on wealth management. But now? This company – a trusted name in the UK financial services sector – fully recognise this. They understand that embracing data and AI is what will continue to position them at the forefront of the UK’s investment management sector. This isn’t a dalliance with data. It’s a … debate about the direction, fighting for investment or dragging people with you. Now, following a recent acquisition, they’re ready to embark on the next phase – transforming the data and harnessing its power. And that’s where you come in. Where you fit in As one of three new leaders in the newly established Group Data More ❯

With a focus on applied machine learning, generative AI, and cloud-native tools, this is an opportunity to shape the future of the product and how they use data to solve real-world challenges. What You'll Be Doing: AI/ML Project Ownership Lead the delivery of machine learning initiatives from exploration through to deployment and monitoring. … Own the full development cycle for ML systems — including architecture, data pipelines, model training, and production deployment. Cross-functional Collaboration Work closely with Product, Engineering, and DevOps teams to embed intelligent features into our platform. Ensure smooth end-to-end integration of AI/ML functionality within broader product development efforts. Technical Leadership Define best practices for MLOps … of others through coaching, peer programming, and technical reviews. Share learnings and help foster a culture of innovation and experimentation. Problem Solving at Scale Tackle challenges related to data quality, interpretability, bias, and reliability. Build processes and infrastructure that make AI/ML workflows efficient, robust, and repeatable. Contribute to internal documentation and knowledge sharing resources. Refine and More ❯

recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for an experienced Azure Data & AI Engineer with a strong focus on advanced analytics, machine learning, and applied AI - particularly Generative AI. This role will suit a technically capable professional who combines real-world … Vault), and telemetry via Application Insights or Log Analytics. KEY RESPONSIBILITIES: Have 5+ years of technical consulting or a similar chronology of demonstrable success in coding and deploying Data and AI models onto Azure environments. At least one year using Azure Fabric Create scalable and reliable data pipelines for data processing, transformation, and storage. … Establish and enforce data governance policies and be ‘hands-on’ in exploratory data analysis to identify and measure quality gaps that are a block to Data and Ai implementation. Implement robust security measures to protect sensitive data within Azure environments. Integrate AI and machine learning models into data pipelines and More ❯

digital insurance provider with ambitious plans to become The Best and Biggest in the UK market. Over the past few years, we've made significant investments in our data and tech capabilities, particularly within our CIO function. Our CIO team is at the forefront of driving innovation and ensuring our technology infrastructure supports our ambitious goals. We've … contribute to our success. We're looking for an inquisitive and technically strong Senior Business Analyst to join our Business Analysis community, with a particular focus on Guidewire data integration and delivery. This role is ideal for someone who thrives understanding how things work under the hood and then explaining it in a way that others get. You … will champion a data driven culture by asking the right questions and challenging assumptions, becoming the go-to expert on the Guidewire data model for the data engineering teams. What you'll be doing: - Completing the end-to-end analysis and documentation of business requirements, with a strong emphasis on Guidewire data More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

Role: Snowflake Data Architect Location: Hove, UK Type: Permanent Role Work Mode: Hybrid Role & Responsibilities Define and implement the end-to-end architecture of Data warehouse on Snowflake. Create and maintain conceptual, logical, and physical data models in Snowflake. Design data pipelines and ingestion frameworks using Snowflake native tools. Collaborate with Data Governance teams to establish data lineage, data quality, and access control mechanisms. Engage with data stewards and stakeholders to build a comprehensive and scalable data warehouse. Implement RBAC, data masking, and encryption practices to ensure compliance with data security policies. Qualifications & Skills 10+ years of experience … in designing enterprise data platforms, with at least 5+ years in Snowflake. Strong expertise in SQL and data warehousing. Hands-on experience working in the insurance industry; prior experience with L&G is an advantage. 3+ years of experience with DBT for data transformation. Deep understanding of agile methodologies in data environments. More ❯

Social network you want to login/join with: Location: Remote (UK-based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both remotely and on-site to lead analysis efforts … and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. - Work closely with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops … and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive client value. Key Experience & Skills: - 5+ years in a business/data analyst role, ideally in a consultancy or commercial setting. - Strong analytical, problem More ❯

exciting new growth stage. We’re on a mission to create a virtual sales agent that performs better than a human sales agent. We’re looking for a Data Engineering Manager to lead a small team in building a key part of our data infrastructure - evolving and scaling the ingestion of customer product catalogues into our … internal systems. This role blends people management, individual contribution, and technology leadership. People Management: You will lead and mentor a small team of Data Engineers, fostering a high-performance culture by guiding their professional growth and ensuring effective communication within the team and with stakeholders. Your strong interpersonal skills will enable you to bring out the best in … Looker stack and typically use Python and Docker in our pipelines. You’ll need to be highly proficient in these or similar tools and comfortable navigating a modern data ecosystem. The person we’re looking for Passionate about designing and delivering solutions to complex problems Curious with a desire for continuous learning Friendly, with a collaborative and pragmatic More ❯

Social network you want to login/join with: North Scout are working in partnership with a major corporate client, we're looking to appoint a Data Operations Engineer to play a hands-on role within their established Data function. This is a great opportunity for someone with a solid foundation in Data Operations … keen to build on their experience in a collaborative, delivery-focused setting. The role As part of a Consultancy team, you’ll be embedded within the client’s data function, helping to ensure the smooth running of daily data operations. You’ll work closely with … both technical colleagues and stakeholders across the business to support reliable, well-documented data processes. This will include; Monitoring and supporting daily data loads and pipeline activity. Writing and refining SQL queries to transform, validate and extract data. Investigating and resolving data quality issues and anomalies. Responding to internal data queries More ❯

Social network you want to login/join with: Data & AI Solutions Deployment Architect, brighton col-narrow-left Client: Bytes Software Services Location: brighton, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 8 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Bytes is a top provider of premium IT solutions … foster a culture of innovation, collaboration, recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: The Data & AI Solutions Deployment Architect will be instrumental in architecting and deploying Azure Data & AI Solutions. A solid, technical, ‘hands-on’ (not just the theory) grasp of Azure … Fabric is essential as we navigate clients through all of the infrastructure, coding, and product development lifecycle challenges around successful Data and AI implementation and deployment. This customer-centric position involves delivering projects, conducting workshops and physically working on client’s environments via Python, and C#. This role would suit an experienced Data platform engineer or More ❯

A leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £85,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager will come from a data engineering background and … have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role you will need the following: Experience designing, improving and maintaining robust data pipelines Strong SQL programming skills. Knowledge … of other programming languages such as Python, C++ and Java beneficial Possesses a strong understanding of Snowflake - beneficial Experience managing small teams of Data Engineers Strong experience working in a cloud environment and knowledge in the following very beneficial: Microsoft Azure, Azure Data Factory and Azure DevOps Experience working in fast-paced Agile environments Creativity and More ❯

Views: 3 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Location: Remote (Global) Core Stack: Ruby on Rails (API-only), Sidekiq, MySQL, AWS (EC2, RDS, EFS), Highcharts.js (data consumers) About INDY INDY powers every operational layer of a movie theater—from ticket sales and concessions to scheduling, accounting, and real-time business intelligence. Our platform handles tens … and serves the results back to cinema managers in seconds. As volume soars, we need a backend-focused engineer to: ●Own and harden this distributed reporting engine. ●Design data pipelines that can ingest years of transactional data and still answer ad-hoc questions quickly. ●You will partner with—but not be accountable for—front-end engineers … partition, and optimize multi-terabyte MySQL schemas. ○Tune Sidekiq queues, worker pools, and EC2 autoscaling groups for bursty loads. ○Refactor long-running jobs into idempotent, parallelizable units. ● Maintain Data Integrity & Observability ○Implement validation, audit trails, and automated backfills. ○Instrument metrics/alerting around throughput, latency, and cost. ● Expand Administrative Workflows ○Expose clean GraphQL/REST contracts that power More ❯

Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Lead Backend Engineers (Platform Experience & Data Warehousing teams) Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland numi is proud to partner with a leading data integration technology company providing excellent experiences for their … clients, including some of the biggest names in the industry. We are seeking experienced Lead Backend Engineers (PHP) to join either the Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimizing end-to-end platform journeys and building impactful customer experiences. They are currently developing a data visualization tool (dashboards) and building … features primarily from scratch. The Data Warehousing team handles data storage and transfer solutions, helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring, and enhancing complex data transfer systems handling large data volumes. As a Lead Backend Engineer, you More ❯

develop the product and development teams' approach to testing - e.g. a framework for test driven development Design and develop automated test scripts with a focus on SQL-based data validation, ensuring the accuracy of data flows and transformation. Integrate automated tests into CI/CD pipelines. Be the person on-point and overall responsible for the … collaborating in any of the following: RESTful services, Message Queues, Relational Databases. Experience of SQL scripting and proven capability of writing sophisticated queries to analyse problems, and interrogate data pipelines Experience a range of testing methodologies and techniques including agile, with the ability to write test procedures, plans and report development/implementation Seniority level Seniority level Mid More ❯

Social network you want to login/join with: We are seeking an experienced Principal Data Engineer to lead a team in developing and maintaining robust, scalable data pipelines, bridging on-premises and cloud environments, and delivering real-time analytics systems. This role requires deep expertise in data engineering and streaming technologies, combined with … to drive the team towards achieving business objectives. You will collaborate with cross-functional teams including architecture, product, and software engineering to ensure the delivery of high-quality data solutions aligned with company goals. Requirements: 5+ years of hands-on experience in data engineering, including expertise in Python, Scala, or Java. Deep understanding of Apache Kafka … as PostgreSQL, MySQL, MSSQL. Familiarity with analytical databases. Familiarity with both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team More ❯

Social network you want to login/join with: Are you a talented Product Owner with a good understanding of data engineering concepts? Are you interested in progressing to the role of Product Manager over time? Are you excited by Sports/Sports data and taking ownership of a brand-new team? If so, this could … be the perfect next role for you! This global leader in real-time sports data delivery is used by some of the worlds largest betting operators. Having recently hired a new Chief Product Officer, the Product team is only a few months old and this role will join a newly formed data engineering/analytics team. … What are they looking for: 2-3 years as a Product Owner/Product Manager Good understanding of data engineering concepts and data pipelines Familiarity with data analytics practices, modern BI tools, and reporting workflows Experience working in agile environments with cross functional teams Previous experience as an Analyst or in a data More ❯

develop the product and development teams' approach to testing - e.g. a framework for test driven development Design and develop automated test scripts with a focus on SQL-based data validation, ensuring the accuracy of data flows and transformation. Integrate automated tests into CI/CD pipelines. Be the person on-point and overall responsible for the … collaborating in any of the following: RESTful services, Message Queues, Relational Databases. Experience of SQL scripting and proven capability of writing sophisticated queries to analyse problems, and interrogate data pipelines Experience a range of testing methodologies and techniques including agile, with the ability to write test procedures, plans and report development/implementation. More ❯

develop the product and development teams' approach to testing - e.g. a framework for test driven development Design and develop automated test scripts with a focus on SQL-based data validation, ensuring the accuracy of data flows and transformation. Integrate automated tests into CI/CD pipelines. Be the person on-point and overall responsible for the … collaborating in any of the following: RESTful services, Message Queues, Relational Databases. Experience of SQL scripting and proven capability of writing sophisticated queries to analyse problems, and interrogate data pipelines Experience a range of testing methodologies and techniques including agile, with the ability to write test procedures, plans and report development/implementation. More ❯

develop the product and development teams' approach to testing - e.g. a framework for test driven development Design and develop automated test scripts with a focus on SQL-based data validation, ensuring the accuracy of data flows and transformation. Integrate automated tests into CI/CD pipelines. Be the person on-point and overall responsible for the … collaborating in any of the following: RESTful services, Message Queues, Relational Databases. Experience of SQL scripting and proven capability of writing sophisticated queries to analyse problems, and interrogate data pipelines Experience a range of testing methodologies and techniques including agile, with the ability to write test procedures, plans and report development/implementation. More ❯

looking for a Legal AI Engineer who’s passionate about building intelligent systems at the intersection of law and machine learning. You’ll work closely with legal experts, data scientists, and product managers to develop AI features that tackle real legal challenges through the use of agentic GenAI. As Legal AI Engineer you will: Design and implement AI … data. Collaborate with legal SMEs to translate domain knowledge into scalable machine learning solutions. Continuously evaluate model performance, ensuring accuracy, fairness, and compliance. Help shape the data pipeline and MLOps practices for handling sensitive legal content securely. Required Experience: Solid experience with Python and ML/NLP libraries (e.g., spaCy, Hugging Face, TensorFlow/PyTorch). Experience More ❯

permit required: Yes col-narrow-right Job Views: 8 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Actian is transforming how enterprises discover, understand, and govern their data assets through our innovative data catalog and intelligence platform. Our customers rely on us to provide a seamless and scalable experience, and we’re looking for a … project management skills to ensure customers see long-term success with Actian solutions. Online job hunting tools Responsibilities: Technical Implementation & Onboarding Lead technical onboarding process for new Zeenea Data Intelligence Platform customers Develop and execute customer implementation plans ensuring smooth deployment and adoption Manage the technical setup, configuration, and deployment of Zeenea, ensuring seamless integration into customer environments … reinforce business impact Contribute to case studies showcasing innovative metadata implementations Skills and Expertise: 5+ years in technical implementation, consulting, professional services, or customer success in a SaaS, data management, or cloud-based environment Excellent ability to translate customer needs into actionable technical requirements Experience managing multiple concurrent implementation projects with enterprise customers Knowledge of APIs & software development More ❯