1 to 25 of 65 Data Pipeline Jobs in Essex

days office, 2 days home) Salary: Competitive + Benefits + Bonus If you are an agile, committed, and innovative analytics engineer skilled in defining and shaping long-term data management strategy, then we want to hear from you! Join us to help improve peoples' lives and make healthcare better for everyone! Why Pharmanovia? Pharmanovia is a dynamic, fast … Neurology. About the role: We are seeking a highly skilled and motivated Senior Analytics Engineer to join our team to help define and build Pharmanovia's long-term data management strategy. Pharmanovia is aiming to build a highly autonomous self-service data and analytics platform, which can extract and align data from many best … e.g., Docker, Kubernetes) and familiarity with container orchestration on AWS (Amazon EKS) Strong understanding of DevOps principles and experience with CI/CD pipelines using tools like AWS Code Pipeline, Jenkins, or GitLab CI/CD Excellent problem-solving skills and ability to troubleshoot complex issues in distributed systems Effective communication skills with the ability to collaborate effectively with More ❯

services, we are looking to hire a mid-level Data Engineer (2+ years' experience) who has worked with Azure and Databricks , and can contribute immediately across pipeline development, categorisation, and optimisation for AI/ML use cases. You'll work with diverse datasets spanning prepaid, financial services, gambling, and payments, supporting business-critical decisions with high … key role in evolving epay's data architecture and ML-enablement strategies. In the first few months, you would have: Taken ownership of a data pipeline or transformation flow within Databricks and contributed to its optimisation and reliability. Worked across raw and curated datasets to deliver categorised and enriched data ready for analytics … they are part of a team and be willing to occupy various roles to allow the team to adjust work more effectively. Responsibilities of the role: Data Pipeline Development: Build and maintain batch and streaming pipelines using Azure Data Factory and Azure Databricks. Data Categorisation & Enrichment: Structure unprocessed datasets through tagging, standardisation, and More ❯

Lead Data Scientist (Equity Only) - 1% Job Description As a Lead Data Scientist at Luupli, you will leverage AWS analytics services to analyze data and extract insights. Collaborate with cross-functional teams to develop data-driven solutions, shape data strategy, and drive business growth. Responsibilities Understand business objectives, identify data requirements, and define analytics goals. Develop data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design and build data pipelines and ETL processes from diverse sources. Apply statistical and machine learning techniques for predictive and segmentation analyses. Identify key metrics, develop KPIs, and create dashboards with Amazon QuickSight. Perform exploratory … data analysis to uncover trends and insights. Work with data engineers to optimise data architecture, quality, and governance. Requirements Bachelor's or master's degree in Computer Science, Statistics, Mathematics, or related field. Experience as a Data Scientist, preferably with AWS analytics services. Proficiency in AWS services like Redshift, Athena, EMR, and More ❯

Lead Data Scientist (Equity Only) - 1% Job Details Location: Basildon, United Kingdom Job Category: Other EU work permit required: Yes Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 Job Description: Lead Data Scientist - Equity-Only role About Luupli: Luupli is a social media app 'in development' that aims to provide opportunities for diverse creators from marginalized … communities. It will highlight their work and facilitate access to social media opportunities. Responsibilities: Collaborate with teams to understand objectives and define analytics goals. Develop data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design data pipelines and ETL processes for data extraction and transformation. Apply statistical and machine learning … techniques for analysis and pattern recognition. Develop KPIs and dashboards using Amazon QuickSight for decision-making. Perform exploratory data analysis to uncover trends and insights. Work with data engineers to optimize data architecture and governance in AWS. Requirements: Bachelor's or master's in CS, Statistics, Mathematics, or related field. Experience as a Data More ❯

Lead Data Scientist (Equity Only) - Colchester Location: Colchester, United Kingdom Job Category: Other EU work permit required: Yes Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 Job Description: Lead Data Scientist - Equity-Only Role (1%) About Luupli Luupli is a social media app 'in development', aimed at providing opportunities for diverse creators from marginalized communities. The … platform will highlight their work and offer access to social media opportunities. Responsibilities: Collaborate with cross-functional teams to define analytics goals and data requirements. Develop data analysis strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design and build data pipelines and ETL processes for data extraction, transformation, and … loading into AWS. Apply statistical and machine learning techniques for predictive and pattern analysis. Create dashboards and KPIs using Amazon QuickSight to support decision-making. Perform exploratory data analysis to identify trends and insights for product and engagement improvements. Work with data engineers to optimize data architecture, quality, and governance in AWS. Requirements: Bachelor More ❯

technologies to improve safety and the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models, perform data cleansing, transformation, and validation. Maintain accurate documentation of data … resources and troubleshooting data-related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist More ❯

technologies to improve safety and the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models, perform data cleansing, transformation, and validation. Maintain accurate documentation of data … resources and troubleshooting data-related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist More ❯

technologies to improve safety and the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models, perform data cleansing, transformation, and validation. Maintain accurate documentation of data … resources and troubleshooting data-related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … to define test strategies, implement automated tests, and validate data quality and integrity. Contribute to technical planning, including estimation, risk assessment, and defining delivery approaches for client engagements and new opportunities. Engage with clients and stakeholders, translating data requirements into technical solutions and communicating complex ideas clearly and effectively. Champion engineering standards, contributing to the development More ❯

Join to apply for the Senior Data Engineer role at Natobotics Join to apply for the Senior Data Engineer role at Natobotics Get AI-powered advice on this job and more exclusive features. Required Core Skills Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description Must have hands-on … experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands … on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must have hands on experience in SQL development Excellent Communication skills & Logical thinking Seniority level Seniority level Mid-Senior level Employment type Employment type Part-time Job function Job More ❯

be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Burman Recruitment Are you a data professional with strong SQL skills and a passion for building scalable data systems? Do you want your work to directly impact learners, educators, and decision-makers? A … leading education provider is seeking a Data Engineer to join their Management Information Services (MIS) team. This is a key role in shaping the way data is collected, stored, and used across the organisation to support strategic decisions, ensure compliance, and drive digital transformation. What You’ll Be Doing Designing and managing SQL-based data infrastructure and ETL processes Developing and maintaining data models, stored procedures, and integrated data pipelines Building insightful dashboards and visualisations using Power BI or SSRS Supporting internal and external reporting needs, including funding body submissions Contributing to data governance, quality assurance, and compliance with UK GDPR Collaborating with IT and digital teams More ❯

Job summary Join our Development Team as an Information Systems Developer, where you'll design and maintain data processes that transform, clean, and present information in user-friendly formats. You'll build integrations feeding data into live systems and analytical workflows, working hands-on with SQL databases, backend applications, REST APIs, and modern web interfaces. Leveraging … with cloud platforms--particularly Azure and AWS--is essential, as is an ability to troubleshoot complex issues and write clean, maintainable code. If you're passionate about turning data into actionable insights and thrive in a collaborative, fast-paced environment, we'd love to hear from you. Main duties of the job Design and Maintain Data Workflows: Build, document, and manage ETL processes to transform, clean, and validate data for live systems, analytics, and reporting. Lead and Coordinate Projects: Own major technical initiatives end to end--scoping work, collaborating with teams and partners. Ensure Code Quality: Uphold best practices in version control, documentation, and peer review to maintain high standards. Troubleshoot and More ❯

top trusted providers in Singapore and service a client base across banking and financial services, insurance, information technology, healthcare, retail and supply chain. We are currently looking for Data Architect who has proven track record in IT Industry. This is an exciting opportunity to expand your skill set, achieve job satisfaction and work-life balance. More details as … below. Role: Snowflake Architect Location: Basildon, UK/Dublin, Ireland Work from Client office 5 days weekly Responsibilities: -Design, develop, and maintain robust data pipelines and ETL processes using Snowflake on AWS. -Implement data warehousing solutions, ensuring efficient storage, retrieval, and transformation of large datasets. -Collaborate with data analysts, scientists, and other stakeholders to … availability and reliability. -Develop and maintain data integration solutions, ensuring seamless data flow between various sources and Snowflake. -Monitor, troubleshoot, and resolve data pipeline issues, ensuring data quality and integrity. -Stay up-to-date with the latest trends and best practices in data engineering and cloud technologies. Cloud Services More ❯

top trusted providers in Singapore and service a client base across banking and financial services, insurance, information technology, healthcare, retail and supply chain. We are currently looking for Data Architect who has proven track record in IT Industry. This is an exciting opportunity to expand your skill set, achieve job satisfaction and work-life balance. More details as … below. Role: Snowflake Architect Location: Basildon, UK/Dublin, Ireland Work from Client office 5 days weekly Responsibilities: -Design, develop, and maintain robust data pipelines and ETL processes using Snowflake on AWS. -Implement data warehousing solutions, ensuring efficient storage, retrieval, and transformation of large datasets. -Collaborate with data analysts, scientists, and other stakeholders to … availability and reliability. -Develop and maintain data integration solutions, ensuring seamless data flow between various sources and Snowflake. -Monitor, troubleshoot, and resolve data pipeline issues, ensuring data quality and integrity. -Stay up-to-date with the latest trends and best practices in data engineering and cloud technologies. Cloud Services More ❯

top trusted providers in Singapore and service a client base across banking and financial services, insurance, information technology, healthcare, retail and supply chain. We are currently looking for Data Architect who has proven track record in IT Industry. This is an exciting opportunity to expand your skill set, achieve job satisfaction and work-life balance. More details as … below. Role: Snowflake Architect Location: Basildon, UK/Dublin, Ireland Work from Client office 5 days weekly Responsibilities: -Design, develop, and maintain robust data pipelines and ETL processes using Snowflake on AWS. -Implement data warehousing solutions, ensuring efficient storage, retrieval, and transformation of large datasets. -Collaborate with data analysts, scientists, and other stakeholders to … availability and reliability. -Develop and maintain data integration solutions, ensuring seamless data flow between various sources and Snowflake. -Monitor, troubleshoot, and resolve data pipeline issues, ensuring data quality and integrity. -Stay up-to-date with the latest trends and best practices in data engineering and cloud technologies. Cloud Services More ❯

Social network you want to login/join with: We have partnered with a company that empowers underwriters to serve their insureds more effectively. They are using advanced data intelligence tools to rebuild the way that underwriters share and exchange risk. With a current focus on the small and medium-sized businesses that power our global economy and … policy to deliver unprecedented insight into insurance pools, and their speciality portfolio is fully diversified with very low catastrophe, aggregation or systemic risk. The Role: Designing and implementing data pipelines and models, ensuring data quality and integrity. Solving challenging data integration problems, utilising optimal patterns, frameworks, query techniques, sourcing from vast and varying data sources. Building, maintaining, and optimising our Data Warehouse to support reporting and analytics needs. Collaborating with product managers, business stakeholders and engineers to understand the data needs, representing key data insights in a meaningful way. Staying up-to-date with industry trends and best practices in data modelling, database development More ❯

Social network you want to login/join with: We have partnered with a company that empowers underwriters to serve their insureds more effectively. They are using advanced data intelligence tools to rebuild the way that underwriters share and exchange risk. With a current focus on the small and medium-sized businesses that power our global economy and … policy to deliver unprecedented insight into insurance pools, and their speciality portfolio is fully diversified with very low catastrophe, aggregation or systemic risk. The Role: Designing and implementing data pipelines and models, ensuring data quality and integrity. Solving challenging data integration problems, utilising optimal patterns, frameworks, query techniques, sourcing from vast and varying data sources. Building, maintaining, and optimising our Data Warehouse to support reporting and analytics needs. Collaborating with product managers, business stakeholders and engineers to understand the data needs, representing key data insights in a meaningful way. Staying up-to-date with industry trends and best practices in data modelling, database development More ❯

network you want to login/join with: A dynamic and prestigious professional services company based in the heart of the City of London is seeking a talented Data Engineer to join their team in this newly created role. This multifaceted position offers an exceptional opportunity for an experienced professional to work broadly across the business, planning, developing … and implementing data solutions. The successful candidate must possess strong analytical skills, in-depth understanding of data engineering principles and the ability to translate business requirements into high quality data solutions The main focus of the role will include: Designs and develops data pipelines for the preparation, transformation and loading of data into the appropriate data storage systems, following standard medallion architecture principles. Oversee ETL (Extract, Transform, Load) operations to ensure data from various sources is accurately transformed and loaded Implement data quality check, validation rules, and profiling techniques to maintain high data integrity. Work on data cleansing and normalisation More ❯

Social network you want to login/join with: Head of Data Engineering & Governance, basildon col-narrow-left Client: Data Science Talent Location: basildon, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: Head of Data Engineering & Governance … client began to focus solely on wealth management. But now? This company – a trusted name in the UK financial services sector – fully recognise this. They understand that embracing data and AI is what will continue to position them at the forefront of the UK’s investment management sector. This isn’t a dalliance with data. It’s a … debate about the direction, fighting for investment or dragging people with you. Now, following a recent acquisition, they’re ready to embark on the next phase – transforming the data and harnessing its power. And that’s where you come in. Where you fit in As one of three new leaders in the newly established Group Data More ❯

Social network you want to login/join with: Head of Data Engineering & Governance, colchester col-narrow-left Client: Data Science Talent Location: colchester, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: Head of Data Engineering & Governance … client began to focus solely on wealth management. But now? This company – a trusted name in the UK financial services sector – fully recognise this. They understand that embracing data and AI is what will continue to position them at the forefront of the UK’s investment management sector. This isn’t a dalliance with data. It’s a … debate about the direction, fighting for investment or dragging people with you. Now, following a recent acquisition, they’re ready to embark on the next phase – transforming the data and harnessing its power. And that’s where you come in. Where you fit in As one of three new leaders in the newly established Group Data More ❯

Social network you want to login/join with: Head of Data Engineering & Governance, chelmsford col-narrow-left Client: Data Science Talent Location: Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: Head of Data Engineering & Governance Investment & Wealth Management … client began to focus solely on wealth management. But now? This company – a trusted name in the UK financial services sector – fully recognise this. They understand that embracing data and AI is what will continue to position them at the forefront of the UK’s investment management sector. This isn’t a dalliance with data. It’s a … debate about the direction, fighting for investment or dragging people with you. Now, following a recent acquisition, they’re ready to embark on the next phase – transforming the data and harnessing its power. And that’s where you come in. Where you fit in As one of three new leaders in the newly established Group Data More ❯

Job Description Snowflake Architect with Azure (Permanent Role) Basildon, UK (Work from Client office 5 days a week) Responsibilities: Design, develop, and maintain robust data pipelines and ETL processes using Snowflake on AWS. Implement data warehousing solutions, ensuring efficient storage, retrieval, and transformation of large datasets. Collaborate with data analysts, scientists, and other stakeholders … to define and fulfill data requirements. Optimize performance and scalability of Snowflake data warehouse, ensuring high … availability and reliability. Develop and maintain data integration solutions, ensuring seamless data flow between various sources and Snowflake. Monitor, troubleshoot, and resolve data pipeline issues, ensuring data quality and integrity. Stay up to date with the latest trends and best practices in data engineering and cloud technologies, especially AWS More ❯

on this job and more exclusive features. Location : Basildon, UK (Work from Client office 5 days week) Hiring Type - Contract/Permanent Responsibilities: Design, develop, and maintain robust data pipelines and ETL processes using Snowflake on AWS. Implement data warehousing solutions, ensuring efficient storage, retrieval, and transformation of large datasets. Collaborate with data analysts … scientists, and other stakeholders to define and fulfil data requirements. Optimize performance and scalability of Snowflake data warehouse, ensuring high … availability and reliability. Develop and maintain data integration solutions, ensuring seamless data flow between various sources and Snowflake. Monitor, troubleshoot, and resolve data pipeline issues, ensuring data quality and integrity. Stay up to date with the latest trends and best practices in data engineering and cloud technologies. Cloud Services More ❯