1 to 25 of 383 Data Pipeline Jobs in the East of England

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

validation frameworks and automated testing for Azure-based data platforms. The role also includes DataOps responsibilities, ensuring reliable, observable, and well-governed pipeline operations across Fabric Data Factory, Azure Data Factory and Synapse environments. Additionally, the engineer will take on Data … Analytics for reliability tracking and alerting. Write SQL queries and PowerShell (or another scripting language) to automate the execution of validation routines, verify pipeline outputs, and support end-to-end data quality workflows Collaborate with Data Engineering, Cloud, and Governance teams to embed standardized validation ...

validation frameworks and automated testing for Azure-based data platforms. The role also includes DataOps responsibilities, ensuring reliable, observable, and well-governed pipeline operations across Fabric Data Factory, Azure Data Factory and Synapse environments. Additionally, the engineer will take on Data … Analytics for reliability tracking and alerting. Write SQL queries and PowerShell (or another scripting language) to automate the execution of validation routines, verify pipeline outputs, and support end-to-end data quality workflows Collaborate with Data Engineering, Cloud, and Governance teams to embed standardized validation ...

validation frameworks and automated testing for Azure-based data platforms. The role also includes DataOps responsibilities, ensuring reliable, observable, and well-governed pipeline operations across Fabric Data Factory, Azure Data Factory and Synapse environments. Additionally, the engineer will take on Data … Analytics for reliability tracking and alerting. Write SQL queries and PowerShell (or another scripting language) to automate the execution of validation routines, verify pipeline outputs, and support end-to-end data quality workflows Collaborate with Data Engineering, Cloud, and Governance teams to embed standardized validation ...

validation frameworks and automated testing for Azure-based data platforms. The role also includes DataOps responsibilities, ensuring reliable, observable, and well-governed pipeline operations across Fabric Data Factory, Azure Data Factory and Synapse environments. Additionally, the engineer will take on Data … Analytics for reliability tracking and alerting. Write SQL queries and PowerShell (or another scripting language) to automate the execution of validation routines, verify pipeline outputs, and support end-to-end data quality workflows Collaborate with Data Engineering, Cloud, and Governance teams to embed standardized validation ...

validation frameworks and automated testing for Azure-based data platforms. The role also includes DataOps responsibilities, ensuring reliable, observable, and well-governed pipeline operations across Fabric Data Factory, Azure Data Factory and Synapse environments. Additionally, the engineer will take on Data … Analytics for reliability tracking and alerting. Write SQL queries and PowerShell (or another scripting language) to automate the execution of validation routines, verify pipeline outputs, and support end-to-end data quality workflows Collaborate with Data Engineering, Cloud, and Governance teams to embed standardized validation ...

validation frameworks and automated testing for Azure-based data platforms. The role also includes DataOps responsibilities, ensuring reliable, observable, and well-governed pipeline operations across Fabric Data Factory, Azure Data Factory and Synapse environments. Additionally, the engineer will take on Data … Analytics for reliability tracking and alerting. Write SQL queries and PowerShell (or another scripting language) to automate the execution of validation routines, verify pipeline outputs, and support end-to-end data quality workflows Collaborate with Data Engineering, Cloud, and Governance teams to embed standardized validation ...

validation frameworks and automated testing for Azure-based data platforms. The role also includes DataOps responsibilities, ensuring reliable, observable, and well-governed pipeline operations across Fabric Data Factory, Azure Data Factory and Synapse environments. Additionally, the engineer will take on Data … Analytics for reliability tracking and alerting. Write SQL queries and PowerShell (or another scripting language) to automate the execution of validation routines, verify pipeline outputs, and support end-to-end data quality workflows Collaborate with Data Engineering, Cloud, and Governance teams to embed standardized validation ...

validation frameworks and automated testing for Azure-based data platforms. The role also includes DataOps responsibilities, ensuring reliable, observable, and well-governed pipeline operations across Fabric Data Factory, Azure Data Factory and Synapse environments. Additionally, the engineer will take on Data … Analytics for reliability tracking and alerting. Write SQL queries and PowerShell (or another scripting language) to automate the execution of validation routines, verify pipeline outputs, and support end-to-end data quality workflows Collaborate with Data Engineering, Cloud, and Governance teams to embed standardized validation ...

validation frameworks and automated testing for Azure-based data platforms. The role also includes DataOps responsibilities, ensuring reliable, observable, and well-governed pipeline operations across Fabric Data Factory, Azure Data Factory and Synapse environments. Additionally, the engineer will take on Data … Analytics for reliability tracking and alerting. Write SQL queries and PowerShell (or another scripting language) to automate the execution of validation routines, verify pipeline outputs, and support end-to-end data quality workflows Collaborate with Data Engineering, Cloud, and Governance teams to embed standardized validation ...

validation frameworks and automated testing for Azure-based data platforms. The role also includes DataOps responsibilities, ensuring reliable, observable, and well-governed pipeline operations across Fabric Data Factory, Azure Data Factory and Synapse environments. Additionally, the engineer will take on Data … Analytics for reliability tracking and alerting. Write SQL queries and PowerShell (or another scripting language) to automate the execution of validation routines, verify pipeline outputs, and support end-to-end data quality workflows Collaborate with Data Engineering, Cloud, and Governance teams to embed standardized validation ...

helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … Maintain accurate data dictionaries, metadata, and workflow documentation for transparency and team collaboration. Optimization & Best Practices Optimize dashboard and data pipeline performance through best practices in data visualization and coding standards. Contribute to the evolution of internal audit data strategy ...

helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … Maintain accurate data dictionaries, metadata, and workflow documentation for transparency and team collaboration. Optimization & Best Practices Optimize dashboard and data pipeline performance through best practices in data visualization and coding standards. Contribute to the evolution of internal audit data strategy ...

helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … Maintain accurate data dictionaries, metadata, and workflow documentation for transparency and team collaboration. Optimization & Best Practices Optimize dashboard and data pipeline performance through best practices in data visualization and coding standards. Contribute to the evolution of internal audit data strategy ...

helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … Maintain accurate data dictionaries, metadata, and workflow documentation for transparency and team collaboration. Optimization & Best Practices Optimize dashboard and data pipeline performance through best practices in data visualization and coding standards. Contribute to the evolution of internal audit data strategy ...

helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … Maintain accurate data dictionaries, metadata, and workflow documentation for transparency and team collaboration. Optimization & Best Practices Optimize dashboard and data pipeline performance through best practices in data visualization and coding standards. Contribute to the evolution of internal audit data strategy ...

across the medallion layers (silver and gold) of the Data Lakehouse • Ensure data quality through monitoring and validation throughout the pipeline • Troubleshoot and resolve data pipeline issues, optimising performance • Ensure compatibility with analytical platforms such as Tableau and ThoughtSpot Key Skills & Experience … Pandas and NumPy. • Proficiency in SQL for querying, transforming, and managing data within databases. • Strong troubleshooting skills for resolving data pipeline issues • Familiarity with Tableau and ThoughtSpot for analytics • Familiarity with cloud platforms such as AWS or GCP, including services like Databricks, Redshift, BigQuery ...

across the medallion layers (silver and gold) of the Data Lakehouse • Ensure data quality through monitoring and validation throughout the pipeline • Troubleshoot and resolve data pipeline issues, optimising performance • Ensure compatibility with analytical platforms such as Tableau and ThoughtSpot Key Skills & Experience … Pandas and NumPy. • Proficiency in SQL for querying, transforming, and managing data within databases. • Strong troubleshooting skills for resolving data pipeline issues • Familiarity with Tableau and ThoughtSpot for analytics • Familiarity with cloud platforms such as AWS or GCP, including services like Databricks, Redshift, BigQuery ...

across the medallion layers (silver and gold) of the Data Lakehouse • Ensure data quality through monitoring and validation throughout the pipeline • Troubleshoot and resolve data pipeline issues, optimising performance • Ensure compatibility with analytical platforms such as Tableau and ThoughtSpot Key Skills & Experience … Pandas and NumPy. • Proficiency in SQL for querying, transforming, and managing data within databases. • Strong troubleshooting skills for resolving data pipeline issues • Familiarity with Tableau and ThoughtSpot for analytics • Familiarity with cloud platforms such as AWS or GCP, including services like Databricks, Redshift, BigQuery ...

scale stuff and we're still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data … environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing unbounded data (pubsub, message queues, event streaming etc) Understanding of the most commonly used Data ...

scale stuff and we’re still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data … environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing unbounded data (pubsub, message queues, event streaming etc) Understanding of the most commonly used Data ...

Company Nigel Wright are delighted to be partnering with the Institute of Directors in their search for a Senior Data Engineer. The Institute of Directors (IoD) is a thriving membership community for Directors in the UK and beyond, where you can connect with other leaders, develop your skills … multiple sources (internal systems, external datasets) Ensure data quality, cleansing and governance processes are implemented Monitor, troubleshoot and optimise data pipeline and data warehouse performance to ensure high availability and efficiency Liaise closely with business and IT stakeholders, including directors and senior leadership ...

Company Nigel Wright are delighted to be partnering with the Institute of Directors in their search for a Senior Data Engineer. The Institute of Directors (IoD) is a thriving membership community for Directors in the UK and beyond, where you can connect with other leaders, develop your skills … multiple sources (internal systems, external datasets) Ensure data quality, cleansing and governance processes are implemented Monitor, troubleshoot and optimise data pipeline and data warehouse performance to ensure high availability and efficiency Liaise closely with business and IT stakeholders, including directors and senior leadership ...