3 of 3 Apache Spark Jobs in West Sussex

to define Bicep templates and deploy Azure infrastructure effectively. Experience creating Azure DevOps YAML pipelines. Knowledge of source control, preferably Git. Strong skills in SQL, Azure Synapse, Data Factory, Spark, and Databricks. Experience establishing coding standards and testing practices. Deep understanding of the full data lifecycle. Involvement in implementing CI/CD methodologies. Experience working in agile, rapid development More ❯

to join our defence & security client on a contract basis. You will helpdesign, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi These roles are supporting our clients team in Worcester (fully onsite), and requires active UK DV clearance. Key Responsibilities: Design, develop, and maintain secure and scalable data pipelines … using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi Implement data ingestion, transformation, and integration processes, ensuring data quality and security Collaborate with data architects and security teams to ensure compliance with security policies and data governance standards Manage and monitor large-scale data flows in real-time, ensuring system performance, reliability, and data integrity Develop robust data … Experience working as a Data Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with Apache NiFi for building and managing complex data flows and integration processes. Knowledge of security practices for handling sensitive data, including encryption, anonymization, and access control. Familiarity with data governance More ❯

techniques to real-world challenges - from predictive modelling to natural language processing, from AI operations to ethical deployment. Alongside this, you'll gain a recognised qualification through the Cambridge Spark apprenticeship programme, with full support to help you develop your technical skills and business acumen. It's an extraordinary opportunity to help shape the future of travel while launching More ❯