15 of 15 Apache Jobs in the South East

schemas for both structured and unstructured data with a snowflake environment Enhance cloud data capabilities, working with AWS S3, Azure Data Lake, and Apache Spark Collaborate with cross-functional teams to ensure data availability for advanced analytics and reporting Automate workflows, implement CI/CD pipelines, and maintain data ...

skills in Python, and experience with Java or Scala. Data Engineering at Scale: Solid ELT/ETL design experience and hands-on work with Apache Spark. Bonus points if you have: Multi-Cloud Exposure: Experience with Azure alongside GCP. Container Orchestration: Experience packaging and deploying workloads with Helm ...

Data Engineer 6 Month Contract Location: London (Onsite 4 days a week) Rate: £700 - £800 per day (INSIDE IR35) Skills: Python, Azure, Kubernetes, Apache Airflow, Apache Spark, DV Clearance We are looking to recruit a DV Cleared Data Engineer for a leading technology consultancy. This will be joining … Work across Azure environments on the low side Support data engineering workloads within Kubernetes environments on the high side Develop and maintain workflows using Apache Airflow Work with Apache Spark for large-scale data processing Support the ongoing development and improvement of established data pipelines Help ensure data ...

help design and deliver cutting-edge data solutions for customers operating in some of the UK's most complex and challenging environments. Using Databricks, Apache Spark and cloud-native technologies, you’ll develop scalable Lakehouse architectures and production-grade data pipelines that enable organisations to trust, share and exploit … opportunity to grow your career while helping customers unlock the power of their data. Responsibilities Design, build and optimise scalable data pipelines using Databricks, Apache Spark, PySpark and Delta Lake. Develop and implement modern Lakehouse architectures, applying Medallion (Bronze, Silver, Gold) design principles to support trusted and reusable data ...

proactive mindset and passion for improving reliability, resilience and operational efficiency Experience with Java and Spring Boot or .NET application support. Knowledge of Apache Artemis, Red Hat AMQ, IBM MQ or similar messaging technologies. Experience with Ansible, StackStorm or other configuration and workflow automation tools. Experience with infrastructure ...

procedural and object orientated software development languages (e.g. Ada, C, C++ & Java) Knowledge of scripting languages (e.g. Python) Knowledge of COTS integration technologies (e.g. Apache) Working with large-scale and complex integration programmes Knowledge of NoMagic Cameo/IBM DOORS, Atlassian toolset, TestRail or equivalent tools ATM knowledge would ...

experience, conversion, and operational efficiency.### What we are looking for### Essential:· Demonstrable experience as a Full-Stack PHP Developer, with strong expertise across PHP, Apache/Ngnix, SQL, and Linux environments.· Proven experience developing and integrating RESTful APIs and third-party services, alongside deploying and managing applications within Cloud ...

Envitia is seeking a Senior Data Engineer to design and deliver cutting-edge data solutions for customers in the UK. Using Databricks, Apache Spark and cloud-native technologies, you’ll build scalable Lakehouse architectures and production-grade pipelines that enable organisations to trust and share data. You’ll take ...

similar). Experience with source control systems (e.g., Git). Comfortable working in Visual Studio Code or similar IDEs. Knowledge of web servers (Apache or Nginx). #J-18808-Ljbffr ...

other genome browser Experience working in a multi-person team delivering production services Experience with large-scale biological datasets Experience working with the Apache Parquet file format Experience implementing AI/ML approaches for quality control and/or genome annotation Behaviours we value in our team: You bring ...

business. Key Responsibilities: Design, build and enhance a secure, scalable and reliable Databricks platformDevelop and maintain batch and real-time data pipelines using Databricks, Apache Spark and Delta LakeContribute to platform architecture, engineering standards and best practices across the data estateWork with Product, Analytics and Data Science teams … contribute to continuous improvement across the engineering teamJob Requirements: Significant experience building and supporting scalable, production-grade data platformsStrong hands-on expertise with Databricks, Apache Spark, Delta Lake, Python and SQLGood understanding of cloud-based data engineering, ideally within Microsoft Azure environmentsExperience with Infrastructure as Code tools such ...

maintain automation scripts in Python and Bash to streamline operational tasks and infrastructure management. Workflow Management: Configure, monitor, and maintain orchestration pipelines using Apache Airflow. System Monitoring & Reliability: Perform Linux system administration, configure system reliability monitoring using Datadog, and resolve complex production incidents. Operational Excellence: Provide technical support …/Linux administration and strong scripting skills (Python & Bash). Monitoring & Workflows: Experience with Datadog (or similar monitoring tools) and workflow orchestration platforms like Apache Airflow. Operations: Experience working with ITSM and task tracking tools (ServiceNow, Jira, Confluence), with comfort working in shift-based models supporting global teams. Proficiency ...

Apache Associates is seeking a Project Manager to lead SaaS and ERP implementation projects from planning through go-live. You will coordinate cross-functional teams, manage timelines, and ensure delivery to client expectations. The role requires proven experience in SaaS deployments and ERP projects, strong organisation, stakeholder communication ...

British nationals only; dual citizenship is not permitted The opportunity We're urgently looking for an experienced Data Engineer with strong AWS, Python and Apache Airflow skills to join a programme on an initial six-month contract. You'll help build and maintain reliable data pipelines, develop cloud-based … essential. What you'll be doing Developing and maintaining data pipelines using Python and AWS services. Building, scheduling and monitoring data workflows with Apache Airflow. Integrating data from multiple sources and preparing it for downstream use. Improving pipeline reliability, performance and data quality. Investigating data processing issues and implementing ...

edge and implementing secure configuration distribution Building streaming ingestion, event pipelines, batch/stream processing workloads using both distributed event streaming technologies and Apache Flink and/or Apache Spark with clear SLA’s and repeatable deployment Implementing metadata, lineage and catalogue capabilities and implementing policy-based security ...