26 to 44 of 44 Apache Jobs in the South East

cloud cost management. What we're looking for: Strong commercial experience as a Data Engineer working with Databricks in production. Excellent knowledge of Apache Spark, Delta Lake and Databricks Workflows. Strong Python and SQL skills. Understanding of Lakehouse architecture, ETL/ELT and distributed data processing. Databricks certification highly ...

fields of data analytics and software Proficiency in Python programming language and common data science packages. Experience with data engineering tools (e.g. Apache Spark, AWS Glue, Kinesis, Snowflake, Apache Airflow) Experience in building data pipelines and data streaming applications. Experience with tools to support the software and analytics ...

services Apply appropriate patterns using proven and emerging technologies Skills and ExperiencePython Linux Bash scripting Git Docker Messaging or streaming technologies (e.g. Kafka or Apache Pulsar) Experience working in Agile/Scrum teams Tooling such as Atlassian or GitLab Exposure to CI/CD pipelines ClearanceThis role requires candidates ...

some of the following technologies on both Windows and Linux: C++ Javascript Python XML JSON HTML CSS Web backend servers (Angular, Django, NodeJS, React, Apache or similar) Web Sockets Docker TCP-IP/UDP SQL or other databases Dev tools (Wireshark, system log interrogation etc..) Databases Cyber Security Desirable ...

some of the following technologies on both Windows and Linux: C++ Javascript Python XML JSON HTML CSS Web backend servers (Angular, Django, NodeJS, React, Apache or similar) Web Sockets Docker TCP-IP/UDP SQL or other databases Dev tools (Wireshark, system log interrogation etc..) Databases Cyber Security Desirable ...

some of the following technologies on both Windows and Linux: C++ Javascript Python XML JSON HTML CSS Web backend servers (Angular, Django, NodeJS, React, Apache or similar) Web Sockets Docker TCP-IP/UDP SQL or other databases Dev tools (Wireshark, system log interrogation etc..) Databases Cyber Security Desirable ...

other genome browser Experience working in a multi-person team delivering production services Experience with large-scale biological datasets Experience working with the Apache Parquet file format Experience implementing AI/ML approaches for quality control and/or genome annotation Behaviours we value in our team: You bring ...

Senior Data Engineer (Databricks) - London (Hybrid) - Up to £85,000 Databricks - Apache Spark - Delta Lake - Python - SQL - Azure We're partnering with a fast-growing technology business that's investing heavily in its data platform and engineering capability. This is an opportunity to join a highly collaborative team where … progression within a growing technology business. Key Experience Required Proven experience as a Data Engineer within production environments. Strong hands-on experience with Databricks, Apache Spark, Delta Lake, Python, and SQL. Experience building and supporting scalable ETL/ELT pipelines. Strong understanding of distributed data processing and data modelling. ...

working as a Data Architect within the Defence space. Active DV Clearance and sole UK nationality Strong AWS data lake, platform and security expertise Apache NiFi architecture, governance and pipeline delivery Secure data integration experience across multiple security domains API, file-based, legacy and bespoke integration design and delivery ...

UK. Strong commercial Java development experience. Experience with popular Java frameworks, such as Spring, Hibernate, Struts or JSF. Experience with Java libraries, such as Apache Commons or Guava. Familiarity with microservices architecture and related technologies, including Docker, Kubernetes and Swagger. Previous public sector experience. Ability to develop clean, maintainable ...

platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/ ...

Lead the engineering delivery and technical direction for a scalable, multi-tenant data integration platform on Google Cloud Platform (GCP). The platform uses Apache Airflow to orchestrate ETL pipelines and enables reliable movement of data from source systems through the platform into downstream vendor systems. Youll guide … contribution where needed (critical ETLs, framework components, design spikes, performance fixes). ETL orchestration & data movement Design and develop robust ETL pipelines orchestrated in Apache Airflow, including scheduling strategies, dependency management, retries, backfills, and processing. Establish patterns for onboarding new source systems and delivering data to downstream vendor systems ...

Lead the engineering delivery and technical direction for a scalable, multi-tenant data integration platform on Google Cloud Platform (GCP). The platform uses Apache Airflow to orchestrate ETL pipelines and enables reliable movement of data from source systems through the platform into downstream vendor systems. Youll guide … contribution where needed (critical ETLs, framework components, design spikes, performance fixes). ETL orchestration & data movement Design and develop robust ETL pipelines orchestrated in Apache Airflow, including scheduling strategies, dependency management, retries, backfills, and processing. Establish patterns for onboarding new source systems and delivering data to downstream vendor systems ...

driven approach. Creating code that is open by default and easy for others to reuse. Required Skills Experience with Big Data technologies, such as Apache Hadoop, Spark or Pig AWS Apache NiFi Python or Java Built on over a 70 year heritage, Roke offers specialist knowledge in sensors ...

common technical standards and ways of working, and presenting these to the community Here's a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT What we're looking for We'd love ...

common technical standards and ways of working, and presenting these to the community Here’s a snapshot of the technologies that we use: Scala Apache Spark Databricks Apache Parquet Azure Cloud Platform Azure DevOps (Test plans, Backlogs, Pipelines) GIT What we’re looking for We’d love ...

Requirements: Proven commercial experience working as a Data Architect within the Defence space. Active DV Clearance. Strong AWS data engineering experience Hands-on Apache NiFi expertise Experience delivering secure ETL/ELT and data integration pipelines Ability to lead technical delivery teams and mentor engineers Strong stakeholder management … communication skills AWS data platforms and secure engineering Apache NiFi pipeline development and support API, file-based, legacy and bespoke integrations Data mapping, transformation and validation CI/CD, DevSecOps and release management Testing (unit, integration, performance and security) Monitoring, logging, alerting and operational support Nice to have ...

Limited (DDIL) communications environments, supporting local processing at the edge Building streaming ingestion, event pipelines, and batch/stream processing workloads using technologies like Apache Flink and/or Apache Spark Implementing metadata, lineage, and catalogue capabilities along with policy-based security and governance Job Requirements: Extensive experience ...

them. The mission You'll work on a network and packet analysis platform that processes high-volume data using technologies such as Python and Apache Pulsar. This is critical to delivering mission-critical software used by National Security customers to keep the UK safe, secure and prosperous. … test and document robust backend servicesApply appropriate patterns using proven and emerging technologiesStakeholder/customer engagementNice to haveMessaging or streaming technologies (e.g. Kafka or Apache Pulsar)Network analysis/packet analysis domain experienceTooling such as GitLabWhy join Roke? At Roke, you'll join a collaborative engineering community with ...