20 of 20 Apache Jobs in the South East

supporting Spark‐based platforms (e.g. EMR, Glue, Databricks) (Preferred) Proficient with DevOps tools and practices (Git, Jenkins, Docker, Kubernetes) as well as ETL frameworks (Apache Spark, Airflow, AWS IoT Analytics/Device Management/Events). (Preferred) Programming expertise in Python, Java, Scala, SQL, Spark, Unix shell scripting ...

Lead Backend Software Engineer – Data Services Federated Data Services | Distributed Systems | Apache Spark | DataFusion | Python | Kubernetes Location: London (2 days per week onsite) Rate: £700–£800 per day (Outside IR35) Duration: Initial 6-month contract with likely extension Overview We're looking for an experienced Lead Backend Software Engineer … data services capable of securely querying and processing data across multiple environments. Design high-performance data processing and streaming workflows using technologies such as Apache Spark, Apache DataFusion, or similar distributed query frameworks. Design and implement Kubernetes-based services and containerised workloads. Build secure APIs and backend services ...

optimising ETL/ELT pipelines. Strong understanding of Lakehouse, Data Warehouse, and Data Lake architectures. Experience with Azure Data Factory, Azure Synapse, and Apache Spark. Knowledge of data modelling, semantic models, and enterprise reporting solutions. Experience implementing data governance, security, and quality frameworks. Strong understanding of modern data engineering ...

data into something they can actually use and act on. What you'll be doing: Designing and building performant data ingestion pipelines using Apache Spark, ideally within Azure Databricks Contributing to the platform's data modelling and architecture Building dashboards and semantic models, and presenting these directly to stakeholders ...

data into something they can actually use and act on. What you'll be doing: Designing and building performant data ingestion pipelines using Apache Spark, ideally within Azure Databricks Contributing to the platform's data modelling and architecture Building dashboards and semantic models, and presenting these directly to stakeholders ...

Java/Groovy and Object Orientated Design principles Working in an SDLC with an integrated development team on CICD tooling (Git) Desirable Experience with Apache Nifi AWS experience, including familiarity with EMR, S3, SQS Awareness of domain driven design approaches and architecture Linux awareness and Scripting skills Postgress/ ...

Java/Groovy and Object Orientated Design principles Working in an SDLC with an integrated development team on CICD tooling (Git) Desirable Experience with Apache Nifi AWS experience, including familiarity with EMR, S3, SQS Awareness of domain driven design approaches and architecture Linux awareness and Scripting skills Postgress/ ...

alerting. Minimum requirements: 3+ years of experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of Python, SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code ...

internal knowledge Competencies and Behaviours: 3+ years experience in data platform engineering, cloud engineering, or similar roles Strong hands-on experience with Databricks, including Apache Spark, Delta Lake, Workflows Proven experience designing and deploying data platforms on AWS and/or Azure (e.g. ADLS, S3, VNet/ ...

large-scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward Financial ...

following technologies (across Windows and Linux environments): C++, Python, JavaScript XML, JSON, HTML, CSS Web frameworks and backend technologies (e.g. Angular, Django, Node.js, React, Apache) WebSockets and real-time data systems Docker and containerisation Networking protocols (TCP/IP, UDP) SQL and database technologies Debugging and diagnostic tools (e.g. ...

following technologies (across Windows and Linux environments): C++, Python, JavaScript XML, JSON, HTML, CSS Web frameworks and backend technologies (e.g. Angular, Django, Node.js, React, Apache) WebSockets and real-time data systems Docker and containerisation Networking protocols (TCP/IP, UDP) SQL and database technologies Debugging and diagnostic tools (e.g. ...

automate workflows, and deliver secure, high-performance data platforms using AWS-native technologies. Key Responsibilities Develop and maintain data pipelines using Python , SQL , and Apache Airflow . Build and manage containerised data applications using Docker . Design and optimise solutions using AWS services including Redshift, OpenSearch, Lambda, Glue, Step … data governance, security, and best practice standards. Essential Skills Active Security Clearance Strong experience with Python and SQL . Hands-on experience with Apache Airflow and Docker . Proven experience with AWS data services, including Redshift, OpenSearch, Lambda, Glue, Step Functions, and Batch . Experience with Git , GitLab ...

. Working knowledge of Bamboo/Bitbucket. Experience with Confluence/Jira. Familiarity with ServiceNow. Basic knowledge of Linux systems. Knowledge of NGINX/Apache, Antivirus Tools (e.g., Trellix/SEP), Tanium, and Backup/BCP/DR strategies. For more information please contact Lauren Morley at JAM Recruitment ...

platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/ ...

platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/ ...

support high availability and load-balancing solutions. Configure and troubleshoot networking technologies including DNS, routing and Firewalls. Manage web services and Proxy technologies including Apache, NGINX and Squid. Oversee backup, recovery and disaster recovery processes using Veeam. Manage endpoint security and device compliance through Microsoft Intune. Maintain server infrastructure … VMware ESXi administration experience. Strong networking knowledge including DNS, load balancing, routing and troubleshooting. Experience with Veeam backup and disaster recovery solutions. Experience managing Apache, NGINX, Squid or similar web technologies. Scripting and automation experience. Strong understanding of infrastructure security, system hardening and access control. Proven experience leading ...

support high availability and load-balancing solutions. Configure and troubleshoot networking technologies including DNS, routing and Firewalls. Manage web services and Proxy technologies including Apache, NGINX and Squid. Oversee backup, recovery and disaster recovery processes using Veeam. Manage endpoint security and device compliance through Microsoft Intune. Maintain server infrastructure … VMware ESXi administration experience. Strong networking knowledge including DNS, load balancing, routing and troubleshooting. Experience with Veeam backup and disaster recovery solutions. Experience managing Apache, NGINX, Squid or similar web technologies. Scripting and automation experience. Strong understanding of infrastructure security, system hardening and access control. Proven experience leading ...

part of a team, and on your own projects Good programming experience in some or all the following programming technologies: Linux (Debian, Ubuntu), Apache, Database Administration (MySQL), Programming knowledge (Bash, Python, PHP, ReactJS and NodeJS) Experience of CI/CD pipelines, Bitbucket and JIRA environments Experience of at least … Technology, you will also lead and mentor the Developer and Graduate Developer working in your immediate team. The main development software technologies include Debian, Apache, MySQL, Python, PHP, ReactJS and NodeJS. As part of this role my client expect the successful candidate to continuously improve their skillset in software ...

Limited (DDIL) communications environments, supporting local processing at the edge Building streaming ingestion, event pipelines, and batch/stream processing workloads using technologies like Apache Flink and/or Apache Spark Implementing metadata, lineage, and catalogue capabilities along with policy-based security and governance Job Requirements: Extensive experience ...