1 to 25 of 26 Apache Jobs in the South East

In this role, you will be responsible for designing, building, and maintaining robust data pipelines and infrastructure on the Azure cloud platform. You will leverage your expertise in PySpark, Apache Spark, and Apache Airflow to process and orchestrate large-scale data workloads, ensuring data quality, efficiency, and scalability. If you have a passion for data engineering and a … significant impact, we encourage you to apply! Job Responsibilities ETL/ELT Pipeline Development: Design, develop, and optimize efficient and scalable ETL/ELT pipelines using Python, PySpark, and Apache Airflow. Implement batch and real-time data processing solutions using Apache Spark. Ensure data quality, governance, and security throughout the data lifecycle. Cloud Data Engineering: Manage and optimize … effectiveness. Implement and maintain CI/CD pipelines for data workflows to ensure smooth and reliable deployments. Big Data & Analytics: Develop and optimize large-scale data processing pipelines using Apache Spark and PySpark. Implement data partitioning, caching, and performance tuning techniques to enhance Spark-based workloads. Work with diverse data formats (structured and unstructured) to support advanced analytics and More ❯

Requirements: 3+ Years data engineering experience Snowflake experience Proficiency across an AWS tech stack DevOps experience building and deploying using Terraform Nice to Have: DBT Data Modelling Data Vault Apache Airflow Benefits: Up to 10% Bonus Up to 14% Pensions Contribution 29 Days Annual Leave + Bank Holidays Free Company Shares Interviews ongoing don't miss your chance to More ❯

In this role, you will be responsible for designing, building, and maintaining robust data pipelines and infrastructure on the Azure cloud platform. You will leverage your expertise in PySpark, Apache Spark, and Apache Airflow to process and orchestrate large-scale data workloads, ensuring data quality, efficiency, and scalability. If you have a passion for data engineering and a … data processing workloads Implement CI/CD pipelines for data workflows to ensure smooth and reliable deployments. Big Data & Analytics: Build and optimize large-scale data processing pipelines using Apache Spark and PySpark Implement data partitioning, caching, and performance tuning for Spark-based workloads. Work with diverse data formats (structured and unstructured) to support advanced analytics and machine learning More ❯

products or platforms Strong knowledge of SQL and experience with large-scale relational and/or NoSQL databases Experience testing data pipelines (ETL/ELT), preferably with tools like Apache Airflow, dbt, Spark, or similar Proficiency in Python or similar scripting language for test automation Experience with cloud platforms (AWS, GCP, or Azure), especially in data-related services Familiarity More ❯

ideally with experience using data processing frameworks such as Kafka, NoSQL, Airflow, TensorFlow, or Spark. Finally, experience with cloud platforms like AWS or Azure, including data services such as Apache Airflow, Athena, or SageMaker, is essential. This is a fantastic opportunity for a Data Engineer to join a rapidly expanding start-up at an important time where you will More ❯

of CI/CD tools and technologies (e.g., Git, Gitlab, Jenkins, GCP, AWS) Knowledge of containerisation and microservice architecture Ability to develop dashboard UIs for publishing performance (e.g., Grafana, Apache Superset, etc.) Exposure to safety certification standards and processes We provide: Competitive salary, benchmarked against the market and reviewed annually Company share programme Hybrid and/or flexible work More ❯

of Zend products. Participate in an on-call rotation Requirements: Experience using the AWS EC2 web console and APIs. Deep understanding of HTTP protocol, including web security, and troubleshooting. Apache or Nginx web server administration and configuration experience. Linux system administration experience (Red Hat, Rocky, Alma, Debian, Ubuntu, et. al.) Experience maintaining production RDBMS servers such as MySQL/ More ❯

VMWare General/Usage Technical Leadership & Design DevSecOps tooling and practices Application Security Testing SAFe (scaled agile) Processes Data Integration Focused Data Pipeline Orchestration, and ELT tooling such as Apache Airflow, Apark, NiFi, Airbyte and Singer. Message Brokers, streaming data processors, such as Apache Kafka Object Storage, such as S3, MinIO, LakeFS CI/CD Pipeline, Integration, ideally More ❯

with new methodologies to enhance the user experience. Key skills: ** Senior Data Scientist experience ** Commercial experience in Generative AI and recommender systems ** Strong Python and SQL experience ** Spark/Apache Airflow ** LLM experience ** MLOps experience ** AWS Additional information: This role offers a strong salary of up to £95,000 (Depending on experience/skill) with hybrid working (2 days More ❯

data engineering or a related field. Proficiency in programming languages such as Python, Spark, SQL. Strong experience with SQL databases. Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF). Experience with cloud platforms (Azure preferred) and related data services. There's no place quite like BFS and we're proud of that. And it's More ❯

skills in system testing, QA practices, and troubleshooting methodologies. Familiarity with integration tools (ESB, Web Services, WebSphere, SOAP). Knowledge of infrastructure: Windows Server/Client, RDS, IIS/Apache/WebSphere, web browsers. Experience in system upgrades, migrations, and CI/CD (Microsoft DevOps). Proficient in SQL, XML, and basic scripting (Python/JavaScript). Able to More ❯

Senior Software engineer to join their team in London on a full-time basis What You’ll Do Architect and implement high-performance data processing systems in Rust Leverage Apache Arrow and Parquet for in-memory and on-disk data efficiency Integrate and extend systems like DataFusion, ClickHouse, and DuckDB Design low-latency pipelines for analytical workloads Collaborate with More ❯

London - upto £60K + Benefits Key Skills: Ubuntu Linux, Bash scripting, Chef/Puppet, Jenkins, Networking protocols - TCP/IP, HTTP, SSL, shell/perl scripting, Web Servers e.g. Apache, etc, Agile methodologies, DockerA well known B2B Saas business are now hiring a Cloud Engineer due to steady growth. There are looking for a technical and client orientated Cloud More ❯

support for Data Analysts with efficient and performant queries. • Skilled in optimizing data ingestion and query performance for MSSQL or other RDBMS. • Familiar with data processing frameworks such as Apache Spark. • Highly analytical and tenacious in solving complex problems. More ❯

engineering workflows like CI/CD and containerised environments Skilled at working with both structured and unstructured data to unlock insights and power models Hands-on experience with Databricks, Apache Spark, or similar tools used in large-scale data processing Exposure to machine learning model deployment using APIs or lightweight serving frameworks like Flask or Keras Familiarity with geospatial More ❯

physical), metadata management, and master data management (MDM). Deep understanding of data integration, transformation, and ingestion techniques using modern tools (e.g., Azure Data Factory, Boomi, Informatica, Talend, dbt, Apache NiFi). Strong familiarity with data warehousing, data lake/lakehouse architectures, and cloud-native analytics platforms. Hands-on experience with SQL and cloud data platforms (e.g., Snowflake, Azure More ❯

servers or similar distributed computing platforms is key.Key Responsibilities:Design and develop agentic AI systems that operate autonomously across diverse data sources and workflows.Implement scalable data processing pipelines using Apache Spark and Python.Build, train, and fine-tune advanced AI/ML models for agent reasoning, planning, and execution.Integrate solutions with MCP (Massively Concurrent Processing) servers or equivalent architectures.Work closely … reinforcement learning.Required Skills & Experience:4+ years of experience in AI/ML engineering or data-intensive systems.Strong proficiency in Python for AI, ML, and data engineering tasks.Deep experience with Apache Spark (PySpark or Scala-based implementations).Solid understanding and hands-on experience with modelling intelligent agents, including symbolic, neural, or hybrid approaches.Experience deploying to and managing workloads on MCP More ❯

standardized Spark SQL and PySpark code for data transformations, ensuring data integrity and accuracy across the pipeline. Automate pipeline orchestration using Databricks Workflows or integration with external tools (e.g., Apache Airflow, Azure Data Factory). Data Ingestion & Transformation: Build scalable data ingestion processes to handle structured, semi-structured, and unstructured data from various sources (APIs, databases, file systems). More ❯

to have strong, hands-on experience within the following areas: Email & Directory Services: Exchange, Mail, MTA, SMTP, Border Sync, Active Directory, Group Policy, DNS Web & Server Infrastructure: IIS/Apache, Server Build & Configuration, PKI (TLS, Certificates), VMWare Automation & Scripting: PowerShell, DevOps tooling (Ansible, GIT, YAML) Experience with scripting repeatable infrastructure configurations and deploying securely within enterprise environments. Strong documentation More ❯

Skills and Experience: Advanced knowledge of Exchange , Mail protocols , MTA , and SMTP Strong understanding of Border Sync Expertise in Directory Services Experience with Web technologies such as IIS and Apache Proven ability to build and configure servers from the ground up Solid understanding of Active Directory and Group Policy Deep knowledge of DNS and PKI (Certificates, TLS) Hands-on More ❯

Broadband etc. Hands-on experience with Opensource initiatives, standards and tools e.g. Opensource Telecoms Products (ONAP, ODL, ONOS, Nephio) , Open APIs and alternative API standards (GraphQL, gRPC, Async APIs), Apache Product Suite, Linux Product Suite, Opensource Databases etc. A very good understanding of Cloud Technologies . Experience building, architecting, designing, and implementing highly distributed global cloud-based systems. Familiarity More ❯

people, Boeing Defence UK provides long-term support for more than 120 Boeing military rotary-wing and fixed-wing aircrafts in the UK. For example, the Chinook and Apache helicopters, and the Poseidon and C-17 airplanes. Our support ranges from mission critical Logistics Information Services, next generation in-flight digital tools, to aircraft and operational modelling and simulation More ❯

keen to build on their testing abilities to help deliver automated regression testing. 2-5 years' Testing experience Web Based Applications NoSQL, MySQL & SQL Server Strong problem-solving ability Apache, Tomcat, jBoss If you are interested in this role and you have the right experience, then please apply for the role with your most up to date CV that More ❯

people, Boeing Defence UK provides long-term support for more than 120 Boeing military rotary-wing and fixed-wing aircrafts in the UK. For example, the Chinook and Apache helicopters, and the Poseidon and C-17 airplanes. Our support ranges from mission critical Logistics Information Services, next generation in-flight digital tools, to aircraft and operational modelling and simulation More ❯

We are looking for candidates who have experience in delivering training and documentation on the following technologies: Datastorage and serialisation Databricks developer Apache Spaark Airflow DBT basics Databricks You must have experience delivering training on these technologies the work is 4 week delivered training some is hands some is self led and some is instructor led. Apply if this More ❯