1 to 25 of 63 Apache Jobs in the South East

however Azure exposure is essential. Data Warehousing: Proven expertise with Snowflake – schema design, performance tuning, data ingestion, and security. Workflow Orchestration: Production experience with Apache Airflow (Prefect, Dagster or similar), including authoring DAGs, scheduling workloads and monitoring pipeline execution. Data Modeling: Strong skills in dbt, including writing modular ...

lakehouse and datalake architectures Familiarity with modern data engineering patterns (ETL/ELT, medallion architecture, observability) Excellent Python and SQL skills Experience working with Apache Spark and large-scale data processing For a full consultation on this exciting new role, please get in touch with ARC IT Recruitment today. ...

have strong Python backend software engineer skills You have experience working with large data sets You have experience of using PySpark and ideally also Apache Spark You believe in automating wherever possible You're a collaborative problem solver with great communication skills Other technology in the stack includes: FastAPI ...

code Proficiency in programming languages such as Python, Spark, SQL Strong experience with SQL databases Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF) Experience with cloud platforms (Azure preferred) and related data services Excellent problem-solving skills and attention to detail Inclusive and curious, continuously ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

Knowledge of machine learning frameworks (e.g., PySpark, PyTorch) and model deployment tools (e.g., MLflow, TensorFlow Serving). Strong experience with data processing frameworks (e.g., Apache Spark, Flink). Expertise in SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra). Hands-on experience with cloud platforms (e.g. ...

Code tools Experience with NoSQL databases (e.g., MongoDB) or SQL (e.g., Postgres) Understanding of web standards, accessibility and development best practice Experience with Apache NiFi Bonus Skills Microservices in C# Integrating LLMs (e.g., LangChain, Vercel AI) Experience using the GOV.UK Design System and Nunjucks What You'll Love ...

data stack (Glue, OpenSearch, RDS) Expert skills within SQL with experience in both transactional RDBMS systems and distributed systems Hands-on with Lakehouse technologies (Apache Iceberg, S3 Tables, StarRocks) Strong grasp of data governance, schema design, and quality frameworks Comfortable leading infrastructure decisions and collaborating across distributed teams This ...

technologies (NoSQL, time-series databases) and deep competence in data modeling principles. Workflow Orchestration: Strong working knowledge of industry-standard data orchestration tools (e.g., Apache Airflow or Kubernetes). The Environment We are seeking a highly collaborative professional with strong problem-solving skills, capable of thriving in a fast ...

able to guide how one could deploy infrastructure into different environments. Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop. Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes) Ability to create data ...

also have Experience developing or using AI applications Experience with NoSQL databases (e.g. MongoDB). Experience with big data processing frameworks (e.g. Apache Spark). Knowledge of Large Language Model (LLM) integration, Retrieval-Augmented Generation (RAG), or Agentic AI frameworks. Experience with high-performance computing (HPC) environments (e.g. SLURM ...

integrations, while ensuring solutions meet regulatory standards and align with architectural best practices. Key Responsibilities: Build and optimise scalable data pipelines using Databricks and Apache Spark (PySpark). Ensure performance, scalability, and compliance. Collaborate on requirements, design, and backlog refinement. Promote engineering best practices including CI/CD, code ...

Qualifications 10–15 years overall experience in data engineering or data architecture. 5+ years of hands-on architecture experience specifically in Databricks. Expert in Apache Spark, PySpark, Databricks SQL, Delta Lake, and distributed systems. Strong understanding of Lakehouse architecture, BI ecosystems, and modern data platforms. Cloud expertise in Azure ...

kubernetes) Experience with Key value stores Experience in git and basic Unix Commands You might also have (Desirable) Experience with large data processing technologies (Apache Spark) Apply now! Benefits and Contract Information Financial incentives: depending on circumstances, monthly family/marriage allowance of £278 monthly child allowance ...

Technical experience will be with Python, dealing with huge volumes of data at scale across both bathc and stream processes. Orchestration tools such as Apache Airflow, Datawarehouse is Snowflake whilst having microservices experience within a cloud environment, ideally AWS. A solid all rounder who can still roll their sleeves ...

cloud technologies Experience with Docker and agile delivery Desirable Skills Terraform or other IaC tools NoSQL (ideally MongoDB) or relational databases (e.g., Postgres) Apache NiFi Web standards, accessibility and development best practice Bonus Experience Microservices in C#/.NET Integrating LLMs with tools like LangChain or Vercel AI What ...

NICE FOR THE SENIOR SOFTWARE ENGINEER TO HAVE.... Cloud based experience Microservice architecture or server-less architecture Big Data/Messaging technologies such as Apache Nifi/MiNiFi/Kafka TO BE CONSIDERED.... Please either apply by clicking online or emailing me directly to dominic.barbet@searchability.com For further information ...

Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence to data governance, security ...

real-world innovation powered by data and technology. Tech Stack & Skills We're Looking For: Palantir Azure Databricks Microsoft Azure Python Docker & Kubernetes Linux Apache Tools Data Pipelines IoT (Internet of Things) Scrum/Agile Methodologies Ideal Candidate: Already DV Cleared or at least SC Strong communication skills – comfortable ...

Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence to data governance, security ...

setting. MSc in Computer Science, Machine Learning, or a related field. Experience building data pipelines (realtime or batch) & data quality using modern toolchain (e.g., Apache Spark, Kafka, Airflow, dbt). Strong foundational knowledge of machine learning and deep learning algorithms, including deep neural networks, supervised/unsupervised learning, predictive ...

network analysis for relationship mapping Familiarity with cloud platforms (AWS, Azure, or GCP) for ML model deployment Experience with big data processing frameworks like Apache Spark Knowledge of NoSQL databases (MongoDB, Elasticsearch) for handling unstructured data Experience with data versioning and feature stores for machine learning Proficiency in model ...

projects and delivering secure, scalable cloud solutions. Nice to have: Immediate availability Understanding of Synapse Spark Architecture Familiarity with a variety of technologies, including Apache Spark, Spark ML, Serverless Spark Pools, TSQL, ETL Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business ...

Actions, AWS CodePipeline Monitoring: Prometheus, Grafana, ELK, CloudWatch Security: CIS, OWASP frameworks, SAST/DAST tools, dependency scanning Web & Systems: LAMP stack (Varnish, Nginx, Apache), MySQL/Postgres, MongoDB Networking & Security: SSL/TLS, TCP/IP, Firewalls, WAFs, DNS, Load Balancers If you're passionate about combining DevOps ...

expertise in: Cloud: IaaS, PaaS, SaaS, M365, Azure, Cloud Security, Azure DevOps Applications: .NET, MS Dynamics, SQL Server, SSRS, M365 Apps, Exchange, SharePoint, IIS, Apache Security: OWASP, Firewalls, ISO27001, Azure Security Benchmark, Microsoft Defender, zScaler Networking: Switches, Firewalls, ExpressRoute, MPLS, Routing Protocols, CASB, Azure FrontDoor Servers: VMware, Windows Server ...