1 to 25 of 34 Apache Jobs in the South East

lakehouse and datalake architectures Familiarity with modern data engineering patterns (ETL/ELT, medallion architecture, observability) Excellent Python and SQL skills Experience working with Apache Spark and large-scale data processing For a full consultation on this exciting new role, please get in touch with ARC IT Recruitment today. ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

code Proficiency in programming languages such as Python, Spark, SQL Strong experience with SQL databases Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF) Experience with cloud platforms (Azure preferred) and related data services Excellent problem-solving skills and attention to detail Inclusive and curious, continuously ...

integrations, while ensuring solutions meet regulatory standards and align with architectural best practices. Key Responsibilities: Build and optimise scalable data pipelines using Databricks and Apache Spark (PySpark). Ensure performance, scalability, and compliance. Collaborate on requirements, design, and backlog refinement. Promote engineering best practices including CI/CD, code ...

also have Experience developing or using AI applications Experience with NoSQL databases (e.g. MongoDB). Experience with big data processing frameworks (e.g. Apache Spark). Knowledge of Large Language Model (LLM) integration, Retrieval-Augmented Generation (RAG), or Agentic AI frameworks. Experience with high-performance computing (HPC) environments (e.g. SLURM ...

Required: 8–12 years of software development experience. Strong hands-on expertise in Scala (mandatory), plus Python and Java. Experience with Big Data frameworks; Apache Spark experience is an advantage. Solid understanding of software engineering principles, data structures, and algorithms. Strong problem-solving skills and ability to work ...

kubernetes) Experience with Key value stores Experience in git and basic Unix Commands You might also have (Desirable) Experience with large data processing technologies (Apache Spark) Apply now! Benefits and Contract Information Financial incentives: depending on circumstances, monthly family/marriage allowance of £278 monthly child allowance ...

Terraform or Ansible for infrastructure automation. Working knowledge of Angular or similar UI frameworks. Solid understanding of SQL and relational database design. Experience with Apache Spark for distributed data processing (Mandatory). Strong problem-solving, analytical, and debugging skills. Excellent communication and teamwork abilities. If you are interested, apply ...

Terraform or Ansible for infrastructure automation. Working knowledge of Angular or similar UI frameworks. Solid understanding of SQL and relational database design. Experience with Apache Spark for distributed data processing (Mandatory). Strong problem-solving, analytical, and debugging skills. Excellent communication and teamwork abilities. If you are interested, apply ...

Technical experience will be with Python, dealing with huge volumes of data at scale across both bathc and stream processes. Orchestration tools such as Apache Airflow, Datawarehouse is Snowflake whilst having microservices experience within a cloud environment, ideally AWS. A solid all rounder who can still roll their sleeves ...

setting. MSc in Computer Science, Machine Learning, or a related field. Experience building data pipelines (realtime or batch) & data quality using modern toolchain (e.g., Apache Spark, Kafka, Airflow, dbt). Strong foundational knowledge of machine learning and deep learning algorithms, including deep neural networks, supervised/unsupervised learning, predictive ...

cloud data warehouses (e.g., Snowflake, Redshift). · Familiarity with data orchestration tools (e.g., Airflow). · Experience with data visualisation platforms (such as Preset.io/Apache Superset or other). · Exposure to CI/CD pipelines, ideally using GitLab CI. · Background working with media, marketing, or advertising data. The Opportunity ...

cloud data warehouses (e.g., Snowflake, Redshift). ·Familiarity with data orchestration tools (e.g., Airflow). ·Experience with data visualisation platforms (such as Preset.io/Apache Superset or other). ·Exposure to CI/CD pipelines, ideally using GitLab CI. ·Background working with media, marketing, or advertising data. The Opportunity ...

Spring Boot, Hibernate, JEE, MVC, Swing, JSP, Webservices (REST/SOAP), Angular/AngularJS, jQuery, JSON, HTML, CSS, XSLT Expertise with: Tomcat, JBoss EAP, Apache, SQL, Oracle, PL/SQL, XML, Maven, Ant, CI/CD (Azure Pipeline), Jira, Subversion Experience generating reports in PDF, MS Word, Excel. Knowledge ...

Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence to data governance, security ...

meet non-functional requirements Here is a snapshot of the technologies that we use Azure Cloud Technologies, Databricks, Azure DevOps, Python, Java, PowerShell, Apache Spark, YAML Pipelines, Esri ArcGIS, JMeter What we're looking for Highly skilled in creating, maintaining and peer reviewing secure test automation code, in object ...

data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

projects and delivering secure, scalable cloud solutions. Nice to have: Immediate availability Understanding of Synapse Spark Architecture Familiarity with a variety of technologies, including Apache Spark, Spark ML, Serverless Spark Pools, TSQL, ETL Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business ...

expertise in: Cloud: IaaS, PaaS, SaaS, M365, Azure, Cloud Security, Azure DevOps Applications: .NET, MS Dynamics, SQL Server, SSRS, M365 Apps, Exchange, SharePoint, IIS, Apache Security: OWASP, Firewalls, ISO27001, Azure Security Benchmark, Microsoft Defender, zScaler Networking: Switches, Firewalls, ExpressRoute, MPLS, Routing Protocols, CASB, Azure FrontDoor Servers: VMware, Windows Server ...

such as React, Redux, TypeScript, Material UI, Storybook, Jest, and Scala.js Proven working knowledge of Backend & Databases such as Scala (v2), Play Framework, ScalaTest, Apache Pekko (including testkits), Mockito, PostgreSQL, and MongoDB. Familiarity with DevOps & Cloud tools like Docker, Kubernetes, Sysdig, OpenSearch, and AWS. Excellent communication and stakeholder management ...

models for performance, scalability, and accuracy. Qualifications: Deep knowledge of neural networks (CNNs, RNNs, LSTMs, Transformers). Strong experience with data tools (Pandas, NumPy, Apache Spark). Solid understanding of NLP algorithms. Experience integrating ML models via RESTful APIs. Familiarity with CI/CD pipelines and deployment automation. Strategic ...

Nginx, Redis, Event driven programming, Message queues, RDBS, NoSQL Database, Data Streams, real time distributed computing. 15. Experience in DevOps and release pipelines 16. Apache Camel 17. Postgresql Good to Have: 1. OBIEE Knowledge 2. TOGAF Certified 3. Splunk 4. Hadoop/EMR/Apache Spark Experience 5. ...

LLMs), and specialized models in Computer Vision and NLP. Big Data Engineering: Design, build, and optimize high-throughput, distributed data pipelines and features using Apache Spark (Scala) and Hive on massive datasets to support model training and inference. Cross-Cloud Execution: Lead the design and deployment of ML models … environment. Required Skills and Expertise (10+ Years) 1. Big Data and Cloud Mastery Programming & Big Data: 10+ years of extensive, hands-on experience with Apache Spark, with strong preference for production development using Scala. Deep expertise with Apache Hive for data querying and management. Cloud Proficiency: Demonstrated expertise ...

LLMs), and specialized models in Computer Vision and NLP. Big Data Engineering: Design, build, and optimize high-throughput, distributed data pipelines and features using Apache Spark (Scala) and Hive on massive datasets to support model training and inference. Cross-Cloud Execution: Lead the design and deployment of ML models … environment. Required Skills and Expertise (10+ Years) 1. Big Data and Cloud Mastery Programming & Big Data: 10+ years of extensive, hands-on experience with Apache Spark, with strong preference for production development using Scala. Deep expertise with Apache Hive for data querying and management. Cloud Proficiency: Demonstrated expertise ...

LLMs), and specialized models in Computer Vision and NLP. Big Data Engineering: Design, build, and optimize high-throughput, distributed data pipelines and features using Apache Spark (Scala) and Hive on massive datasets to support model training and inference. Cross-Cloud Execution: Lead the design and deployment of ML models … environment. Required Skills and Expertise (10+ Years) 1. Big Data and Cloud Mastery Programming & Big Data: 10+ years of extensive, hands-on experience with Apache Spark, with strong preference for production development using Scala. Deep expertise with Apache Hive for data querying and management. Cloud Proficiency: Demonstrated expertise ...