1 to 25 of 28 Apache Jobs in the South West

Python, Java or Scala, and SQL. Hands-on experience building and operating large-scale data pipelines using big data and distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud-native data platforms ...

data architectures, including cloud-based and distributed systems. Strong proficiency in SQL and Python . Experience with data engineering and pipeline technologies such as Apache Airflow and Spark . Experience working with cloud platforms, particularly AWS and Azure . Knowledge of big data technologies and distributed data processing. Understanding ...

Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands ...

Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Reporting tools ...

work effectively with technical teams including Data Scientists and MLOps Engineers. Experience working with Data Science and/or MLOps environments. Experience with Apache Spark. Experience with Scala. Experience working with S3 and cloud storage technologies. Experience with graph databases. Experience with Elasticsearch. Experience with vector databases/vector ...

Jenkins, Bamboo, Concourse etc. Monitoring utilising products such as: Prometheus, Grafana, ELK, filebeat etc. Observability - SRE Big Data solutions (ecosystems) and technologies such as: Apache Spark and the Hadoop Ecosystem Edge technologies e.g. NGINX, HAProxy etc. Excellent knowledge of YAML or similar languages It is essential for this role ...

Essential Skills of the Analytical Platform Engineer Python Kubernetes Docker CI/CD pipelines (GitLab or similar) Desirable skills MLOps and data engineering concepts Apache Spark Scala S3-compatible object storage Graph database technologies If you are an driven and experienced Analytical platform engineer looking for their next exciting ...

implement highly scalable and efficient data pipelines using advanced Python (Pandas, web scraping and machine learning libraries), SQL (including advanced optimisation techniques) and Apache Airflow. Lead the extraction, transformation and loading (ETL) of large and complex datasets, including time series data, from various sources (web APIs, databases, real-time … data modelling and design skills. Extensive experience designing and building large-scale, efficient data pipelines for complex and time series data. Proven experience with Apache Airflow for data orchestration and scheduling at scale. Expertise in AWS cloud services (S3, Redshift, EC2, Lambda, etc.) is a must. Definition and design ...

when required Must hold active Enhanced DV Clearance (West) Circa £700 p/d inside IR35 Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java Desirable skills: Java Docker Kubernetes ...

skills Hands-on experience with Databricks for scalable data engineering, analytics, and collaborative development, as well as proficiency in managing large datasets using Apache Iceberg for efficient, reliable table management and data lake optimization Experience architecting and implementing enterprise-scale data warehouses on cloud platforms (e.g., AWS, Azure … data pipeline deployment and monitoring using CI/CD tools and infrastructure-as-code practices Hands-on expertise with distributed data processing frameworks (e.g., Apache Spark, Hadoop) and real-time data streaming technologies (e.g., Kafka, Kinesis, Spark) Track record of collaborating with cross-functional teams (engineering, analytics, business stakeholders ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … Engineer Should Have: Active eDV clearance (West) Willingness to work full time on site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either ...

hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that ...

strong skills in several of the following Modern JavaScript GitLab CI/CD Observability Technologies Web API Integration GitLab Version Control Database Technologies OpenShift Apache NiFi Message Broker Technologies Java Web Auth Distributed Architecture Kubernetes SecDevOps Cloud Native Technologies The Interview Process We believe in keeping the interview process ...

Beneficial experience: AWS services, JUnit, Cucumber, XML/JSON, working with large databases, and tools such as SVN/Git, Ant/Maven, Tomcat, Apache, Jenkins. Behavioural skills Decision maker: able to weigh complex options and reach sound decisions. Influencer: able to articulate and challenge the status quo. Well ...

data processing solutions using BigQuery, Pub/Sub, Dataflow and Dataproc Experience developing end‐to‐end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam. Expert understanding of when to use a range of data storage technologies including relational/non‐relational, document ...

Boot. Design and implement cloud-native solutions on AWS. Perform database query optimization and performance tuning. Work on ETL/Data Processing solutions using Apache Flink. Integrate enterprise applications, databases, and third-party systems. Participate in application architecture discussions, code reviews, and performance optimization initiatives. Deploy and maintain applications …/EKS CloudWatch IAM SNS/SQS VPC Database & Data Processing Skills Oracle SQL Server PostgreSQL MySQL Database Query Performance Tuning SQL Optimization Apache Flink ETL DevOps & Tools Git Jenkins Maven Docker Kubernetes SonarQube JIRA Agile/Scrum Required Qualifications Bachelor's or Master's degree in Computer Science ...

implement cloud-native solutions on AWS . Perform database query optimization and performance tuning . Work on ETL/Data Processing solutions using Apache Flink . Integrate enterprise applications, databases, and third-party systems. Participate in application architecture discussions, code reviews, and performance optimization initiatives. Deploy and maintain applications … CloudWatch IAM SNS/SQS VPC Database, Data Processing & DevOps Oracle/SQL Server/PostgreSQL/MySQL Database Query Performance Tuning SQL Optimization Apache Flink ETL Git, Jenkins, Maven Docker, Kubernetes SonarQube, JIRA Agile/Scrum Required Qualifications Bachelor's or Master's degree in Computer Science, Information ...

related disciplines within enterprise environments 4+ years of hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform Strong expertise in Apache Spark, SQL, Python, Delta Lake, and modern data engineering practices Experience building and optimizing Extract, Transform, Load and Extract, Load, Transform data pipelines for scalable … solutions on the Databricks Lakehouse Platform. Design and implement scalable data and analytics solutions leveraging Databricks technologies Build, maintain, and optimize data pipelines using Apache Spark, SQL, Python, and Delta Lake Develop governed datasets and data products that support reporting, analytics, and artificial intelligence initiatives Partner with business stakeholders ...

Management Stakeholder Collaboration Leadership & Mentorship Technology Stack The successful candidate will have experience working with some or all of the following technologies: Data Processing: Apache Spark/PySpark Workflow Orchestration: Apache Airflow Containerisation: Kubernetes Cloud Platform: Microsoft Azure Data APIs & Semantic Layer: CubeJS Programming Languages: Python, SQL Essential ...

lake. Translate architectural designs into implementation plans, work packages and practical technical delivery approaches. Lead API-based, file-based, legacy and bespoke integrations using Apache NiFi and AWS services. Manage the onboarding of source systems, including interface analysis, data mapping, transformation rules and security considerations. Define and coordinate unit … Significant experience leading enterprise-scale data engineering or integration programmes. Strong, hands-on AWS delivery experience, including secure engineering practices and operational observability. Strong Apache NiFi experience, including pipelines, processors, controller services, flow governance and operational monitoring. Proven experience delivering API integrations, file-based integrations, legacy system interfaces ...

teams and setting best practice standards Designing data models, ETL pipelines, warehousing solutions and distributed systems Building and supporting real-time streaming platforms using Apache Flink and related technologies Ensuring compliance with industry standards and government regulations Tracking delivery against agreed designs and managing design deviations Supporting pre-sales … data architecture on complex, secure programmes Strong hands-on AWS experience (EC2, S3, RDS, Lambda, Redshift); Azure or GCP a bonus Proven experience using Apache Flink for real-time, high-throughput data processing Experience leading, mentoring and developing technical teams Confident engaging with senior technical and non-technical stakeholders ...

secure AWS data lake Designing secure integration patterns across multiple classifications and MOD operating environments Defining conceptual, logical and physical data models Specifying Apache NiFi architecture patterns, flow standards and reusable ingestion components Designing REST API, SOAP, file-based, batch, legacy and bespoke integrations Defining governance, metadata, lineage, auditability … experience designing secure AWS data platforms and data lake architectures Knowledge of AWS security, IAM, networking, storage and relevant data services Extensive experience with Apache NiFi architecture, flow design and governance Experience designing REST, SOAP, file, batch, legacy and bespoke integrations Knowledge of structured, semi-structured and unstructured data ...

services remain secure, resilient, and aligned with business objectives. Key Responsibilities Define and maintain secure configuration standards across middleware technologies including WebSphere, IBM MQ, Apache, Tomcat, WebLogic, NGINX, and Node.js. Drive middleware security compliance and remediation activities. Develop platform strategy, roadmaps, and improvement plans. Manage and prioritise platform backlogs … guidance to stakeholders across the organisation. Essential Skills & Experience 5+ years' experience working with enterprise middleware technologies, including several of: IBM WebSphere IBM MQ Apache Tomcat WebLogic NGINX Node.js Strong background in middleware security and secure configuration management. Experience working with CIS Benchmarks . Previous experience leading technical teams. ...

services remain secure, resilient, and aligned with business objectives. Key Responsibilities Define and maintain secure configuration standards across middleware technologies including WebSphere, IBM MQ, Apache, Tomcat, WebLogic, NGINX, and Node.js. Drive middleware security compliance and remediation activities. Develop platform strategy, roadmaps, and improvement plans. Manage and prioritise platform backlogs … guidance to stakeholders across the organisation. Essential Skills & Experience 5+ years' experience working with enterprise middleware technologies, including several of: IBM WebSphere IBM MQ Apache Tomcat WebLogic NGINX Node.js Strong background in middleware security and secure configuration management. Experience working with CIS Benchmarks . Previous experience leading technical teams. ...

services remain secure, resilient, and aligned with business objectives. Key Responsibilities Define and maintain secure configuration standards across middleware technologies including WebSphere, IBM MQ, Apache, Tomcat, WebLogic, NGINX, and Node.js. Drive middleware security compliance and remediation activities. Develop platform strategy, roadmaps, and improvement plans. Manage and prioritise platform backlogs … guidance to stakeholders across the organisation. Essential Skills & Experience 5+ years' experience working with enterprise middleware technologies, including several of: IBM WebSphere IBM MQ Apache Tomcat WebLogic NGINX Node.js Strong background in middleware security and secure configuration management. Experience working with CIS Benchmarks . Previous experience leading technical teams. ...