10 of 10 Contract Apache Jobs

Lead Backend Software Engineer – Data Services Federated Data Services | Distributed Systems | Apache Spark | DataFusion | Python | Kubernetes Location: London (2 days per week onsite) Rate: £700–£800 per day (Outside IR35) Duration: Initial 6-month contract with likely extension Overview We're looking for an experienced Lead Backend Software Engineer … data services capable of securely querying and processing data across multiple environments. Design high-performance data processing and streaming workflows using technologies such as Apache Spark, Apache DataFusion, or similar distributed query frameworks. Design and implement Kubernetes-based services and containerised workloads. Build secure APIs and backend services ...

alerting. Minimum requirements: 3+ years of experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt; Working knowledge of Python, SQL and shell scripting; Experience with Docker/k8s and “infrastructure as a code ...

large-scale cloud data services on AWS. What we need: Strong hands-on experience with AWS services Terraform for infrastructure as code Experience supporting Apache Spark workloads Comfortable working in agile delivery teams alongside developers, data engineers and testers preferable: GitLab CI/CD and Docker Exposure to data ...

with cloud-based data platforms and modern data stacks. Knowledge of data quality tools such as Great Expectations. Experience with orchestration tools such as Apache Airflow or Azure Data Factory (ADF). Experience with performance and large-volume data testing. Experience validating data across ETL pipelines, APIs, Excel ...

Python and Spark. Work with stakeholders to deliver robust, business-focused data solutions. Essential Skills Microsoft Fabric (hands-on platform engineering experience). Python. Apache Spark. Azure Data Factory, Databricks and Data Lake. Enterprise-scale data platform design and delivery. Experience coaching, mentoring and leading technical teams. Important This ...

Swindon (we could consider twice per fortnight etc). Required Skills & Experience Strong experience testing data pipelines/ETL processes Hands-on experience with Apache Spark Experience working with Databricks and/or AWS Glue Proven ability to build automation or testing frameworks (Python preferred) Experience with large-scale ...

complex legacy data pipelines into production-grade PySpark Building scalable, reusable data movement frameworks across multiple engineering teams Driving best practice around AWS Glue, Apache Spark and Apache Airflow Designing high-quality testing frameworks covering performance, data quality and reliability Leveraging Agentic AI development tools to improve engineering … consumed We're looking for someone with experience in Staff, Principal or Lead Data Engineering roles Python and expert-level PySpark AWS Glue Apache Spark Apache Airflow Cloud-native Data Engineering architectures Large-scale data pipeline modernisation Building reusable engineering patterns within enterprise environments Data testing, validation ...

Technical Skills: o Experience with batch processes, Guidewire Messaging framework, and OOTB plugins o Familiarity with Infra concepts and deployment architecture (WMB, WAS, and Apache) o Strong knowledge on Software architecture and design in Guidewire Ecosystem Data Analysis: Ability to write SQL queries for data analysis. GW Cloud/ ...

Technical Skills: o Experience with batch processes, Guidewire Messaging framework, and OOTB plugins o Familiarity with Infra concepts and deployment architecture (WMB, WAS, and Apache) o Strong knowledge on Software architecture and design in Guidewire Ecosystem Data Analysis: Ability to write SQL queries for data analysis. GW Cloud/ ...

. Working knowledge of Bamboo/Bitbucket. Experience with Confluence/Jira. Familiarity with ServiceNow. Basic knowledge of Linux systems. Knowledge of NGINX/Apache, Antivirus Tools (e.g., Trellix/SEP), Tanium, and Backup/BCP/DR strategies. For more information please contact Lauren Morley at JAM Recruitment ...