17 of 17 Contract Apache Jobs in England

Data Engineer 6 Month Contract Location: London (Onsite 4 days a week) Rate: £700 - £800 per day (INSIDE IR35) Skills: Python, Azure, Kubernetes, Apache Airflow, Apache Spark, DV Clearance We are looking to recruit a DV Cleared Data Engineer for a leading technology consultancy. This will be joining … Work across Azure environments on the low side Support data engineering workloads within Kubernetes environments on the high side Develop and maintain workflows using Apache Airflow Work with Apache Spark for large-scale data processing Support the ongoing development and improvement of established data pipelines Help ensure data ...

Jenkins, Bamboo, Concourse etc. Monitoring utilising products such as: Prometheus, Grafana, ELK, filebeat etc. Observability - SRE Big Data solutions (ecosystems) and technologies such as: Apache Spark and the Hadoop Ecosystem Edge technologies e.g. NGINX, HAProxy etc. Excellent knowledge of YAML or similar languages It is essential for this role ...

query optimisation C#, ASP.NET and .NET Core Cosmos DB SDKs and NoSQL data modelling Change Data Feed and Spark integration PySpark and Apache Spark Microsoft Fabric data pipelines Partitioning, indexing and consistency levels Pytest and automated testing Git and GitLab DevOps/CI pipelines Scalable application and concurrency patterns ...

enhancement programme. Investment Data Engineer, key skills: Strong commercial experience in Data Engineering, particularly using Snowflake Proven experience developing and maintaining workflows using Apache Airflow and DBT (Data Build Tool) Experience integrating and supporting Bloomberg data feeds, services or associated investment data solutions Strong SQL development and data modelling ...

Strong incident identification, investigation, resolution and recovery skills. - Experience working to service level agreements and established service management processes. ITIL 4 Foundation. Linux experience. Apache NiFi experience. Strong problem-solving, communication and interpersonal skills. A proactive, independent and adaptable approach. Ability to work with minimal supervision and take initiative. ...

service and critical incident reports. Leadership: Mentor support engineers, maintain strong client relationships, and coordinate UK datacentre visits when required. Requirements Essential Technical: Linux, Apache NiFi. Knowledge: ITIL 4 Foundation. Traits: Proactive, independent, adaptable, strong problem-solver with excellent interpersonal skills. Desirable Tech Stack Active Directory (ADDS), DNS, Network ...

other genome browser Experience working in a multi-person team delivering production services Experience with large-scale biological datasets Experience working with the Apache Parquet file format Experience implementing AI/ML approaches for quality control and/or genome annotation Behaviours we value in our team: You bring ...

Role As a Senior Data Engineer, you'll take ownership of the design, development and optimisation of production-grade data solutions using Databricks, Apache Spark and Delta Lake. Your responsibilities will include: Designing, building and optimising scalable ETL/ELT data pipelines using Databricks, PySpark and Spark SQL Implementing … engineering skills with the ability to take technical ownership of complex data solutions. You'll ideally have: Strong commercial experience with Databricks Excellent PySpark, Apache Spark and Spark SQL skills Experience building production-grade ETL/ELT pipelines Strong knowledge of Delta Lake and Lakehouse architecture Experience implementing Medallion ...

Lead the engineering delivery and technical direction for a scalable, multi-tenant data integration platform on Google Cloud Platform (GCP). The platform uses Apache Airflow to orchestrate ETL pipelines and enables reliable movement of data from source systems through the platform into downstr click apply for full ...

working as a Data Architect within the Defence space. Active DV Clearance and sole UK nationality Strong AWS data lake, platform and security expertise Apache NiFi architecture, governance and pipeline delivery Secure data integration experience across multiple security domains API, file-based, legacy and bespoke integration design and delivery ...

UK. Strong commercial Java development experience. Experience with popular Java frameworks, such as Spring, Hibernate, Struts or JSF. Experience with Java libraries, such as Apache Commons or Guava. Familiarity with microservices architecture and related technologies, including Docker, Kubernetes and Swagger. Previous public sector experience. Ability to develop clean, maintainable ...

Boot. Design and implement cloud-native solutions on AWS. Perform database query optimization and performance tuning. Work on ETL/Data Processing solutions using Apache Flink. Integrate enterprise applications, databases, and third-party systems. Participate in application architecture discussions, code reviews, and performance optimization initiatives. Deploy and maintain applications …/EKS CloudWatch IAM SNS/SQS VPC Database & Data Processing Skills Oracle SQL Server PostgreSQL MySQL Database Query Performance Tuning SQL Optimization Apache Flink ETL DevOps & Tools Git Jenkins Maven Docker Kubernetes SonarQube JIRA Agile/Scrum Required Qualifications Bachelor's or Master's degree in Computer Science ...

engineer with strong experience in streaming technologies, event-driven architecture, and distributed data systems. The Role Design and build real-time data pipelines using Apache Flink , Apache Kafka , and AWS Kinesis Develop scalable event-driven and streaming solutions Integrate data from source systems including Oracle, MySQL, and Sybase … enrichment, and quality capabilities Deliver low-latency data into enterprise data platforms Create and manage infrastructure using Terraform Skills & Experience Strong commercial experience with Apache Flink Strong experience with Apache Kafka Experience with AWS Kinesis Advanced SQL skills and strong relational database knowledge Experience working with Oracle, MySQL ...

Lead the engineering delivery and technical direction for a scalable, multi-tenant data integration platform on Google Cloud Platform (GCP). The platform uses Apache Airflow to orchestrate ETL pipelines and enables reliable movement of data from source systems through the platform into downstream vendor systems. Youll guide … contribution where needed (critical ETLs, framework components, design spikes, performance fixes). ETL orchestration & data movement Design and develop robust ETL pipelines orchestrated in Apache Airflow, including scheduling strategies, dependency management, retries, backfills, and processing. Establish patterns for onboarding new source systems and delivering data to downstream vendor systems ...

Data Engineer 6 Month Contract Location: London (Onsite 4 days a week) Rate: £700 - £800 per day (INSIDE IR35) Skills: Python, Azure, Kubernetes, Apache Airflow, Apache Spark, DV Clearance We are looking to recruit a DV Cleared Data Engineer for a leading technology consultancy click apply for full ...

Requirements: Proven commercial experience working as a Data Architect within the Defence space. Active DV Clearance. Strong AWS data engineering experience Hands-on Apache NiFi expertise Experience delivering secure ETL/ELT and data integration pipelines Ability to lead technical delivery teams and mentor engineers Strong stakeholder management … communication skills AWS data platforms and secure engineering Apache NiFi pipeline development and support API, file-based, legacy and bespoke integrations Data mapping, transformation and validation CI/CD, DevSecOps and release management Testing (unit, integration, performance and security) Monitoring, logging, alerting and operational support Nice to have ...

bespoke integration approaches for source-system onboarding. Define conceptual, logical and physical data models, including data flows, data domains and data ownership considerations. Specify Apache NiFi architecture patterns, flow standards, interface contracts and reusable ingestion components. Define governance, metadata, lineage, auditability, security monitoring and data quality requirements. Produce High … lake architectures on AWS. Strong knowledge of AWS security, IAM, networking, storage and data platform services relevant to secure data engineering. Extensive experience with Apache NiFi architecture, flow design, governance and operational considerations. Experience designing integrations using REST APIs, SOAP services, file transfers, batch ingestion, legacy adapters and bespoke ...