326 to 350 of 422 Apache Jobs in the UK

DevOps knowledge, including Linux/Unix, OpenShift/Kubernetes, and Ansible. Experience building and supporting reactive, event-sourced systems. Hands-on experience with Apache Spark and Apache Flink. Strong understanding of Apache HTTP, Envoy, and REST API design. Experience working with Protobuf, Avro, and Parquet data formats. ...

engineer with strong experience in streaming technologies, event-driven architecture, and distributed data systems. The Role Design and build real-time data pipelines using Apache Flink , Apache Kafka , and AWS Kinesis Develop scalable event-driven and streaming solutions Integrate data from source systems including Oracle, MySQL, and Sybase … enrichment, and quality capabilities Deliver low-latency data into enterprise data platforms Create and manage infrastructure using Terraform Skills & Experience Strong commercial experience with Apache Flink Strong experience with Apache Kafka Experience with AWS Kinesis Advanced SQL skills and strong relational database knowledge Experience working with Oracle, MySQL ...

Management Stakeholder Collaboration Leadership & Mentorship Technology Stack The successful candidate will have experience working with some or all of the following technologies: Data Processing: Apache Spark/PySpark Workflow Orchestration: Apache Airflow Containerisation: Kubernetes Cloud Platform: Microsoft Azure Data APIs & Semantic Layer: CubeJS Programming Languages: Python, SQL Essential ...

Management Stakeholder Collaboration Leadership & Mentorship Technology Stack The successful candidate will have experience working with some or all of the following technologies: Data Processing: Apache Spark/PySpark Workflow Orchestration: Apache Airflow Containerisation: Kubernetes Cloud Platform: Microsoft Azure Data APIs & Semantic Layer: CubeJS Programming Languages: Python, SQL Essential ...

work independently or as part of a team and operate to tight deadlinesSense of humour pleaseAdvantageous But Not a Must: Great knowledge of Apache, specifically Mod RewriteGood working knowledge of Linux, including command lineServer administration experienceEcommerce experienceSmartyCompetitive SalaryCareer Growth and Financial StabilityExcellent Benefits: Opportunity to work ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

Options trading desk to translate business needs into scalable software solutions. You will contribute hands-on development using Core Java, Kafka, CouchbaseDB, and Apache Storm, while mentoring engineers and shaping architectural direction for the bank's risk platform. #J-18808-Ljbffr ...

architecture, acting as the design authority to ensure secure, scalable, auditable solutions across classified environments. The position requires extensive experience with AWS data platforms, Apache NiFi, API #J-18808-Ljbffr ...

experience writing high-quality production code Strong foundation in operating systems and systems programming Proven track record in performance engineering Familiarity with tools like Apache Arrow, Parquet, DataFusion, Clickhouse, or DuckDB is a plus Understanding of cutting-edge ML infrastructure stack (e.g. PyTorch, CUDA) is also a plus Experience ...

including new capabilities like the E-7 AEW&C and the P-8A Maritime Patrol Aircraft, Autonomous Systems, C4ISR Services, Support for the Chinook & Apache Fleets, Logistic Information Services and Training Services and are very much in a growth phase. Responsibilities: As the Boundary Cell you shall ...

help strengthen pre and post-change validation, enhance observability, and support the continuous improvement of automation capabilities. Technology Stack Linux/UNIX Python Ansible Apache Airflow Prometheus Grafana Loki VMware F5 What We're Looking For We're looking for engineers with: Strong Linux/UNIX administration fundamentals Experience ...

Programming Languages: Bash, PHP, GoLang Virtualisation: We have a custom hypervisor (ZPF) but things like VMWare ESXi/KVM/oVirt/RHEV Classics: Apache, MySQL, Redis, Varnish Logstash & Elasticsearch Networking (switching, routing, firewalls, IDS/IPS, VPN, load balancing, DNS, Cisco, F5, Akamai) Multi cloud setup - AWS, Digital ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

ready data processing solutions using BigQuery, Pub/Sub, Dataflow and DataprocExperience developing end-to-end solutions using batch and streaming frameworks such as Apache Spark and Apache Beam. Expert understanding of when to use a range of data storage technologies including relational/non-relational, document ...

platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/ ...

platforms for performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/ ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real-time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability ...

design, develop, deploy, and optimize scalable data solutions on Microsoft Azure. The ideal candidate will bring strong hands-on expertise in Azure Databricks, Apache Spark, PySpark, Python, and SQL, with proven experience building production-grade data pipelines, implementing governance through Unity Catalog, and automating deployments using GitLab-based …/CD and Databricks Asset Bundles. Key Responsibilities Design, build, test, and maintain scalable batch and streaming data pipelines using Azure Databricks, Apache Spark, PySpark, Python, SQL, and Delta Lake. Develop reusable ETL and ELT frameworks for data ingestion, transformation, validation, and publishing across lakehouse layers. Design and manage ...

Lead the engineering delivery and technical direction for a scalable, multi-tenant data integration platform on Google Cloud Platform (GCP). The platform uses Apache Airflow to orchestrate ETL pipelines and enables reliable movement of data from source systems through the platform into downstream vendor systems. Youll guide … contribution where needed (critical ETLs, framework components, design spikes, performance fixes). ETL orchestration & data movement Design and develop robust ETL pipelines orchestrated in Apache Airflow, including scheduling strategies, dependency management, retries, backfills, and processing. Establish patterns for onboarding new source systems and delivering data to downstream vendor systems ...

scale a multi-tenant data integration platform on Google Cloud Platform. You’ll lead the design and delivery of reliable ETL pipelines using Apache Airflow, improve CI/CD and platform automation, and create clear end-to-end data lineage from source systems to downstream vendors. What … governance, and vendor teams. What you’ll bring: Proven experience as a Technical Lead, Lead Engineer, or Senior Data Engineer. Strong production experience with Apache Airflow, Python, and ETL/ELT pipelines. Hands-on GCP experience with services such as BigQuery, Cloud Storage, Pub/Sub, Dataflow ...