16 of 16 Apache Jobs in the City of London

pipelines, deployment automation and infrastructure-as-code practices. What We're Looking For Essential Strong commercial experience building production-grade data pipelines using Apache Spark (PySpark preferred). Experience delivering modern data platforms using Databricks or an equivalent Spark-based platform. Strong SQL skills and experience with data modelling. ...

while collaborating with the Data & Analytics Lead, technical colleagues and business stakeholders. Experience in the following areas would also be useful: Materialised Lake Views Apache Spark or Python. APIs and cloud business system integration. Data governance, lineage and quality frameworks. What We Offer A hands-on role developing ...

able to guide how one could deploy infrastructure into different environments. Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop. Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes) Ability to create data ...

management and international regulatory compliance. YOUR SKILLS AND EXPERIENCE ESSENTIAL CRITERIA Strong experience designing, building and maintaining scalable data pipelines and integration solutions using Apache Airflow (or similar orchestration platforms), Python, SQL and bash/linux. Experience developing cloud-native data platforms and solutions on AWS, including working with ...

Protect, AppViewX or equivalent. * Public and private CA integration; HSM and key-management integration; secure key generation, storage, backup & recovery. * Certificate deployment across IIS, Apache, NGINX, Java, databases, load balancers, firewalls, proxies, network appliances and enterprise applications. * ACME, SCEP, EST, REST API & agent/connector-based certificate automation. * Operational ...

preferred knowledge of AI infrastructure. Proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Proven experience ...

knowledge of AI infrastructure. Good proficiency in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem‐solving skills and ability to work in a fast‐paced environment. Excellent communication and collaboration skills. Significant experience ...

infrastructure. Well versed and proven experience in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem‐solving skills and ability to work in a fast‐paced environment. Excellent communication and collaboration skills. Longstanding experience ...

Mockito Experience with clean architecture, DI, modular design Comfortable owning CI/CD, code quality, observability Familiarity with Docker, Maven, Jenkins ⭐ Nice to Have Apache Calcite Starburst or federated query engines JVM performance tuning High-throughput service interfaces (REST/gRPC) Data governance or policy enforcement layers 👥 This Role ...

Senior Data Engineer to lead the Astronomer Astro deployment within a hybrid environment. The role focuses on building, deploying and operationalizing Astronomer Astro, Apache Airflow, and integrated data pipelines. You will collaborate with the data engineering team, mentor peers, and drive best practices for production readiness, monitoring and documentation ...

bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than … this role: Astronomer is on a mission to make DataOps a first-class discipline in every modern data organization. As the driving force behind Apache Airflow, we're powering mission-critical pipelines at scale for companies like Condé Nast, Rappi, Sonos, and more. As a Sales Engineer at Astronomer ...

change data capture (CDC), ETL/ELT and orchestration. A good understanding of relational and non-relational databases, open table formats (e.g. Delta Lake, Apache Iceberg), and data storage and lifecycle design. Practical knowledge of data governance, including cataloguing, lineage, data quality, ownership, classification and access policy, with tools … Associate/Fabric Analytics Engineer Associate. Experience with major cloud data services on Azure, AWS or Google Cloud. Knowledge of streaming platforms such as Apache Kafka or cloud-native equivalents. Familiarity with BI and semantic tooling, such as Power BI semantic models, or the Databricks/Snowflake semantic capabilities. ...

Java and related technologies. Document code and processes to support knowledge sharing within the team. Profile Must haves: 2+ years industry experience Java Linux Apache Mongo/Postgres AI - prompt engineering or AI-assisted development (Claude, Cursor etc) Worked on a broker platform or similar industry experience a huge ...

Consultant to support the implementation and deployment of Astronomer (Astro) within a leading asset management organisation. Job Responsibilities/Objectives Astronomer is built around Apache Airflow and is used to develop, schedule, automate and manage complex data pipelines. The organisation is currently implementing the platform and requires an experienced … ownership of the implementation and providing training and support to upskill the wider team. Experience with Astronomer/Astro is essential, alongside knowledge of Apache Airflow, dbt and Snowflake. Key Responsibilities Lead the implementation, build and deployment of Astronomer (Astro). Configure and manage Apache Airflow to schedule ...

Engineering Strong experience working with AWS in data engineering environments. Hands‐on experience with AWS Glue for data integration and processing. Strong experience using Apache Airflow for workflow orchestration and pipeline management. Advanced Python development skills. Experience with Apache Spark or similar distributed data processing technologies would ...

designing, building, testing, and operating) of real-time data processing pipelines, utilizing at least one core streaming or real-time analytics technology such as Apache Kafka (including Kafka Streams), Apache Flink, or ClickHouse. Experience designing and implementing APIs within distributed software architectures. Experience with Git, automated testing, Kubernetes ...