251 to 275 of 304 Apache Jobs in England

systèmes distribués La participation aux choix d’architecture et aux design reviews Environnement technique Langages : Rust (principal) Architectures distribuées : microservices, API gRPC Middleware : Apache Pulsar, RabbitMQ Cloud : AWS Stockage HPC : Lustre (ou équivalent) Réseaux (atout) : RDMA, libfabric GPU (connaissances appréciées) : CUDA, architecture mémoire Profil recherché Expérience significative en développement ...

practices. Responsibilities will include: Providing Staff-level technical leadership across complex data engineering and modernisation initiatives. Remaining deeply hands‐on with Python, PySpark and Apache Spark , independently building and proving engineering solutions. Designing and optimising scalable data pipelines and processing frameworks across AWS . Tackling complex Spark performance challenges … including shuffles, joins, data skew, partitioning and memory optimisation. Designing and challenging engineering approaches across AWS Glue, Apache Airflow and associated technologies. Reviewing existing code, identifying performance bottlenecks and driving improvements in engineering quality. Establishing reusable engineering patterns, frameworks and approaches to accelerate large‐scale data migrations. Applying ...

technical design reviews. Must Haves (Hard Skills) Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake. Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi-structured financial data logs (JSON/… such as dbt) and scheduling tools (such as Airflow). Stream/Message Queues: Solid understanding of event-driven architectures and streaming processing via Apache Kafka. Strong Programming Foundations: Proficiency in Python, SQL, or an Object-Oriented language (Java/Scala). Nice to Haves Experience operating data assets ...

pipelines using Python and PySpark Building and optimising data workflows using AWS Glue, Athena, Redshift , and related AWS services Supporting modern lakehouse architectures, including Apache Iceberg Working with relational and NoSQL databases to ensure data is reliable and fit for purpose Collaborating with analysts, engineers, product owners, and stakeholders … Athena, Amazon Redshift , and cloud‐based data platforms Strong SQL skills and experience working with both relational and NoSQL databases Experience supporting or developing Apache Iceberg or modern lakehouse solutions Experience working in Agile delivery environments Familiarity with Linux and Git‐based version control Desirable experience Experience with Amazon ...

MLflow, VS Code or JupyterHub for model development, experimentation and deployment.* Work with technologies to access, manage and analyse data at scale (e.g., Apache Iceberg and Trino).**Delivery Excellence*** Participate fully in Agile ceremonies including sprint planning, backlog refinement, demonstrations and retrospectives.* Produce high-quality technical documentation … machine-learning models, including monitoring, drift detection and performance management.* Awareness of modern lakehouse or enterprise data platforms and technologies such as Trino and Apache Iceberg.* Experience in NLP, large language models, Generative AI, deep learning, graph analytics.* Responsible AI or retrieval-augmented generation.* Delivery of data products ...

MLflow, VS Code or JupyterHub for model development, experimentation and deployment. Work with technologies to access, manage and analyse data at scale (e.g., Apache Iceberg and Trino). Delivery Excellence Participate fully in Agile ceremonies including sprint planning, backlog refinement, demonstrations and retrospectives. Produce high-quality technical documentation … machine-learning models, including monitoring, drift detection and performance management. Awareness of modern lakehouse or enterprise data platforms and technologies such as Trino and Apache Iceberg. Experience in NLP, large language models, Generative AI, deep learning, graph analytics. Responsible AI or retrieval-augmented generation. Delivery of data products ...

robust, efficient, and ready to support advanced analytics and business insights. Responsibilities Design, develop, and implement large-scale data pipelines using tools such as Apache Spark, Hadoop, and Apache Hive to process vast amounts of structured and unstructured data. Collaborate with cross-functional teams to understand data requirements … with SQL-based databases including Oracle and Microsoft SQL Server; solid understanding of database design principles. Familiarity with big data frameworks like Hadoop, Spark, Apache Hive, and related ecosystem components. Experience working with ETL tools such as Informatica for data integration tasks. Demonstrated ability to analyze complex datasets using ...

Apache Associates is seeking a Project Manager to lead SaaS and ERP implementation projects from planning through go-live. You will coordinate cross-functional teams, manage timelines, and ensure delivery to client expectations. The role requires proven experience in SaaS deployments and ERP projects, strong organisation, stakeholder communication ...

Apache Associates is seeking a Project Manager to lead SaaS and ERP implementation projects from planning through go-live. You will coordinate cross-functional teams, manage timelines, and ensure delivery to client expectations. The role requires proven experience in SaaS deployments and ERP projects, strong organisation, stakeholder communication ...

Apache Associates is looking for an organised, proactive Service Delivery Manager to lead Level 1 and Level 2 Support teams and Project Engineers. You will own day-to-day delivery of managed services and client projects, ensuring SLA adherence and clear communication to clients. The role offers a hybrid ...

cloud-scale storage systems. Ideal candidates should have over 5 years of experience and a strong background in operating systems. Familiarity with tools like Apache Arrow and an understanding of machine learning infrastructure are preferred. The role requires in-person work in either NYC or London, supporting innovative storage ...

client base. Key Responsibilities The successful candidate will be responsible for: Developing, maintaining, and optimising backend services using PHP and the LAMP stack (Linux, Apache, MySQL, PHP). Working with version control, primarily GIT, to manage and track code changes. Debugging issues and reviewing code from peers to ensure ...

Consultant to support the implementation and deployment of Astronomer (Astro) within a leading asset management organisation. Job Responsibilities/Objectives Astronomer is built around Apache Airflow and is used to develop, schedule, automate and manage complex data pipelines. The organisation is currently implementing the platform and requires an experienced … ownership of the implementation and providing training and support to upskill the wider team. Experience with Astronomer/Astro is essential, alongside knowledge of Apache Airflow, dbt and Snowflake. Key Responsibilities Lead the implementation, build and deployment of Astronomer (Astro). Configure and manage Apache Airflow to schedule ...

skills, including complex stored procedures, transformations and query optimisation. Deep understanding of MPP architecture, distributed tables, execution plans and performance tuning. Databricks & Apache Spark Extensive commercial experience with Azure Databricks, Spark SQL, Databricks SQL and PySpark. Strong understanding of Apache Spark execution, data distribution, joins, shuffles and performance ...

British nationals only; dual citizenship is not permitted The opportunity We're urgently looking for an experienced Data Engineer with strong AWS, Python and Apache Airflow skills to join a programme on an initial six-month contract. You'll help build and maintain reliable data pipelines, develop cloud-based … essential. What you'll be doing Developing and maintaining data pipelines using Python and AWS services. Building, scheduling and monitoring data workflows with Apache Airflow. Integrating data from multiple sources and preparing it for downstream use. Improving pipeline reliability, performance and data quality. Investigating data processing issues and implementing ...

organisation. Responsibilities: Build scalable ETL and ELT pipelines within AWS Develop and optimise data models in Amazon Redshift Create and manage workflows using Apache Airflow Integrate NetSuite and other Finance data sources Establish trusted data-quality, monitoring and validation processes Own solutions from initial requirements through to production Experience … Required: Strong commercial Python and SQL experience Hands‐on experience with AWS data services Amazon Redshift or comparable cloud data‐warehouse experience Apache Airflow or similar orchestration experience Strong ETL/ELT, data‐modelling and production pipeline knowledge The confidence to work directly with Finance and technical stakeholders Experience ...

reliability, scalability and performance of existing data infrastructure while building the foundations for future ML and AI initiatives.The current stack includes:Data Engineering: Apache Iceberg, Kafka, Parquet and Amazon AthenaCloud Infrastructure: AWS-native data lake architecture, data ingestion, processing and storageArchitecture: AWS-based data lake (~5TB), with opportunities … data processing, streaming architectures and data pipeline optimisationSomeone who enjoys end-to-end ownership, technical problem-solving and working without layers of bureaucracyExperience with Apache Iceberg, Kafka, Parquet or Athena is highly desirable, while exposure to SageMaker or ML infrastructure is a bonus - production data engineering expertise ...

reliability, scalability and performance of existing data infrastructure while building the foundations for future ML and AI initiatives. The current stack includes: Data Engineering: Apache Iceberg, Kafka, Parquet and Amazon Athena Cloud Infrastructure: AWS-native data lake architecture, data ingestion, processing and storage Architecture: AWS-based data lake … streaming architectures and data pipeline optimisation Someone who enjoys end-to-end ownership, technical problem-solving and working without layers of bureaucracy Experience with Apache Iceberg, Kafka, Parquet or Athena is highly desirable, while exposure to SageMaker or ML infrastructure is a bonus - production data engineering expertise ...

clear SLAs and backups. Own the observability platform (ClickHouse, OpenTelemetry): logs, metrics, traces, synthetics, SLOs and actionable alerting. Own the data platform: Glue pipelines, Apache Iceberg lakehouse, Redshift and CDC; serve BI users with traceable datasets and handle data requests with strong privacy practice. Operate platform security controls (identity … security practice; willing to participate in the on‐call rota. Excellent communication; comfortable prioritising, working with stakeholders and reporting upwards. Desirable ClickHouse, Redshift or Apache Iceberg; data engineering with AWS Glue or Spark. Delivering the technical side of a security standard (Cyber Essentials Plus, ISO 27001). Experience overseeing ...

Build repeatable evaluations, investigate failure cases and use the results to guide model and pipeline improvements. Orchestrate data and model workflows. Build and maintain Apache Airflow pipelines, with monitoring, retries and clear approaches to failure recovery. Deploy and operate AI services. Work with AWS services including Lambda, ECS/… through unfamiliar problems. You’re comfortable discussing trade-offs, asking questions and taking responsibility for delivery. Useful additional experience LLMs or NLP, GPU workloads, Apache Airflow, AWS, infrastructure-as-code tools such as Pulumi, or financial-market data. You don’t need experience with every tool in our stack. ...

designing, building, testing, and operating) of real-time data processing pipelines, utilizing at least one core streaming or real-time analytics technology such as Apache Kafka (including Kafka Streams), Apache Flink, or ClickHouse. Experience designing and implementing APIs within distributed software architectures. Experience with Git, automated testing, Kubernetes ...

designing, building, testing, and operating) of real-time data processing pipelines, utilizing at least one core streaming or real-time analytics technology such as Apache Kafka (including Kafka Streams), Apache Flink, or ClickHouse. Experience designing and implementing APIs within distributed software architectures. Experience with Git, automated testing, Kubernetes ...

Familiarity with PostgreSQL and Snowflake Preferred: Familiarity with Web Frameworks such as Django, Flask or FastAPI Preferred: Familiarity with event streaming platforms such as Apache Kafka Preferred: Familiarity with data pipeline platforms such as Apache Airflow Preferred: Familiarity with Java Preferred: Experience in one or more relevant financial ...

related field. Solid programming skills in both Python and SQL. Proven work experience in Google Cloud Platform or other clouds, developing batch (Apache Airflow) and streaming (Dataflow) scalable data pipelines. Passion for processing large datasets at scale (BigQuery, Apache Druid, Elasticsearch) Familiarity with Terraform, DBT & Looker ...

critical to meeting Nomura’s regulatory and internal liquidity reporting requirements.Architect, develop, and enhance a large-scale data processing platform using Scala and Apache Spark on AWS \ MinIO.Work closely with business users to analyse business requirements and deliver high-quality data for regulatory reporting, including liquidity and risk metrics.Contribute … English with strong written & verbal communication skillsExcellent teamwork skills, comfortable with working as part of a globally spread-out teamPreferred:Scala ExperienceExperience with Apache Spark SQL/DataframesKnowledge of Basel III and liquidity reportingExposure and interest in using AI coding tools such as Claude Code and GitHub CopilotNomura Leadership ...