51 to 75 of 117 Apache Jobs in London

analytics and AI. the company is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. Benefits At the company, we strive to provide comprehensive benefits and perks that meet the needs ...

agile SDLC environment, leveraging modern programming languages, DevOps, and test-driven development Exposure to Docker, Git hands on experience with pipeline orchestration tools like Apache Airflow, Autosys, Control-M – Preferred Apache Ariflow proficient at working with large and complex code bases using GitLab/Github, Fork/Pull ...

product managers, to understand data requirements and deliver high-quality solutions Architect and implement data ingestion, transformation, and storage processes using tools such as Apache Spark, Azure Data Factory, and other similar technologies Optimize data pipeline performance, ensuring data accuracy, reliability, and timely delivery Mentor and guide junior data … Engineering, or a related field 7+ years of experience in data engineering, with at least 3 years in a leadership role Strong proficiency in Apache Spark, Azure Data Factory, and other data pipeline tools Experience with cloud platforms such as Azure, AWS, or GCP Solid understanding of data modeling ...

databases utilised in modern AI applications. Strong Python development skills. Data & Infrastructure: Experience with some of the following technologies is highly desirable: Frameworks & Infrastructure: Apache Spark Apache Airflow Kafka Elasticsearch/OpenSearch Databases: PostgreSQL MongoDB Vector databases such as Qdrant, Milvus, or pgvector Python Ecosystem: Pandas Polars Engineering ...

complex legacy data pipelines into production-grade PySpark Building scalable, reusable data movement frameworks across multiple engineering teams Driving best practice around AWS Glue, Apache Spark and Apache Airflow Designing high-quality testing frameworks covering performance, data quality and reliability Leveraging Agentic AI development tools to improve engineering … consumed We're looking for someone with experience in Staff, Principal or Lead Data Engineering roles Python and expert-level PySpark AWS Glue Apache Spark Apache Airflow Cloud-native Data Engineering architectures Large-scale data pipeline modernisation Building reusable engineering patterns within enterprise environments Data testing, validation ...

NICE FOR THE SENIOR SOFTWARE ENGINEER TO HAVE. Cloud based experience Microservice architecture or server-less architecture Big Data/Messaging technologies such as Apache Nifi/MiNiFi/Kafka TO BE CONSIDERED. Please either apply by clicking online or emailing me directly to For further information please call ...

work with Modern C++ Distributed systems Large-scale data processing High-performance microservices Data infrastructure and analytics pipelines Bonus points for SQL Boost ASIO Apache Arrow, Parquet, Protocol Buffers or FlatBuffers gRPC, REST or WebSockets Docker, Kubernetes, AWS or Google Cloud Rust, Python or Q This is an opportunity ...

best practices including CI/CD, deployment and monitoring. Mentor junior team members and contribute to technical design decisions. Essential Skills Python & SQL Databricks & Apache Spark Agentic AI/AI Agents Generative AI & LLMs RAG, Embeddings & Vector Search NLP MLflow/MLOps Experience deploying AI solutions into production Nice ...

with external clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred Preferred: Experience working with Apache Spark (TM) to process large‐scale distributed datasets Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical ...

understanding of the role of testing, DevOps etc. in the development cycle. An understanding of distributed messaging technologies, ideally including experience of JMS, Apache Pulsar or Solace. Experience with relational databases, such as MS SQL Server. Knowledge of frameworks such as Spring, Spring Boot, and Project Reactor/Spring ...

bring mission‐critical software, analytics, and AI to life and is the company behind Astro, the industry‐leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data‐driven applications. Trusted by more than ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

interactive user interfaces using Core Java, Kotlin, Spring Boot, and ReactJS. Real-Time Data Processing: Build and maintain scalable event-driven architectures utilizing Apache Kafka and Apache Flink for real-time risk data streaming. API & Integration Engineering: Design, implement, and maintain high-performance RESTful APIs and gRPC services … Cloud Services, Kubernetes. Additional Technical & Functional Competencies Frontend Architecture: TypeScript, JavaScript (ES6+), Redux/Context API, HTML5, CSS3, REST/gRPC integration. Streaming & Messaging: Apache Kafka, Apache Flink. APIs & Protocols: RESTful web services, gRPC, JSON, Protocol Buffers. Core Computer Science: Strong mastery of data structures, algorithms, object-oriented ...

operating data pipelines and analytical systems using technologies such as Google BigQuery, Amazon Athena, or ClickHouse. Experience with distributed data processing frameworks such as Apache Spark and/or Apache Flink. Experience with messaging and streaming systems such as Apache Kafka or Apache Pulsar. Experience working ...

Develop and maintain data pipelines using Python, SQL, and Apache Airflow. • Containerise data applications and workflows using Docker. • Build and optimise data solutions using AWS services including: • Redshift, OpenSearch, Lambda, Glue, Step Functions, and Batch. • Collaborate with cross-functional teams to deliver robust, secure, and scalable data infrastructure. • Manage … improvement initiatives. • Ensure data quality, governance, and security best practices are followed. Requirements Strong programming skills in Python and proficiency in SQL. Experience with Apache Airflow for DAG orchestration and monitoring. Hands-on experience with Docker for containerisation. Proficient in AWS data services: Redshift, OpenSearch, Lambda, Glue, Step Functions ...

with cross-functional teams, and mentoring junior engineers. Ideal candidates will have over 7 years of experience in data engineering, proficiency in tools like Apache Spark and Azure Data Factory, and familiarity with AI and machine learning concepts. This role offers a dynamic work environment, promoting innovation and continuous ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

downstream systems, including trader-facing tools. Your experience 5+ years software engineering experience in building distributed systems. Excellent Java skills Experience with streaming technologies (Apache Flink preferred; Kafka Streams, Spark Streaming, etc.). Solid understanding of event-driven architecture and asynchronous processing patterns. Experience handling data consistency challenges such ...

operating data pipelines and analytical systems using technologies such as Google BigQuery, Amazon Athena, or ClickHouse. Experience with distributed data processing frameworks such as Apache Spark and/or Apache Flink. Experience with messaging and streaming systems such as Apache Kafka or Apache Pulsar. Experience working ...

production-grade solutions using BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Composer . Frameworks & Storage: Strong understanding of batch/streaming tools (e.g., Apache Spark, Apache Beam ) and when to apply different storage paradigms (relational, columnar, document, data lakes). Modern Best Practices: Active practice with version ...

root‐cause analysis. Experience building or supporting production data pipelines in a collaborative engineering environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . Technology Environment The role will involve working with … should bring relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised ...

root‐cause analysis. Experience building or supporting production data pipelines in a collaborative engineering environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . Technology Environment The role will involve working with … should bring relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised ...

iManage Work 10, Preview Servers, RAVN, iManage Mobility, Threat Manager, Co-Authoring, Closing Folders, SPM, Litera CAM, GDSI Core Platforms: Windows Server 2016-2022, Apache, Linux, Windows OS, MacOS, AVD This role reports to the Senior Manager of Desktop and Application Services. Responsibilities include: Application Management Administer, configure ...

projects, designing production-grade systems, and working cross-functionally to meet customer needs. Ideal candidates will have expertise in data engineering, cloud ecosystems, and Apache Spark. #J-18808-Ljbffr ...