126 to 150 of 191 Apache Jobs in London

Nomura is seeking a Software Developer to join the GLAD team in London. You will work on server-side data processing, using Scala and Apache Spark on AWS MinIO to deliver accurate liquidity and regulatory metrics. Role requires experience with Java/Python/Scala, relational databases, and Linux. ...

Mockito Experience with clean architecture, DI, modular design Comfortable owning CI/CD, code quality, observability Familiarity with Docker, Maven, Jenkins ⭐ Nice to Have Apache Calcite Starburst or federated query engines JVM performance tuning High-throughput service interfaces (REST/gRPC) Data governance or policy enforcement layers 👥 This Role ...

understanding of the role of testing, DevOps etc. in the development cycle. An understanding of distributed messaging technologies, ideally including experience of JMS, Apache Pulsar or Solace Experience with relational databases, such as MS SQL Server. Nice to have Knowledge of frameworks such as Spring, Spring Boot, and Project ...

with downstream systems, including trader‐facing tools. Experience 5+ years software engineering experience in building distributed systems. Excellent Java skills. Experience with streaming technologies (Apache Flink preferred; Kafka Streams, Spark Streaming, etc.). Solid understanding of event‐driven architecture and asynchronous processing patterns. Experience handling data consistency challenges such ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

3+ years experience working in version control environments using platforms such as Gitlab or Github 2+ years experience working with job orchestration tools like Apache Airflow, both as a pipeline developer and reviewer 2+ years experience with data ingestion and transformation frameworks (e.g., dbt, Fivetran, or custom/ ...

Experience with JavaScript and Python 3.8+ Familiarity with modern web standards, including HTML5 and CSS3 Experience with Linux or UNIX-like systems Experience with Apache and ReactJS Experience with SQL Databases such as PostgreSQL Experience with Python unit testing and full-stack web testing Benefits and Perks of working ...

data engineering, with demonstrated expertise in designing and implementing scalable, flexible modern data architectures Experience building modern data lake/lakehouse architectures (e.g., Apache Iceberg) in cloud environments Strong knowledge of AWS (S3, Redshift) or Azure data services Experience with ETL/ELT processes and data ingestion Proven expertise … using transformation tools such as dbt Experience with data pipeline orchestration tools (such as Apache Airflow) Experience with best practices applied to data (e.g., testing, CI/CD) Advantageous Experience developing dashboards and reporting solutions using data visualization tools such as Power BI or Amazon QuickSight Experience with generative ...

Liquidity Architecture Delivery team. You will develop server-side processes and help build a large-scale data platform using Java/Python/Scala, Apache Spark, on AWS/MinIO, delivering data for regulatory reporting. The role requires fluent English, Linux experience, teamwork in a globally distributed group ...

debugging Configuration management systems such as Saltstack, Chef, Puppet or Ansible Load balancing and reverse proxies such as Nginx, Varnish, HAProxy, Squid or Apache SQL databases Time series databases such as OpenTSDB, Graphite, Prometheus or Grafana Bonus Points Experience with continuous/rapid release engineering Strong tooling and automation ...

Senior Data Engineer to lead the Astronomer Astro deployment within a hybrid environment. The role focuses on building, deploying and operationalizing Astronomer Astro, Apache Airflow, and integrated data pipelines. You will collaborate with the data engineering team, mentor peers, and drive best practices for production readiness, monitoring and documentation ...

first senior data hire, reporting directly to founders and shaping the data platform from the ground up. The role requires strong Python, SQL, and Apache technologies experience, with on-site work in London four days per week and a compensation package of up to £160,000 plus equity. #J ...

bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. Benefits We strive to provide comprehensive benefits and perks that meet the needs of all our employees. Our Commitment ...

TypeScript, Next.js, or LightningJS Experience with platforms and tools such as Node.js, GraphQL, GitHub, AWS, Azure, GCP, Cloudflare, Firebase, Mixpanel, Contentful, Vercel, Xcode, and Apache Nice-To-Have: Experience with React Native, Swift, and SwiftUI Experience with web and cloud infrastructure and deployment workflows Experience building tools or experiences ...

working with cloud‐native technologies, and applying robust software engineering practices. Key Responsibilities Design, develop, and optimise scalable, testable data pipelines using Python and Apache Spark. Implement batch workflows and ETL processes adhering to modern engineering standards. Develop Cloud-Based Workflows Orchestrate data workflows using AWS services such … Glue, EMR Serverless, Lambda, and S3. Contribute to the evolution of lakehouse architecture leveraging Apache Iceberg. Apply Software Engineering Best Practices Use version control, CI/CD pipelines, automated testing, and modular code principles. Participate in pair programming, code reviews, and architectural design sessions. Data Quality & Observability Build monitoring ...

bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than … this role: Astronomer is on a mission to make DataOps a first-class discipline in every modern data organization. As the driving force behind Apache Airflow, we're powering mission-critical pipelines at scale for companies like Condé Nast, Rappi, Sonos, and more. As a Sales Engineer at Astronomer ...

related disciplines within enterprise environments 4+ years of hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform Strong expertise in Apache Spark, SQL, Python, Delta Lake, and modern data engineering practices Experience building and optimizing Extract, Transform, Load and Extract, Load, Transform data pipelines for scalable … solutions on the Databricks Lakehouse Platform. Design and implement scalable data and analytics solutions leveraging Databricks technologies Build, maintain, and optimize data pipelines using Apache Spark, SQL, Python, and Delta Lake Develop governed datasets and data products that support reporting, analytics, and artificial intelligence initiatives Partner with business stakeholders ...

change data capture (CDC), ETL/ELT and orchestration. A good understanding of relational and non-relational databases, open table formats (e.g. Delta Lake, Apache Iceberg), and data storage and lifecycle design. Practical knowledge of data governance, including cataloguing, lineage, data quality, ownership, classification and access policy, with tools … Associate/Fabric Analytics Engineer Associate. Experience with major cloud data services on Azure, AWS or Google Cloud. Knowledge of streaming platforms such as Apache Kafka or cloud-native equivalents. Familiarity with BI and semantic tooling, such as Power BI semantic models, or the Databricks/Snowflake semantic capabilities. ...

mindset focused on automation, reliability, and maintainable solutions.## **Preferred Qualifications*** Experience with Argo CD, Helm, or other GitOps tooling.* Familiarity with Airflow, Snowflake, or Apache Iceberg.* Experience with Apache Kafka or Amazon MSK.* Experience with hybrid cloud, enterprise networking, or multi-account AWS environments.* Experience with Ansible ...

Global Liquidity Architecture Delivery (GLAD) team to build and maintain server-side processes for regulatory and liquidity reporting. The role focuses on Scala and Apache Spark on AWS, with collaboration across a global team. You will work with business users to translate requirements into robust data solutions, contribute ...

Java and related technologies. Document code and processes to support knowledge sharing within the team. Profile Must haves: 2+ years industry experience Java Linux Apache Mongo/Postgres AI - prompt engineering or AI-assisted development (Claude, Cursor etc) Worked on a broker platform or similar industry experience a huge ...

deep experience in Linux-based high-throughput environments, plus exposure to streaming platforms like Kafka and data lake technologies such as Delta Lake or Apache Iceberg. #J-18808-Ljbffr ...

architectures (such as load balancing, LAMP, CDN’s), even if you haven’t worked on one Configuration and maintenance of common applications such as Apache, memcached, Squid, MySQL, NFS, DHCP, NTP, SSH, DNS, and SNMP A healthy respect for our mottos “Move Fast” and “Be Bold” Good communications skills ...

proud to talk about Familiarity with supervised ML Familiarity with supervised LLM chat and workflow automation Familiarity with Graphs and GNNs Familiarity with Apache Spark or other distributed processing frameworks Additional Information Why You’ll Love Working Here? You will have flexibility in how and where you work . ...