151 to 175 of 256 Apache Jobs in London

SOAP APIs. Technical Skills: Experience with batch processes, Guidewire Messaging framework and OOTB plugins; familiarity with infra concepts and deployment architecture (WMB, WAS and Apache); strong knowledge of software architecture and design in Guidewire ecosystem. Data Analysis: Ability to write SQL queries for data analysis. GW Cloud/SaaS ...

with external clients across a variety of industry markets. Minimum of 5+ years of customer‐facing experience would be preferred Preferred: Experience working with Apache Spark (TM) to process large‐scale distributed datasets Communication: Proven ability to communicate and teach complex technical concepts to both technical and non‐technical ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

platforms capable of processing billions of events per day and managing terabytes scale datasets. Develop modern Data Lakehouse platforms leveraging S3-compatible object storage, Apache Iceberg, Spark, and Trino. Build real-time streaming integration using Apache Kafka and Apache Flink for low-latency event processing, enrichment … OpenShift, Terraform, CI/CD, GitOps, and Infrastructure as Code. Lead metadata, lineage, and data discovery capabilities using technologies such as DataHub, OpenMetadata, or Apache Atlas to improve platform transparency and usability. Ensure platform security and regulatory compliance through fine-grained access controls, encryption, secrets management, auditing, and secure ...

data engineering, with demonstrated expertise in designing and implementing scalable, flexible modern data architectures Experience building modern data lake/lakehouse architectures (e.g., Apache Iceberg) in cloud environments Strong knowledge of AWS (S3, Redshift) or Azure data services Experience with ETL/ELT processes and data ingestion Proven expertise … using transformation tools such as dbt Experience with data pipeline orchestration tools (such as Apache Airflow) Experience with best practices applied to data (e.g., testing, CI/CD) Advantageous Experience developing dashboards and reporting solutions using data visualization tools such as Power BI or Amazon QuickSight Experience with generative ...

skills Hands-on experience with Databricks for scalable data engineering, analytics, and collaborative development, as well as proficiency in managing large datasets using Apache Iceberg for efficient, reliable table management and data lake optimization Experience architecting and implementing enterprise-scale data warehouses on cloud platforms (e.g., AWS, Azure … data pipeline deployment and monitoring using CI/CD tools and infrastructure-as-code practices Hands-on expertise with distributed data processing frameworks (e.g., Apache Spark, Hadoop) and real-time data streaming technologies (e.g., Kafka, Kinesis, Spark) Track record of collaborating with cross-functional teams (engineering, analytics, business stakeholders ...

provenance. Hands‐on experience with data lineage/metadata tooling in enterprise environments (e.g., Collibra, Alation, Informatica EDC/IDMC, IBM Infosphere, Microsoft Purview, Apache Atlas, Amundsen, DataHub or similar). Proven ability to build lineage for complex platforms: data lakes, warehouses, marts, and distributed processing (Spark‐based pipelines … production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet. Advanced SQL skills; experience with Oracle databases is preferred. Working knowledge of Autosys & Apache Airflow. Experience with CI/CD tools (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift). Familiarity with AWS S3 for large-scale data storage. ...

root‐cause analysis. Experience building or supporting production data pipelines in a collaborative engineering environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . Technology Environment The role will involve working with … should bring relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised ...

leading Data Management consultancy in London seeks a skilled professional experienced in PySpark and Apache Spark for a hands-on role. You will work closely with clients and play a crucial part in developing innovative solutions using cloud technologies like AWS, Azure, and GCP. Excellent communication and ability ...

streaming technologies such as Kafka and FlinkWorked in cloud Native environmentsDeployed to the cloud themselves using Docker/KubernetesPrevious use of technologies such as Apache DruidBenefitsExceptional bonus structureFlexible workingA team that will truly listen to any ideas and influence you could havePlease email Lily.Wolahan@stanfordblack.comor call ...

Mockito Experience with clean architecture, DI, modular design Comfortable owning CI/CD, code quality, observability Familiarity with Docker, Maven, Jenkins ⭐ Nice to Have Apache Calcite Starburst or federated query engines JVM performance tuning High-throughput service interfaces (REST/gRPC) Data governance or policy enforcement layers 👥 This Role ...

working in a Product organisation and ideally Fintech Practical hands on knowledge of Java Technology Stack. J2EE/Spring etc. Experience of working with Apache Nifi Experienced in working with AWS, Docker, Jenkins etc. rolling out AWS environments and environment strategy. Have sound Database experience, preferably Oracle. Experience ...

product and commercial teams. You Need Expert Python and SQL, with experience building production ML systems and data pipelines (PyTorch, XGBoost, Spark/PySpark, Apache Iceberg, Ray, MLflow, SageMaker, Airflow, or equivalent). Deep experimentation and statistical inference skills, and a strong grasp of optimisation under uncertainty (bandits, causal ...

years of experience working in version control environments such as GitLab or GitHub; Have 2+ years of experience with job orchestration tools such as Apache Airflow as both a pipeline developer and reviewer; Have 2+ years of experience with data ingestion and transformation frameworks such as dbt, Fivetran ...

technology environment is important but this is not expected to be a hands on role • This role is responsible for platforms built using Java, Apache Nifi, Kafka, SpringBoot, Angular 7 and Oracle, experience with some of these technologies is important • Continuous Integration and Deployment is achieved using a combination ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. Benefits At Databricks, we strive to provide comprehensive benefits and perks that meet the needs ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn, Facebook. Benefits At Databricks, we strive to provide comprehensive benefits ...

with downstream systems, including trader‐facing tools. Experience 5+ years software engineering experience in building distributed systems. Excellent Java skills. Experience with streaming technologies (Apache Flink preferred; Kafka Streams, Spark Streaming, etc.). Solid understanding of event‐driven architecture and asynchronous processing patterns. Experience handling data consistency challenges such ...

responsibility and commitment to qualitySelf-driven, motivated work ethicEnergetic and enthusiastic personalityWhat makes you stand out:IMC or another investment management qualificationExperience with Apache AirflowExperience with DatabricksExperience with asset management dataPassion for design and architectureWhy join our team:We help you be your best through professional development opportunities, interesting ...

technical and technical audiences alikePassion for collaboration, life-long learning, and driving business value through AI[Preferred] Experience using the Databricks Intelligence Platform and Apache Spark to process large-scale distributed datasetsWilling to travel once every 4-8 weeks to see customers (as needed)About DatabricksDatabricks is the Data ...

technical audiences alike Passion for collaboration, life-long learning, and driving business value through AI [Preferred] Experience using the Databricks Intelligence Platform and Apache SparkTM to process large-scale distributed datasets Willing to travel once every 4-8 weeks to see customers (as needed) About Databricks Databricks ...

Good to Have Knowledge of the adTech space and particularly the identifiers used in the field. Experience with large‐scale distributed data processing (e.g., Apache Spark) and cloud data infrastructure across GCP and AWS (e.g., Dataproc, Dataflow, GKE, EMR). Experience with Temporal More about us: LiveRamp’s mission ...

Experience with domain-specific workflow systems (e.g., Nextflow) for scaling high-throughput pipeline execution.Familiarity with general-purpose data orchestration and processing frameworks (e.g., Dagster, Apache Beam) for integrating research pipelines into a production platformFamiliarity with building and maintaining bioinformatics infrastructure on Google Cloud Platform (GCP).Familiarity with modern, high ...

3+ years experience working in version control environments using platforms such as Gitlab or Github 2+ years experience working with job orchestration tools like Apache Airflow, both as a pipeline developer and reviewer 2+ years experience with data ingestion and transformation frameworks (e.g., dbt, Fivetran, or custom/ ...

root‐cause analysis. Experience building or supporting production data pipelines in a collaborative engineering environment. Experience working with distributed data processing frameworks such as Apache Spark . Working knowledge of common data formats such as JSON , Avro and Parquet . For More Experienced Candidates Stronger ownership of technical design … should bring relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised ...