276 to 300 of 372 Apache Spark Jobs in England

mindset and openness to learning from others Nice to have: Hands on orchestration skills and experience using Terraform Experience with big data tools (e.g. Spark, AWS Glue, or similar) Strong grasp of code review best practices Cloud Migration/AWS knowledge Understanding/experience working with orchestration and data ...

provenance. Hands‐on experience with data lineage/metadata tooling in enterprise environments (e.g., Collibra, Alation, Informatica EDC/IDMC, IBM Infosphere, Microsoft Purview, Apache Atlas, Amundsen, DataHub or similar). Proven ability to build lineage for complex platforms: data lakes, warehouses, marts, and distributed processing (Spark‐based … Working knowledge of ETL/ELT patterns, data modeling (dimensional + normalized), and batch scheduling dependencies. Ability to interpret data transformation logic from pipelines (Spark SQL/PySpark/Hive queries/orchestration configs). Strong documentation capability: source‐to‐target mappings, lineage diagrams, data dictionaries, metadata standards ...

collaboration and delivery. What We’re Looking For Strong proficiency in Python, Scala, or Java with hands‐on experience in Big Data technologies including Spark, Hadoop, or similar distributed processing frameworks. Practical experience building real-time event streaming pipelines using technologies such as Kafka, Spark Streaming, or Amazon … environments. Bonus Points For Expertise in data modelling, schema design, and working with structured and semi‐structured datasets. Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. Knowledge of automating cloud-based ingestion and transformation frameworks. Experience delivering data engineering solutions within highly regulated ...

tech such as Kafka, Flink, Kinesis, Pub/Sub Orchestrate workflows using Airflow, Dataflow, Glue Work at Scale Process and transform large datasets using Spark and Flink Design systems that perform in production - not just on paper Own Data Storage & Performance Work across relational, NoSQL, and analytical stores (Postgres … data quality, testing, observability, and operational excellence What We’re Looking For Core Engineering Strength Strong Python and SQL Deep experience with Spark and modern data platforms (Databricks/Snowflake) Solid grasp of cloud data services (AWS or GCP) Architecture & Design Judgement Demonstrated ownership of large-scale data platform ...

Nomura is seeking a Software Developer to join the GLAD team in London. You will work on server-side data processing, using Scala and Apache Spark on AWS MinIO to deliver accurate liquidity and regulatory metrics. Role requires experience with Java/Python/Scala, relational databases ...

Vision Familiarity with Bayesian Learning Familiarity with Causal Inference Familiarity with Recommender Systems Familiarity with Graphs and GNNs Familiarity with Reinforcement Learning Familiarity with Apache Spark or other distributed processing frameworks A paid 6-week sabbatical leave after four years For everyone, everywhere. We’re people building money ...

proud to talk about Familiarity with supervised ML Familiarity with supervised LLM chat and workflow automation Familiarity with Graphs and GNNs Familiarity with Apache Spark or other distributed processing frameworks Additional Information Why You’ll Love Working Here? You will have flexibility in how and where you work ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. Benefits We strive to provide comprehensive benefits and perks that meet the needs of all our employees. ...

Chester (Hybrid). You will own data lifecycle, building scalable pipelines and ensuring governance in a regulated financial environment. You'll work with Python, Spark, Kafka, NiFi, Hadoop, Hive, and modern data-platform technologies, delivering production-grade controls and observability. #J-18808-Ljbffr ...

Barlowe LLP is seeking an engineer to build and operate distributed analytics platforms in London. The role involves using technologies such as Spark, Kafka, and AWS to power research and trading teams. The ideal candidate will have strong experience with data analytics systems, automation skills in Python ...

help architect a multi-petabyte data estate, processing billions of datapoints daily from thousands of sources. The stack includes Java, Python, Kafka, ArcticDB, Airflow, Spark, and more, tackling complex distributed systems at scale. Join a team where AI agents are increasingly central, with emphasis on discoverability and usability ...

drive AI-assisted development practices to improve quality and speed. The role emphasizes applying cloud-native architectures, modern data technologies like Kafka, Databricks, and Spark, and maintaining operational stability while shaping the team's technical strategy #J-18808-Ljbffr ...

days a week and delivering high-quality, consultative outcomes. Ideal candidates will have strong communication skills and a track record in Big Data technologies (Spark, Hadoop, EMR, MapR) and NoSQL/MPP databases, with a passion for #J-18808-Ljbffr ...

years of experience in data science and predictive modeling. Expertise in SQL, R, or Python for data analysis. Experience with big data technologies (Hadoop, Spark). Ability to translate complex data into business strategy. Highly competitive salary and stock options. Relocation assistance if required. State-of-the-art workstation ...

Kafka, RabbitMQ, or Pulsar Experience with Kafka Connect Experience in setting up data platforms and establishing standards Experience with distributed data processing frameworks (e.g., Spark or Flink) #ICBCareers #ICBEngineering #J-18808-Ljbffr ...

lead embedded data science teams, partnering effectively with senior stakeholders across multiple domains Hands‐on technical expertise with tools such as Databricks, Python, Spark, and GCP/BigQuery Engineering mindset, with experience moving teams toward machine learning engineering best practice Credibility to lead long‐tenured individual contributors while providing ...

with stakeholders. Preferred qualifications, capabilities, and skills Experience designing/implementing pipelines using DAGs (e.g. Kubeflow, DVC, Ray) Experience of big data technologies (e.g. Spark, Hadoop) Have constructed batch and streaming microservices exposed as REST/gRPC endpoints Familiarity with GraphQL #CIBAppliedAI #J-18808-Ljbffr ...

programming, hardware-aware optimization, or FPGA-adjacent systems. Experience with ML/data tooling such as PyTorch, JAX, CUDA, GPU clusters, Ray, Kafka, Kubernetes, Spark, or comparable technologies. Understanding of market microstructure, backtesting pitfalls, transaction costs, and the operational needs of live quantitative strategies. Experience in environments operating real ...

startup, or equivalent experience navigating fast-paced startup lifecycles. Strong understanding of modern data warehouse architectures, real-time analytics, and data governance (e.g., BigQuery, Spark, Kafka). Deep technical expertise in Generative AI development (e.g., prompt engineering, model tuning, vector databases like Vertex AI Vector Search, and AI frameworks ...

Company description Publicis Media harnesses the power of modern media through leading agency brands Dysrupt, Infinite Roar, Publicis Collective, Publicis Health Media, Spark Foundry, StarcomandZenith, as well as global accelerator PMX; immersive experience group PMCI and access to integrated platform-based technologies and offerings from CJ, EpsilonandInfluential. ...

operating large-scale data pipelines or search/retrieval systems Are proficient in Python and/or TypeScript, and familiar with tools like Spark, Kafka, Flink, data warehouses, and SQL Take a product-minded approach, design with user workflows in mind, and iterate quickly based on feedback Favor pragmatic ...

leadership teams. Minimum Qualifications Masters in Statistics, Mathematics, Data Science, Machine Learning, Physics, Engineering, Computer Science or equivalent Proficiency in data querying using SQL, Spark, or equivalent technologies Proficiency in scripting languages for data processing and analysis (ex: Python, R, or Scala) Excellent communication and multi-functional collaboration skills ...

Data, Data Warehousing, Business Intelligence, Machine Learning). Data Ecosystems: Familiarity with modern data architectures and tools, such as Big Data frameworks (Hadoop, Spark, Hive, BigQuery), Data Warehouses, and Machine Learning. Role Qualifications Industry Experience: 10+ years of experience in the Manufacturing and broader industrial supply chain environment. Sales ...

person attendance expected at least 3 days per week. At Robinhood, we believe in the power of in-person work to accelerate progress, spark innovation, and strengthen community. Our office experience is intentional, energizing, and designed to fully support high-performing teams. Requires participation in an on-call rotation ...

person attendance expected at least 3 days per week. At Robinhood, we believe in the power of in-person work to accelerate progress, spark innovation, and strengthen community. Our office experience is intentional, energizing, and designed to fully support high-performing teams. Requires participation in an on-call rotation ...