226 to 250 of 305 Apache Spark Jobs in London

work on large generative models.AV/robotics/simulation; multi-sensor driving data (video, telemetry; LiDAR a plus).Productionising research: Flyte/Ray/Spark-style jobs, dataset lineage, training mix configuration.Reward models, offline RL, or closed-loop evaluation of driving policies.Cloud GPU fleets (Azure/AWS/ ...

systems like Cassandra, Elasticsearch, Kafka, and more across different environmentsTechnologies We UseDifferent backend languages, including Java, Rust, and GoOpen-source technologies like Cassandra, ElasticSearch, Spark, Kafka, Kubernetes, FlinkIndustry-standard build tooling, including Gradle and GitHubWhat We ValueDemonstrated ability to collaborate and empathise with a variety of individuals. Able ...

have else we will be enable you with the required trainingAWS Glue and Data Catalog, EMR, Athena, S3, Redshift/RDS, Kafka/Spark, AWS Security, IAMOR Azure Data factory, Azure Data bricks, Azure Data Lake, Azure SQL DW & Azure SQL, Azure Storage, HDInsight (Spark/Kafka),Azure … Event Hub, Azure AD/IAM and Data CatalogORCloud DataFlow, DataPrep, CloudSQL, BigTable, BigQuery, Cloud Spanner, Kafka/Spark, Google Cloud IAMWhy should you apply? For top talent we offer a highly competitive salary and a number of other benefits: Bonus programmeMedical and dental careLife InsuranceChildcare VouchersPension schemeFriendly work ...

Engineer, maintaining and further developing a well-established cloud and CI/CD setup to implement and evolve reliable, well-tested data pipelines in Spark/Scala and to extend the dimensional data models. You will be part of the technical team collaborating closely with platform engineering, data science … ingesting from various sources into Databricks Collaborate closely with software engineers to evolve our software platform and address technical challenges Design, develop, and optimize Spark/Scala jobs for ingestion and transformation, using the existing GitHub Actions and Terraform setup for deployments Implement, run and monitor dbt tests ...

business value in collaboration with an Account Executive and a Senior Solutions Architect. Gain excitement from clients about Databricks through hands‐on evaluation and Spark programming, integrating with the wider cloud ecosystem and third‐party applications. Contribute to building the Databricks technical community through engagement at workshops, seminars … data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache SparkTM, Delta Lake and MLflow. EEO Statement At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. ...

data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive to provide comprehensive ...

will lead requirements for the Treasury Analytics Group, support FIS Quantum & TBSM, and work on a new risk/analytics platform using Hadoop, Spark, and NoSQL tools. The role reqs 5+ years of experience, Linux/Oracle/MS SQL, ITIL, and scripting with Java/Python. Collaboration with ...

with stakeholders. Preferred qualifications, capabilities, and skills Experience designing/implementing pipelines using DAGs (e.g. Kubeflow, DVC, Ray) Experience of big data technologies (e.g. Spark, Hadoop) Have constructed batch and streaming microservices exposed as REST/gRPC endpoints Familiarity with GraphQL We recognize that our people are our strength ...

create trust with stakeholders.Preferred qualifications, capabilities, and skillsExperience designing/implementing pipelines using DAGs (e.g. Kubeflow, DVC, Ray)Experience of big data technologies (e.g. Spark, Hadoop)Have constructed batch and streaming microservices exposed as REST/gRPC endpointsFamiliarity with GraphQL#CIBAppliedAIJ.P. Morgan is a global leader in financial services, providing ...

your prior roles.Prior experience using causal inference/econometric techniques and bayesian methodologies for hypothesis testing.Prior experience using large datasets with distributed computing (e.g. spark, hadoop or other map-reduce tech)Experience working in a fast-moving tech company or startup.This role is a full-time role based ...

roles. Prior experience using causal inference/econometric techniques and bayesian methodologies for hypothesis testing. Prior experience using large datasets with distributed computing (e.g. spark, hadoop or other map-reduce tech)Experience working in a fast-moving tech company or startup. This role is a full-time role based ...

insights that drive the AI product roadmap forward. Tech Stack Includes: AWS: EC2, Athena, S3, Kinesis, Lambda, Step Functions, RDS, QuickSight Languages & Frameworks: Python, Spark, TensorFlow, LLMs & LLM coding tools Databases & Search: MySQL, PostgreSQL, SOLR Experience: Minimum 3 years of post-degree commercial experience in a data science ...

/column-level security, lineage and audit Build reusable Terraform modules for Databricks and automate platform changes through CI/CD pipelines Tune Spark, Delta and Photon workloads to improve performance and reduce DBU and cloud spend Manage identity, SSO/SCIM, service principals, secret scopes and network isolation … experience as a Data Platform Engineer, Cloud Engineeror Data Engineer, with hands-on Databricks production experience Strong knowledge of the Databricks Lakehouse, Delta Lake, ApacheSpark and Unity Catalog Production experience administering Databricks on at least onemajor cloud (AWS, Azure or GCP), including networking, IAM and storage Proficiency with Terraform (ideally ...

already changed how you work, not just how fast. We expect you to enjoy leveraging AI and agentic systems to operate more effectively.Tech environmentScala | Spark | Databricks | AWS | Claude | Airflow | Kubernetes | Terraform | Functional ProgrammingYou will thrive here if youEnjoy end-to-end ownership, from writing the code to architecture design … Java or Python.Ability to design, build, and maintain distributed data systems in a cloud-based environment.Hands-on experience with big data frameworks such as Spark or Databricks.Knowledge of cloud infrastructure (AWS, GCP, or Azure).Judgement to balance scalability, performance, and maintainability.Experience with data modelling and workflow orchestration.Bonus points forHands ...

changed how you work, not just how fast. We expect you to enjoy leveraging AI and agentic systems to operate more effectively. Tech environmentScala | Spark | Databricks | AWS | Claude | Airflow | Kubernetes | Terraform | Functional ProgrammingYou will thrive here if youEnjoy end-to-end ownership, from writing the code to architecture design … Python. Ability to design, build, and maintain distributed data systems in a cloud-based environment. Hands-on experience with big data frameworks such as Spark or Databricks. Knowledge of cloud infrastructure (AWS, GCP, or Azure).Judgement to balance scalability, performance, and maintainability. Experience with data modelling and workflow orchestration. ...

software development lifecycleSolid background in Java/Scala and a scripting language like Python.Experience building large scale data pipelinesStrong familiarity with the Apache Hadoop ecosystem including : Spark, Kafka, Flink, Iceberg/Delta Lake/Hive, Apache Presto/Trino, etc.Experience with relational SQL and NoSQL databases, including ...

ideal candidate will have more than 10 years of experience in backend development and data platform engineering, with strong expertise in Java and Apache Spark. The role offers competitive compensation and benefits, reflecting the company's commitment to employee well-being. #J-18808-Ljbffr ...

/or Parity Experience in using various Solidity frameworks like Truffle, Mix IDE or Intellij-Sol. Contributions to relevant open source projects; Experience Hadoop, Spark, or Docker. Basic or deep knowledge of Ethereum Whisper or IPFS/Swarm.My client is based in the City of LondonPython, Ethereum, Blockchain ...

with modeling tools such as Python, PyTorch, TensorFlow, scikit‐learn, etc. Hands‐on experience building large‐scale distributed machine learning systems such as Hadoop, Spark, etc. Effective communication skills in Chinese. Equal Opportunity Employment At JD.com, we’re committed to building a diverse and inclusive workplace where everyone ...

Building streaming data pipelines and event-driven systems Kafka, Pulsar, NATS, RabbitMQ, or similar messaging platforms Designing distributed schedulers, queues, and asynchronous processing systems Spark, Flink, Beam, or MapReduce Ad tech, social networks, search engines, or other large-scale content platforms We conduct coding interviews as part ...

code reviews Contributing to, proposing and reviewing technical standards Improving operational processes Mentoring more junior colleagues Java Vert.x Spring Rest APIs MySQL Microservices Kafka Spark NodeJS React AWS Terraform AngularJS Benefits Competitive compensation, variable bonus and performance‐based reward opportunities, and retirement programs Medical, dental, and vision insurance Generous ...

conducted for several leading frontier model developers and national safety institutes, and has been featured in OpenAI's o1 system card and Meta Muse Spark’s Safety & Preparedness Report.About the roleAs a Senior Research Scientist at Faculty, you will join our high-impact R&D team to lead original ...

London --------------------------------------- JOB DETAILS Role Title: Data Engineer (Python Enterprise Developer) Must have skills: -Python, Postgres SQL, Azure Databricks, AWS(S3), Git, Azure DevOps CICD, Apache Airflow -Preferred Domain: Energy trading Minimum number of relevant years of experience: 8+ Detailed Job Description: JD: • 8+ years of experience in python scripting. … building native python ETL pipelines for scraping/processing. • Good to have experience in processing big data. • Proficient in SQL programming, Postgres SQL. Spark knowledge is a good to have • Knowledge on DevOps CI/CD like Azure Pipelines, Jenkins, Git. • Experience working with AWS services(S3, lambda ...

market data normalisation. Experience handling time-series challenges such as timestamp precision, sequence gaps, duplicate and out-of-order events. Experience with distributed processing (Spark, Polars, Dask, Ray or similar). Experience with Kafka or similar streaming technologies. Familiarity with PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar. Docker, Linux … market data engineering with proven experience building reliable, scalable data platforms. Our non-negotiable requirements are: Expert Python Strong SQL Scalable data pipeline development Apache Parquet Market data normalisation Automated data quality controls Deep tick and market data expertise Experience in MLOps is advantageous but not essential. We welcome ...

market data normalisation. Experience handling time-series challenges such as timestamp precision, sequence gaps, duplicate and out-of-order events. Experience with distributed processing (Spark, Polars, Dask, Ray or similar). Experience with Kafka or similar streaming technologies. Familiarity with PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar. Docker, Linux … market data engineering with proven experience building reliable, scalable data platforms. Our non-negotiable requirements are: Expert Python Strong SQL Scalable data pipeline development Apache Parquet Market data normalisation Automated data quality controls Deep tick and market data expertise Experience in MLOps is advantageous but not essential. We welcome ...