26 to 46 of 46 Apache Spark Jobs in London

processing, including vector databases, fine‐tuning LLMs, and deploying LLMs with tools such as HuggingFace, Langchain, and OpenAI. Hands‐on experience working with Distributed Spark based systems. Experience communicating and teaching technical concepts to non‐technical and technical audiences alike. Passion for collaboration, life‐long learning, and driving … values through ML. [Preferred] 2+ years customer‐facing experience in a pre‐sales or post‐sales role. [Preferred] Experience working with Apache Spark to process large‐scale distributed datasets. Can meet expectations for technical training and role‐specific outcomes within 3 months of hire. Can travel ...

environments Strong experience designing large-scale, cloud-based data platforms Deep expertise in AWS services, including EC2, S3, RDS, Lambda, Redshift Proven experience with Apache Flink and real-time streaming architectures Strong background in: Data modelling ETL/ELT processes Data warehousing and distributed systems Experience leading, mentoring …/security-focused environments Strong understanding of data governance, standards, and architecture frameworks Desirable Skills Experience with Azure or GCP Knowledge of Scala and Apache Spark Familiarity with DevOps practices and cloud-native delivery models Experience working alongside cyber security teams on secure systems Security Requirements Must currently ...

Core Java Spring Boot frameworks Proven experience building distributed backend systems Hands-on experience with Kafka (or similar streaming platforms) Experience with Scala and Apache Spark for data processing Integration withbackend services such as: PostgreSQL Redis S3 (or equivalent object storage) Expertise in modern engineering practices, including: Continuous ...

unstructured datasets. Strong stakeholder management and communication skills. Desirable Insurance or financial services experience, ideally within pricing, underwriting, fraud, or claims. Experience with Spark, Hadoop, NoSQL, or modern big data platforms. Agile delivery experience and collaborative software development practices. Experience leading analytics teams and driving organisational change. Robert Walters ...

Experience with: Relational databases (SQL Server, PostgreSQL, Oracle, MySQL) Data visualisation tools (Power BI, Tableau, Spotfire) Cloud platforms, particularly Microsoft Azure Big data technologies (Spark, Elasticsearch, Hadoop) Statistical modelling and advanced analytics Machine learning and pattern recognition techniques Web technologies such as HTML and JavaScript ...

operations. Demonstrated depth in Big Data engineering, with proficiency in at least one of the following areas: distributed data processing platforms such as Databricks, Spark, or EMR search platforms such as OpenSearch or Elasticsearch graph databases such as Neo4j Strong understanding of Agile and Lean practices, including backlog refinement ...

large-scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward ...

loop, calibration, guardrails, auditability) Experience with hyperparameter tuning at scale and experimentation frameworks Strong technical experience with SQL and Python; significant experience with Spark for large-scale data processing Excellent interpersonal skills with demonstrable collaborative leadership capabilities (coaching, mentoring, guiding, delivery ownership and stakeholder engagement) and strong standards ...

work on a Big Data Project in the finance sector. Required Experience: Java Big Data experience On-premises cluster experience Databases Kubernetes Kafka Apache Spark Preffered Experience: Finance sector experience ...

work on a Big Data Project in the finance sector. Required Experience: Java Big Data experience On-premises cluster experience Databases Kubernetes Kafka Apache Spark Preffered Experience: Finance sector experience ...

with experience shaping technical direction across teams and stakeholders Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats, as well ...

stakeholders. Preferred qualifications, capabilities, and skills Experience designing/implementing pipelines using DAGs (e.g., Kubeflow, DVC, Ray). Experience with big data technologies (e.g., Spark, Hadoop). Have constructed batch and streaming microservices exposed as REST/gRPC endpoints. Familiarity with GraphQL. We recognize that our people ...

Analytics Engineer London, hybrid 3 times a week Department: IT Type: 3-month rolling contract Outside IR35 Position: Analytics Engineer The organisation is seeking an experienced Analytics Engineer to join its Data & Analytics team. The ...

engineer first. Deep proficiency in Python/C++, experience with low-latency inference systems, and familiarity with distributed computing frameworks (Ray, Spark, Flink). You write code that survives in production, not just notebooks. The Full ML Lifecycle: Expertise in end-to‐end system design: from feature stores ...

insights that drive the AI product roadmap forward. Tech Stack Includes : AWS: EC2, Athena, S3, Kinesis, Lambda, Step Functions, RDS, QuickSight Languages & Frameworks: Python, Spark, TensorFlow, LLMs & LLM coding tools Databases & Search: MySQL, PostgreSQL, SOLR Requirements Experience: Minimum 3 years of post-degree commercial experience in a data science ...

people management experience You have extensive, up‐to‐date knowledge and hands‐on experience with machine learning and data engineering technologies (e.g., Kubernetes, Spark, Databricks, GPU) You have extensive experience in Generative AI technology areas such as search, personalization, sorting, ranking, recommendation, bidding, pricing, etc You have large‐scale ...

Purpose of position Data sits at the heart of the company. This role ensures that Awin can fully leverage the data available across the group, enabling the development of robust reporting capabilities that support stronger ...

solving complex challenges and improving data quality as the platform scales. ·The environment is modern and cloud based, with exposure to technologies such as Spark, Snowflake and BigQuery across AWS, GCP and Azure. ·You will have the opportunity to support and mentor other engineers, contribute to engineering standards … engineers What We Are Looking For ·Proven Python and SQL experience within production environments ·Experience delivering data transformation projects end to end ·Experience with Spark, Snowflake, BigQuery or similar technologies ·Solid experience working with AWS, GCP or Azure ·Comfortable working with complex, imperfect datasets ·Experience owning solutions from design ...

processing, including vector databases, fine‐tuning LLMs, and deploying LLMs with tools such as HuggingFace, Langchain, and OpenAI. Hands‐on experience working with Distributed Spark based systems. Graduate degree in a quantitative discipline (Computer Science, Engineering, Statistics, Operations Research, etc.) or equivalent practical experience. Experience communicating and teaching technical … driving our values through ML. Preferred: 2+ years customer‐facing experience in a pre‐sales or post‐sales role. Preferred: Experience working with Apache SparkTM to process large‐scale distributed datasets. Can meet expectations for technical training and role‐specific outcomes within 3 months of hire. Can travel ...

Experience in building machine learning models for business application Experience in applied research Preferred Qualifications Experience with modeling tools such as R, scikit-learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc. Experience with large scale distributed systems such as Hadoop, Spark etc. Amazon is an equal opportunity employer ...

Experience in building machine learning models for business application Experience in applied research Preferred Qualifications Experience with modeling tools such as R, scikit‐learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc. Experience with large scale distributed systems such as Hadoop, Spark etc. Equal Opportunity & Privacy Amazon ...