51 to 73 of 73 Apache Spark Jobs in London

Experience with: Relational databases (SQL Server, PostgreSQL, Oracle, MySQL) Data visualisation tools (Power BI, Tableau, Spotfire) Cloud platforms, particularly Microsoft Azure Big data technologies (Spark, Elasticsearch, Hadoop) Statistical modelling and advanced analytics Machine learning and pattern recognition techniques Web technologies such as HTML and JavaScript ...

time ML & reproducibility: A strong grasp of production inference patterns and reproducible environments (Docker, MLflow or equivalent). Cloud & tooling: AWS, plus SageMaker, Snowflake, Spark/Databricks and Kubernetes. Engineering mindset: A focus on reliability, maintainability and continuous improvement. ...

operations. Demonstrated depth in Big Data engineering, with proficiency in at least one of the following areas: distributed data processing platforms such as Databricks, Spark, or EMR search platforms such as OpenSearch or Elasticsearch graph databases such as Neo4j Strong understanding of Agile and Lean practices, including backlog refinement ...

large-scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including:Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward ...

large-scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward ...

machine learning frameworks and programming languages such as Python, R, or similar. Experience working with large datasets and data processing technologies (e.g., Hadoop, Spark, SQL). Familiarity with anomaly detection, supervised, unsupervised learning methods, deep learning, and graph based solutions Demonstrated ability to work collaboratively in cross-functional teams ...

loop, calibration, guardrails, auditability) Experience with hyperparameter tuning at scale and experimentation frameworks Strong technical experience with SQL and Python; significant experience with Spark for large-scale data processing Excellent interpersonal skills with demonstrable collaborative leadership capabilities (coaching, mentoring, guiding, delivery ownership and stakeholder engagement) and strong standards ...

with stakeholders. Preferred qualifications, capabilities, and skills Experience designing/implementing pipelines using DAGs (e.g. Kubeflow, DVC, Ray) Experience of big data technologies (e.g. Spark, Hadoop) Have constructed batch and streaming microservices exposed as REST/gRPC endpoints Familiarity with GraphQL Level of experience Senior (5+ years of experience ...

with experience shaping technical direction across teams and stakeholders Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg or similar table formats, as well ...

Analytics Engineer London, hybrid 3 times a week Department: IT Type: 3-month rolling contract Outside IR35 Position: Analytics Engineer The organisation is seeking an experienced Analytics Engineer to join its Data & Analytics team. The ...

engineer first. Deep proficiency in Python/C++, experience with low-latency inference systems, and familiarity with distributed computing frameworks (Ray, Spark, Flink). You write code that survives in production, not just notebooks. The Full ML Lifecycle: Expertise in end-to‐end system design: from feature stores ...

insights that drive the AI product roadmap forward. Tech Stack Includes : AWS: EC2, Athena, S3, Kinesis, Lambda, Step Functions, RDS, QuickSight Languages & Frameworks: Python, Spark, TensorFlow, LLMs & LLM coding tools Databases & Search: MySQL, PostgreSQL, SOLR Requirements Experience: Minimum 3 years of post-degree commercial experience in a data science ...

Purpose of position Data sits at the heart of the company. This role ensures that Awin can fully leverage the data available across the group, enabling the development of robust reporting capabilities that support stronger ...

from idea to scaled adoption, with KPI definition, testing/experimentation, and benefits tracking. Build on modern data/ML platforms (e.g., Databricks/Spark and Snowflake) with CI/CD, monitoring, and operational controls. Operate in a controlled environment with strong model governance (model risk, compliance, and controls … productionisation, monitoring, and support. Operationalise analytics/ML with trusted data, model governance, and delivery controls (CI/CD, deployment, monitoring) on Databricks/Spark and Snowflake. Lead senior stakeholders (Sales, Product, Risk/Compliance, CDO/CTO, SMAD/Quants, engineering/data) to align priorities, secure decisions ...

retraining, and optimise models for reliability and cost efficiency in AWS. Collaboration & Enablement: Partner with data engineers to integrate ML workflows into wider platforms (Spark, Databricks), and share best practice and mentor other technical professionals. What You'll Love About This Role Think Big: Build ML and AI solutions … models underperform across data, features and architecture, and make reasoned trade-offs. Real-time & distributed ML: A strong grasp of production inference patterns, plus Spark and distributed data processing. Reproducibility & tooling: Reproducible environments (UV/Docker) and MLflow or equivalent, on AWS with Spark, Databricks and Snowflake. Engineering ...

processing, including vector databases, fine-tuning LLMs, and deploying LLMs with tools such as HuggingFace, Langchain, and OpenAI Hands-on experience working with Distributed Spark based systems. Experience communicating and teaching technical concepts to non-technical and technical audiences alike. Passion for collaboration, life-long learning, and driving … values through ML. Preferred: 2+ years customer-facing experience in a pre-sales or post-sales role. Preferred: Experience working with Apache SparkTM to process large-scale distributed datasets. Can meet expectations for technical training and role-specific outcomes within 3 months of hire. Can travel ...

processing, including vector databases, fine‐tuning LLMs, and deploying LLMs with tools such as HuggingFace, Langchain, and OpenAI. Hands‐on experience working with Distributed Spark based systems. Graduate degree in a quantitative discipline (Computer Science, Engineering, Statistics, Operations Research, etc.) or equivalent practical experience. Experience communicating and teaching technical … driving our values through ML. Preferred: 2+ years customer‐facing experience in a pre‐sales or post‐sales role. Preferred: Experience working with Apache SparkTM to process large‐scale distributed datasets. Can meet expectations for technical training and role‐specific outcomes within 3 months of hire. Can travel ...

customers achieve more with the AWS cloud. BASIC QUALIFICATIONS - Experience as technical specialist in design and architecture - Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience in consulting, design and implementation of serverless distributed solutions - Experience in cloud based solution (AWS or equivalent), system, network and operating … Computer Science or related field, or experience working with or evaluating AI systems - Experience in data applications using large scale distributed systems (e.g., EMR, Spark, Elasticsearch, Hadoop, Pig, and Hive) Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. ...

Experience in building machine learning models for business application Experience in applied research Preferred Qualifications Experience with modeling tools such as R, scikit‐learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy etc. Experience with large scale distributed systems such as Hadoop, Spark etc. Equal Opportunity & Privacy Amazon ...