51 to 75 of 77 Apache Spark Jobs in London

/or AI solutions Are an expert in one of predictive modelling, classification, regression, optimisation, NLP algorithms or recommendation systems Have experience with Spark Have knowledge of DevOps technologies such as Docker and Terraform and ML Ops practices and platforms like ML Flow Have experience with agile delivery methodologies ...

experience with Generative AI and LLMs, including prompt engineering, fine-tuning, evaluation, and production deployment. Strong command of modern data stacks, including Python, SQL, Spark, BigQuery, and Snowflake. Clear communication skills, able to explain complex AI concepts to both technical and non-technical audiences. Benefits and perks There ...

data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

seasonality analysis) Solid foundation in statistical modelling and machine learning theory Proficiency in Python and experience working with large, complex datasets using SQL and Spark Ability to manage multiple priorities across a portfolio of projects Experience engaging both technical and business stakeholders Experience with libraries such as SciPy, Scikit ...

data science or statistical role. Expertise in advanced analytics techniques including machine learning, optimisation and segmentation. Strong proficiency in Python, SQL and Spark SQL. Experience working with large datasets and distributed computing tools such as Azure Synapse and Snowflake. Familiarity with data transformation tools (Databricks, Azure Data Factory ...

working within a globally‐distributed team A background in some of the following a bonus: Java experience Python experience Ruby experience Big data technologies: Spark, Trino, Kafka Financial Markets experience SQL: Postgres, Oracle Cloud‐native deployments: AWS, Docker, Kubernetes Observability: Splunk, Prometheus, Grafana #J-18808-Ljbffr ...

series, geospatial, image, etc. Different types of database – relational; document; graph; columnar; key‐value Large scale data processing platforms, typically based on Hadoop/Spark Business intelligence/analytics products or frameworks Data analysis and data modelling requirements Experience working with cloud platforms and working with relevant PaaS/ ...

business stakeholders to deliver robust, high-performance data solutions in a cloud-native AWS environment. The ideal candidate has strong expertise in PySpark, Python, Apache Airflow, AWS services, Terraform, and modern DevOps practices. Good to have SC eligibility or SC clearance Key Responsibilities Data Engineering & Pipeline Development Design, develop … transformation, cleansing, enrichment, and validation processes. Troubleshoot and resolve data pipeline failures, bottlenecks, and performance issues. Workflow Orchestration Design and manage complex workflows using Apache Airflow. Create and maintain DAGs with robust scheduling, dependency management, alerting, and recovery mechanisms. Monitor workflow execution and proactively address failures or performance concerns. ...

data models and outputs Set up monitoring and ensure data health for outputs What we are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What ...

with Git, Python, and Ansible Familiarity with containers (Docker, Kubernetes, LXC) Experience with monitoring tools and SQL databases Exposure to big data systems (e.g., Spark, HDFS, Airflow) Summary A great opportunity for someone who enjoys solving complex infrastructure challenges, automating systems, and working closely with engineering teams. Spectrum ...

work on a Big Data Project in the finance sector. Required Experience: Java Big Data experience On-premises cluster experience Databases Kubernetes Kafka Apache Spark Preffered Experience: Finance sector experience ...

work on a Big Data Project in the finance sector. Required Experience: Java Big Data experience On-premises cluster experience Databases Kubernetes Kafka Apache Spark Preffered Experience: Finance sector experience ...

Strong SQL and database knowledge Experience working with large-scale or high-volume datasets Exposure to big data or distributed systems technologies such as Spark or Kafka Previous experience within financial services is beneficial but not essential Strong academic background, ideally in Computer Science What ...

with predictive and diagnostic analytics in CLTV, risk scoring, financial crime or marketing Technical proficiency in SQL databases and tools like Python, R, or Spark Skilled in visualisation and dashboard development using Power BI, Qlik or Tableau Solid background in Financial Services, with experience in Capital Markets, Insurance ...

patterns and contribute to shared accelerators. What we’re looking for Hands‐on LLMs, embeddings, vector databases; retrieval strategies and grounding. Data engineering fundamentals (Spark/Databricks; ETL/ELT) and operational handover. Consulting behaviours: stakeholder engagement and clear, client‐ready communication. Nice to have Document/graph stores ...

Analytics Engineer London, hybrid 3 times a week Department: IT Type: 3-month rolling contract Outside IR35 Position: Analytics Engineer The organisation is seeking an experienced Analytics Engineer to join its Data & Analytics team. The ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilise programming expertise … experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue ...

e.g., Grafana, Humio) and chaos engineering. Familiarity with leveraging Generative AI (e.g., GitHub Copilot, Gemini) to accelerate development. Experience with big data technologies like Apache Spark or Amazon S3. If indicated, please note that years of experience are a guide; we will consider applications from all candidates ...

owning the complete machine learning lifecycle. Ideal candidates will have an advanced degree in Computer Science or similar, proficiency in Python, and experience with Spark and DevOps technologies. Benefits include private health insurance and a flexible hybrid work model. #J-18808-Ljbffr ...

tooling and working with large transactional datasets • Understanding of OTC products including CDS, Interest Rate Swaps and Variance Swaps Highly Desirable • Experience with C++, Spark, Kafka or other distributed compute tools • Exposure to position keeping, risk, or PnL systems • Strong debugging, profiling and optimisation capability across data pipelines ...

What Others Only Talk About London (Hybrid) We have partnered with a market-leading, global energy software business that’s assembling an elite AI “Spark Team” . The Mission Design and deliver cutting-edge AI solutions that actually move the needle – not just prototypes that sit on a shelf. ...

opportunities for remote or on-site engagement, diverse training, and contributions to a sustainable open-source product. Strong hands-on experience with tools like Apache Spark, Kubernetes, and Terraform is essential. #J-18808-Ljbffr ...

code review, source control, build, test, deploy, and operations Awesome If You: Are experienced in Rust/Java/Kotlin Have experience with AWS, Apache Kafka, Kafka Streams, Apache Beam/Flink/Spark – especially deployment, monitoring & debugging Have experience with productisation of Machine Learning research projects ...

handling edge cases, improving data quality and solving complex data challenges. The environment is modern and cloud based, with exposure to technologies such as Spark, Snowflake and BigQuery across AWS, GCP and Azure. You will also have the opportunity to support and mentor other engineers through collaboration, code reviews … Looking For Strong Python and SQL expertise gained within large scale production environments Experience delivering complex data transformation projects end to end Experience with Spark, Snowflake, BigQuery or similar technologies Exposure to cloud environments such as AWS, GCP or Azure Comfortable working with large, messy and evolving datasets Experience ...

Role Summary With specific expertise in AI, Data Science and Natural Language Processing (NLP) domain, this pre‐sales role collates and synthesises requirements to design and present innovative end‐to‐end solution options to enable ...