26 to 50 of 231 Apache Spark Jobs in the UK

strategy. What We're Looking For Essential 5+ years' experience in Data Engineering or a similar role. Strong experience with Python, SQL, Apache Spark, and Cloud platforms (AWS, Azure or GCP) Experience designing and operating production-scale data platforms. Desirable Experience working with AWS. Experience supporting machine learning ...

strategy. What We're Looking For Essential 5+ years' experience in Data Engineering or a similar role. Strong experience with Python, SQL, Apache Spark, and Cloud platforms (AWS, Azure or GCP) Experience designing and operating production-scale data platforms. Desirable Experience working with AWS. Experience supporting machine learning ...

self-service data capabilities. Understanding of emerging technologies including AI, machine learning, real-time analytics, and data lakes. Desirable Experience Experience with Hadoop, Spark, Kafka, or similar big data technologies. Exposure to advanced analytics and machine learning solutions. Relevant certifications such as CDMP, Azure Data Engineer, or AWS Data ...

Know Salary: Up to £80,000 per annum. Team: Work with cross‐functional teams and mentor junior engineers. Tools: Microsoft Fabric, Azure ML, MLflow, Spark, Python, SQL, CI/CD, and ML frameworks like TensorFlow, PyTorch, Scikit‐learn. Scope: End‐to‐end AI/ML solutions for multi‐product …/ML. Familiarity with Microsoft Fabric (Data Engineering, Data Science, Real‐Time Analytics) and Azure ML, including MLflow. Proficiency with tools such as Apache Spark, Azure Data Factory, GIT, Python and SQL. Skilled in developing, training and deploying machine learning models with frameworks like TensorFlow, PyTorch or Scikit ...

engineering best practices Skills & Experience * 3+ years' commercial experience in Data Engineering * Strong Java or Python development skills * Experience with Kafka, Flink or Spark * Experience building ETL/ELT or streaming data pipelines * Knowledge of AWS (Azure or GCP also considered) * Experience with Docker, Kubernetes and CI/ ...

strategic thinking. Essential Skills & Experience Strong Microsoft Fabric expertise (Lakehouse, Warehouse, Pipelines, Notebooks) OneLake architecture and management Advanced SQL/T-SQL PySpark and Spark optimisation Data warehousing, modelling and ETL/ELT development Power BI semantic modelling Experience delivering enterprise cloud data platforms Experience integrating multiple business systems ...

Snowflake, Databricks). Experience with data integration (ETL/ELT, APIs). Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) is a plus. Domain Knowledge Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations. In-depth knowledge ...

Risk, XVA, CCR, FRTB, portfolio risk, fixed income analytics, securitised products, liquidity risk, or managed risk-as-a-service solutions. Familiarity with Snowflake, Databricks, Spark, AWS, Azure, Confluence, Azure DevOps, Git, Tableau, Power BI, message queues, or comparable tools and platforms. Knowledge of market data vendors, data mastering, golden ...

development . 3+ years of experience with cloud data platforms such as AWS, Azure, or Google Cloud Platform . 3+ years of experience with Spark, Databricks, Snowflake, Hadoop, or other big data technologies . Nice to Have: Experience with orchestration tools such as Apache Airflow, Azure Data Factory ...

range of projects that include internal and external suppliers. Essential Skills Proven experience as a Data Engineer Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles. Experience with Microsoft Fabric Experience of using programming languages such as Python, Scala and SQL. Demonstrable ...

work closely with stakeholders and translate business requirements into effective AI solutions Desirable Generative AI experience Large Language Models (LLMs) LangChain or similar frameworks Spark, Hadoop or other big data technologies Experience with distributed computing, streaming platforms or workflow orchestration tools Experience monitoring and optimising model performance in production ...

improve overall operational stability of software applications and systems Designs and implements data pipelines, analytics workflows, and reporting solutions using Python, Databricks, and Spark Develops and maintains web-based applications and dashboards using modern web stacks (React, Angular, etc.) Builds and optimises data models, ETL/ELT processes ...

monitoring. Strong background in CI/CD pipeline design, automation, and maintenance. Hands-on experience with data engineering tools and storage solutions (e.g., ADLS, Spark, Databricks, SQL/NoSQL databases). Experience with distributed computing and big data processing frameworks such as PySpark. Knowledge of infrastructure-as-code tools ...

Experience working for a software vendor, SaaS provider, or professional services organisation. Familiarity with Ataccama or similar enterprise data platforms. Exposure to Hadoop/Spark, NoSQL, XSLT, Hive, Kafka, Snowflake, or Databricks. Python or other programming languages. Familiarity with SDLC, code management and upgrades, and Unix/Linux. Perks ...

this role leads the engineering of cloud-native data services for the firm’s strategic platform, driving the migration to Databricks and delivering scalable Spark/Scala solutions on AWS. The overall objective of this role is to lead applications systems analysis and programming activities. Proven leadership in building … matching engines, AI/GenAI services and large-scale data platforms. This role will drive transformation of enterprise data capabilities using Databricks, scala/spark and cloud native architectures, ensuring platform is stable, scalable, resilient, secure and AI enabled. As platform landscape evolved towards cloud-native, AI enabled ...

PostgreSQL (or similar relational databases) and NoSQL databases. Experience with vector databases such as Qdrant, Milvus or pgvector . Familiarity with technologies such as Apache Spark, Airflow, Kafka, Elasticsearch/OpenSearch, Pandas and Polars . Strong understanding of data modelling, storage architecture and performance optimisation. Desirable Experience working ...

What we’re looking for: Strong Python development and software engineering experience Experience building scalable data pipelines and distributed data platforms Knowledge of Kafka, Spark and modern data processing technologies Experience with orchestration tools such as Airflow, Dagster or Prefect Hands-on experience with Docker, Kubernetes and containerised deployments ...

grade code Distributed Data Processing Experience building and operating: batch processing systems distributed data systems near real-time streaming pipelines Familiarity with: Kafka Flink Spark Databricks experience is a strong plus Databases & Data Warehousing Comfortable working with: RDBMS data warehousing solutions Strong understanding of data modelling aligned with business ...

twin platforms.* Experience with vector databases, embeddings, semantic search, or RAG.* Experience with streaming data platforms such as Kafka, Pub/Sub, Flink, or Spark Streaming.* Experience supporting closed-loop automation, predictive assurance, or self-healing network use cases.* Experience working with OSS systems, inventory platforms, assurance systems ...

experience designing and implementing multi‐agent architectures Enterprise AI Integration & Data API‐ and event‐driven integration of AI into enterprise workflows Data platforms: Databricks, Spark, Snowflake; streaming via Kafka Backend & Distributed Systems Languages: Python (expert), Java/Spring Boot (enterprise standard), Go (plus) Architecture: Microservices, domain‐driven design, event ...

control, and Responsible AI/MRM compliance Enterprise AI Integration & Data API- and event‐driven integration of AI into enterprise workflows Data platforms: Databricks, Spark, Snowflake; streaming via Kafka Backend & Distributed Systems Languages: Python (expert), Java/Spring Boot (enterprise standard), Go (plus) Architecture: Microservices, domain‐driven design, event ...

reviews and continuous improvement Skills & Experience * Commercial experience in Data Engineering * Strong Python or Java development skills * Experience with AWS cloud services * Knowledge of Apache Spark, Hadoop, NiFi or similar big data technologies * Experience building ETL/ELT pipelines and processing large datasets * Understanding of software engineering best ...

Architecture.- Strong programming skills in Python and SQL.- Familiarity with cloud platforms such as AWS, Azure, or GCP.- Knowledge of Snowflake and experience with Spark/PySpark.- Experience in designing and implementing modern data platform engineering solutions.If you are ready to make an impact within a dynamic team ...

multidisciplinary team to support and enhance over 70 active BI products. What You'll Bring Essential Skills & Experience: Core Technologies: Azure Databricks (or similar Spark-based platforms) and Azure Data Factory (ADF). Languages: SQL and Python. Data Platforms: Azure Data Lake and SQL Server RDBMS. ETL Tools ...

security Practical cloud‐native experience Preferred Qualifications, Capabilities, and Skills Experience with modern data technologies such as Databricks or Snowflake Hands‐on experience with Spark/PySpark and other big data processing technologies Demonstrated proficiency in software applications and technical processes within disciplines such as data engineering, cloud, artificial ...