51 to 72 of 72 Apache Spark Jobs in the UK excluding London

essential: Background in financial services or regulated environments. Exposure to financial crime domains such as fraud, AML or sanctions. Experience with Spark or PySpark. Familiarity with AWS cloud services and data platforms. You will be assessed on key capabilities relevant to the role, including risk and controls, change ...

scaling patterns and reuse. Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with ...

secure and scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with ...

while adhering to regulatory standards. You’ll own the codebase, drive DevOps practices with Terraform, CI/CD, Jenkins and Harness, and work with Spark/Hadoop and AWS services like Glue, S3, and Lake formation. #J-18808-Ljbffr ...

looking for a mixture of the following skills: Python Kubernetes Docker CI/CD basics (Gitlab pipelines) Data science and MLOps knowledge (highly desirable) Spark (highly desirable) Scala (highly desirable) S3 (highly desirable) Graph databases (highly desirable) Elasticsearch (highly desirable) Vector stores (highly desirable) OIDC/OAuth (highly desirable ...

lead embedded data science teams, partnering effectively with senior stakeholders across multiple domains Hands‐on technical expertise with tools such as Databricks, Python, Spark, and GCP/BigQuery Engineering mindset, with experience moving teams toward machine learning engineering best practice Credibility to lead long‐tenured individual contributors while providing ...

technical challenges and unfamiliar technologies where required Technical Skills: Must-Have Skills: Python Kubernetes Docker CI/CD fundamentals (GitLab Pipelines) Highly Desirable Skills: Spark Scala S3 Storage Graph Databases Elasticsearch Vector Stores OIDC/OAuth NodeJS React To apply for Analytics Platform Engineer contract or permanent job, please ...

unit testing. Solid understanding of agile methodologies such as CI/CD, Application Resiliency, and Security Knowledge of Big Data distributed compute frameworks like Spark, Glue, MapReduce etc. Excellent troubleshooting, analytical, and communication skills. Preferred qualifications, capabilities, and skills Experience in Data pipelines using Spark Exposure ...

Data Engineer Location: London (Hybrid) Salary: Up to £75,000 + Bonus + Benefits Technology: SQL, Python, Spark - Azure, AWS, GCP - ETL/ELT - Data Governance The Opportunity Are you a Data Engineer looking for an opportunity to work on large-scale data transformation programmes whilst helping shape enterprise … data lineage. Support Data Governance initiatives, ensuring data security, privacy and compliance standards are maintained. Work with large and complex datasets using SQL, Python, Spark, Hadoop and modern data technologies. Collaborate with technical and business stakeholders within Agile delivery environments. Support data architecture and data modelling activities across enterprise ...

Purpose of position Data sits at the heart of the company. This role ensures that Awin can fully leverage the data available across the group, enabling the development of robust reporting capabilities that support stronger ...

scale. The position sits in a team delivering high-impact ML across marketing and advertising, working on both real-time and batch workloads with Spark, Python, Java, and #J-18808-Ljbffr ...

problem-solving and analytical skills Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Hands-on expertise with Spark/PySpark and big data processing technologies Knowledge of open-source table formats and catalog services such as Apache Iceberg Experience with ...

from ingestion and streaming through to warehousing, serving, and cost optimisation You have deep experience with streaming architectures – Kinesis, Kafka/MSK, Flink, or Spark Streaming – and know when each is the right choice You can model the cost implications of architecture decisions and advise clients on trade‐offs … between throughput, latency, durability, and spend AWS certification at professional or specialty level is strongly preferred Mastery of Python, SQL, and Spark – and strong opinions on how they should be used in production data pipelines Deep experience with dbt, Airflow, or equivalent orchestration – including how to build pipelines that ...

from ingestion and streaming through to warehousing, serving, and cost optimisation You have deep experience with streaming architectures – Kinesis, Kafka/MSK, Flink, or Spark Streaming – and know when each is the right choice You can model the cost implications of architecture decisions and advise clients on trade‐offs … between throughput, latency, durability, and spend AWS certification at professional or specialty level is strongly preferred Mastery of Python, SQL, and Spark – and strong opinions on how they should be used in production data pipelines Deep experience with dbt, Airflow, or equivalent orchestration – including how to build pipelines that ...

must have demonstrable experience designing, deploying, and operating big data platforms at scale. You will have hands-on experience with OSS data ecosystems (e.g., Spark, Trino, Airflow, Apache Superset, and similar technologies). You will have knowledge of cloud platforms and traditional on-premise hosting; hands-on experience ...

adoption of modern data mesh principles across complex enterprise environments. What You'll Be Doing Architect and deliver modern data solutions using Databricks, Spark, PySpark and SQL Design scalable batch and real-time data pipelines that ingest data from legacy and modern platforms Lead the development of cloud-based … decision making Provide technical leadership and architectural direction on large-scale transformation programmes Essential Experience Strong hands-on expertise with Databricks Extensive experience using Spark, PySpark and SQL Proven track record designing and implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka ...

experimentation frameworks that support business decision-making. Data Engineering & Model Productionisation: Develop robust analytical datasets and machine learning pipelines using Databricks, Python, SQL and Spark, ensuring solutions are scalable, reliable and production-ready. Stakeholder Partnership & Commercial Impact: Partner with business stakeholders to define hypotheses, success measures and value metrics … analytics solutions within commercial environments. Python, SQL & Data Platform Expertise: Advanced Python and SQL skills, with experience building reproducible machine learning workflows using Databricks, Spark or similar large‐scale data processing technologies. Machine Learning & Statistical Expertise: Deep understanding of supervised and unsupervised machine learning, feature engineering, model evaluation, experimentation ...

Hands‐on experience in system design, application development, testing, and operational stability Proficient in coding in one or more languages such as Java or Spark Experience developing, debugging, and maintaining code in a large corporate environment with modern programming and database querying languages Knowledge of the Software Development Life … within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile) Ability to solve data‐oriented problems using technologies such as SQL, Relational DB, Spark, NoSQL, optimizing for performance Preferred Qualifications, Capabilities, and Skills Experience with Spark performance tuning of complex calculations on large datasets Experience delivering production ...

within a technical discipline (e.g., cloud, AI, machine learning, mobile). Ability to solve data-oriented problems using technologies such as SQL, relational databases, Spark, and NoSQL. Preferred Qualifications, Capabilities, and Skills Additional formal training or certification in software engineering concepts. Exposure to AI tools and technologies for software … development. Experience with Spark performance tuning for complex calculations on large datasets. Experience delivering production changes to complex software using Scala and Spark. If you’re ready to lead, innovate, and make an impact, we invite you to join our team and shape the future of finance technology with ...

business use cases and/or to improve product/system performance, quality and accuracy. Near Real-Time and Batch Inferencing: Use infrastructure like Spark and Ray to stand up inferencing services that integrate with operational/analytics workloads. ML Infrastructure: Help build a first-class machine learning platform … learning on real recommendations use cases (brownie points for productionised sequential learning use cases!). Experience with ML/distributed ML frameworks like Ray, Spark-MLlib, TensorFlow etc. Experience with real-time scoring/evaluation of models with low latency constraints. Great coding skills and strong software development experience ...

Engineer requirig strong GCP experience. The role will focus on building scalable data platforms and pipelines on GCP, working with technologies including Kafka, Python, Spark and Iceberg , while implementing robust data governance, lineage and auditability. Key Requirements: Active SC Clearance - (SC Elapsed Candidates will also be considered!) Strong … experience Kafka, Python, Spark & Iceberg Data Governance and Lineage expertise Please note that rate and IR35 determination are still being finalised and are expected next week . Given the project timelines, immediately available contractors are strongly preferred .Please apply now to avoid missing out on being shorlisted for this. ...

business use cases and/or to improve product/system performance, quality and accuracy. Near Real‐Time and Batch Inferencing: Use infrastructure like Spark and Ray to stand up inferencing services that integrate with operational/analytics workloads. ML Infrastructure: Help build a first‐class machine learning platform … learning on real recommendations use cases (brownie points for productionised sequential learning use cases). Experience with ML/distributed ML frameworks like Ray, Spark‐MLlib, TensorFlow etc. Experience with real‐time scoring/evaluation of models with low latency constraints. Great coding skills and strong software development experience ...