Apache Spark Jobs in the UK excluding London

76 to 100 of 318 Apache Spark Jobs in the UK excluding London

Solutions Architect

Manchester, England, United Kingdom
Hybrid / WFH Options
Matillion
and presentation skills, with the ability to engage both technical and non-technical stakeholders Desirable Criteria Experience with Matillion products and competitive ETL solutions Knowledge of big data technologies (Spark, PySpark), data lakes, and MPP databases (Teradata, Vertica, Netezza) Familiarity with version control tools such as Git, and experience with Python Degree in Computer Science or related field (or More ❯
Posted:

Senior Cloud and Data Solution Architect

Slough, England, United Kingdom
JR United Kingdom
technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs … skills. A minimum of 5 years’ experience in a similar role. Ability to lead and mentor the architects. Mandatory Skills [at least 2 Hyperscalers] GCP, AWS, Azure, Big data, Apache spark, beam on BigQuery/Redshift/Synapse, Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF Desirable Skills: Designing Databricks based More ❯
Posted:

Senior QA Engineer - ETL Data Migration

London, South East, England, United Kingdom
Interquest
products or platforms Strong knowledge of SQL and experience with large-scale relational and/or NoSQL databases Experience testing data pipelines (ETL/ELT), preferably with tools like Apache Airflow, dbt, Spark, or similar Proficiency in Python or similar scripting language for test automation Experience with cloud platforms (AWS, GCP, or Azure), especially in data-related services More ❯
Employment Type: Contractor
Rate: £450 - £475 per day
Posted:

Senior Engineering Manager - Data

Slough, England, United Kingdom
JR United Kingdom
experience leading data or platform teams in a production environment Proven success with modern data infrastructure: distributed systems, batch and streaming pipelines Hands-on knowledge of tools such as Apache Spark, Kafka, Databricks, DBT or similar Familiarity with data warehousing, ETL/ELT processes, and analytics engineering Programming proficiency in Python, Scala or Java Experience operating in a More ❯
Posted:

Machine Learning Engineer with Data Engineering expertise

Slough, England, United Kingdom
JR United Kingdom
in Python with libraries like TensorFlow, PyTorch, or Scikit-learn for ML, and Pandas, PySpark, or similar for data processing. Experience designing and orchestrating data pipelines with tools like Apache Airflow, Spark, or Kafka. Strong understanding of SQL, NoSQL, and data modeling. Familiarity with cloud platforms (AWS, Azure, GCP) for deploying ML and data solutions. Knowledge of MLOps More ❯
Posted:

Data Engineer

Sheffield, England, United Kingdom
Tes
skills in Python and SQL Demonstrable hands-on experience in AWS cloud Data ingestions both batch and streaming data and data transformations (Airflow, Glue, Lambda, Snowflake Data Loader, FiveTran, Spark, Hive etc.). Apply agile thinking to your work. Delivering in iterations that incrementally build on what went before. Excellent problem-solving and analytical skills. Good written and verbal … translate concepts into easily understood diagrams and visuals for both technical and non-technical people alike. AWS cloud products (Lambda functions, Redshift, S3, AmazonMQ, Kinesis, EMR, RDS (Postgres)). Apache Airflow for orchestration. DBT for data transformations. Machine Learning for product insights and recommendations. Experience with microservices using technologies like Docker for local development. Apply engineering best practices to More ❯
Posted:

Lead Data Engineer

Reading, Berkshire, United Kingdom
Hybrid / WFH Options
Bowerford Associates
ability to explain technical concepts to a range of audiences. Able to provide coaching and training to less experienced members of the team. Essential Skills: Programming Languages such as Spark, Java, Python, PySpark, Scala or similar (minimum of 2). Extensive Big Data hands-on experience across coding/configuration/automation/monitoring/security is necessary. Significant … MUST have the Right to Work in the UK long-term as our client is NOT offering sponsorship for this role. KEYWORDS Lead Data Engineer, Senior Lead Data Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, On-Prem, Cloud, ETL, Azure Data Fabric, ADF, Databricks, Azure Data, Delta Lake, Data Lake. Please note that due to a More ❯
Employment Type: Permanent
Salary: £75000 - £80000/annum Pension, Good Holiday, Healthcare
Posted:

Pricing & Revenue Data Scientist

Slough, England, United Kingdom
JR United Kingdom
Tech stack Python (pandas, NumPy, scikit-learn, PyTorch/TensorFlow) SQL (Redshift, Snowflake or similar) AWS SageMaker → Azure ML migration, with Docker, Git, Terraform, Airflow/ADF Optional extras: Spark, Databricks, Kubernetes. What you'll bring 3-5+ years building optimisation or recommendation systems at scale. Strong grasp of mathematical optimisation (e.g., linear/integer programming, meta-heuristics … Production mindset: containerise models, deploy via Airflow/ADF, monitor drift, automate retraining. Soft skills: clear comms, concise docs, and a collaborative approach with DS, Eng & Product. Bonus extras: Spark/Databricks, Kubernetes, big-data panel or ad-tech experience. #J-18808-Ljbffr More ❯
Posted:

Data Engineer / Scientist

Guildford, Surrey, United Kingdom
Hybrid / WFH Options
Actica Consulting Limited
scalable data infrastructure, develop machine learning models, and create robust solutions that enhance public service delivery. Working in classified environments, you'll tackle complex challenges using tools like Hadoop, Spark, and modern visualisation frameworks while implementing automation that drives government efficiency. You'll collaborate with stakeholders to transform legacy systems, implement data governance frameworks, and ensure solutions meet the … Collaborative, team-based development; Cloud analytics platforms e.g. relevant AWS and Azure platform services; Data tools hands on experience with Palantir ESSENTIAL; Data science approaches and tooling e.g. Hadoop, Spark; Data engineering approaches; Database management, e.g. MySQL, Postgress; Software development methods and techniques e.g. Agile methods such as SCRUM; Software change management, notably familiarity with git; Public sector best More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer / Scientist

Bristol, Gloucestershire, United Kingdom
Hybrid / WFH Options
Actica Consulting Limited
scalable data infrastructure, develop machine learning models, and create robust solutions that enhance public service delivery. Working in classified environments, you'll tackle complex challenges using tools like Hadoop, Spark, and modern visualisation frameworks while implementing automation that drives government efficiency. You'll collaborate with stakeholders to transform legacy systems, implement data governance frameworks, and ensure solutions meet the … Collaborative, team-based development; Cloud analytics platforms e.g. relevant AWS and Azure platform services; Data tools hands on experience with Palantir ESSENTIAL; Data science approaches and tooling e.g. Hadoop, Spark; Data engineering approaches; Database management, e.g. MySQL, Postgress; Software development methods and techniques e.g. Agile methods such as SCRUM; Software change management, notably familiarity with git; Public sector best More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer / Scientist

Bristol, England, United Kingdom
Hybrid / WFH Options
Actica Consulting Limited
scalable data infrastructure, develop machine learning models, and create robust solutions that enhance public service delivery. Working in classified environments, you'll tackle complex challenges using tools like Hadoop, Spark, and modern visualisation frameworks while implementing automation that drives government efficiency. You'll collaborate with stakeholders to transform legacy systems, implement data governance frameworks, and ensure solutions meet the … Collaborative, team-based development; Cloud analytics platforms e.g. relevant AWS and Azure platform services; Data tools hands on experience with Palantir ESSENTIAL; Data science approaches and tooling e.g. Hadoop, Spark; Data engineering approaches; Database management, e.g. MySQL, Postgress; Software development methods and techniques e.g. Agile methods such as SCRUM; Software change management, notably familiarity with git; Public sector best More ❯
Posted:

Application Senior Support Manager - VP

Belfast, Northern Ireland, United Kingdom
Hybrid / WFH Options
Citigroup Inc
science solutions that are Accurate, Reliable, Relevant, Consistent, Complete, Scalable, Timely, Secure, Nimble. Olympus is built on Big data platform and technologies under Cloudera distribution like HDFS, Hive, Impala, Spark, YARN, Sentry, Oozie, Kafka. Our team interfaces with a vast client base and works in close partnership with Operations, Development and other technology counterparts running the application production platform … conduct and business practices, and escalating, managing and reporting control issues with transparency. Skills & Qualifications: Working knowledge of various components and technologies under Cloudera distribution like HDFS, Hive, Impala, Spark, YARN, Sentry, Oozie, Kafka. Very good knowledge on analyzing the bottlenecks on the cluster - performance tuning, effective resource usage, capacity planning, investigating. Perform daily performance monitoring of the cluster More ❯
Posted:

AI Engineering Researcher

Slough, England, United Kingdom
JR United Kingdom
SQL and database technologies (incl. various Vector Stores and more traditional technologies e.g. MySQL, PostgreSQL, NoSQL databases). − Hands-on experience with data tools and frameworks such as Hadoop, Spark, or Kafka - advantage − Familiarity with data warehousing solutions and cloud data platforms. − Background in building applications wrapped around AI/LLM/mathematical models − Ability to scale up algorithms More ❯
Posted:

Data Engineer

Warrington, England, United Kingdom
JR United Kingdom
performance databases, including PostgreSQL, ClickHouse, Cassandra, and Redis. In-depth knowledge of ETL/ELT pipelines, data transformation, and storage optimization. Skilled in working with big data frameworks like Spark, Flink, and Druid. Hands-on experience with both bare metal and AWS environments. Strong programming skills in Python, Java, and other relevant languages. Proficiency in containerization technologies (Docker, Kubernetes More ❯
Posted:

Senior Data Engineer

Oxford, England, United Kingdom
Hybrid / WFH Options
Cubiq Recruitment
and optimising data pipelines and distributed systems using Airflow, Dagster, or Kedro . Expertise in cloud platforms such as AWS, GCP, or Azure , along with modern data technologies like Spark, Kafka, or Hadoop . Proficiency in programming languages such as Python, Scala, or Java , with the ability to write efficient, scalable code . Experience working with AI/ML More ❯
Posted:

Sr. Cloud Data Platform Engineer

Glasgow, United Kingdom
Barclays
ensure all data is accurate, accessible, and secure. To be successful in this role, you should have experience with: Cloud platforms (AWS/Azure) Data Engineering (Airflow/DBT, Spark) DevSecOps practices Additional highly valued skills include: Terraform Python/Java AWS/Azure Data Engineering Snowflake/Databricks You may be assessed on key critical skills relevant for More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Java Engineer

Belfast, United Kingdom
Hybrid / WFH Options
VanRath
continuous delivery Excellent problem-solving skills and a collaborative mindset Agile development experience in a team setting Bonus Skills (nice to have) Experience with big data tools like Hadoop, Spark, or Scala Exposure to fraud, payments , or financial services platforms Understanding of cloud-native development and container orchestration Knowledge of test-driven development and modern code quality practices What More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Generative AI Architect (Open AI) Professional Services

Slough, England, United Kingdom
JR United Kingdom
teams . Preferred Skills High-Performance Computing (HPC) and AI workloads for large-scale enterprise solutions. NVIDIA CUDA, cuDNN, TensorRT experience for deep learning acceleration. Big Data platforms (Hadoop, Spark) for AI-driven analytics in professional services. #J-18808-Ljbffr More ❯
Posted:

Data Engineer

Wilmslow, England, United Kingdom
Hybrid / WFH Options
The Citation Group
we’d love you to have... Understanding of cloud computing security concepts Experience in relational cloud based database technologies like Snowflake, BigQuery, Redshift Experience in open source technologies like Spark, Kafka, Beam Good understanding of Cloud providers – AWS, Microsoft Azure, Google Cloud Familiarity with DBT, Delta Lake, Databricks Experience working in an agile environment Here’s a taste of More ❯
Posted:

Lead Software Engineer - AWS

Glasgow, Scotland, United Kingdom
J.P. MORGAN-1
discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.) Experience in Computer Science, Engineering, Mathematics, or a related field and expertise in technology disciplines Exposure to big data frameworks (Spark, Hadoop etc.) used for scalable distributed processing Ability to collaborate effectively with Data Scientists to translate analytical insights into technical solutions Preferred qualifications, capabilities, and skills Familiarity with No More ❯
Posted:

Senior Data Engineer - KPMG Curve

Leeds, England, United Kingdom
Hybrid / WFH Options
KPMG United Kingdom
work as part of a client delivery team, working to the highest technical standards. What will you need to do it? Experience in prominent languages such as Python, Scala, Spark, SQL. Experience working with any database technologies from an application programming perspective - Oracle, MySQL, Mongo DB etc. Experience with the design, build and maintenance of data pipelines and infrastructure More ❯
Posted:

Senior Software Engineer - APIs, Visa Recurring Payment Monitor

Reading, England, United Kingdom
Visa
capabilities is beneficial. • Experience of providing third line support & working closely with application support, operations, and infrastructure teams for debugging & issue resolution. • Knowledge of Big Data platforms such as Spark, Scala, Hive, HDFS, Map Reduce, Yarn, HBASE, or Kafka is an advantage. Visa is committed to creating a diverse environment and is proud to be an equal opportunity employer. More ❯
Posted:

Senior Data Engineer - KPMG Curve

Leeds, England, United Kingdom
Hybrid / WFH Options
KPMG UK
work as part of a client delivery team, working to the highest technical standards. What will you need to do it? Experience in prominent languages such as Python, Scala, Spark, SQL. Experience working with any database technologies from an application programming perspective - Oracle, MySQL, Mongo DB etc. Experience with the design, build and maintenance of data pipelines and infrastructure More ❯
Posted:

Machine Learning Operations (ML Ops) Engineer

Immingham, England, United Kingdom
TieTalent
Ops. Ideally, you’ll also be technically skilled in most or all of the below: Expert knowledge of Python and SQL, inc. the following libraries: Numpy, Pandas, PySpark and Spark SQL Expert knowledge of ML Ops frameworks in the following categories: experiment tracking and model metadata management (e.g. MLflow) orchestration of ML workflows (e.g. Metaflow) data and pipeline versioning More ❯
Posted:

Machine Learning Operations (ML Ops) Engineer

Hull, England, United Kingdom
TieTalent
Ops. Ideally, you’ll also be technically skilled in most or all of the below: Expert knowledge of Python and SQL, inc. the following libraries: Numpy, Pandas, PySpark and Spark SQL Expert knowledge of ML Ops frameworks in the following categories: experiment tracking and model metadata management (e.g. MLflow) orchestration of ML workflows (e.g. Metaflow) data and pipeline versioning More ❯
Posted:
Apache Spark
the UK excluding London
10th Percentile
£46,250
25th Percentile
£52,125
Median
£65,000
75th Percentile
£73,250
90th Percentile
£95,500