26 to 50 of 66 Apache Spark Jobs in the UK excluding London

Science or a related field. Experience working on and shipping live service games. Experience working on Spring Boot projects. Experience deploying software/services on Kubernetes. Experience working with Apache Spark and Iceberg. More ❯

OpenShift, MicroK8s; • Infrastructure as Code (IaC), automation & configuration management; • Ansible (plus Puppet, Saltstack), Terraform, CloudFormation; • NodeJS, REACT/MaterialUI (plus Angular), Python, JavaScript; • Big data processing and analysis, e.g. Apache Hadoop (CDH), Apache Spark; • RedHat Enterprise Linux, CentOS, Debian or Ubuntu. • Java 8, Spring framework (preferably Spring boot), AMQP - RabbitMQ, • Open source technologies; • Experience of Agile software More ❯

structured insights. Experience in building data pipelines and models in SAP Datasphere or SAP BW4/Hana Advanced skills in SQL, data modelling, and data transformation Familiarity with Databricks, Apache Spark, PySpark, and Delta Lake Agile mindset with experience in DevOps and iterative delivery Excellent communication and stakeholder engagement abilities Sound like a fit? Let's build the More ❯

around the globe. We are seeking a talented Data Engineer to join our team. As a Data Engineer, you will work with a variety of technologies including Python, Py-Spark, Pandas, SQL and Azure DevOps. You will be responsible for modeling and implementing predictive maintenance solutions for our products, specifically focusing on jet engines. Responsibilities Collaborate with stakeholders to More ❯

Java, TypeScript, Python, and Go Web libraries and frameworks such as React and Angular Designing, building, and maintaining CI/CD pipelines Big data technologies, such as NiFi, Hadoop, Spark Cloud and containerization technologies such as AWS, OpenShift, Kubernetes, Docker DevOps methodologies, such as infrastructure as code and GitOps Database technologies, e.g. relational databases, Elasticsearch, Mongo Why join Gemba More ❯

Capture, Technical Leadership, Architectural Patterns (OO, Cloud-native, Microservices), Database Design, Application Security Testing. Cloud & Infrastructure: AWS, Azure, VMWare usage and general knowledge. Data & Integration: Data Pipeline Orchestration (Airflow, Spark, NiFi etc.), Message Brokers (Kafka), Object Storage (S3, MinIO), API Management, Python Scripting. Automation & Low-Code: Low-code Platforms (Power Platform, Appian, UiPath etc.), RPA solutions, Business Process Analysis. More ❯

to define Bicep templates and deploy Azure infrastructure effectively. Experience creating Azure DevOps YAML pipelines. Knowledge of source control, preferably Git. Strong skills in SQL, Azure Synapse, Data Factory, Spark, and Databricks. Experience establishing coding standards and testing practices. Deep understanding of the full data lifecycle. Involvement in implementing CI/CD methodologies. Experience working in agile, rapid development More ❯

to define Bicep templates and deploy Azure infrastructure effectively. Experience creating Azure DevOps YAML pipelines. Knowledge of source control, preferably Git. Strong skills in SQL, Azure Synapse, Data Factory, Spark, and Databricks. Experience establishing coding standards and testing practices. Deep understanding of the full data lifecycle. Involvement in implementing CI/CD methodologies. Experience working in agile, rapid development More ❯

of proficiency developing applications using most of the following: Strong knowledge of SQL and Python programming. Extensive experience working within a cloud environment. Experience with big data technologies (e.g. Spark, Databricks, Delta Lake, BigQuery). Experience with alternative data technologies (e.g. duckdb, polars, daft). Familiarity with eventing technologies (Event Hubs, Kafka etc ). Deep understanding of file formats More ❯

time, taking project briefs and refining them to strong results. Exposure to Python data science stack Knowledge and working experience of AGILE methodologies. Proficient with SQL. Familiarity with Databricks, Spark and geospatial data/modelling are a plus. Interview process: Subject to change 1) 15minute conversation with Talent Team 2) 30minute interview with hiring manager 3) You'll be More ❯

management and monitoring. Hands-on experience with AWS Have a good grasp of IaC (Infrastructure-as-code) tools like Terraform and CloudFormation. Previous exposure to additional technologies like Python, Spark, Docker, Kubernetes is desirable. Ability to develop across a diverse technology stack and willingness and ability to take on new technologies. Demonstrated experience participating on cross functional teams in More ❯

Research/Statistics or other quantitative fields. Experience in NLP, image processing and/or recommendation systems. Hands on experience in data engineering, working with big data framework like Spark/Hadoop. Experience in data science for e-commerce and/or OTA. We welcome both local and international applications for this role. Full visa sponsorship and relocation assistance More ❯

Join our client in embarking on an ambitious data transformation journey using Databricks, guided by best practice data governance and architectural principles. To support this, we are recruiting for talented data engineers. As a major UK energy provider, our client More ❯

Systems Architecture - AWS data engineer Job Description Location: UK - Will require travel to customer site ](Belfast) Job Summary: We are seeking a skilled and experienced AWS Data Engineer to join our team. The successful candidate will be responsible for implementing More ❯

Graduate Data Engineer (Python Spark SQL) *Newcastle Onsite* to £33k Do you have a first class education combined with Data Engineering skills? You could be progressing your career at a start-up Investment Management firm that have secure backing, an established Hedge Fund client as a partner and massive growth potential. As a Graduate Data Engineer you'll join … Science or similar technical/scientific discipline, backed by minimum A A A grades at A-level You have commercial Data Engineering experience working with technologies such as SQL, Apache Spark and Python including PySpark and Pandas You have a good understanding of modern data engineering best practices Ideally you will also have experience with Azure and Data … development opportunities Social team atmosphere with a range of events and early finish for drinks on Fridays Apply now to find out more about this Graduate Data Engineer (Python Spark SQL) opportunity. At Client Server we believe in a diverse workplace that allows people to play to their strengths and continually learn. We're an equal opportunities employer whose More ❯

Data Engineer (Python Spark ETL) London/WFH to £90k Are you a tech savvy Data Engineer keen to make an impact, delivering Greenfield systems You could be progressing your career at a successful and growing Cyber Security Risk Management tech company that specialises in solutions for SME's, working on complex and interesting systems at the cutting edge … they were established seven years ago. You'll take ownership of building a new Data Lake from scratch using a range of modern tools and technologies, primarily Python and Spark in an AWS environment.This is an impactful role where you'll be at the heart of the technology function to drive optimisations and develop new capabilities that maximise the … Lakes, Data Warehousing, ETL/ELT processes and data pipeline orchestration You have strong Python and SQL coding skills You have experience with big data frameworks and tools including Spark You have a good knowledge of AWS data services (e.g. S3, Redshift, EMR, Glue) You have strong analytical, problem solving and critical thinking skills You have excellent communication skills More ❯

modern data lake/lakehouse architectures Strong grasp of cloud data platforms (AWS, Azure, GCP, Snowflake) Understanding of Data Mesh , Data Fabric , and data product-centric approaches Familiarity with Apache Spark , Python , and ETL/ELT pipelines Strong knowledge of data governance, lifecycle management, and compliance (e.g. GDPR) Consulting experience delivering custom data solutions across sectors Excellent leadership More ❯

etc. Infrastructure as Code and CI/CD paradigms and systems such as: Ansible, Terraform, Jenkins, Bamboo, Concourse etc. Observability - SRE Big Data solutions (ecosystems) and technologies such as: Apache Spark and the Hadoop Ecosystem Excellent knowledge of YAML or similar languages The following Technical Skills & Experience would be desirable: Jupyter Hub Awareness RabbitMQ or other common queue More ❯

building solutions for Compliance Data Archival & Reporting application. Core Java, Spring and Hibernate will be the primary technologies used supplemented by strong technical knowledge of Oracle databases Knowledge of Spark, Big Data is desirable but not mandatory. The candidate should have hands on experience in designing and developing solutions The candidate will apply internal standards for re-use, architecture … unit test framework like junit and mockito. Experience in any cloud technologies like Openshift/PCF/AWS/GCP. Experience with building distributed systems, using solutions such as Spark, Big Data Technologies would be preferred but not mandatory. Knowledge of Big Data querying tools (Cloudera stack or similar) e.g. Hive or Impala would be preferred but not mandatory. More ❯

developing & deploying scalable backend systems. Familiarity with CICD, containerisation, deployment technologies & cloud platforms (Jenkins, Kubernetes, Docker, AWS) or Familiarity with Big Data and Machine Learning technologies (NumPy, PyTorch, TensorFlow, Spark). Excellent communication, collaboration & problem solving skills, ideally with some experience in agile ways of working. Security clearance: You must be able to gain and maintain the highest level More ❯

management and monitoring. Hands-on experience with AWS Have a good grasp of IaC (Infrastructure-as-code) tools like Terraform and CloudFormation. Previous exposure to additional technologies like Python, Spark, Docker, Kubernetes is desirable. Ability to develop across a diverse technology stack and willingness and ability to take on new technologies. Demonstrated experience participating on cross functional teams in More ❯

associated Data Science tooling. Experience in technical communication with both business stakeholders and technical peers. Experience working with big data concepts, strategies, methodologies, and tools such as MongoDB, Snowflake, Spark, or Hadoop. Knowledge and experience of deploying enterprise scale data science products. Experience in coaching and mentoring team members. Experience and skills we'd love: Computer Vision Expertise: Practical More ❯

conduct and business practices, and escalating, managing and reporting control issues with transparency. Qualifications: Experience in a product development/product management environmenta Relevant experience within core java and spark Experience in systems analysis and programming of java applications Experience using big data technologies (e.g. Java Spark, hive, Hadoop) Ability to manage multiple/competing priorities and manage More ❯

to align technology with business objectives and cost efficiency. Security & Compliance Knowledge: GDPR, API authentication, and observability best practices. Big data processing: Understanding data lakes, warehouses, and tools like Spark, Kafka, and Airflow. ETL Pipelines: Ability to evaluate data ingestion, transformation, and cleaning processes. DevOps & CI/CD: Hands-on knowledge of Jenkins, GitHub Actions, Terraform, and CloudFormation. What More ❯

or statistical/mathematical software (e.g. R, SAS, or Matlab) - Experience with statistical models e.g. multinomial logistic regression - Experience in data applications using large scale distributed systems (e.g., EMR, Spark, Elasticsearch, Hadoop, Pig, and Hive) - Experience working with data engineers and business intelligence engineers collaboratively - Demonstrated expertise in a wide range of ML techniques PREFERRED QUALIFICATIONS - Experience as a More ❯