551 to 575 of 605 Apache Spark Jobs in the UK

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue ...

Core Java, OOPS Spring Framework (v11 or v17 preferred) Microservices/REST API AWS Cloud Coading Skills Terraform/Ansible SQL/Database management Apache Spark Angular/UI (Good to have ...

looking to build a team of 4 Lead/Senior Developers to support a team of juniors. Required Skills & Qualifications Java AWS AWS Glue Apache Spark Snowflake 📩 Interested? Click apply if you are interested in this position or email matthew.carter@opusrs.com ...

Spring, Microservices, AWS, Kafka, JD: Design, develop, and maintain scalable microservices using Java and Spring Boot. Build and optimize real-time data pipelines leveraging Apache Kafka, Flink, and Spark/Databricks. Develop robust data distribution and streaming solutions for high-throughput systems. Deploy, manage, and monitor services … Kafka and distributed streaming systems. Solid understanding of SQL and data modeling. Experience with containerization (Docker) and orchestration (Kubernetes). Working knowledge of Flink, Spark, or Databricks for data processing. Familiarity with AWS services (ECS, EKS, S3, Lambda, etc.). Basic scripting in Python for automation or data manipulation. ...

system design, data pipelines, and data modeling for high-volume systems. ?? Nice to Have Background in Settlements, Payments, or Accounting . Experience with Spark, Flink, or Apache Beam . Ready to lead a major architectural transition in the finance domain? Apply now. Randstad Technologies is acting ...

data-intensive SaaS platform operating in a complex, regulated industry. This is a hands-on senior IC role focused on distributed data processing, Spark-based pipelines, and Python-heavy engineering. You’ll be working on large-scale batch data workflows that power pricing, forecasting, and operational decision-making systems. … Data Science, or GenAI role. What You’ll Be Doing • Design, build, and evolve large-scale distributed data pipelines using Spark/PySpark. • Develop production-grade Python data workflows that implement complex business logic. • Work with Databricks for job execution, orchestration, and optimisation. • Own and optimise cloud-based data ...

generative AI applications. - Perform Exploratory Data Analysis (EDA), data mining, and visualization to extract insights. - Design and implement Big Data solutions using Hadoop, Spark, PySpark, and DataLake architectures. - Develop and deploy ML models (supervised, unsupervised, tree-based, ensemble methods). - Implement deep learning architectures (CNN, RNN, LSTM) using TensorFlow … compliance of AI systems. Required Skills: Analytical Tools: - EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) - Statistical & Multivariate Analysis Big Data: - Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark - DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning - Supervised Models: Naïve Bayes, Logistic Regression, SVM, Linear Regression, KNN - Tree-Based Models: Decision Trees ...

generative AI applications. - Perform Exploratory Data Analysis (EDA), data mining, and visualization to extract insights. - Design and implement Big Data solutions using Hadoop, Spark, PySpark, and DataLake architectures. - Develop and deploy ML models (supervised, unsupervised, tree-based, ensemble methods). - Implement deep learning architectures (CNN, RNN, LSTM) using TensorFlow … compliance of AI systems. Required Skills: Analytical Tools: - EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) - Statistical & Multivariate Analysis Big Data: - Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark - DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning - Supervised Models: Naïve Bayes, Logistic Regression, SVM, Linear Regression, KNN - Tree-Based Models: Decision Trees ...

generative AI applications. Perform Exploratory Data Analysis (EDA), data mining, and visualization to extract insights. Design and implement Big Data solutions using Hadoop, Spark, PySpark, and Data Lake architectures. Develop and deploy ML models (supervised, unsupervised, tree-based, ensemble methods). Implement deep learning architectures (CNN, RNN, LSTM) using … compliance of AI systems. Required Skills: Analytical Tools: EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) Statistical & Multivariate Analysis Big Data: Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning Supervised Models: Nave Bayes, Logistic Regression, SVM, Linear Regression, KNN, Tree-Based Models: Decision Trees ...

data. You’ll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn, PyTorch, TensorFlow/Keras, LangChain, Pydantic, Spark, Kafka, Databricks, MLflow, Azure, Docker, Kubernetes. Salary: Up to £100k Working Environment: Fully Remote in UK What you’ll do Research, prototype, and deploy … summarisation, document processing) Build and tune models using scikit-learn, PyTorch, TensorFlow/Keras, and XGBoost Create data pipelines for batch and streaming with Spark and Kafka Use Databricks and MLflow for experiments, deployment, and monitoring What you’ll bring Hands-on Python for data science and ML Practical ...

Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka, Kinesis, or RabbitMQ. … . Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka, Kinesis, or RabbitMQ. … . Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka, Kinesis, or RabbitMQ. … . Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka, Kinesis, or RabbitMQ. … . Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka, Kinesis, or RabbitMQ. … . Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka, Kinesis, or RabbitMQ. … . Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka, Kinesis, or RabbitMQ. … . Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka, Kinesis, or RabbitMQ. … . Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka, Kinesis, or RabbitMQ. … . Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka, Kinesis, or RabbitMQ. … . Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka, Kinesis, or RabbitMQ. … . Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka, Kinesis, or RabbitMQ. … . Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...

Engineer Job Location: Remote (UK) Job Type: Full-time permanent Experience: 10 to 12 years Joining: Immediate joiner preferred Mandatory Skills: Scala, AWS, Spark Streaming, DevOps, Bash Scripting. Job Description: Design, develop, and maintain scalable backend services on AWS. Build event-driven architectures using SQS, Kafka, Kinesis, or RabbitMQ. … . Proficiency in SQL and NoSQL databases (DynamoDB, RDS). Experience building and deploying applications on Kubernetes (EKS). Bash Scripting Real time with Spark structured streaming ...