26 to 50 of 63 Apache Spark Jobs in the South East

models into production environments. Data & Engineering Skills Strong SQL skills and experience working with large datasets. Familiarity with data processing tools (Pandas, NumPy, Spark). Experience building APIs (FastAPI, Flask) for ML services. ...

models into production environments. Data & Engineering Skills Strong SQL skills and experience working with large datasets. Familiarity with data processing tools (Pandas, NumPy, Spark). Experience building APIs (FastAPI, Flask) for ML services. ...

models into production environments. Data & Engineering Skills Strong SQL skills and experience working with large datasets. Familiarity with data processing tools (Pandas, NumPy, Spark). Experience building APIs (FastAPI, Flask) for ML services. ...

models into production environments. Data & Engineering Skills Strong SQL skills and experience working with large datasets. Familiarity with data processing tools (Pandas, NumPy, Spark). Experience building APIs (FastAPI, Flask) for ML services. ...

models into production environments. Data & Engineering Skills Strong SQL skills and experience working with large datasets. Familiarity with data processing tools (Pandas, NumPy, Spark). Experience building APIs (FastAPI, Flask) for ML services. ...

models into production environments. Data & Engineering Skills Strong SQL skills and experience working with large datasets. Familiarity with data processing tools (Pandas, NumPy, Spark). Experience building APIs (FastAPI, Flask) for ML services. ...

models into production environments. Data & Engineering Skills Strong SQL skills and experience working with large datasets. Familiarity with data processing tools (Pandas, NumPy, Spark). Experience building APIs (FastAPI, Flask) for ML services. ...

Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence to data governance ...

Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence to data governance ...

also have Experience developing or using AI applications Experience with NoSQL databases (e.g. MongoDB). Experience with big data processing frameworks (e.g. Apache Spark). Knowledge of Large Language Model (LLM) integration, Retrieval-Augmented Generation (RAG), or Agentic AI frameworks. Experience with high-performance computing (HPC) environments (e.g. ...

Face Transformers; OpenCV for vision. Experiment tracking and reproducibility tools (e.g., MLflow, Weights & Biases). Data wrangling and analysis (Pandas, NumPy, SQL); familiarity with Spark or similar is a plus. Model optimisation and deployment fundamentals: ONNX, TorchScript, FastAPI/gRPC; GPU acceleration (CUDA basics desirable). Responsible ...

MLOps: experiment tracking (e.g., MLflow), model registry, CI/CD for ML. Serving and orchestration: AWS SageMaker, EKS, batch & real-time inference. Data pipelines: Spark/SQL, orchestration (Airflow), monitoring for drift/perf. Nice to Have Cost/performance optimisation on AWS; GPU scheduling; quantisation/distillation. Experience ...

setting. MSc in Computer Science, Machine Learning, or a related field. Experience building data pipelines (realtime or batch) & data quality using modern toolchain (e.g., Apache Spark, Kafka, Airflow, dbt). Strong foundational knowledge of machine learning and deep learning algorithms, including deep neural networks, supervised/unsupervised learning ...

data extraction, transformation, and pipeline development. Experience with dashboarding and visualization tools (Tableau, Qlik, or similar). Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes. Useful experience; Python or R for advanced analytics, automation, or experimentation support. Knowledge of statistical methods and experimentation (A/ ...

data extraction, transformation, and pipeline development. Experience with dashboarding and visualization tools (Tableau, Qlik, or similar). Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes. Useful experience; Python or R for advanced analytics, automation, or experimentation support. Knowledge of statistical methods and experimentation (A/ ...

data extraction, transformation, and pipeline development. Experience with dashboarding and visualization tools (Tableau, Qlik, or similar). Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes. Useful experience; Python or R for advanced analytics, automation, or experimentation support. Knowledge of statistical methods and experimentation (A/ ...

data extraction, transformation, and pipeline development. Experience with dashboarding and visualization tools (Tableau, Qlik, or similar). Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes. Useful experience; Python or R for advanced analytics, automation, or experimentation support. Knowledge of statistical methods and experimentation (A/ ...

understanding of observability tools like Prometheus/Grafana/CloudWatch. Good hands-on experience with Scala/Python/SQL, IaC(Terraform), Glue/Spark, Lambda, CI/CD (Jenkins/Gitlab) Nice to have skills: - QuickSight/Tableau; Redshift tuning; ksqlDB/Flink; Aurora Postgres. - Edge/ ...

containerised workloads (Docker, Kubernetes, Kubeflow, etc.) and integrating with CI/CD tools (Jenkins, GitHub Actions, GitLab CI). Familiarity with distributed computing frameworks (Spark, Ray, TensorFlow Distributed, PyTorch Distributed). Strong understanding of monitoring, logging, and observability for large-scale ML systems. Experience in cost optimisation for compute ...

operational processes Required Qualifications 3+ years of experience as a Data Engineer or in a similar role Strong experience with Azure Databricks (PySpark, Spark SQL) Hands-on experience with Azure Synapse Analytics (dedicated and/or serverless pools) Solid understanding of data warehousing concepts and dimensional modeling Proficiency … Experience working in Agile/Scrum environments Preferred Qualifications Azure certifications (e.g., Azure Data Engineer Associate ) Experience with streaming technologies (Event Hubs, Kafka, or Spark Structured Streaming) Knowledge of data governance tools (Purview, Unity Catalog) Experience with Power BI or other BI/analytics tools Exposure to DevOps, Infrastructure ...

kubernetes) Experience with Key value stores Experience in git and basic Unix Commands You might also have (Desirable) Experience with large data processing technologies (Apache Spark) Apply now! Benefits and Contract Information Financial incentives: depending on circumstances, monthly family/marriage allowance of £278 monthly child allowance ...

meet non-functional requirements Here is a snapshot of the technologies that we use Azure Cloud Technologies, Databricks, Azure DevOps, Python, Java, PowerShell, Apache Spark, YAML Pipelines, Esri ArcGIS, JMeter What we're looking for Highly skilled in creating, maintaining and peer reviewing secure test automation code ...

Terraform or Ansible for infrastructure automation. Working knowledge of Angular or similar UI frameworks. Solid understanding of SQL and relational database design. Experience with Apache Spark for distributed data processing (Mandatory). Strong problem-solving, analytical, and debugging skills. Excellent communication and teamwork abilities. If you are interested ...

Terraform or Ansible for infrastructure automation. Working knowledge of Angular or similar UI frameworks. Solid understanding of SQL and relational database design. Experience with Apache Spark for distributed data processing (Mandatory). Strong problem-solving, analytical, and debugging skills. Excellent communication and teamwork abilities. If you are interested ...

Good communication skills – able to explain data to non-technical colleagues Comfortable working independently, managing your own projects Desirable skills: SQL knowledge Experience with Spark or other big data tools Practical Details Salary: £45,000 – £50,000 per annum Location: Bracknell Head Office Working Pattern: Hybrid – typically 3 days ...