10 of 10 Apache Spark Jobs in Central London

/ELT) to support analytics and downstream use cases Developing scalable data solutions using Python , with a focus on maintainability and performance Working with Apache Spark/PySpark to process and transform large datasets Supporting the ingestion, transformation and validation of complex financial data Improving the performance, reliability … That Will Help You Succeed Essential Commercial experience as a Data Engineer at a mid‐level Strong Python development skills Hands‐on experience with Apache Spark/PySpark Solid experience building ETL/ELT pipelines Background within the financial services industry (investment management experience desirable) Comfortable working with ...

Solid understanding of data warehousing, lakehouse and datalake architectures Familiarity with modern data engineering patterns (ETL/ELT, medallion architecture, observability) Experience working with Apache Spark and large-scale data processing For a full consultation on this exciting new role, please get in touch with ARC IT Recruitment ...

+ 10% bonus + benefits Purpose: Build and maintain large, scalable Data Lakes, processes and pipelines Tech: Python, PySpark, AWS, Iceberg/Kafka, Spark/Glue, CI/CD Industry: Financial services/securities trading Immersum continue to support a leading SaaS securities trading platform, who are hiring … Infra tooling using Terraform, Ansible and Jenkins whilst automating everything with Python Tech (experience in any listed is advantageous) Python Cloud: AWS Lake house: Apache Spark or AWS Glue Cloud Native storage: Iceberg, RDS, RedShift, Kafka IaC: Terraform, Ansible CI/CD: Jenkins, Gitlab Other platforms such ...

Messaging Technologies with a good understanding of Kubernetes, Dockers and preferably some exposure to GCP (Google Cloud Platform), ReactJS, Python, Big Data Technologies like Spark, Beam Excellent personal organisation, completer/finisher, consensus builder with excellent communication skills and able to lead global development teams both directly ...

PyTorch, TensorFlow, JAX) Experience with scikit-learn, XGBoost, LightGBM Strong software engineering practices and clean code principles Data & Computing : Experience with big data technologies (Spark, Dask) SQL and NoSQL databases Cloud platforms (AWS, GCP, Azure) Experience Track record of successfully deployed ML models at scale Experience with time series ...

Feature Store Containerisation and orchestration using Docker, Kubernetes or ECS Infrastructure as Code using Terraform or CloudFormation Large-scale data processing frameworks such as Spark or Dask Knowledge of data governance, compliance and regulated environments Experience delivering solutions within highly regulated industries such as government, finance or healthcare Security ...

stores (Feast, AWS Feature Store). Containerisation (Docker) and orchestration (Kubernetes, ECS). Infrastructure as Code (Terraform, CloudFormation). Large-scale data processing frameworks (Spark, Dask). Familiarity with data governance and compliance frameworks. Experience in regulated industries such as healthcare or finance. Benefits: Competitive salary ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. We build and operate ground-breaking, ultra-secure ...

generative AI applications. Perform Exploratory Data Analysis (EDA), data mining, and visualization to extract insights. Design and implement Big Data solutions using Hadoop, Spark, PySpark, and Data Lake architectures. Develop and deploy ML models (supervised, unsupervised, tree-based, ensemble methods). Implement deep learning architectures (CNN, RNN, LSTM) using … compliance of AI systems. Required Skills: Analytical Tools: EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) Statistical & Multivariate Analysis Big Data: Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning Supervised Models: Nave Bayes, Logistic Regression, SVM, Linear Regression, KNN, Tree-Based Models: Decision Trees ...

architecture, and network stack optimization. Data Infrastructure: Familiarity with the modern data stack, including time-series databases, object stores, and streaming frameworks like Apache Flink or Spark Streaming . Engineering Rigor: You write clean, testable, and reliable code. You understand that in this environment, a system failure ...