126 to 140 of 140 Apache Spark Jobs in London

tooling and working with large transactional datasets • Understanding of OTC products including CDS, Interest Rate Swaps and Variance Swaps Highly Desirable • Experience with C++, Spark, Kafka or other distributed compute tools • Exposure to position keeping, risk, or PnL systems • Strong debugging, profiling and optimisation capability across data pipelines ...

tooling and working with large transactional datasets Understanding of OTC products including CDS, Interest Rate Swaps and Variance Swaps Highly Desirable Experience with C++, Spark, Kafka or other distributed compute tools Exposure to position keeping, risk, or PnL systems Strong debugging, profiling and optimisation capability across data pipelines ...

stores (Feast, AWS Feature Store). Containerisation and orchestration (Docker, Kubernetes, ECS). Infrastructure as Code (Terraform, CloudFormation). Large-scale data processing frameworks (Spark, Dask). Experience in regulated industries or working with sensitive data. Security Clearance UKIC DV eligible required £7,000 tax-free DV bonus ...

stores (Feast, AWS Feature Store). Containerisation and orchestration (Docker, Kubernetes, ECS). Infrastructure as Code (Terraform, CloudFormation). Large-scale data processing frameworks (Spark, Dask). Experience in regulated industries or working with sensitive data. Security Clearance UK SC/DV eligibility required. £7,000 tax-free ...

Level grades are included on your CV). Basic scripting knowledge in Python or Bash Excellent customer-facing skills You have a sales spark - while this role isn't a focussed sales role, this is required due to the nature of the role A motivated self-starter with ...

power, and deep knowledge of just about every industry. We believe a mix of data, analytics, automation, and responsible AI can do almost anything—spark digital metamorphoses, widen the range of what humans can do, and breathe life into smart products and services. Want to join our crew ...

power, and deep knowledge of just about every industry. We believe a mix of data, analytics, automation, and responsible AI can do almost anything—spark digital metamorphoses, widen the range of what humans can do, and breathe life into smart products and services. Want to join our crew ...

Design, develop, and optimise data pipelines for large datasets from multiple sources (APIs, databases, financial data providers). Implement complex data transformations using Spark (PySpark or Scala) and other tools. Work extensively with Azure Databricks , including Unity Catalog, Delta Lake, and Spark SQL. Ensure data quality, consistency … . Automate deployments and implement DevOps best practices , including CI/CD pipelines. Tech Stack & Skills Azure Databricks ( 3+ years hands-on) Python and Spark (PySpark) or Scala SQL/NoSQL databases Azure Data Factory, Blob Storage, Azure SQL Database Data pipeline optimisation & architecture design Streaming data: Kafka ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue ...

fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure data quality and alignment with business goals. Utilize programming expertise … experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services on AWS Extensive knowledge of AWS services like API Gateway, Lambda, Redshift, Glue ...

generative AI applications. - Perform Exploratory Data Analysis (EDA), data mining, and visualization to extract insights. - Design and implement Big Data solutions using Hadoop, Spark, PySpark, and DataLake architectures. - Develop and deploy ML models (supervised, unsupervised, tree-based, ensemble methods). - Implement deep learning architectures (CNN, RNN, LSTM) using TensorFlow … compliance of AI systems. Required Skills: Analytical Tools: - EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) - Statistical & Multivariate Analysis Big Data: - Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark - DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning - Supervised Models: Naïve Bayes, Logistic Regression, SVM, Linear Regression, KNN - Tree-Based Models: Decision Trees ...

generative AI applications. - Perform Exploratory Data Analysis (EDA), data mining, and visualization to extract insights. - Design and implement Big Data solutions using Hadoop, Spark, PySpark, and DataLake architectures. - Develop and deploy ML models (supervised, unsupervised, tree-based, ensemble methods). - Implement deep learning architectures (CNN, RNN, LSTM) using TensorFlow … compliance of AI systems. Required Skills: Analytical Tools: - EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) - Statistical & Multivariate Analysis Big Data: - Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark - DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning - Supervised Models: Naïve Bayes, Logistic Regression, SVM, Linear Regression, KNN - Tree-Based Models: Decision Trees ...

generative AI applications. Perform Exploratory Data Analysis (EDA), data mining, and visualization to extract insights. Design and implement Big Data solutions using Hadoop, Spark, PySpark, and Data Lake architectures. Develop and deploy ML models (supervised, unsupervised, tree-based, ensemble methods). Implement deep learning architectures (CNN, RNN, LSTM) using … compliance of AI systems. Required Skills: Analytical Tools: EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) Statistical & Multivariate Analysis Big Data: Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning Supervised Models: Nave Bayes, Logistic Regression, SVM, Linear Regression, KNN, Tree-Based Models: Decision Trees ...