24 of 24 Remote Apache Spark Jobs in London

Lead, Data Engineering Manager etc. Proven success with modern data infrastructure: distributed systems, batch and streaming pipelines Hands-on knowledge of tools such as Apache Spark, Kafka, Databricks, DBT or similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes ...

Lead, Data Engineering Manager etc. Proven success with modern data infrastructure: distributed systems, batch and streaming pipelines Hands-on knowledge of tools such as Apache Spark, Kafka, Databricks, DBT or similar Experience building, defining, and owning data models, data lakes, and data warehouses Programming proficiency in the likes ...

proficiency in programming languages such as Python, Java, or Scala. Experience with cloud platforms like Azure. Knowledge of big data technologies such as Hadoop, Spark, or Kafka. Proficiency in SQL and database management systems. Familiarity with data warehousing concepts and tools. Ability to work collaboratively with cross-functional teams. ...

proficiency in programming languages such as Python, Java, or Scala. Experience with cloud platforms like Azure. Knowledge of big data technologies such as Hadoop, Spark, or Kafka. Proficiency in SQL and database management systems. Familiarity with data warehousing concepts and tools. Ability to work collaboratively with cross-functional teams. ...

Lake Azure Synapse Azure SQL and Azure Storage Azure Data Factory ADF Expertise in building and managing complex data pipelines Databricks Handson experience with Spark based data processing notebooks and ML workflows Data Modeling Proficiency in conceptual logical and physical data modeling SQL Python Advanced skills for data manipulation ...

Lake Azure Synapse Azure SQL and Azure Storage Azure Data Factory ADF Expertise in building and managing complex data pipelines Databricks Handson experience with Spark based data processing notebooks and ML workflows Data Modeling Proficiency in conceptual logical and physical data modeling SQL Python Advanced skills for data manipulation ...

. Experience with AWS services – Lambda, SNS, S3, EKS, API Gateway. Knowledge of ETL/ELT design, Data Warehousing and big data frameworks (Snowflake, Spark etc.). Understanding of governance and compliance (GDPR, HIPAA). Strong stakeholder management and communication skills. Ability to provide technical leadership, set modelling standards ...

/or machine learning) Deep technical understanding of data engineering and AI/ML tooling, workflows, and trends in enterprise setting Proficiency in Python, Spark, and/or SQL with experience developing ETL applications Excellent communication and presentation skills, with comfort in objection handling Hands-on experience with ...

5+ years in Data Engineering, Data Quality, or Data Governance roles with production systems. Strong SQL and hands-on experience with one or more: Spark/Databricks, dbt, Airflow/Databricks Workflows, Kafka/Kinesis, Python. Experience implementing data quality frameworks and observability (e.g., Great Expectations, Soda, Monte Carlo ...

DataDog etc.) Understanding of DataOps, FinOps, and cost-optimised data management practices. Familiarity with distributed systems and high-throughput data processing (e.g. Ray, Dask, Spark). Experience with feature engineering, model lifecycle management, and data-driven research environments (e.g. JupyterHub). Our recruitment philosophy We value self-awareness ...

DataDog etc.) Understanding of DataOps, FinOps, and cost-optimised data management practices. Familiarity with distributed systems and high-throughput data processing (e.g. Ray, Dask, Spark). Experience with feature engineering, model lifecycle management, and data-driven research environments (e.g. JupyterHub). Our recruitment philosophy We value self-awareness ...

governance, and data architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data governance, data sharing across ...

private/on-prem AI platforms (e.g. NVIDIA-based stacks, private AI platforms). Solid understanding of data engineering concepts (ETL, data lakes, Spark or similar). Experience designing scalable, distributed systems. Familiarity with model lifecycle management and MLOps practices. Proven ability to align AI initiatives to business outcomes ...

model lifecycle management (MLOps), including monitoring, retraining, and model versioning. Ability to work across data infrastructure, from SQL to large-scale distributed data tools (Spark, etc.). Strong written and verbal communication skills, especially in cross-functional contexts. Bonus Experience (Nice to Have) Exposure to large language models (LLMs ...

data extraction, transformation, and pipeline development. Experience with dashboarding and visualization tools (Tableau, Qlik, or similar). Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes. Useful experience; Python or R for advanced analytics, automation, or experimentation support. Knowledge of statistical methods and experimentation (A/ ...

data extraction, transformation, and pipeline development. Experience with dashboarding and visualization tools (Tableau, Qlik, or similar). Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes. Useful experience; Python or R for advanced analytics, automation, or experimentation support. Knowledge of statistical methods and experimentation (A/ ...

data extraction, transformation, and pipeline development. Experience with dashboarding and visualization tools (Tableau, Qlik, or similar). Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes. Useful experience; Python or R for advanced analytics, automation, or experimentation support. Knowledge of statistical methods and experimentation (A/ ...

data extraction, transformation, and pipeline development. Experience with dashboarding and visualization tools (Tableau, Qlik, or similar). Familiarity with big data tools (Snowflake, Databricks, Spark) and ETL processes. Useful experience; Python or R for advanced analytics, automation, or experimentation support. Knowledge of statistical methods and experimentation (A/ ...

experience mentoring Junior Engineers and setting best-practice within a team Experience in the following would be beneficial: Working with big data technology, ideally Spark but others will also be useful such as Hadoop or Elasticsearch Experience with DevOps tooling and approaches (automation and tooling is something ...

operational processes Required Qualifications 3+ years of experience as a Data Engineer or in a similar role Strong experience with Azure Databricks (PySpark, Spark SQL) Hands-on experience with Azure Synapse Analytics (dedicated and/or serverless pools) Solid understanding of data warehousing concepts and dimensional modeling Proficiency … Experience working in Agile/Scrum environments Preferred Qualifications Azure certifications (e.g., Azure Data Engineer Associate ) Experience with streaming technologies (Event Hubs, Kafka, or Spark Structured Streaming) Knowledge of data governance tools (Purview, Unity Catalog) Experience with Power BI or other BI/analytics tools Exposure to DevOps, Infrastructure ...

operational processes Required Qualifications 3+ years of experience as a Data Engineer or in a similar role Strong experience with Azure Databricks (PySpark, Spark SQL) Hands-on experience with Azure Synapse Analytics (dedicated and/or serverless pools) Solid understanding of data warehousing concepts and dimensional modeling Proficiency … Experience working in Agile/Scrum environments Preferred Qualifications Azure certifications (e.g., Azure Data Engineer Associate ) Experience with streaming technologies (Event Hubs, Kafka, or Spark Structured Streaming) Knowledge of data governance tools (Purview, Unity Catalog) Experience with Power BI or other BI/analytics tools Exposure to DevOps, Infrastructure ...

platform architecture and help improve maintainability, reliability, and scalability Assist in integrating new technologies and frameworks to support evolving business needs Bonus Experience Kafka, Spark, Trino, Redis SQL (Postgres, Oracle) Cloud technologies: AWS, Kubernetes, Docker Observability tools: Splunk, Prometheus, Grafana Secondary languages: Python, Ruby Compensation: Competitive (circa £150k total ...

quantitative discipline (Mathematics, Computer Science, Data Science, Physics or Statistics) Experience in data analytics or model development (internships included) Proficiency in designing, implementing (python, spark, cloud environments) and deploying quantitative models in a large financial institution, preferably in Front Office. Hands-on approach needed Experience utilising Machine Learning ...

English; other European languages advantageous. What We Can Offer You At Nscale, you'll find a collaborative, supportive, and innovative environment where your contributions spark real impact. We're building something extraordinary, and our people are driving it. Competitive package with reviews every 12 months 🚀 Hybrid or remote working ...