7 of 7 Remote/Hybrid PySpark Jobs in the City of London

deployment automation and infrastructure-as-code practices. What We're Looking For Essential Strong commercial experience building production-grade data pipelines using Apache Spark (PySpark preferred). Experience delivering modern data platforms using Databricks or an equivalent Spark-based platform. Strong SQL skills and experience with data modelling. Good ...

strong problem solving, communication, and stakeholder management skills. Requirements 4-6 years of experience in data engineering with a strong focus on Databricks (SQL & PySpark). Strong hands-on experience with Azure data services, including ADF, ADLS, and Azure Functions. Proven experience designing and implementing metadata-driven data pipelines. ...

best practices and driving a culture of continuous improvement. Requirements 8+ years of experience in data engineering with a strong focus on Databricks (SQL & PySpark). Extensive experience with Azure data services, including ADF, ADLS, and Azure Functions. Proven track record of designing and implementing metadata‐driven data pipelines. ...

Datatech Analytics is seeking an AWS Data Engineer to own and evolve data products in a hybrid London-based role. You will design and optimise ETL/ELT pipelines, expand the AWS data lake, and ...

Physics, Statistics, or a related quantitative field. Core Technical Stack: Hands-on proficiency with Python, SQL, and Excel, alongside exposure to platforms like Databricks, PySpark, Palantir Foundry, or R. Specialized Experience: Proven track record in delivering advanced analytics, algorithm design, operational research, or big data engineering solutions. Energy & Utilities ...

experience with Azure Cosmos DB, including SQL API and Mongo API. Excellent knowledge of Cosmos DB Change Data Feed (CDF) and Spark integration. Strong PySpark and Apache Spark distributed computing experience. Experience with Cosmos DB SDKs, including .NET, Java, Python or Node.js. Expertise in NoSQL data modelling, partitioning, indexing … experience with Pytest and automated unit/integration testing. Knowledge of Git, GitLab DevOps and CI/CD pipelines. Experience with Microsoft Fabric and PySpark data pipelines. For more information or to apply directly, please email I review applications daily and will contact shortlisted candidates as quickly as possible. ...

Data Engineer - PySpark/AI Location: Holborn, London - hybrid, three office days per week Salary: Up to £75,000 dependent on experience Ref: J13171 Our client is a growing technology business developing data and AI products that help organisations gain deeper insight into consumer behaviour. They are expanding their … decisions Use Claude Code to support development, debugging, testing and documentation Experience required: Strong SQL skills for transforming, cleaning and loading data Commercial Python, PySpark and Pandas experience Experience with orchestration tools such as Airflow, Dagster or Celery Practical experience with Spark and EMRHands-on knowledge of AWS services ...