176 to 195 of 195 PySpark Jobs in London

estate from Python/MySQL into a Databricks + Snowflake ecosystem built for scale, auditability and reliability. The Role Build & optimise pipelines in Databricks, PySpark, Python, Kafka Modernise legacy systems into a scalable, auditable cloud data platform Work closely with Product, DevOps & Regulatory teams You Bring Strong Python, PySpark ...

verbal communication skills, including the ability to explain complex methodology to diverse audiences. You might also have Familiarity with Databricks, DBT, Spark/PySpark, or similar large‐scale data platforms. Modified infrastructure‐as‐code (e.g. Terraform) or contributing to production data pipelines. Mentored junior data scientists or engineers. Knowledge … passion for, the cryptocurrency and blockchain space. Technologies we use Python SQL Databricks DBT PySpark/Spark Terraform AWS Postgres We encourage applicants across any race, ethnicity, gender/gender expression, age, spirituality, ability, experience and more. If you need any accommodations to make our interview process more accessible ...

Support data migration efforts from Azure to Databricks Use Terraform to manage and deploy cloud infrastructure Build robust data workflows in Python (e.g., pandas, PySpark) Ensure the platform is scalable, efficient, and ready for future AI use cases REQUIRED SKILLS & EXPERIENCE Strong experience with Azure and Databricks environments Advanced … Python skills for data engineering (pandas, PySpark) Proficiency in designing and maintaining ETL pipelines Experience with Terraform for infrastructure automation Track record of working on cloud migration projects, especially Azure to Databricks Comfortable working onsite in London 2 days/week and engaging cross-functionally Strong communication and problem ...

pipelines to ingest, transform, and prepare data Develop and optimise datasets for reporting and analytics Implement data transformations using SQL and Python (incl. PySpark) Monitor, troubleshoot, and improve performance of data pipelines and queries Apply data quality controls and maintain clear documentation Contribute to ongoing improvements in data architecture … with AWS data services (e.g. Redshift, Athena, S3, Glue, Lambda) Strong SQL skills Exposure to SnapLogic or similar integration platforms Proficiency in Python (including PySpark) Familiarity with modern data tooling (e.g. open table formats, DuckDB beneficial) Experience with version control (Git/CodeCommit preferred) Awareness of BI tools (e.g. ...

star schema and other best practices to optimise data usability. Sets best practices and standards on how we use SQL & dbt/Python/Pyspark and/or other languages to solve business problems. Becomes an expert in the business subject area the team are working on, holding expertise … click. We're a group that chooses to lift each other up and think smart every day. Extensive experience in SQL/Python/Pyspark and/or other languages relevant to data processingExtensive experience in dbt and ideally Airflow (or other orchestration tools)Extensive experience in Entity-Relationship ...

New Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time ...

Engineering team focused on Customer value understanding and delivering scalable data solutions. You will design, build and maintain production-grade data pipelines across AWS, PySpark, Snowflake and SQL-based transformations, while driving best practices in CI/CD, DevOps and data modelling in a cross-functional environment. #J ...

contribute to engineering standards and help drive best practices across the team. You'll build scalable data pipelines and frameworks using Azure, Databricks and PySpark, working across the full engineering lifecycle from design through to production. You'll also support other engineers through code reviews, knowledge sharing and pair … reliable data solutions that create real business value. Skills & Experience Strong experience building cloud-native data platforms, ideally on Azure Commercial experience with Databricks, PySpark and Python Strong SQL and data engineering expertise Experience designing and delivering scalable ETL and data pipeline solutions #J-18808-Ljbffr ...

contribute to engineering standards and help drive best practices across the team. You'll build scalable data pipelines and frameworks using Azure, Databricks and PySpark, working across the full engineering lifecycle from design through to production. You'll also support other engineers through code reviews, knowledge sharing and pair … reliable data solutions that create real business value. Skills & Experience Strong experience building cloud-native data platforms, ideally on Azure Commercial experience with Databricks, PySpark and Python Strong SQL and data engineering expertise Experience designing and delivering scalable ETL and data pipeline solutions If you're looking ...

deployment Productionise models developed by Data Scientists, transforming notebooks and prototypes into modular, tested and production-ready code Develop scalable ML solutions using Python, PySpark, Databricks and MLflow Deploy machine learning models into batch and real-time environments through APIs, scheduled workflows and production pipelines Manage model versioning, promotion … commercial experience as an ML Engineer, with a clear focus on engineering and productionising machine learning models Strong hands-on development skills across Python, PySpark and SQL Commercial experience working with Databricks, MLflow and Delta Lake Proven experience building and operating distributed data and machine learning pipelines Experience taking ...

Technical Skills You'll have experience with some of the following: Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you've held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. Deerfoot Recruitment Solutions Ltd is a leading independent tech recruitment consultancy in the UK. For every CV sent to clients, we donate ...

EPAM Systems in London seeks a Senior Data Engineer - Tech Lead to shape cloud-native data platforms using Azure Databricks, PySpark and Lakehouse principles. You will lead architecture, drive modernization, and mentor engineers while delivering scalable pipelines for high-volume workloads. You will collaborate with stakeholders to translate business ...

hackajob is partnering directly with Barclays to hire for this role. Join us at Barclays as an Integrated Financial Crime Model Developer. You will design, build and deploy machine learning models that support scalable, high ...

hackajob is partnering directly with Barclays to hire for this role. Join us at Barclays as an Integrated Financial Crime Model Developer. You will design, build and deploy machine learning models that support scalable, high ...

this area will be required to support the Data Scientists to run a Proof of Concept (PoC) Migration Phase. Support in transforming Programme PySpark for the respective use cases, as part of migration preparation. Work collaboratively with nominated Data Scientists (Programme) to validate the functionality/performance … important the resources work collaboratively with the nominated Data Scientists to help with model/data pipeline build standardisation, issue resolution, etc. PySpark experience. The pipeline is written in PySpark, it is vital that the engineers can quickly get up to speed on the pipeline, advise on efficiency ...

this area will be required to support the Data Scientists to run a Proof of Concept (PoC) Migration Phase. Support in transforming Programme PySpark for the respective use cases, as part of migration preparation. Work collaboratively with nominated Data Scientists (Programme) to validate the functionality/performance … important the resources work collaboratively with the nominated Data Scientists to help with model/data pipeline build standardisation, issue resolution, etc. PySpark experience. The pipeline is written in PySpark, it is vital that the engineers can quickly get up to speed on the pipeline, advise on efficiency ...

leading Data Management consultancy in London seeks a skilled professional experienced in PySpark and Apache Spark for a hands-on role. You will work closely with clients and play a crucial part in developing innovative solutions using cloud technologies like AWS, Azure, and GCP. Excellent communication and ability ...

pipelines covering data preparation, experimentation, training, evaluation, deployment, monitoring, and optimisation. Develop large-scale data processing and feature engineering solutions using technologies such as PySpark and Databricks. Create multimodal machine learning models that combine image, text, metadata, and behavioural data to enhance forecasting and AI capabilities. Collaborate with Applied … Strong Python software engineering expertise, including testing, code quality, and maintainable application development. Proven experience working with large-scale data processing technologies such as PySpark and Databricks. Strong background building end-to-end ML pipelines across the full machine learning lifecycle. Hands-on experience with deep learning frameworks including ...

data products — from client scoping and solution design to execution and ongoing delivery. Ensure high analytical and technical standards across the team, including SQL, PySpark, Python, and data validation best practices. Act as an escalation point for complex analytical challenges, providing hands‐on guidance where needed. Partner closely with … perfect job for someone who has: Proven experience managing and mentoring data analysts or analytics teams. Strong hands‐on experience with SQL and PySpark for data analysis — Must. Strong Python scripting experience — Must. Excellent communication skills in English, with the ability to translate complex analysis into clear business insights. ...

. The role focuses on building data models and pipelines in Snowflake, including Snowflake ML, and collaborating with Data Scientists to migrate and validate PySpark-based use cases during the September–December window. Ideal candidates will bring Snowflake expertise, PySpark experience, and DBT knowledge. #J-18808-Ljbffr ...