1 to 25 of 5,178 Python Jobs in London

Deep understanding of data warehouse design principles and methodologies Advanced knowledge of optimisation techniques for large‐scale data processing Strong proficiency in SQL and Python for handling complex data problems Hands‐on experience with Apache Spark (PySpark or Spark SQL) Experience with the Azure data stack Knowledge of workflow orchestration ...

business problems into data, analytical and technical tasks with support from senior colleagues. Design, build and maintain data pipelines, models and products using SQL, Python and modern data engineering tools. Work with data warehouses, lakehouse platforms and event-driven patterns, including building semantic models for analytics and visualisation. Contribute … Looking For Core Data & Technical Skills Experience translating business questions into data or analytical requirements, with guidance where needed. Good SQL and Python skills for data modelling, transformation, automation and analysis. Experience working with data models in data warehouses, lakehouse environments or analytics tools such as Power BI. Familiarity with ...

problem-solving skills. Strong written and verbal communication skills in English. Ability to work independently and within distributed international teams. Programming Languages Technical Skills Python (Expert Level) C# JavaScript/TypeScript SQL AI & Machine Learning Machine Learning Deep Learning Neural Networks Natural Language Processing (NLP) Generative AI Large Language Models ...

Engineer or similar . Strong hands-on experience building and operating cloud-native data platforms . Strong programming experience using Java and/or Python . Hands-on experience with real-time streaming and event-driven architectures , including Kafka, Kinesis or equivalent. Experience with distributed data processing technologies such ...

scope, acting as the key point of escalation for decisions that impact your area of work - Demonstrable experience of building data pipelines using Spark, Python or SQL - Experience working with AWS and its data and AI/ML services such as SageMaker - Experience of big data and lakehouse platforms ...

OLTP systems from an integration perspective. Strong SQL skills, including writing procedures, views and functions for data analysis, profiling and quality checks. Proficiency in Python (or a similar language) and experience with orchestration and transformation tooling (e.g. Databricks Workflows, Lakeflow Declarative Pipelines, Azure Data Factory, dbt). Experience designing metadata ...

Senior Data Engineer Role (Python/Spark/Databricks) - Hybrid - Contract - Banking Role - Senior Data Engineer Rate - £850 p/d (Inside IR35) Duration - 6 months with very likely extension Location - Hybrid/Liverpool Street (London) - 3 days per week in a Liverpool Street office About the Role Global financial … responsible for delivering critical data platforms and analytics capabilities across the business. This is a genuinely hands-on engineering role, requiring strong expertise in Python, Databricks, Spark/PySpark and SQL. The successful candidate will be actively involved in the design, development, optimisation and support of enterprise-scale data platforms ...

remote long-term contract opportunity with a leading client in London.## Requirements* 8+ years of experience in Data Engineering* Strong expertise in Python and extensive experience with PySpark and distributed data processing* Expert-level knowledge of AWS services including EMR, Glue, Lambda, S3, Athena, Redshift, ECS/EKS, Step Functions … Computer Science, Engineering, or a related field* Language(s): English (fluent)## Job Description* Design, develop, and maintain large-scale data pipelines using Python and PySpark* Build and optimise batch and near real-time data processing solutions* Design scalable data architectures on AWS* Develop ETL/ELT workflows for ingesting ...

DevOps & Automation Maintain CI/CD pipelines using Azure DevOps, GitHub Actions, etc., for ADF, Databricks and ML model deployments. Develop automation scripts in Python, PowerShell, or Bash to reduce manual intervention and improve service reliability. SQL and Data Warehouse Operations Write, optimize, and troubleshoot SQL queries for data validation … monitoring); Power BI Service (dataset refreshes, access control, report diagnostics). DevOps & Automation – CI/CD using Azure DevOps, GitHub Actions, YAML pipelines. Scripting – Python, PowerShell. Monitoring – Azure Monitor, Log Analytics, Alerts, Application Insights. SQL & Data Warehousing – SQL skills for debugging, data validation, and optimization; experience with Azure ...

Logic Apps Azure Stream Analytics Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell) Strong PySpark, Delta Lake, Unity Catalog and Python skills. Includes ability to write unit and integration tests in Python with unittest, pytest, etc. Strong understanding of software development practices, such as SOLID principals ...

experience with GCP data services such as BigQuery, Dataflow, Dataproc, Cloud Composer (Airflow), Pub/Sub, Cloud Storage, Bigtable, and Cloud SQL. Proficiency in Python and SQL, with experience in Spark or Apache Beam. Experience designing data warehouse and data lake architectures, including data modeling. Working experience with Terraform ...

Selection Criteria Expertise in designing and building data intensive applications and pipelines, with an open mindset on choice of tools Strong proficiency in Python and SQL, with a focus on writing clean, performant code to process and manage large volumes of data Experience designing and implementing complex data-matching, reconciliation ...

Code (IaC) using Terraform and/or Bicep with good understanding of Azure Resource Manager. Experience with scripting and automation using languages such as Python, Bash, or PowerShell. Solid understanding of CI/CD principles and experience with tools like Jenkins, Github Actions, GitLab CI, or Azure DevOps (ADO). ...

have some of the skills and experience listed below, don’t let that stop you from applying! Engineering and Data Engineering Hands-on Python experience Knowledge of cloud infrastructure like AWS, GCP or Azure Have used version control systems, specifically Git or similar tools Understanding of TDD and diverse testing ...

level and we are looking for data engineers who have a variety of different skills which include some of the below. Strong proficiency in Python Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: Data warehousing and lake architectures ETL/ELT pipeline development SQL and NoSQL databases ...

including writing complex queries, partitioning, clustering and cost-aware query optimisation . Experience of modern orchestration/ELT tooling, ideally Dagster and dbt. Strong Python for data engineering Solid understanding of data warehousing techniques; ETL/ELT processes and dimensional modelling. Experience designing data models and documentation that are usable ...

consultative approach, youre comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are seeking an experienced Python Developer with significant data engineering experience to join a high-performing engineering team working on secure, data-intensive systems. The successful candidate will have a strong … background in Python software development, data engineering and data processing, with experience designing, building and maintaining robust data pipelines and services within complex technical environments. Requirements Key Responsibilities: Design, develop and maintain high-quality Python applications, services and data processing solutions. Build and optimise scalable ETL/ELT pipelines ...

consultative approach, you’re comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are seeking an experienced Python Developer with significant data engineering experience to join a high-performing engineering team working on secure, data-intensive systems. The successful candidate will have … strong background in Python software development, data engineering and data processing, with experience designing, building and maintaining robust data pipelines and services within complex technical environments. Key Responsibilities: Design, develop and maintain high-quality Python applications, services and data processing solutions. Build and optimise scalable ETL/ELT pipelines ...

passionate about building and delivering transformative digital solutions for a diverse range of Public and Private sector clients. We are recruiting for a Senior Python Developerto join our Hippo Herd. We work at the intersection of strategy, design, and technology to solve complex problems and create lasting value. Our collaborative … agile culture empowers our teams to make a genuine impact. As a Senior Python Developer, you will play an important role in making Hippo the best Consultancy out there. You will work as part of a multi-disciplinary team combining data, design, product, delivery, analysis and engineering to deliver bespoke ...

Full-Stack Developer – React, Python, Oracle Database, and AI/GenAI Job Category: Full-Stack Development/Software Engineering Job Type: Full-Time Job Location: London Boundaryless is a boutique consulting firm, providing clients with deep expertise in advanced analytics & data forensics, agentic automation, and Artificial Intelligence solutions. We operate … deploy end-to-end applications across front-end and back-end technologies. Build responsive, scalable, secure, and user-focused web applications using React.js, Python, and Oracle Database. Develop and maintain robust back-end services, APIs, and microservices using Python frameworks such as FastAPI, Flask, or Django. Build high-performance front ...

using modern cloud-native data engineering technologies. Provide technical direction across data modelling, ingestion, transformation, orchestration and integration. Apply practical experience of Spark, PySpark, Python and SQL within enterprise data environments. Governance, Security & Quality Embed effective data governance, security, quality and access controls within cloud data environments. Ensure architecture decisions … another cloud data platform. Strong understanding of modern data architecture patterns, data modelling and ETL/ELT approaches. Practical experience with Spark, PySpark, Python and SQL and the design of scalable batch and real-time data pipelines. Experience designing appropriate data governance, security and data quality controls. Experience with modern ...

teams. Design, build, test and deploy scalable batch and near-real-time data pipelines, reusable data products and analytics solutions on Snowflake using SQL, Python, Snowpark, Snowpipe, Streams, Tasks and Dynamic Tables. Deliver across the full data engineering lifecycle, from requirements analysis and solution design through development, testing, deployment, operational … skills. Technical proficiency Experience developing or supporting cloud data warehouses using Snowflake and at least one of AWS, Azure or GCP. Proficiency in SQL, Python, data stack frameworks, integration libraries and orchestration tools, including Snowpark, Snowpipe, Streams, Tasks and Dynamic Tables. Knowledge of Snowflake architecture, stages, file formats, virtual warehouse ...

closely related field. Proven experience designing and building scalable data pipelines (ETL/ELT) for batch and streaming use cases using modern technologies (e.g., Python, SQL, Spark, Flink, Airflow) and advanced knowledge on the workings of these. Hands-on experience in building and operating workloads Databricks. Hands-on experience creating ...

Databricks and/or Snowflake, including the design, implementation, and optimization of data platforms at scale Strong SQL expertise and software engineering experience using Python and/or other modern programming languages. Experience developing and orchestrating data pipelines using technologies such as DBT, Apache Spark, Airflow, Dagster, Kafka, Flink ...

Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such as Python Reporting tools (e.g. Tableau, PowerBI, Qlik) GDPR and Government Service Standard (desirable) Passionate, motivated and enthusiastic about developing technology solutions. Experience working in an Agile ...