1 to 25 of 4,785 Permanent Python Jobs in the UK

architectures that power intelligent decision-making. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Develop and support real-time streaming pipelines and event-driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using ...

Implement best practices for Databricks development and deployment. Optimise Databricks workloads for performance and cost. Need to program using the languages such as SQL, Python, R, YAML and JavaScript Data Integration: Integrate data from various sources, including relational databases, APIs, and streaming data sources. Implement data integration patterns and best … Skills & Experience: 10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks. Strong proficiency in Python and Spark (PySpark) or Scala. Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns. Extensive experience with Azure data services, including ...

Implement best practices for Databricks development and deployment. Optimise Databricks workloads for performance and cost. Need to program using the languages such as SQL, Python, R, YAML and JavaScript Data Integration: Integrate data from various sources, including relational databases, APIs, and streaming data sources. Implement data integration patterns and best … Skills & Experience: 10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks. Strong proficiency in Python and Spark (PySpark) or Scala. Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns. Extensive experience with Azure data services, including ...

Technical Leadership: Oversee data modelling, data governance, and data quality frameworks while driving technical excellence. Strong hands-on experience in technologies such as SQL, Python, Spark, and modern cloud data services. Collaborate with engineering and DevOps teams to establish CI/CD architectures using Azure DevOps, Kubernetes, and Terraform. Familiarity … Recognised expert in Data Architecture, Data Modelling, Engineering, and data platform design. Experience utilising distributed and non-distributed compute architectures with strong proficiency in Python, SQL, Spark, and Scala. Experience architecting CI/CD frameworks (Azure DevOps, GitHub Actions, Jenkins) with real-world platform lifecycle management. Infrastructure-as-Code expertise ...

Engineer or similar . Strong hands-on experience building and operating cloud-native data platforms . Strong programming experience using Java and/or Python . Hands-on experience with real-time streaming and event-driven architectures , including Kafka, Kinesis or equivalent. Experience with distributed data processing technologies such ...

query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery Support the performance tuning … Data Factory, Synapse Pipelines, Azure Functions and Logic Apps PySpark SQL (Athena, Redshift, Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring Git, CI/CD and Agile delivery practices Experience being ...

Selection Criteria Expertise in designing and building data intensive applications and pipelines, with an open mindset on choice of tools Strong proficiency in Python and SQL, with a focus on writing clean, performant code to process and manage large volumes of data Experience designing and implementing complex data-matching, reconciliation ...

Live Tables and Databricks Workflows and orchestration Knowledge of Azure Data Platform services, including ADF, ADLS Gen2, Azure Synapse Analytics A strong background in Python and SQL development Proven experience building batch and streaming data pipelines Experience implementing Medallion Architecture and Lakehouse patterns Strong understanding of data modelling techniques (dimensional ...

level and we are looking for data engineers who have a variety of different skills which include some of the below. · Strong proficiency in Python · Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: o Data warehousing and lake architectures o ETL/ELT pipeline development ...

data solutions in complex environments.You’ll bring:Significant Data Engineering experience, with evidence of delivering solutions that have created measurable business value.Strong experience using Python or Scala.Hands-on knowledge of Big Data and streaming technologies such as Spark and Kafka.Experience designing data models, ETL and ELT pipelines, data warehouses ...

complex environments. You'll bring: Significant Data Engineering experience, with evidence of delivering solutions that have created measurable business value. Strong experience using Python or Scala. Hands-on knowledge of Big Data and streaming technologies such as Spark and Kafka. Experience designing data models, ETL and ELT pipelines, data warehouses ...

Data Engineer – Python/SQL/Azure/Databricks Location: Southampton, Hampshire Job Type: Permanent, Full-Time Salary: Competitive + Excellent Benefits The Opportunity An exciting opportunity has arisen for a talented Data Engineer to join a leading organisation. You will play a key role in developing and enhancing … taking ownership of technical solutions and wants to work with cutting-edge data technologies. Key Responsibilities Design, develop and maintain scalable data pipelines using Python and SQL. Build and enhance a cloud-based enterprise data platform using Azure and Databricks. Develop robust data integration processes to support analytics, reporting ...

consultative approach, you're comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are seeking an experienced Python Developer with significant data engineering experience to join a high-performing engineering team working on secure, data-intensive systems. The successful candidate will have … strong background in Python software development, data engineering and data processing, with experience designing, building and maintaining robust data pipelines and services within complex technical environments. RequirementsKey Responsibilities: Design, develop and maintain high-quality Python applications, services and data processing solutions. Build and optimise scalable ETL/ELT pipelines ...

consultative approach, youre comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are seeking an experienced Python Developer with significant data engineering experience to join a high-performing engineering team working on secure, data-intensive systems. The successful candidate will have a strong … background in Python software development, data engineering and data processing, with experience designing, building and maintaining robust data pipelines and services within complex technical environments. Requirements Key Responsibilities: Design, develop and maintain high-quality Python applications, services and data processing solutions. Build and optimise scalable ETL/ELT pipelines ...

passionate about building and delivering transformative digital solutions for a diverse range of Public and Private sector clients. We are recruiting for a Senior Python Developerto join our Hippo Herd. We work at the intersection of strategy, design, and technology to solve complex problems and create lasting value. Our collaborative … agile culture empowers our teams to make a genuine impact. As a Senior Python Developer, you will play an important role in making Hippo the best Consultancy out there. You will work as part of a multi-disciplinary team combining data, design, product, delivery, analysis and engineering to deliver bespoke ...

passionate about building and delivering transformative digital solutions for a diverse range of Public and Private sector clients. We are recruiting for a Senior Python Developerto join our Hippo Herd. We work at the intersection of strategy, design, and technology to solve complex problems and create lasting value. Our collaborative … agile culture empowers our teams to make a genuine impact. As a Senior Python Developer, you will play an important role in making Hippo the best Consultancy out there. You will work as part of a multi-disciplinary team combining data, design, product, delivery, analysis and engineering to deliver bespoke ...

passionate about building and delivering transformative digital solutions for a diverse range of Public and Private sector clients. We are recruiting for a Senior Python Developerto join our Hippo Herd. We work at the intersection of strategy, design, and technology to solve complex problems and create lasting value. Our collaborative … agile culture empowers our teams to make a genuine impact. As a Senior Python Developer, you will play an important role in making Hippo the best Consultancy out there. You will work as part of a multi-disciplinary team combining data, design, product, delivery, analysis and engineering to deliver bespoke ...

coding Build data pipelines for data throughout the Azure Data Platform stages, integrating data management best practices at all stages (Azure Synapse, PostgreSQL, ADF, Python) Develop data sets which are optimised for their given use case, e.g. self-service analytics Migrate data from legacy reporting solutions onto the Azure Data … workload management (Metadata Driven Ingestion). Good working experience of database technologies and database integration, such as SQL, Postgres, MySQL or Oracle. Experience in Python (PySpark) Experience in working with DevOps capabilities like version control, automated builds, testing and release management capabilities using Microsoft DevOps and Git repositories. Good numerical ...

contribute to engineering excellence through best practices, mentoring, and thoughtful technical direction. Job responsibilities Design scalable, reusable data processing and data quality frameworks using Python, PySpark, and dbt Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability Develop and operate workflow orchestration (e.g., Apache … data movement and transformations Model and transform data for analytics using SQL and dbt to support business intelligence and reporting workloads Write production-grade Python/PySpark code with disciplined testing, performance tuning, and maintainable object-oriented design Implement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based ...

contribute to engineering excellence through best practices, mentoring, and thoughtful technical direction. Job responsibilities Design scalable, reusable data processing and data quality frameworks using Python, PySpark, and dbt Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability Develop and operate workflow orchestration (e.g., Apache … data movement and transformations Model and transform data for analytics using SQL and dbt to support business intelligence and reporting workloads Write production-grade Python/PySpark code with disciplined testing, performance tuning, and maintainable object-oriented design Implement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based ...

contribute to engineering excellence through best practices, mentoring, and thoughtful technical direction. Job responsibilities Design scalable, reusable data processing and data quality frameworks using Python, PySpark, and dbt Build and optimize batch and streaming data pipelines with strong performance, fault tolerance, and observability Develop and operate workflow orchestration (e.g., Apache … data movement and transformations Model and transform data for analytics using SQL and dbt to support business intelligence and reporting workloads Write production-grade Python/PySpark code with disciplined testing, performance tuning, and maintainable object-oriented design Implement infrastructure-as-code (e.g., Terraform) to provision and manage cloud-based ...

reporting and analytics solutions using Microsoft Power BI and Microsoft Fabric. Build scalable data models, semantic models, dashboards, and self-service reporting capabilities. Develop Python-based data processing and automation solutions to ingest, transform, validate, and analyze large datasets. Collaborate with engineering and business stakeholders to identify performance trends, operational … including DAX, Power Query, semantic models, and dashboard design. Experience with Microsoft Fabric, Azure Data Services, or modern cloud-based analytics platforms. Advanced Python programming skills for data processing, automation, and analytics. Strong SQL development and database querying experience. Experience working with source control and collaborative development practices using GitHub. ...

AutomationKnowledge in maintaining CI/CD pipelines using Azure DevOps, GitHub Actions, etc. for ADF, Databricks and ML models deployments. Develop automation scripts using Python, PowerShell, or Bash to reduce manual intervention and improve service reliability. SQL and Data Warehouse OperationsWrite, optimize, and troubleshoot SQL queries for: Data validationRoot cause … orchestrationAzure Machine Learning: pipelines, model deployment, monitoringPower BI Service: dataset refreshes, access control, report diagnosticsDevOps & AutomationCI/CD: Azure DevOps, GitHub Actions, YAML pipelinesScripting: Python, PowerShellMonitoring: Azure Monitor, Log Analytics, Alerts, Application Insights SQL & Data WarehousingSQL skills for debugging, data validation, and optimizationExperience with Azure SQL DB, or SQL ServerFamiliarity ...

query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery Support the performance tuning … Data Factory, Synapse Pipelines, Azure Functions and Logic Apps PySpark SQL (Athena, Redshift, Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring Git, CI/CD and Agile delivery practices Current active ...

Grafana - SplunkKafka - FlinkSpring BootTomcatIBM MQDataPowerLinux - UnixWhat You'll DoBuild Production-Grade SoftwareDesign and develop scalable automation platforms and reliability toolingWrite clean, maintainable code in Python, Java, or GoBuild systems for deployment orchestration, testing, validation, and rollbackDevelop self-service platforms that reduce operational toil and improve engineering productivityImprove Reliability & ObservabilityEnhance monitoring … Looking ForCore Requirements1-5 years of software engineering experience, or equivalent SRE-DevOps experience with strong software development skillsStrong programming skills in Python, Java, or GoSolid understanding of data structures, algorithms, system design, and distributed systemsExperience with cloud platforms (AWS, GCP, or Azure)Familiarity with containerization and orchestration technologies such ...