1 to 25 of 4,889 Permanent SQL Jobs in England

roadmap: track delivery of quick‐wins, report progress on mid‐term initiatives, and flag risks or dependencies TECHNICAL SKILLS & EXPERTISE Strong data engineering skills: SQL (advanced), Python or PowerShell for data extraction, transformation, and automation; experience with ETL/ELT pipelines Dashboard development: Power BI (preferred), Tableau, Grafana, or equivalent ...

cultivating a data-driven culturewithin the organisation, mentoring team members, and contributing to the continuous improvement of the Engineering Practice You Will Demonstrate: Proficiencyin SQL and Python:You are highly proficient in SQL and Python, enabling you to handle complex data problems with ease. Understanding of Data Lakehouse Architecture … Hands-On Experience with Spark-Based Solutions:Youpossessexperience with Spark-based platforms like Azure Synapse, Databricks, Microsoft Fabric, or evenon-premiseSpark clusters, usingPySparkor Spark SQL to manage and process large datasets. Expertisein Building ETL and ELT Pipelines:You are skilled in building robust ETL and ELT pipelines, mostly in Azure ...

cultivating a data-driven culturewithin the organisation, mentoring team members, and contributing to the continuous improvement of the Engineering Practice You Will Demonstrate: Proficiencyin SQL and Python:You are highly proficient in SQL and Python, enabling you to handle complex data problems with ease. Understanding of Data Lakehouse Architecture … Hands-On Experience with Spark-Based Solutions:Youpossessexperience with Spark-based platforms like Azure Synapse, Databricks, Microsoft Fabric, or evenon-premiseSpark clusters, usingPySparkor Spark SQL to manage and process large datasets. Expertisein Building ETL and ELT Pipelines:You are skilled in building robust ETL and ELT pipelines, mostly in Azure ...

ensure close collaboration with the wider team and with our customers. What you will do as a Senior Data Engineer Design, administer and optimise SQL Server databases, ensuring performance, security, resilience, and availability. Troubleshoot and resolve database-related issues in development and production environments. Implement and maintain database security controls … junior engineers. What you’ll bring Proven experience in data engineering with ability to work independently and take ownership of deliverables. Strong Python and SQL skills, with experience building and optimising data pipelines. Strong experience with Microsoft SQL Server and working with large, complex databases. Strong experience designing, administering ...

Essential Skills & Experience Strong commercial experience as a Data Engineer Hands-on experience with Microsoft Fabric (essential) Experience working within Azure data environments Strong SQL development skills Experience with Python and/or PySpark Knowledge of Azure Synapse Analytics and Azure Data Factory Experience building and maintaining data pipelines ...

Essential Skills & Experience Strong commercial experience as a Data Engineer Hands-on experience with Microsoft Fabric (essential) Experience working within Azure data environments Strong SQL development skills Experience with Python and/or PySpark Knowledge of Azure Synapse Analytics and Azure Data Factory Experience building and maintaining data pipelines ...

across the team Proven experience working with cloud‐based data platforms (e.g., GCP, Azure, AWS, Snowflake); Microsoft Fabric is a plus Strong proficiency in SQL and Python, with the ability to write complex queries and reusable scripts for data transformation, validation, testing and automation, ensuring data accuracy, reliability and efficiency ...

Data Factory).• Develop and refine data models to support BI reporting, analytics, and ML/AI use cases.• Write efficient, well-documented T-SQL and PySpark code following team coding standards.Data Quality, Testing & Governance• Implement automated testing, data validation, and monitoring (SLAs, alerts) to ensure pipeline reliability.• Contribute … years in data engineering or a closely related role.• Bachelor’s degree in Computer Science, Data Engineering, or a related field.Technical Skills:· Strong T-SQL skills and working proficiency in PySpark or Python for data processing.· Hands-on experience with MS Azure Storage Explorer and SSMS.· Hands-on experience with ...

ensure data quality/accuracy. Mentor and guide junior data engineers, providing technical expertise and project oversight. What we're looking for Advanced SQL, including writing complex queries, partitioning, clustering and cost-aware query optimisation . Experience of modern orchestration/ELT tooling, ideally Dagster and dbt. Strong Python ...

build data models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with … data engineering teams and independently. Line/Team management experience, leadership experience Experience of working with cloud infrastructure (Azure or AWS, GCP is beneficial) SQL and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ...

translate business problems into data, analytical and technical tasks with support from senior colleagues. Design, build and maintain data pipelines, models and products using SQL, Python and modern data engineering tools. Work with data warehouses, lakehouse platforms and event-driven patterns, including building semantic models for analytics and visualisation. Contribute … over. What We’re Looking For Core Data & Technical Skills Experience translating business questions into data or analytical requirements, with guidance where needed. Good SQL and Python skills for data modelling, transformation, automation and analysis. Experience working with data models in data warehouses, lakehouse environments or analytics tools such ...

services. Technical Leadership: Oversee data modelling, data governance, and data quality frameworks while driving technical excellence. Strong hands-on experience in technologies such as SQL, Python, Spark, and modern cloud data services. Collaborate with engineering and DevOps teams to establish CI/CD architectures using Azure DevOps, Kubernetes, and Terraform. … expert in Data Architecture, Data Modelling, Engineering, and data platform design. Experience utilising distributed and non-distributed compute architectures with strong proficiency in Python, SQL, Spark, and Scala. Experience architecting CI/CD frameworks (Azure DevOps, GitHub Actions, Jenkins) with real-world platform lifecycle management. Infrastructure-as-Code expertise (Terraform ...

premium, claims, exposure, reinsurance and finance. Design gold‐layer (consumption) models and, where Power BI is the consumption layer, semantic models served from Databricks SQL and shaped for efficient reporting and self‐service analytics. Select and design for the right storage and exchange formats for each workload, including row‐based … e.g. Parquet, CSV, Excel, XML, JSON, Protobuf). Optimise platform performance and cost, including partitioning vs. liquid clustering, file sizing, Photon, and cluster and SQL warehouse sizing. Manage the model lifecycle: optimise and update models for new and existing client projects, reverse engineer physical models from existing databases and SQL ...

lakehouses and data warehouses. Data modelling and dimensional modelling techniques such as Kimball. ETL/ELT development and large-scale data integration. PySpark, Spark SQL and modern transformation techniques. Advanced SQL and relational databases including SQL Server, PostgreSQL and Oracle. Integrating structured, semi-structured and unstructured data sources. Migration … modernisation of legacy platforms such as Oracle, SQL Server/SSIS or Synapse. Power BI semantic models, curated datasets and supporting analytics platforms. Data quality, governance, metadata management and lineage. Data security, classification and access control approaches. Automated testing, validation, reconciliation testing and performance optimisation. DataOps, CI/ ...

that connect our key business systems, using Boomi and Azure services, including point-to-point integrations. Alongside this, you will provide technical oversight of SQL development within the team, offering guidance and stepping in when needed. This role offers an exciting opportunity to contribute to our data management and governance … work with key stakeholders internally and externally to resolve them. Apply good engineering practice, including source control, testing and documentation. Provide technical oversight of SQL development within the team, stepping in when needed. Work closely with the Director of Data Services and other stakeholders to implement the company's data ...

reporting into this role. Design and develop homogenous data repositories to deliver data led decision making. Ingest data from various sources, including on premise SQL databases, REST API’s, Apache Kafka streams, etc. Define and apply cleansing rules to the data to ensure meets quality expectations. Define and model data … structuring code, testing, IOC, etc. Strong repositories, CI/CD skills. Strong knowledge of Kimball data modelling, such as star schema, snowflake, etc. Strong SQL skills. Strong data analysis skills. Excellent written and verbal communication skills A demonstrable track record of getting stuff done whilst managing competing pressures and deadlines ...

across projects. Identify opportunities to reuse existing data models and data assets to improve efficiency and consistency. Perform reverse engineering of existing databases and SQL scripts to produce accurate data models and documentation. Assess logical and physical data models for quality, integrity, performance and alignment with business requirements. Validate business … data analysis and profiling Strong data warehousing and OLTP systems from an integration perspective Strong understanding of data integration best practices and concepts Strong SQL skills required scripting preferred Strong Knowledge of all phases of the system development life cycle Experience with major database and big data platforms (e.g. ...

across projects. Identify opportunities to reuse existing data models and data assets to improve efficiency and consistency. Perform reverse engineering of existing databases and SQL scripts to produce accurate data models and documentation. Assess logical and physical data models for quality, integrity, performance and alignment with business requirements. Validate business … data analysis and profiling Strong data warehousing and OLTP systems from an integration perspective Strong understanding of data integration best practices and concepts Strong SQL skills required scripting preferred Strong Knowledge of all phases of the system development life cycle Experience with major database and big data platforms (e.g. ...

/qualifications of the Senior Data Engineer position will include * Strong experience developing enterprise data solutions using Microsoft Fabric and Azure Synapse Analytics * Advanced SQL development skills, including query optimisation and performance tuning * Experience designing and developing complex ETL and ELT processes * Strong understanding of data warehousing, data lake ...

etc., for ADF, Databricks and ML model deployments. Develop automation scripts in Python, PowerShell, or Bash to reduce manual intervention and improve service reliability. SQL and Data Warehouse Operations Write, optimize, and troubleshoot SQL queries for data validation, root cause analysis, and report troubleshooting. Support and maintain data warehouse environments … such as Azure Synapse Analytics, SQL Server/Azure SQL DB, Snowflake or BigQuery. Monitor ETL performance and investigate slow-running queries and data load failures. Issue Investigation & RCA Investigate job failures and performance issues across data pipelines, ML endpoints, and dashboards. Perform root cause analysis and provide short‐term ...

Design, develop, and deploy ADF pipelines. Manage and troubleshoot ADF pipelines, ensuring data integrity and error handling is robust. Creation and maintenance of complex SQL stored procedures. Integrate data from various sources, including flat files, REST/SOAP APIs, and third-party databases, into the data warehouse/platform. Develop … maintain complex stored procedures, views, and functions in SQL to support data integration and reporting needs. Collaborate with business analysts, data scientists, and other stakeholders to understand data requirements and deliver solutions. Consideration for data warehouse/platform performance Support the development of reports and dashboards using tools like Power ...

Design and build data models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools andtechnologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such asrelational, non-relational, or cloud-based. Working collaboratively with … data engineering teams and independently. Line/Team management experience, leadership experience Experience of working with cloud infrastructure (Azure or AWS, GCP is beneficial) SQL and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ...

disciplinary team. This role is central to delivering Canopius’ data strategy through development of new data capabilities and supporting the final transition from legacy SQL Server-based environments. Alongside hands-on delivery, the role provides technical leadership across data engineering initiatives, helping to establish a future-ready, cloud-native data … secure, scalable, maintainable, and aligned with organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure trusted, accurate outputs. Support ...

data capture for monitoring and controls. Create and maintain dashboards and visualizations using tools such as Power BI, Tableau, Kibana, or Grafana. Write efficient SQL, Python, or Spark code for data extraction, transformation, and analysis. Implement data quality checks and validation processes to ensure the accuracy and reliability of monitoring … building MI and reporting solutions. Hands-on experience with dashboarding and visualization tools such as Power BI, Tableau, Kibana, Grafana, or similar. Advanced SQL skills and experience using Python or Spark for data processing and analytics. Familiarity with cloud data platforms, including Azure, AWS, or GCP, and modern data architectures. ...

data transformation, data models, schemas, metadata, and workload management (Metadata Driven Ingestion). Good working experience of database technologies and database integration, such as SQL, Postgres, MySQL or Oracle. Experience in Python (PySpark) Experience in working with DevOps capabilities like version control, automated builds, testing and release management capabilities using … will be of benefit, including: Data Platform tools CI/CD using Azure DevOps IT Security practices Development tools and languages (e.g. Python/SQL) Required Qualifications, Certificates or Licences Minimum of Degree level or equivalent experience. Extensive industry experience in data development projects Other Technical qualifications will be considered. ...