26 to 50 of 5,994 SQL Jobs in the UK

Essential Skills & Experience Strong commercial experience as a Data Engineer Hands-on experience with Microsoft Fabric (essential) Experience working within Azure data environments Strong SQL development skills Experience with Python and/or PySpark Knowledge of Azure Synapse Analytics and Azure Data Factory Experience building and maintaining data pipelines ...

Essential Skills & Experience Strong commercial experience as a Data Engineer Hands-on experience with Microsoft Fabric (essential) Experience working within Azure data environments Strong SQL development skills Experience with Python and/or PySpark Knowledge of Azure Synapse Analytics and Azure Data Factory Experience building and maintaining data pipelines ...

modelling and analysis to delivering meaningful insights through Power BI. Our current data environment has been developed largely in-house, with Python and Microsoft SQL Server forming the core of our data pipelines and Power BI as our established reporting and visualisation platform. This environment supports the business today … business problems and collaborating with others to find pragmatic, maintainable solutions. What You’ll Be Doing Develop, maintain and enhance our existing Python and SQL Server-based data pipelines. Design and build reliable data transformations that support reporting and analytical requirements. Improve pipeline reliability, performance and maintainability through appropriate error ...

data pipelines and processing algorithms for performance, reliability, and scalability to handle growing data volumes and user demands. Identify and resolve performance bottlenecks, optimize SQL queries, and fine-tune system configurations for improved efficiency. Implement data governance policies, access controls, and encryption mechanisms to ensure the confidentiality, integrity, and availability … design scalable data designs to meet business needs. Strong experience of different data architectures including hub and spoke, data lakes, data fabrics, lakehouses. Strong SQL skills and experience with relational databases (e.g., ORACLE, MS SQL) and NoSQL databases (e.g., MongoDB, Cassandra). Good communication skills to explain and gain ...

/qualifications of the Senior Data Engineer position will include * Strong experience developing enterprise data solutions using Microsoft Fabric and Azure Synapse Analytics * Advanced SQL development skills, including query optimisation and performance tuning * Experience designing and developing complex ETL and ELT processes * Strong understanding of data warehousing, data lake ...

etc., for ADF, Databricks and ML model deployments. Develop automation scripts in Python, PowerShell, or Bash to reduce manual intervention and improve service reliability. SQL and Data Warehouse Operations Write, optimize, and troubleshoot SQL queries for data validation, root cause analysis, and report troubleshooting. Support and maintain data warehouse environments … such as Azure Synapse Analytics, SQL Server/Azure SQL DB, Snowflake or BigQuery. Monitor ETL performance and investigate slow-running queries and data load failures. Issue Investigation & RCA Investigate job failures and performance issues across data pipelines, ML endpoints, and dashboards. Perform root cause analysis and provide short‐term ...

Design, develop, and deploy ADF pipelines. Manage and troubleshoot ADF pipelines, ensuring data integrity and error handling is robust. Creation and maintenance of complex SQL stored procedures. Integrate data from various sources, including flat files, REST/SOAP APIs, and third-party databases, into the data warehouse/platform. Develop … maintain complex stored procedures, views, and functions in SQL to support data integration and reporting needs. Collaborate with business analysts, data scientists, and other stakeholders to understand data requirements and deliver solutions. Consideration for data warehouse/platform performance Support the development of reports and dashboards using tools like Power ...

data capture for monitoring and controls. · Create and maintain dashboards and visualizations using tools such as Power BI, Tableau, Kibana, or Grafana. · Write efficient SQL, Python, or Spark code for data extraction, transformation, and analysis. · Implement data quality checks and validation processes to ensure accuracy and reliability of monitoring data. … aggregation, and building MI/reporting solutions. · Hands-on experience with dashboarding and visualization tools (Power BI, Tableau, Kibana, Grafana, or similar). · Advanced SQL skills and experience with Python or Spark for data processing and analytics. · Familiarity with cloud data platforms (Azure, AWS, GCP) and modern data architectures. · Experience ...

disciplinary team. This role is central to delivering Canopius’ data strategy through development of new data capabilities and supporting the final transition from legacy SQL Server-based environments. Alongside hands-on delivery, the role provides technical leadership across data engineering initiatives, helping to establish a future-ready, cloud-native data … secure, scalable, maintainable, and aligned with organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure trusted, accurate outputs. Support ...

wider business functions What We're Looking For: • Proven experience in data engineering, ideally within the defence, aerospace or industrial sectors • Strong Python and SQL programming skills, with experience developing and maintaining data pipelines • Familiarity with ETL/ELT technologies and data streaming tools such as Airflow, Azure, SSIS, Spark … Kafka • Experience working with databases and data platforms such as PostgreSQL, SQL Server, Oracle, Snowflake or similar technologies • Knowledge of data visualisation tools, particularly Power BI, DAX or Tableau • Understanding of data architecture, data governance, data quality and secure data management • Experience with Git, Docker, Kubernetes and CI/ ...

multi-faceted data projects. 3 years supervisory or team leadership experience. Strong foundation in statistics and hands-on experience with tools such as Excel, SQL, R, Python, ETL tools, API development. Demonstrated proficiency in database design, ETL processes, data warehousing. Strong foundation in PostgreSQL, SQL Server, Oracle, and cloud platforms … conducting qualitative data analysis. Microsoft Office (Excel, Outlook, PowerPoint, Power BI), Smartsheet. Project Management (Jira, Confluence, GitHub, Monday.com). Programming and Statistics (Python SQL, R, or other statistical packages or languages) Preferred Qualifications: 1 year of experience in early childhood education and/or Head Start programs. Experience with federal ...

data capture for monitoring and controls. Create and maintain dashboards and visualizations using tools such as Power BI, Tableau, Kibana, or Grafana. Write efficient SQL, Python, or Spark code for data extraction, transformation, and analysis. Implement data quality checks and validation processes to ensure the accuracy and reliability of monitoring … building MI and reporting solutions. Hands-on experience with dashboarding and visualization tools such as Power BI, Tableau, Kibana, Grafana, or similar. Advanced SQL skills and experience using Python or Spark for data processing and analytics. Familiarity with cloud data platforms, including Azure, AWS, or GCP, and modern data architectures. ...

maintain data ingestion processes from clinical, operational, financial and external systems, including relational databases, REST APIs and file-based sources. Build and optimise SQL and PySpark transformations across Bronze, Silver and Gold data layers. Work with technologies including Databricks, Delta Lake, Lakeflow, dbt and Unity Catalog. Implement automated data quality … within a growing data team. You will ideally have: Proven experience working as a Data Engineer or in a similar data engineering role. Strong SQL skills, including performance tuning, CTEs, window functions and data modelling. Good Python programming skills, particularly PySpark, for data transformation, API integrations and automation. Hands ...

data transformation, data models, schemas, metadata, and workload management (Metadata Driven Ingestion). Good working experience of database technologies and database integration, such as SQL, Postgres, MySQL or Oracle. Experience in Python (PySpark) Experience in working with DevOps capabilities like version control, automated builds, testing and release management capabilities using … will be of benefit, including: Data Platform tools CI/CD using Azure DevOps IT Security practices Development tools and languages (e.g. Python/SQL) Required Qualifications, Certificates or Licences Minimum of Degree level or equivalent experience. Extensive industry experience in data development projects Other Technical qualifications will be considered. ...

data engineering, ideally aerospace/defence or industrial sectors. ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka). Strong Python and SQL; C++, C#, or MATLAB a plus. Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg, TimescaleDB. Data Platform Capabilities: Low-Code No-Code Data Science solutions (Dataiku ...

services. Technical Leadership: Oversee data modelling, data governance, and data quality frameworks while driving technical excellence. Strong hands-on experience in technologies such as SQL, Python, Spark, and modern cloud data services. Collaborate with engineering and DevOps teams to establish CI/CD architectures using Azure DevOps, Kubernetes, and Terraform. … expert in Data Architecture, Data Modelling, Engineering, and data platform design. Experience utilising distributed and non-distributed compute architectures with strong proficiency in Python, SQL, Spark, and Scala. Experience architecting CI/CD frameworks (Azure DevOps, GitHub Actions, Jenkins) with real-world platform lifecycle management. Infrastructure-as-Code expertise (Terraform ...

workshops and solution design activities. Skills & Experience Essential 5+ years' experience in Data Engineering, Business Intelligence, Analytics or a related field. Microsoft Fabric Strong SQL skills. Experience developing ETL/ELT processes. Understanding of data modelling and relational databases. Experience working with Power BI. Knowledge of cloud-based data platforms. ...

Experienced with financial data and processes such as budgeting, forecasting, reporting, and controlling. Experience with Prophix, Unit4, or Visma is an advantage. Strong in SQL and data modelling, with hands-on experience developing and operating ETL/ELT pipelines and business system integrations. Experienced in automating data processing and extracting ...

Microsoft Azure and cloud computing concepts Apache Spark - Databricks, Microsoft Fabric or another Spark engine Python - we build most of our solutions in Python SQL - writing complex high-performance queries, understanding how queries execute on different compute technologies Azure Data Factory or other cloud orchestration tools Azure Data Lake storage ...

reports, dashboards, semantic models and KPI scorecards using appropriate visualisation and accessibility practices.Develop data preparation and transformation logic using Power Query, Dataflows Gen2, SQL and, where appropriate, Fabric pipelines or notebooks.Create clear, maintainable DAX measures and dimensional models that support accurate and performant analysis.Contribute to the configuration … knowledge of DAX, Power Query and data modelling, including facts, dimensions and relationships.Experience connecting to, preparing and validating data from common sources such as SQL databases, files, APIs or cloud platforms.Understanding of Power BI Service concepts, including workspaces, apps, refresh, gateways, permissions and deployment.Awareness and experience of Microsoft Fabric capabilities ...

data-driven culture within the organisation, mentoring team members, and contributing to the continuous improvement of the Engineering Practice You Will Demonstrate: Proficiency in SQL and Python: You are highly proficient in SQL and Python, enabling you to handle complex data problems with ease. Understanding of Data Lakehouse Architecture … Solutions: You possess experience with Spark-based platforms like Azure Synapse, Databricks, Microsoft Fabric, or even on-premise Spark clusters, using PySpark or Spark SQL to manage and process large datasets. Expertise in Building ETL and ELT Pipelines: You are skilled in building robust ETL and ELT pipelines, mostly ...

products. Practical experience with Microsoft Fabric or closely related Microsoft Azure data services, with the ability to quickly become productive across Fabric workloads. Strong SQL skills and practical experience with at least one engineering language, typically Python or PySpark. Experience integrating data from a range of sources, including enterprise applications ...

products. Practical experience with Microsoft Fabric or closely related Microsoft Azure data services, with the ability to quickly become productive across Fabric workloads. Strong SQL skills and practical experience with at least one engineering language, typically Python or PySpark. Experience integrating data from a range of sources, including enterprise applications ...

value. You will turn complex or loosely defined business questions into structured analysis, clear insights and practical recommendations. You will explore enterprise data using SQL and modern analytical tools to uncover trends, test hypotheses and support faster, evidence-led decisions. You will combine financial, client, operational and CRM data … data-driven organisation. Proven ability to partner with senior stakeholders, understand complex business challenges and translate them into practical analytical solutions and actions. Strong SQL skills, with confidence interrogating large and complex datasets independently. Strong working knowledge of Power BI, including data modelling and visualisation; experience with DAX would ...

point of escalation for decisions that impact your area of work - Demonstrable experience of building data pipelines using Spark, Python or SQL - Experience working with AWS and its data and AI/ML services such as SageMaker - Experience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake ...