51 to 75 of 5,994 SQL Jobs in the UK

point of escalation for decisions that impact your area of work - Demonstrable experience of building data pipelines using Spark, Python or SQL - Experience working with AWS and its data and AI/ML services such as SageMaker - Experience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake ...

point of escalation for decisions that impact your area of work - Demonstrable experience of building data pipelines using Spark, Python or SQL - Experience working with AWS and its data and AI/ML services such as SageMaker - Experience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake ...

point of escalation for decisions that impact your area of work - Demonstrable experience of building data pipelines using Spark, Python or SQL - Experience working with AWS and its data and AI/ML services such as SageMaker - Experience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake ...

platforms,lakehousesand data warehouses. Data modelling and dimensional modelling techniques such as Kimball. ETL/ELT development and large-scale data integration. PySpark, Spark SQL and modern transformation techniques. Advanced SQL and relational databases including SQL Server, PostgreSQL and Oracle. Integrating structured, semi-structured and unstructured data sources. Migration … modernisation of legacy platforms such as Oracle, SQL Server/SSIS or Synapse. Power BI semantic models, curated datasets and supporting analytics platforms. Data quality, governance, metadata management and lineage. Data security, classification and access control approaches. Automated testing, validation, reconciliation testing and performance optimisation. DataOps, CI/ ...

Data Architecture. Day to day, you’ll: Build and run data pipelines and notebooks in Fabric, using Data Factory, Lakehouse, Python, PySpark and SQL Ingest data from our core systems, including Workday, Dynamics 365, Business World and SharePoint Build and maintain data structures in Fabric Warehouse and Lakehouse, and deliver … mingling standards in everything you build, so client and firm data stay separate Move existing Azure Data Factory, Azure Data Lake and SQL Server solutions into Fabric, redesigning legacy ETL and ELT processes along the way Use version control, CI/CD, automated testing and monitoring to keep your pipelines ...

will:Have experience developing applications using technologies such as React, Node.js, .NET, FastAPI, or similar frameworks.Have knowledge of data analytics tools and technologies including SQL, Power BI, and Python data libraries.Have exposure to artificial intelligence, machine learning concepts, large language models (LLMs), AI APIs, or AI-assisted development tools.Have knowledge ...

technical requirements into scalable integration designs, covering data mappings, transformation logic, scheduling, security, error handling and reconciliation. Extract, transform and exchange data through SQL, APIs, web services, file-based interfaces and approved integration tools. Assess the upstream and downstream impact of changes to systems, processes, data structures and interfaces. Develop … Data Analyst or in a similar role within a data-driven environment, or hold a relevant degree or qualification. You will also have: Good SQL skills for data extraction, transformation and troubleshooting. A practical understanding of APIs, REST, SOAP, JSON, XML, SFTP, web services, authentication methods and ETL/ ...

control and co-mingling standards in everything you build, so client and firm data stay separateMove existing Azure Data Factory, Azure Data Lake and SQL Server solutions into Fabric, redesigning legacy ETL and ELT processes along the wayUse version control, CI/CD, automated testing and monitoring to keep your … criteria you’ll need is practical experience with Microsoft Fabric (Data Factory, Lakehouse, Warehouse and Notebooks) or Databricks, working proficiency in Python, PySpark and SQL for data engineering, an understanding of data modelling, warehousing and ETL/ELT principles, working knowledge of Power BI and version control (for example ...

control and co-mingling standards in everything you build, so client and firm data stay separateMove existing Azure Data Factory, Azure Data Lake and SQL Server solutions into Fabric, redesigning legacy ETL and ELT processes along the wayUse version control, CI/CD, automated testing and monitoring to keep your … criteria you’ll need is practical experience with Microsoft Fabric (Data Factory, Lakehouse, Warehouse and Notebooks) or Databricks, working proficiency in Python, PySpark and SQL for data engineering, an understanding of data modelling, warehousing and ETL/ELT principles, working knowledge of Power BI and version control (for example ...

Data Platforms – Develop and support cloud data solutions using services such as S3, Glue, Redshift, Redshift Spectrum, Lambda and IAM. Data Transformation – Use SQL and Python to transform, validate and prepare data for reporting, analytics and downstream applications. Data Modelling – Design and maintain robust data models, including dimensional models, fact ...

Enrich layers of the medallion architecture. Onboard new source systems by setting up the team’s reusable ingestion patterns (Fabric mirroring from Snowflake and SQL Server, change data capture, file and API loads). Do this through configuration rather than one-off code. Write and tune PySpark and T-SQL … review, and CI/CD promotion from Dev to UAT to Production. Contribute to the infrastructure-as-code (Terraform) and the orchestration config database (SQL projects/DACPAC) as needed. Work with Data Stewards, Data Analysts and the Data Architect to understand source data and turn mapping specs and business ...

build, develop and manage STACK's enterprise data platform. This is a production-focused engineering role requiring practical expertise in Databricks, PySpark, Python, SQL and Delta Lake. The role will design reliable pipelines integrating Finance, Delivery, Operations, HR and PMO systems, establish governed and high-quality datasets, and support secure … reliability and performance of the platform. Key Responsibilities: Design, develop, deploy and maintain production-grade ETL/ELT pipelines using Databricks, PySpark, Python and SQL, integrating APIs, databases, SaaS applications, files and spreadsheets. Develop and optimize scalable Delta Lake data models and lakehouse architecture for reporting, analytics and future ...

underpin reporting, analytics, and operational decision-making across the project programme. Working within a multidisciplinary Data & Analytics team, the successful candidate will use Databricks, SQL, Python, and Microsoft technologies to deliver robust, scalable, and maintainable data solutions. They will collaborate closely with Data Architects and Performance Analysts to transform business … Azure technologies. Build scalable ETL/ELT pipelines to ingest, transform, and load data from multiple enterprise systems. Develop data transformations using PySpark, Spark SQL, SQL, and Python. Create and maintain curated datasets that support business intelligence, reporting, and analytics. Implement data quality, reconciliation, validation, and monitoring processes. Optimise data ...

Lakehouses, Warehouses, Notebooks, Dataflows and reusable data products. Data architecture: Implement scalable data architectures and engineering patterns, including Bronze, Silver and Gold data layers. SQL development: Develop, optimise and troubleshoot SQL and T-SQL used within data pipelines, transformations, warehouses and reporting solutions. Semantic modelling: Design and maintain governed Semantic … Data Factory, Lakehouse, Warehouse, OneLake, Notebooks, Dataflows and Semantic Models. Fabric migration: Experience supporting or delivering migrations from Azure Synapse to Microsoft Fabric Advanced SQL: Strong SQL and T-SQL development, optimisation and troubleshooting skills. Python and Spark: Experience building data processing and transformation solutions using Python and Spark. Data ...

provide the best business solution Develop Power Automate workflows to streamline business processes Develop and maintain Dataverse data models and business logic Write efficient SQL queries, stored procedures, and database solutions Participate in code reviews, testing and debugging Contribute to application architecture and technical design Support software deployments through Azure … modernise legacy applications Reporting & Data Create reusable datasets and semantic models Design reports that support operational and strategic decision making Build data integrations between SQL Server, Dataverse and business systems Assist with Microsoft Fabric initiatives where appropriate Promote good data governance and quality Stakeholder Engagement Work closely with internal stakeholders ...

Fabric & Azure Birmingham | Hybrid working | £55,000–£65,000 + 8% bonus + 7% pension + 40 days' holiday Microsoft Fabric | Python/PySpark | SQL | Azure Data Engineering We're looking for a hands-on Data Engineer to join the growing data capability of an established UK wealth management business. … Microsoft Fabric. Your work will include: Developing and maintaining Microsoft Fabric data pipelines, Lakehouses and data processing workloads. Building ETL/ELT solutions using SQL, Python/PySpark and Azure technologies. Working with Fabric Data Factory, OneLake, Warehouse and notebooks. Integrating internal and external data sources, including APIs. Developing data ...

support data quality and governance. Create and maintain ETL/ELT processes using Data Factory, Data Pipelines, Notebooks, and Spark. Develop, maintain, and enhance SQL scripts, stored procedures, views, and data models. Monitor and troubleshoot performance issues within Fabric environments. Implement security, access controls, and governance standards. Support CI/… analysts, architects, and stakeholders to translate requirements into technical solutions. Produce technical documentation and knowledge transfer materials. What you will have Technical Skills Strong SQL development skills. Experience designing and implementing ETL/ELT solutions. Knowledge of Lakehouse and Data Warehouse architectures. Experience with Data Pipelines, Dataflows Gen2, and Notebooks. ...

support data quality and governance. Create and maintain ETL/ELT processes using Data Factory, Data Pipelines, Notebooks, and Spark. Develop, maintain, and enhance SQL scripts, stored procedures, views, and data models. Monitor and troubleshoot performance issues within Fabric environments. Implement security, access controls, and governance standards. Support CI/… analysts, architects, and stakeholders to translate requirements into technical solutions. Produce technical documentation and knowledge transfer materials. What you will have Technical Skills Strong SQL development skills. Experience designing and implementing ETL/ELT solutions. Knowledge of Lakehouse and Data Warehouse architectures. Experience with Data Pipelines, Dataflows Gen2, and Notebooks. ...

support data quality and governance. Create and maintain ETL/ELT processes using Data Factory, Data Pipelines, Notebooks, and Spark. Develop, maintain, and enhance SQL scripts, stored procedures, views, and data models. Monitor and troubleshoot performance issues within Fabric environments. Implement security, access controls, and governance standards. Support CI/… analysts, architects, and stakeholders to translate requirements into technical solutions. Produce technical documentation and knowledge transfer materials. What you will have Technical Skills Strong SQL development skills. Experience designing and implementing ETL/ELT solutions. Knowledge of Lakehouse and Data Warehouse architectures. Experience with Data Pipelines, Dataflows Gen2, and Notebooks. ...

3+ years with strong Foundry depth). Proven, hands-on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema design, metadata management, and governance. Familiarity ...

3+ years with strong Foundry depth). Proven, hands-on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema design, metadata management, and governance. Familiarity ...

YOUR APPLICATION. Key Responsibilities Data Pipeline and Data Product Engineering Design, build, test and maintain scalable data pipelines and data products using Databricks, Python, SQL and Azure data technologies. Ingest, transform and curate data from operational systems, files, APIs and other internal or external sources. Build and maintain data assets … data engineering and transformation workloads. Hands-on Azure Synapse experience and the ability to understand, maintain and migrate existing Synapse-based data solutions. Strong SQL skills and practical experience of data modelling and transformation. Experience designing, building and supporting scalable batch data pipelines and data products. Understanding of data quality ...

optimising for cost and performance Build and maintain Microsoft Fabric artefacts including lakehouses, warehouses, notebooks, dataflows, and semantic models Perform advanced data transformations using SQL, Python, Spark, or Fabric Data Engineering experiences to prepare data for analytics and reporting Manage and optimise data models used by Power BI, ensuring good … Understanding of the requirements of stringent data governance Ability to consult with clients Proven experience of mentoring teams Experience of advanced data transformations using SQL, Python, Spark, or Fabric Data Engineering experiences to prepare data for analytics and reporting At Sword, our core values and culture are based on caring ...

services. Technical Leadership: Oversee data modelling, data governance, and data quality frameworks while driving technical excellence. Strong hands-on experience in technologies such as SQL, Python, Spark, and modern cloud data services. Collaborate with engineering and DevOps teams to establish CI/CD architectures using Azure DevOps, Kubernetes, and Terraform. … expert in Data Architecture, Data Modelling, Engineering, and data platform design. Experience utilising distributed and non-distributed compute architectures with strong proficiency in Python, SQL, Spark, and Scala. Experience architecting CI/CD frameworks (Azure DevOps, GitHub Actions, Jenkins) with real-world platform lifecycle management. Infrastructure-as-Code expertise (Terraform ...

value to the organisation. Skills and Experience: Strong experience developing enterprise data solutions using Microsoft Fabric, Azure Synapse Analytics and Microsoft cloud technologies. Advanced SQL skills with experience designing, developing and optimising data pipelines, ETL/ELT processes and large-scale data solutions. Strong understanding of data warehouse, data lake ...