19 of 19 Permanent Spark SQL Jobs in the UK excluding London

level profitability, design productivity, and pricing strategies. You will operate in a hands-on, build-it-yourself environment, leveraging strong technical skills in SQL and modern BI platforms to interpret data and communicate clear findings to a non-technical audience. Come join one of the world's biggest … Build and maintain Sigma dashboards to provide Brand Operations with self-serve, ongoing visibility into productivity, profitability, and pricing trends Write and maintain SQL (Spark SQL/Databricks) queries to support both recurring and ad hoc analytics requests within tight reporting cycles Support ...

extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise … mature a growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data ...

analytics roadmap (S/4HANA Embedded Analytics, SAP Datasphere, SAP Analytics Cloud). Lead pilot projects and migrations (e.g., Cognos to Power BI, SQL DW to Fabric OneLake). Collaborate with stakeholders across all business levels and our Accenture partners. Education & Qualifications Bachelor's degree in Computer Science … Data Factory, Synapse, and cloud data services. Expert‐level skills in data modelling, ETL processes, and semantic layer design. Advanced programming capabilities in SQL (T‐SQL/Spark SQL), Python, and PySpark. Hands‐on experience with Power BI (Desktop and Service ...

Formation - Medallion Architecture based ETL processes using S3, Iceberg and Athena - Azure DevOps/AWS CodeCommit/AWS CodePipeline - AWS Step functions - Athena SQL ; Spark SQL ; Python - AWS CLI - Release management (CI/CD) - Knowledge and Experience - desirable - AWS Databrew - AWS RDS/Redshift ...

this role is to deliver new, and implement changes to existing data solutions, data extraction and transform (ETL), using the full Microsoft SQL stack, for identified and agreed business requirements. In addition, the Senior Data Engineer will be responsible for translating business requirements into Azure Cloud-based … Azure SQL, Azure Data Lake, Datra bricks, Purview and Azure App Service is essential Proficiency in Python/SQL/SparkSQL/PySpark is essential Strong experience of Azure delivery experience including analysis/development/configuration/deployments essential Expert level technical skill ...

3+ years with strong Foundry depth). Proven, hands-on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema ...

3+ years with strong Foundry depth). Proven, hands-on experience working with Palantir Foundry in a production environment. Strong proficiency in Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema ...

performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within data pipelines. Data Transformation & Processing: Implement complex data transformations using Spark (PySpark or Scala) and other relevant technologies. Develop and maintain data processing logic for cleaning, enriching, and aggregating data. Ensure data consistency and accuracy … throughout the data lifecycle. Azure Databricks Implementation: Work extensively with Azure Databricks Unity Catalog, including Delta Lake, Spark SQL, and other relevant services. Implement best practices for Databricks development and deployment. Optimise Databricks workloads for performance and cost. Need to program using the languages such ...

team. This role is central to delivering Canopius' data strategy through development of new data capabilities and supporting the final transition from legacy SQL Server-based environments. Alongside hands-on delivery, the role provides technical leadership across data engineering initiatives, helping to establish a future-ready, cloud-native … secure, scalable, maintainable, and aligned with organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure ...

Implement automated testing, CI/CD patterns + deployment best practices for Foundry-based data assets. Technical Environment: Data Engineering, Palantir Foundry, Python, SQL, PySpark, Spark SQL + Cloud (AWS, Azure, GCP), CI/CD, Git based workflows. Benefits ...

years of strong hands-on Palantir Foundry experience. Proven experience working with Palantir Foundry in a production environment . Strong proficiency in Python, SQL, PySpark, and Spark SQL . Experience delivering production-grade data pipelines in AWS, Azure, or GCP . Strong understanding ...

processes and solutions. Lead the execution of Microsoft Fabric migration activities. Lead and guide migration engineers and QA resources. Develop Python, PySpark and Spark SQL code for data validation and curation within notebooks. Create data integration test cases and support testing activities. Implement and amend data … Azure Functions o Azure App Service o Logic Apps o Azure Kubernetes Service (AKS) o Web Apps Hands-on expertise in PySpark, SQL and Python. Good knowledge of real-time streaming applications, preferably including Kafka, Azure Functions or Azure Service Bus. Strong understanding of Spark processing ...

design and deliver cutting-edge data solutions for customers operating in some of the UK's most complex and challenging environments. Using Databricks, Apache Spark and cloud-native technologies, you’ll develop scalable Lakehouse architectures and production-grade data pipelines that enable organisations to trust, share and exploit … grow your career while helping customers unlock the power of their data. Responsibilities Design, build and optimise scalable data pipelines using Databricks, Apache Spark, PySpark and Delta Lake. Develop and implement modern Lakehouse architectures, applying Medallion (Bronze, Silver, Gold) design principles to support trusted and reusable data products. ...

. Awareness of modern lakehouse concepts and integration with layered data platforms, including Delta Lake and raw/curated data layers. Exposure to Spark/Databricks and PySpark or Spark SQL for collaborating with data engineering teams and troubleshooting end-to-end data flows. ...

middleware, stabilise it, and begin replacing it with a cleaner, sustainable solution built around modern data tooling (Microsoft Fabric, Databricks, or equivalent, plus SQL and Power BI). Phase 2 (ongoing): Expand to include reporting. Once the core system is stable, the role broadens into wider business reporting … gather requirements from senior stakeholders across the business. Simultaneous: Bring Data Hub and Data Warehouse closer in design standards. Must-haves: Strong SQL Microsoft Fabric, Databricks, Synapse, or similar modern data platform experience Power BI (building and owning reports/dashboards, not just consuming) Comfortable working with ambiguous ...

/CD pipelines, version control, and DevOps practices related to data engineering. Proficiency in SQL (T-SQL/SparkSQL) for data manipulation, transformation, and querying. Solid understanding and practical application of Data Vault and Kimball data modelling methodologies. Experience designing and optimising ETL/ELT workflows ...

will lead a small team, mentor junior engineers, and collaborate with stakeholders to deliver scalable data pipelines on Databricks using PySpark and Spark SQL. The role involves guiding data strategy, migrating legacy processes, and delivering enterprise data solutions in a cloud-native environment, with hybrid #J-18808-Ljbffr ...

Brand Operations with item-level analysis and profitability insights. You will own recurring analyses on SKU counts, pricing strategies and design productivity, using SQL and modern BI tools to deliver clear findings to non-technical stakeholders. You will build Sigma dashboards, run ad hoc queries with Spark SQL/Databricks, and help size SKU proliferation risk while recommending consolidation strategies. #J-18808-Ljbffr ...

analytics; exposure to predictive modelling and machine learning is a plus. Proficient in SQL and Python, with bonus points for PySpark, SparkSQL, and Git. Skilled in data visualisation with tools such as Tableau or Power BI. Confident writing efficient code and troubleshooting sophisticated queries. Clear and adaptable communicator ...