6 of 6 Spark SQL Jobs in the UK

forward-thinking data team What You'll Do: Build and maintain ETL/ELT pipelines and data models in Fabric (Data Factory, Notebooks, Spark) Write high-performance Spark SQL, T-SQL, Python/PySpark Manage ingestion, transformation, and loading from multiple sources … tools like GitHub Copilot, ChatGPT, and Fabric Copilot Essential Experience: Microsoft Fabric is essential Azure Data ecosystem Lakehouse architectures & Data Factory Python, PySpark, Spark SQL Proven hands-on delivery in this stack If you're an experienced Data Engineer with strong Microsoft Fabric and Azure experience ...

technical designs, data models, ETL/ELT pipelines, and engineering implementation. Provide architectural guidance to data engineers working on Azure Databricks, ADF, PySpark, SQL, and Delta Lake. Collaborate with enterprise architecture, solution architecture, security, infrastructure, DevOps, and business teams. Define CI/CD, DevOps, deployment, monitoring, and operational … modelling, dimensional modelling, canonical data models, and enterprise data models. Strong experience in designing ETL/ELT data pipelines. Good understanding of PySpark, Spark SQL, Python, and SQL. Strong knowledge of data warehouse, data lake, data mart, and semantic layer architecture. Experience in defining data quality ...

platforms (AWS, Azure, GCP). • Develop & Optimise robust data models, warehouses and 'big data' architectures. • Integrate & Transform data using tools such as Databricks, Spark, Kafka, Talend, Informatica, AWS Glue or Azure Data Factory. • Collaborate & Influence with cross-functional agile teams and client stakeholders. • Automate & Secure CI/… this role. Essential qualifications: • You should have hands-on experience with cloud platforms such as AWS, Azure or GCP. • Strong proficiency in Python, SQL, Scala, Spark-SQL, JavaScript or PowerShell. • Proven ability to design and build data pipelines and workflow solutions. • Experience with data ...

Engineer within Azure cloud environments. Proven hands-on expertise with Azure Databricks in enterprise-scale production environments. Strong programming skills using: Python/SQL/PySpark/Spark SQL. Experience designing and building scalable data pipelines and data processing frameworks. Strong understanding of modern Lakehouse architecture … understand data requirements and translate them into scalable engineering solutions. Design, develop and maintain high-performance data pipelines using Azure Databricks, PySpark, Spark SQL and Python. Contribute to the design and implementation of Lakehouse architecture using Delta Lake and Databricks best practices. Develop and manage data ...

support technical decision-making * Troubleshoot complex system and data issues What you'll bring: * Deep experience building production grade data systems * Strong SQL and hands-on experience with modern data tooling and cloud platforms * Ability to work beyond data into backend engineering (APIs, services, system design) * Experience with … someone who combines deep data expertise with broader engineering capability, get in touch with Justin Donaldson for a confidential chat. Skills: dbt spark sql snowflake apache airflow cloud JBLE1 ...

Technical Requirements Expert-level dbt Core/Cloud proficiency, including advanced Jinja, macro development, and incremental materialization strategies. Deep experience with Databricks (Unity Catalog, SparkSQL) and Apache Iceberg on AWS S3. Ability to reverse-engineer Legacy Teradata/BTEQ and write highly optimized SQL for Databricks. Hands ...