1 to 25 of 55 Remote/Hybrid PySpark Jobs in the UK excluding London

standards and best practices. About you Extensive experience designing and delivering enterprise-scale data engineering solutions Strong hands-on experience with Azure Databricks, including PySpark, Delta Live Tables and Databricks Workflows and orchestration Microsoft Fabric experience, including Lakehouse, Data Factory, Warehouse and Spark Knowledge of Azure Data Platform services ...

e.g. DAMA) • Strong expertise in Microsoft Azure, Fabric, Microsoft 365 platform • Fluency in one or more of the following programming languages (SQL, Python (pandas, PySpark, REST API integration), M Power Query, DAX, JavaScript) • Proven experience as a Data Architect, Data Engineer, or similar role. • Extensive experience with database management ...

analytics strategy AI & Automation Agentic AI patterns and intelligent automation solutions Document intelligence and AI-driven business use cases SQL Python and/or PySpark Data pipelines and transformation frameworks CI/CD concepts and deployment automation Azure DevOps and/or GitHub Infrastructure as Code awareness Environment promotion ...

contribute to long-term platform innovation Required Experience Strong experience designing enterprise data platforms within Microsoft Azure environments Deep expertise with Azure Databricks, Spark (PySpark/Scala), Delta Lake, and Lakehouse architecture Strong hands-on experience with Snowflake architecture and optimisation Experience with Azure Data Factory, ADLS Gen2, Synapse ...

Exposure to metadata management, data governance, and data quality frameworks Experience with CI/CD (Azure DevOps, Gi t) and ideally scripting (Python/PySpark) Job Offer £700-£800 per day (Inside IR35) Hybrid working (2-3 days in London) Initial 6-month contract with extension potential ...

OneLake, pipelines and notebooks, and how these can be used to build scalable enterprise data solutions. Strong experience with SQL, Python and/or PySpark and modern data engineering approaches. Strong understanding of data architecture and data modelling, including designing reusable and scalable data structures. Experience implementing modern software ...

Strong hands-on experience with Quantexa implementation and development. Proven experience building and supporting big data platforms . Advanced knowledge of Apache Spark/PySpark . Strong programming skills in Scala and/or Python . Expertise in SQL and large-scale data modelling. Strong cloud experience across ...

working across Architecture, Engineering, Product, and Business teams. Data Engineering & Platforms Strong hands-on experience with: Databricks Delta Lake Unity Catalog dbt Spark/PySpark Data pipeline development and optimisation Lakehouse architectures ETL/ELT frameworks Enterprise data platform implementation Cloud Technologies (AWS) Experience with: Amazon S3 AWS Glue ...

Data Engineering Foundation: Practical experience with data modelling, ETL/ELT, and various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow, Spark, Databricks, Fabric. Cloud Capability: Experience with at least one major cloud provider (AWS, Azure ...

Microsoft Fabric, Azure Data Platform technologies, and modern cloud data architectures Hands-on experience with Databricks, Unity Catalog, and Delta Lake Advanced SQL and PySpark development skills Experience implementing Medallion Architecture principles Strong data modelling expertise, including Star Schema and Data Vault methodologies Solid understanding of data governance, security ...

about its values Values | PA ConsultingWe use a range of different tools and technologies depending on the specific task, these include: Data Bricks, Python, PySpark, R, Excel, Palantir Foundry and PowerBI.QualificationsEssential requirements Even if you don’t meet every requirement below, feel free to still apply ...

required as well as a solid understanding of working in a cloud-based environment (AWS is preferred).Proficient using transformation tools such as PySpark/Pandas.Knowledge and practice of graph databases is preferred but not required.Key responsibilities/Skills and experienceFamiliarity using data quality frameworks, ie. Great Expectations.Experience building ...

engineering best practicesYou have experience with Databricks, ideally also AzureYou have experience of working with technologies such as SQL, Apache Spark and Python including PySpark and PandasYou're excited to join a start-up in a role that you can shape and influenceYou're collaborative with excellent communication skillsApply ...

data architecture, data warehousing and cloud data platforms Hands-on experience with Azure technologies Experience developing ETL/ELT solutions Experience with Python, PySpark, Microsoft Fabric, streaming technologies or large-scale enterprise environments would be advantageous. In return they are offering A salary of up to £50,000 Hybrid ...

statement - up to 750 words. This statement should be used to provide examples of how you meet the essential criteria below: Practitioner: Ability toorchestrate PySpark jobs on EMR, managing dependencies, workflow execution, and operational efficiency. Working: Knowledge of designingevent-driven architectures, leveragingAWS Lambda functionsto triggerPySpark workflowsbased on real-time ...

with Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architecture Hands-on experience with Databricks, Unity Catalog and Delta Lake Strong SQL and PySpark skills Experience implementing Medallion Architecture principles Knowledge of data modelling methodologies including Star Schema and Data Vault Strong understanding of data governance, security ...

solutions Requirements: Enterprise data warehouse architecture and design Microsoft Fabric, Azure Data Platform technologies and modern Lakehouse architectures Databricks, Unity Catalog and Delta Lake PySpark, Databricks, SQL Medallion Architecture implementation Data modelling approaches including Star Schema and Data Vault Data governance, security and access management Why This Opportunity Greenfield ...

complex data led organisation* Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI* Expertise in Streaming Data, Event Driven Design ...

complex data led organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design ...

genuinely strong at data engineering as a craft, not generalists who have only used platforms at a surface level.You will have:Strong experience building PySpark-based pipelines that run reliably in production.A solid grasp of Spark execution behaviour, including partitioning, shuffles, joins and performance trade-offs.Hands-on experience with ...

skills Desirable SkillsExperience in data value management including governance, quality, and ownership Knowledge of cloud platforms such as Azure or AWS Familiarity with Python, PySpark, data lakes, and data warehousing concepts Understanding of DevOps, automated testing, and release management Knowledge of insurance principles or claims processes Experience working ...

schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data transformation logic using PySpark/Python (data cleansing, standardisation, validation) Configure monitoring, logging, and alerting Execute unit and integration testing across pipelines Core Skills: Azure Databricks Python Desirable ...

schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data transformation logic using PySpark/Python (data cleansing, standardisation, validation) Configure monitoring, logging, and alerting Execute unit and integration testing across pipelines Core Skills: Azure Databricks Python Desirable ...

schema design Develop API connectors and ingestion pipelines using Python Implement integration services feeding into the Databricks environment Build data transformation logic using PySpark/Python (data cleansing, standardisation, validation) Configure monitoring, logging, and alerting Execute unit and integration testing across pipelines Core Skills: Azure Databricks Python Desirable ...

methodology. Platforms & Tools Experience with Databricks (preferred) or similar platforms: Snowflake, BigQuery, Redshift, Synapse, or equivalent Strong proficiency with: SQL (advanced level) Spark/PySpark Data pipeline orchestration tools (e.g., Airflow, ADF, etc.) Data Modelling Extensive experience designing: Fact and dimension tables Star and snowflake schemas Aggregation layers ...