126 to 150 of 160 Remote/Hybrid PySpark Jobs

Skill Data architecture , cloud ( Azure/GCP/AWS ) , Databricks/snowflake , Data modelling, exposure to agentic Ai , Gen AI Secondary Skill Mandatory Skills Pyspark, advance SQL, ETL , data- warehousing Must-Have Skills Pyspark, advance SQL, ETL , data- warehousing Good-to-Have Skills Required Skills & Experience 14+ years ...

modelling, Kimball, or Data Vault Exposure to modern cloud data platforms, ideally within the Microsoft ecosystem Familiarity with tools such as DBT, Python, or PySpark is beneficial Experience working in data transformation or modernisation programmes Understanding of architecture principles or a clear interest in developing into a Data Architect ...

building data models and pipelines in Snowflake, migrating programme use cases, and collaborating with Data Scientists to validate model performance. Experience with Snowflake ML, PySpark, and DBT is essential. The candidate will manage the migration from Pre-Prod to Prod, support PoC phases, and document findings during the transition ...

technology sprawl while improving security, supportability and delivery speed. 4. Data Engineering and Integration Design and build reliable ingestion and transformation pipelines using Python, PySpark, SQL and Delta Lake. Implement full and incremental ingestion, CDC where appropriate, schema evolution, reconciliation, error handling and data quality controls. Design reusable integration … Databricks Serverless and compute/workload optimisation Azure identity, networking, security, secrets, monitoring and private connectivity Databricks SQL, Delta Lake and performance optimisation Python, PySpark and SQL Jobs/workflows, incremental processing, CDC and data quality REST/API and external data integration patterns FinOps, cost attribution, tagging, budgets ...

Lead the design and implementation of scalable data architectures on the Databricks Lakehouse platform. Oversee the development of efficient ETL/ELT pipelines using PySpark, SQL, and Delta Lake. Mentor and guide junior data engineers, promoting best practices in code quality, CI/CD, and performance tuning. Collaborate with … Requirements & Skills Databricks Expertise: Extensive hands-on experience with Databricks, Delta Lake, Unity Catalog, and Spark optimization. Programming Languages: Advanced proficiency in Python/PySpark and SQL. Cloud & Infrastructure: Strong background in cloud data platforms (Azure, AWS, or GCP) and cloud-native architectures. Engineering Best Practices: Experience with ...

/ELT processes for data ingestion and transformation. Supporting and enhancing a business-critical reporting and analytics platform. Developing SQL and Python/PySpark-based data solutions. Managing and optimising SQL database environments, ensuring performance, reliability and scalability. Collaborating with Data Analysts, BI professionals and stakeholders across the organisation. … skills and experience working with complex relational databases. Hands-on experience building and supporting ETL/ELT pipelines. Strong Python and/or PySpark development experience. Experience with SQL Server or similar database technologies. Excellent problem-solving skills and the ability to engage effectively with both technical ...

Are you passionate about AI? At Satori Analytics, we aim to change the world one algorithm at a time by bringing clarity to global brands thought Data & AI. From cloud-based ecosystems for fintech to ...

Role Description Location:West Yorkshire- multiple locations(Hybrid- 3 days working from onsite-Mandatory) Immediate start Permanent/Contract inside IR35/Fixed term contract We're looking for a Lead Data Engineer to join ...

/ETL workflows within a Fabric Lakehouse environment Work with OneLake, Lakehouse architecture, and modern data engineering best practices Utilise PySpark, SQL and Databricks for complex data transformation and engineering workloads Create robust data ingestion, orchestration and monitoring processes Support the development of enterprise-wide analytics solutions and Power … with Microsoft Fabric, including Data Factory, Dataflows, Notebooks and Lakehouse solutions Experience building and supporting production-grade ELT/ETL pipelines Strong skills in PySpark and SQL Experience working with OneLake, Delta formats or modern Lakehouse architectures Exposure to Databricks and distributed data processing environments Understanding of data modelling ...

Location:West Yorkshire- multiple locations(Hybrid- 3 days working from onsite-Mandatory)Immediate startPermanent/Contract inside IR35/Fixed term contractWe’re looking for a Lead Data Engineer to join UST Data Team. As ...

GBMs, GAMs, Random Forests, Neural Networks and clustering techniques Knowledge of statistics and distributions commonly used in insurance Experience in programming languages (e.g. Python, PySpark, R, SAS, SQL) Proficient at communicating results in a concise manner both verbally and written Behaviours: Motivated by technical excellence Driven to deliver iterative ...

support production-grade ETL/ELT pipelines that source, transform and curate data for Internal Audit. Develop maintainable Python solutions using Pandas, Polars and PySpark, selecting fit-for-purpose approaches based on scale, performance and operational needs. Write advanced SQL for data transformation, reconciliation, profiling and analysis across OLTP … computer science, engineering or a related quantitative discipline. A master’s degree is welcome. Hands‐on proficiency in Python, including Pandas, Polars and PySpark, with experience writing testable and maintainable code. Strong SQL proficiency and practical understanding of OLTP databases, relational design and query performance. Strong understanding of data ...

ongoing performance and reliability of the SQL database estate. This role would suit a Data Engineer with strong Databricks, SQL and Python/PySpark expertise who enjoys solving technical challenges, improving data platforms and working collaboratively with both technical and non-technical stakeholders. Key Responsibilities Design, develop and maintain … Oxfordshire HQ Opportunity to join a growing Data & Innovation function Hands-on exposure to modern Microsoft data technologies including Databricks, SQL, Python and PySpark Opportunity to influence the development and maturity of the organisation's data platform Collaborative working environment with exposure to a broad range of data ...

driven outcomes. Develop interactive business applications using Foundry Workshop , Slate , and custom front-end solutions. Build robust applications and integrations using TypeScript , Python , and PySpark . Collaborate with business and technical stakeholders to translate requirements into scalable data solutions. Integrate AI/ML capabilities into data workflows and support … hands-on experience with Palantir Foundry , including: Data ingestion and integration Data transformations Foundry datasets Foundry applications and Workshop Strong programming expertise in: Python PySpark Experience building custom applications and user-facing solutions within Foundry. Strong understanding of distributed systems and microservices architecture. Experience with AWS services such ...

modern data platform. Develop and maintain Medallion Architecture data layers, ensuring data is available for reporting and analytics. Create high-performance data transformations using PySpark, Databricks and Fabric Notebooks. Implement data governance and access controls through Databricks Unity Catalog. Support CI/CD deployment processes using Git integration … within a Data Engineering environment, delivering reliable and scalable data solutions. Strong hands-on experience with Microsoft Fabric and Databricks. Strong programming capability across PySpark and T-SQL. Experience working with Delta Lake, Lakehouse architectures and modern cloud data platforms. Understanding of data quality frameworks, testing approaches and governance ...

Principal Consultant - Lead Data Analyst/Data Modeller Company: Transform Together Contract: 6-month Fixed Term Contract, with option to extend or become a permanent member of the team Compensation: OTE £90,000 Location: Hybrid ...

estate from Python/MySQL into a Databricks + Snowflake ecosystem built for scale, auditability and reliability. The Role Build & optimise pipelines in Databricks, PySpark, Python, Kafka Modernise legacy systems into a scalable, auditable cloud data platform Work closely with Product, DevOps & Regulatory teams You Bring Strong Python, PySpark ...

pipelines to ingest, transform, and prepare data Develop and optimise datasets for reporting and analytics Implement data transformations using SQL and Python (incl. PySpark) Monitor, troubleshoot, and improve performance of data pipelines and queries Apply data quality controls and maintain clear documentation Contribute to ongoing improvements in data architecture … with AWS data services (e.g. Redshift, Athena, S3, Glue, Lambda) Strong SQL skills Exposure to SnapLogic or similar integration platforms Proficiency in Python (including PySpark) Familiarity with modern data tooling (e.g. open table formats, DuckDB beneficial) Experience with version control (Git/CodeCommit preferred) Awareness of BI tools (e.g. ...

Data Engineer Up to £60,000 We are working with an organisation that is going through an exciting period of growth and continued investment across its technology and data landscape. With data playing an increasingly ...

Data Engineer Up to £60,000 We are working with an organisation that is going through an exciting period of growth and continued investment across its technology and data landscape. With data playing an increasingly ...

Data Engineer Up to £60,000 We are working with an organisation that is going through an exciting period of growth and continued investment across its technology and data landscape. With data playing an increasingly ...

Data Engineer Up to £60,000 We are working with an organisation that is going through an exciting period of growth and continued investment across its technology and data landscape. With data playing an increasingly ...

Technical Skills You’ll have experience with some of the following: Cloud & Data Platforms: AWS, Azure, Google Cloud Platform, Databricks Programming Languages: Python, R, PySpark Agentic & GenAI Platforms: Microsoft Copilot Studio, OpenAI GPT-5 Agents, UiPath, Adept AI, Orby AI, Beam AI If you’ve held any of these … Specialist, Python Developer, AI Transformation Consultant, Databricks Consultant, Azure AI Consultant, AWS Data Scientist, GCP Data Consultant, Agentic AI Consultant, OpenAI GPT Specialist, PySpark Developer. ...

contribute to engineering standards and help drive best practices across the team. You'll build scalable data pipelines and frameworks using Azure, Databricks and PySpark, working across the full engineering lifecycle from design through to production. You'll also support other engineers through code reviews, knowledge sharing and pair … reliable data solutions that create real business value. Skills & Experience Strong experience building cloud-native data platforms, ideally on Azure Commercial experience with Databricks, PySpark and Python Strong SQL and data engineering expertise Experience designing and delivering scalable ETL and data pipeline solutions #J-18808-Ljbffr ...

contribute to engineering standards and help drive best practices across the team. You'll build scalable data pipelines and frameworks using Azure, Databricks and PySpark, working across the full engineering lifecycle from design through to production. You'll also support other engineers through code reviews, knowledge sharing and pair … reliable data solutions that create real business value. Skills & Experience Strong experience building cloud-native data platforms, ideally on Azure Commercial experience with Databricks, PySpark and Python Strong SQL and data engineering expertise Experience designing and delivering scalable ETL and data pipeline solutions If you're looking ...