101 to 125 of 150 Remote PySpark Jobs

work. The contract is initially 6 months with remote working. You will own ingestion, model deployment, evaluation, and CI/CD across environments, leveraging PySpark, Unity Catalog, and batch inference on Claude. #J-18808-Ljbffr ...

IR35 . Rate: £650 - £750 Location: Hybrid – 2/3 days per week on-site Contract: 6 months | Outside IR35 Key Skills: Data Lakehouse PySpark DBT Iceberg AWS Strong data engineering and pipeline development experience You’ll be responsible for designing, building and optimising scalable data pipelines and lakehouse ...

data modelling, semantic layers and Power BI delivery. You'll have the opportunity to: ·Design and build production-grade pipelines using Azure Databricks, Python, PySpark and SQL ·Develop scalable Lakehouse architecture using Delta Lake and Unity Catalog ·Build data and BI products from scratch and own them through … Claude and OpenRouter to support development, code review and documentation To succeed, you'll need: ·Strong production experience with Azure Databricks ·Advanced Python, PySpark and SQL skills ·Advanced Power BI, DAX and data-modelling experience ·Experience building and owning complex data or BI solutions end to end ·Confidence translating ...

query, validate and optimise data across cloud-based analytical platforms such as Athena, Redshift and Azure Synapse Build scalable data processing solutions using PySpark, Python and cloud-native orchestration services Implement data quality checks, validation processes, monitoring and logging to ensure trusted and reliable data delivery Support the performance … engineering, integration and analytics challenges Collaborate with experienced engineers, architects and data specialists in supportive, multidisciplinary teams Develop expertise across cloud-native data services, PySpark, SQL and modern engineering practices Access mentoring, knowledge sharing and development opportunities to help you grow your career Contribute to solutions that deliver measurable ...

using both Microsoft Fabric tools and the Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics. Job Requirements Strong proficiency in PySpark, Databricks SQL, T-SQL, and handling Delta Lake formats Hands‐on experience building production pipelines inside Databricks workspaces and Fabric capacities Practical knowledge … data processing. Build and maintain the Medallion Architecture silver & gold layer across shared storage. Write optimized transformations in Fabric Notebooks and Databricks clusters using PySpark and SQL. Configure data access, masking, and governance policies within Databricks Unity Catalog. Optimize Lakehouse table performance using Z-Order indexing, liquid clustering ...

strategy. At the heart of this is our Databricks data platform, and you will take ownership of building, optimising, and maintaining data pipelines using PySpark - orchestrating feeds from source systems through to our group data platform and taking technical ownership of all parts of the process.You will work closely … experience building and managing workloads on the Databricks platform, including Delta Lake, Unity Catalog, and Declarative Automation BundlesPySpark - proficiency in writing and optimising PySpark code for data transformation and processingAzure - solid experience working within the Azure ecosystem, including services such as Azure Data Factory, Azure Data Lake Storage ...

Vantage Data Centers is looking for a Mid‐Level Data Engineer in London to help build and scale the enterprise data platform. You'll design and maintain data pipelines using Python and Azure services, ensuring ...

prestigious UK client. The role centers on designing and building data platforms and guiding the transition to Microsoft Fabric, with SQL, Python/PySpark and Data Factory as core technologies. The position offers a flexible base with the role primarily home-based across the UK, with offices for collaboration ...

pipelines and multimodal models. You will collaborate with Applied Scientists, Data Engineers, PMs and business stakeholders to productionise solutions. Role requires strong Python, PySpark/Databricks experience, hands-on DL with PyTorch or TensorFlow, and a pragmatic, business-focused #J-18808-Ljbffr ...

visible role where you'll combine strong technical skills with commercial thinking to drive meaningful product improvements. Your Skills & Experience Strong SQL skills Python (PySpark experience is beneficial) Experience in Product Analytics Strong knowledge of A/B testing and experimentation Excellent statistical analysis skills, with exposure to modelling ...

visible role where you'll combine strong technical skills with commercial thinking to drive meaningful product improvements. Your Skills & Experience Strong SQL skills Python (PySpark experience is beneficial) Experience in Product Analytics Strong knowledge of A/B testing and experimentation Excellent statistical analysis skills, with exposure to modelling ...

high-performing engineering squad, owning technical challenges and driving best practices across the team. You’ll build scalable pipelines using Azure, Databricks and PySpark, collaborating with Product and Delivery to deliver reliable data platforms and business value. London-based with hybrid working conditions. #J-18808-Ljbffr ...

Northampton, UK. This hybrid role involves working 2 days a week in the office. The ideal candidate will have expertise in Bigdata technologies, including PySpark and AWS services, as well as strong communication and problem-solving skills. You will be expected to collaborate effectively within a diverse team while ...

month fixed-term contract with hybrid work (onsite 2 days per week). The role requires strong Snowflake experience, including Snowflake ML, plus PySpark and SQL skills. DBT experience is advantageous as you build and migrate data pipelines for programme use cases from Pre-Prod to Prod. You will ...

Hybrid, 3 days onsite). This 12-month fixed-term contract role focuses on building and supporting modern cloud-based data platforms using AWS, PySpark, and IaC. You will work with Terraform, GitLab CI/CD, and collaborate with engineers to deliver secure, scalable cloud solutions. You’ll join ...

Skill Data architecture , cloud ( Azure/GCP/AWS ) , Databricks/snowflake , Data modelling, exposure to agentic Ai , Gen AI Secondary Skill Mandatory Skills Pyspark, advance SQL, ETL , data- warehousing Must-Have Skills Pyspark, advance SQL, ETL , data- warehousing Good-to-Have Skills Required Skills & Experience 14+ years ...

modelling, Kimball, or Data Vault Exposure to modern cloud data platforms, ideally within the Microsoft ecosystem Familiarity with tools such as DBT, Python, or PySpark is beneficial Experience working in data transformation or modernisation programmes Understanding of architecture principles or a clear interest in developing into a Data Architect ...

building data models and pipelines in Snowflake, migrating programme use cases, and collaborating with Data Scientists to validate model performance. Experience with Snowflake ML, PySpark, and DBT is essential. The candidate will manage the migration from Pre-Prod to Prod, support PoC phases, and document findings during the transition ...

technology sprawl while improving security, supportability and delivery speed. 4. Data Engineering and Integration Design and build reliable ingestion and transformation pipelines using Python, PySpark, SQL and Delta Lake. Implement full and incremental ingestion, CDC where appropriate, schema evolution, reconciliation, error handling and data quality controls. Design reusable integration … Databricks Serverless and compute/workload optimisation Azure identity, networking, security, secrets, monitoring and private connectivity Databricks SQL, Delta Lake and performance optimisation Python, PySpark and SQL Jobs/workflows, incremental processing, CDC and data quality REST/API and external data integration patterns FinOps, cost attribution, tagging, budgets ...

Lead the design and implementation of scalable data architectures on the Databricks Lakehouse platform. Oversee the development of efficient ETL/ELT pipelines using PySpark, SQL, and Delta Lake. Mentor and guide junior data engineers, promoting best practices in code quality, CI/CD, and performance tuning. Collaborate with … Requirements & Skills Databricks Expertise: Extensive hands-on experience with Databricks, Delta Lake, Unity Catalog, and Spark optimization. Programming Languages: Advanced proficiency in Python/PySpark and SQL. Cloud & Infrastructure: Strong background in cloud data platforms (Azure, AWS, or GCP) and cloud-native architectures. Engineering Best Practices: Experience with ...

/ELT processes for data ingestion and transformation. Supporting and enhancing a business-critical reporting and analytics platform. Developing SQL and Python/PySpark-based data solutions. Managing and optimising SQL database environments, ensuring performance, reliability and scalability. Collaborating with Data Analysts, BI professionals and stakeholders across the organisation. … skills and experience working with complex relational databases. Hands-on experience building and supporting ETL/ELT pipelines. Strong Python and/or PySpark development experience. Experience with SQL Server or similar database technologies. Excellent problem-solving skills and the ability to engage effectively with both technical ...

Are you passionate about AI? At Satori Analytics, we aim to change the world one algorithm at a time by bringing clarity to global brands thought Data & AI. From cloud-based ecosystems for fintech to ...

Role Description Location:West Yorkshire- multiple locations(Hybrid- 3 days working from onsite-Mandatory) Immediate start Permanent/Contract inside IR35/Fixed term contract We're looking for a Lead Data Engineer to join ...

/ETL workflows within a Fabric Lakehouse environment Work with OneLake, Lakehouse architecture, and modern data engineering best practices Utilise PySpark, SQL and Databricks for complex data transformation and engineering workloads Create robust data ingestion, orchestration and monitoring processes Support the development of enterprise-wide analytics solutions and Power … with Microsoft Fabric, including Data Factory, Dataflows, Notebooks and Lakehouse solutions Experience building and supporting production-grade ELT/ETL pipelines Strong skills in PySpark and SQL Experience working with OneLake, Delta formats or modern Lakehouse architectures Exposure to Databricks and distributed data processing environments Understanding of data modelling ...

Location:West Yorkshire- multiple locations(Hybrid- 3 days working from onsite-Mandatory)Immediate startPermanent/Contract inside IR35/Fixed term contractWe’re looking for a Lead Data Engineer to join UST Data Team. As ...