26 to 50 of 150 Remote/Hybrid PySpark Jobs

Data Stack, critically ADF and Synapse (experience with Microsoft Fabric is a plus) Highly developed python and data pipeline development knowledge, must include substantial PySpark experience Demonstrable DevOps and DataOps experience with an understanding of best practices for engineering, test and ongoing service delivery An understanding of Infrastructure ...

Strong hands-on experience with Quantexa implementation and development. Proven experience building and supporting big data platforms . Advanced knowledge of Apache Spark/PySpark . Strong programming skills in Scala and/or Python . Expertise in SQL and large-scale data modelling. Strong cloud experience across ...

Strong hands‐on experience with Quantexa implementation and development. Proven experience building and supporting big data platforms . Advanced knowledge of Apache Spark/PySpark . Strong programming skills in Scala and/or Python . Expertise in SQL and large-scale data modelling. Strong cloud experience across ...

documented solutions, while continuously improving how data is collected, transformed and consumed. What You'll Need Essential Strong SQL skills Python and/or PySpark experience Microsoft Fabric delivery experience ETL/ELT and data pipeline development API integrations Data modelling and transformation expertise Git/source control experience ...

particularly interested in engineers with strong hands-on Databricks experience. Essential Skills Commercial experience building solutions within Databricks. Strong hands-on expertise with PySpark, Spark SQL, and Delta Lake. Experience designing and supporting production-grade ETL/ELT pipelines. Strong Python and SQL development skills. Experience working with large ...

particularly interested in engineers with strong hands-on Databricks experience. Essential Skills Commercial experience building solutions within Databricks. Strong hands-on expertise with PySpark, Spark SQL, and Delta Lake. Experience designing and supporting production-grade ETL/ELT pipelines. Strong Python and SQL development skills. Experience working with large ...

JSON over HTTPS Strong understanding of the SDLC Strong communication and collaboration skills for cross-team working Azure certifications are a plus C#, python, pyspark or similar preferable. We’ve been nationally recognised as a 5 star housebuildersince 2010 for supplying high-quality homes for all generations. That ...

JSON over HTTPS Strong understanding of the SDLC Strong communication and collaboration skills for cross-team working Azure certifications are a plus C#, python, pyspark or similar preferable. We’ve been nationally recognised as a 5 star housebuildersince 2010 for supplying high-quality homes for all generations. That ...

utilities, nuclear, or defence) Clear exposure to project controls data (cost, schedule, risk, change, earned value) Hands-on skills in: Azure Data Factory, Databricks (PySpark), Synapse or equivalent Strong SQL and Python for transformations Building enterprise-ready datasets for Power BI Nice-to-Have Skills Familiarity with Primavera ...

premises data sources. Engineer reliable data pipelines and models: Design batch, incremental and near-real-time ETL/ELT using SQL, Python and PySpark; apply medallion, dimensional/Kimball, normalised and data-product patterns as appropriate; and use production-grade techniques such as CDC, SCD, schema-change handling, idempotency … implementation. Strong Microsoft Fabric experience across OneLake, Lakehouse, Warehouse, Data Pipelines, Notebooks and Dev/Test/Production workspace patterns. Advanced SQL, Python and PySpark, with practical experience of Delta/Parquet, medallion architecture and production-grade batch/incremental ETL/ELT. Strong Git and CI/ ...

Data Engineering Foundation: Practical experience with data modelling, ETL/ELT, and various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow, Spark, Databricks, Fabric. Cloud Capability: Experience with at least one major cloud provider (AWS, Azure ...

Hands-on expertise in Snowflake and Databricks Proficient in Microsoft Azure, including Azure Data Factory and Azure Data Lake Advanced SQL and Python or PySpark skills Experience building enterprise-level ETL/ELT pipelines Knowledge of data modelling, governance, and data quality Previous consultancy or client-facing delivery experience ...

solutions Strong stakeholder engagement and communication skills Agile delivery experience Desirable Experience Financial Services, Banking or Investment Management experience Microsoft Fabric Databricks Python or PySpark Data migration and transformation programmes Team leadership or mentoring experience Contract Details £650-£750 per day Inside IR35 6-Month Initial Contract Hybrid Working ...

solutions Strong stakeholder engagement and communication skills Agile delivery experience Desirable Experience Financial Services, Banking or Investment Management experience Microsoft Fabric Databricks Python or PySpark Data migration and transformation programmes Team leadership or mentoring experience Contract Details £650-£750 per day Inside IR35 6-Month Initial Contract Hybrid Working ...

Data Stack, critically ADF and Synapse (experience with Microsoft Fabric is a plus)Highly developed python and data pipeline development knowledge, must include substantial PySpark experienceDemonstrable DevOps and DataOps experience with an understanding of best practices for engineering, test and ongoing service deliveryAn understanding of Infrastructure as Code concepts ...

Ability to manage workload independently and drive initiatives proactively. Experience designing and supporting enterprise-scale cloud data platforms. Skills ETL, Power Automate, Power BI, PySpark #J-18808-Ljbffr ...

batch and streaming data pipelines, AI-ready data products, feature pipeline and analytics solutions on the Databricks Platform using Delta Lake, Spark SQL/PySpark, Unity Catalog and Databricks SQL.Deliver solutions across the full data & AI engineering lifecycle, from requirements analysis and solution design through development, testing, deployment, operational … scalable data platforms, data products and analytics solutions using modern lake house or cloud data warehouse technologiesProficiency writing advanced, highly optimised SQL and Spark (PySpark/Scala), with a focus on performance optimisation and maintainability.Designing and building solutions on a cloud data warehouse or lakehouse platform (e.g., Databricks, Snowflake ...

Title: AWS Data Engineer Job Location: London, UK/Hybrid Job Type: 12 Months FTC Job Description: Need Expert in Python Pyspark, AWS, Cloud, AWS Services, AWS Components Designing and developing scalable, testable data pipelines using Python and Apache Spark Orchestrating data workflows with AWS tools like Glue ...

design Databricks and/or Microsoft Fabric at architecture level Azure Data Factory, Synapse, Azure SQL, Data Lake Storage Gen2 Advanced SQL, Python or PySpark, Spark optimisation, Delta Lake, Unity Catalog Azure DevOps or GitHub Actions, Terraform or Bicep Entra ID, Key Vault, private endpoints, RBAC UK GDPR ...

Looking ForProven expertise with the Databricks platform, including Unity Catalog, Delta Lake, orchestration, and enterprise-scale Azure deployments.Strong technical skills in Python, PySpark, and distributed data processing frameworks, with experience building production-grade data platforms.Extensive experience implementing CI/CD pipelines using Azure DevOps, Jenkins, GitHub Actions, or equivalent ...

Databricks Serverless configuration and workload optimisation Databricks SQL and Delta Lake development Cluster management, compute policies, autoscaling, and workload monitoring Data Engineering Strong Python, PySpark, and SQL development skills Design and build ingestion and transformation pipelines Full and incremental data loading CDC (Change Data Capture) implementation Data quality controls ...

Looking For Strong SQL Data Engineering or Analytics Engineering experience Databricks or comparable platforms such as Snowflake, Hadoop or SQL Server Python and ideally PySpark ETL/ELT and data modelling Strong problem-solving and critical-thinking skills Good understanding of data architecture and infrastructure Ability to work independently ...

relevant data solutions development qualifications (e.g. Microsoft certification; Databricks Certification; data apprenticeship qualifications)Additional InformationTech StackSQL Server, SSIS, T-SQLADF, ADLS, Azure SQL Database, PySpark, Spark SQL, Databricks, Delta lakeSummaryType: Full-timeFunction: Analyst ...

Engineer Associate (DP-600), Power BI Data Analyst Associate (PL-300), or Azure Data Fundamentals (DP-900). Proficiency in Python and SQL, including PySpark and Spark SQL, used across our Microsoft Fabric data platform. Experience with ERP/finance systems data (NetSuite, SAP, Dynamics, etc.) Experience picking ...

ingest, cleanse and model data for BI reporting, ML and AI, ensuring quality and governance. The role emphasizes strong Azure skills (ADF, ADLS, Databricks), PySpark, Python and SQL, with a DevOps and CI/CD mindset. Hybrid work with three days in the office weekly is offered. #J ...