1 to 25 of 76 Remote/Hybrid PySpark Jobs in the UK

data modelling, dimensional modelling, canonical data models, and enterprise data models. Strong experience in designing ETL/ELT data pipelines. Good understanding of PySpark, Spark SQL, Python, and SQL. Strong knowledge of data warehouse, data lake, data mart, and semantic layer architecture. Experience in defining data quality, data validation ...

data modelling, dimensional modelling, canonical data models, and enterprise data models. Strong experience in designing ETL/ELT data pipelines. Good understanding of PySpark, Spark SQL, Python, and SQL. Strong knowledge of data warehouse, data lake, data mart, and semantic layer architecture. Experience in defining data quality, data validation ...

data modelling, dimensional modelling, canonical data models, and enterprise data models. Strong experience in designing ETL/ELT data pipelines. Good understanding of PySpark, Spark SQL, Python, and SQL. Strong knowledge of data warehouse, data lake, data mart, and semantic layer architecture. Experience in defining data quality, data validation ...

data modelling, dimensional modelling, canonical data models, and enterprise data models. Strong experience in designing ETL/ELT data pipelines. Good understanding of PySpark, Spark SQL, Python, and SQL. Strong knowledge of data warehouse, data lake, data mart, and semantic layer architecture. Experience in defining data quality, data validation ...

integration, and the software development lifecycle (SDLC). Hands-on experience with big data frameworks such as Spark, Hadoop, or Hive, including derivatives like PySpark (preferred), Spark Scala, or Spark SQL, along with familiarity with development-accelerating libraries and frameworks. Experience using data modelling tools such as ERwin ...

integration, and the software development lifecycle (SDLC). Hands-on experience with big data frameworks such as Spark, Hadoop, or Hive, including derivatives like PySpark (preferred), Spark Scala, or Spark SQL, along with familiarity with development-accelerating libraries and frameworks. Experience using data modelling tools such as ERwin ...

data engineering Strong programming expertise in Python Hands-on experience with Databricks (workflows, notebooks, jobs, Delta Lake) Strong experience with Apache Spark/PySpark Experience building scalable ETL pipelines Proficiency in SQL and relational databases Experience with cloud platforms (AWS/Azure/GCP) Experience with modern data warehousing ...

junior engineers and contribute to technical leadership Collaborate with stakeholders to turn business requirements into scalable data solutions Essential Skills Strong SQL and Python (PySpark preferred) Proven experience building cloud-based data platforms on Azure Hands-on experience with Azure Databricks, Delta Lake and Azure Data Lake Expertise designing ...

OneLake, Data Factory, Synapse Data Engineering/Data Science, and Real-Time Analytics). Core Data Stack: High proficiency in advanced SQL , Python/PySpark, and data lakehouse architectures (Delta Lake). Cloud Infrastructure: Strong understanding of Microsoft Azure data services (Azure Data Factory, Azure Synapse, Azure ...

only on ETL. However, we will consider candidates who bring Cloud + CI/CD experience alongside technologies such as: Proficient SQL; familiarity with PySpark is beneficial dbt Microsoft Fabric SQLMesh 5. Core Engineering Skills Strong Python, with good documentation and unit testing practices Comfortable in an agile delivery ...

+ environment configurations. Analysing current Data Engineering solutions + identifying data migration requirements. Onboarding datasets, users + workloads onto target platform. Data Engineering: Python, PySpark, SQL, Data Pipeline Development, ETL/ELT Design, Data Modelling, Data Quality, Data Validation. AWS Cloud Platform, S3, IAM, CI/CD concepts, DevOps ...

working with flexibility and autonomy Key Experience Deep end-to-end experience delivering enterprise Databricks analytics solutions Expertise in Lakehouse Architecture, Delta Lake, Spark, PySpark Strong data modelling skills (3NF, Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala ...

analytical use cases Ability to work closely with both technical and non-technical stakeholders, translating business requirements into data solutions Experience with Python or PySpark, particularly within Fabric Notebooks Exposure to Azure data services such as Data Factory, Synapse or Data Lake Power BI experience, including supporting reporting ...

assurance processes Excellent problem-solving skills with the ability to diagnose and resolve complex data issues Strong communication and stakeholder management experience Desirable Experience PySpark and/or Python development Azure Data Factory (ADF) Azure Synapse Analytics Azure Data Lake Storage Power BI development and data modelling Exposure ...

Azure. Experience with other platforms like AWS, Snowflake, or Databricks is also beneficial. Hands-on expertise with Data Factory (Fabric or Azure), notebooks (Python, PySpark), advanced SQL, and robust data modelling and performance optimisation skills. Proven track record in building scalable data pipelines and implementing modern architectures such ...

level Performance tuning of complex SQL/T-SQL at scale Confidence taking ownership of workstreams and mentoring junior team members Desirable for both: PySpark/Python in Fabric Notebooks, Azure Data Factory/Synapse/Data Lake, Power BI, AI/ML exposure ...

years of proven experience delivering robust data engineering solutions. The Fabric Ecosystem: Demonstrable, hands-on expertise with Microsoft Fabric , SQL , and Python/PySpark Notebooks . Core Competencies: Proven skill in dimensional modeling, data governance, and data extraction from online platforms via SaaS and APIs. Analytical Mindset: Excellent ability ...

optimisation, and software engineering best practices What We’re Looking For Proven hands-on experience with Databricks platform and orchestration Strong skills in Python, PySpark, and SQL, with knowledge of distributed data systems Expertise in developing full lifecycle data pipelines across ingestion, transformation, and serving layers Experience with data ...

Data Lake and Azure Synapse Analytics Solid understanding of ETL processes, data integration and pipeline development Advanced SQL skills as well as Python/PySpark experience for data processing Exposure to Power BI or other reporting tools is beneficial What's on Offer Salary up to £65,000 Fully ...

data pipelines using Databricks and Apache Spark. Build and optimize data workflows for batch and real-time processing. Transform and process large datasets using PySpark, SQL, and Delta Lake. Implement data ingestion from multiple sources (APIs, streaming, databases). Your Skills: Python proficiency. AWS : Cloud formation , Service Catalog ...

data pipelines using Databricks and Apache Spark. Build and optimize data workflows for batch and real-time processing. Transform and process large datasets using PySpark, SQL, and Delta Lake. Implement data ingestion from multiple sources (APIs, streaming, databases). Your Skills: Python proficiency. AWS : Cloud formation , Service Catalog ...

wider data community Promote high coding and data practice standards Experiment with emerging data, ML and AI technologies What you'll need: Strong Python, PySpark, SQL and Databricks or Snowflake experience AWS cloud data engineering expertise Experience building scalable batch and real-time data pipelines Airflow, CI/ ...

ADLS). Solid understanding of Scrum practices and a strong Agile mindset. Advanced proficiency in Python and its key data and ML libraries (NumPy, PySpark, Scikit learn, TensorFlow/PyTorch) Working knowledge of generative AI models (e.g., ChatGPT, Claude), Databricks GenAI tooling (including embedding models), and modern data structures ...

Strong experience building and delivering data pipelines using cloud platforms (AWS preferred) and big data tools like Kafka or Spark. Confident using Python (or PySpark) and SQL to process, transform and analyse data, and able to guide others in doing the same. Good understanding of modern data platforms (such ...

Strong experience building and delivering data pipelines using cloud platforms (AWS preferred) and big data tools like Kafka or Spark. Confident using Python (or PySpark) and SQL to process, transform and analyse data, and able to guide others in doing the same. Good understanding of modern data platforms (such ...