6 of 6 PySpark Jobs in the East Midlands

data modelling and data warehousing concepts (star/snowflake schemas, SCD2, Dimensions/Facts) Proficient in SQL and Python, with hands-on experience using PySpark, Spark SQL, and/or Pandas. Experience in technical documentation of migration processes, data mappings, data quality checks, and testing outcomes. Ability to work ...

similar Demonstrable experience in programming full scale data and analytic pipelines, storage solutions and process automation functions Highly proficient coding skills in SQL, Python & PySpark Proven knowledge in at least one of the following big data technologies – HIVE, Hadoop, MongoDB, Spark Experience within the Life Science, Medical Research ...

ideally in a multi-site business environment Strong proficiency in Python and SQL, with hands-on experience in Spark/PySpark and modern table formats (e.g. Delta Lake, Iceberg, Hudi) Expertise in AWS data services (e.g. S3, Glue, Redshift, Lambda, Step Functions, Kinesis) and infrastructure-as-code (Terraform ...

frameworks Engineering Delivery Design and evolve scalable data pipelines (batch and incremental watermark-based ingestion) using: Microsoft Fabric Pipelines Azure Data Factory PySpark/Python Fabric Notebooks Implement and maintain a medallion lakehouse architecture using OneLake and Fabric Warehouses Ensure Direct Lake-ready semantic models for analytics Lead incident … Hands-on experience with Microsoft Fabric, including: Workspaces, OneLake, Fabric Warehouses, Fabric Notebooks and Data Pipelines and Direct Lake semantic models Strong Python and PySpark development capability Solid SQL skills for warehouse development and metadata layers Proven ownership of production data systems end-to-end Wider Azure data platform ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...