13 of 13 PySpark Jobs in the Midlands

Microsoft Fabric including OneLake, Lakehouse, Delta, Data Pipelines, Dataflows and semantic models. • Strong SQL skills including optimisation and performance tuning. • Experience using Python or PySpark for data transformations. • Experience building ETL or ELT pipelines using Fabric Data Pipelines or Azure Data Factory. • Strong understanding of data modelling and modern ...

strong data governance and GDPR compliance Skills Experience in data engineering within enterprise environments Strong Azure/Microsoft Fabric experience SQL and Python/PySpark ETL/ELT (ADF/Fabric) Knowledge of data modelling and governance ...

will have the following skills and experience: Deep expertise with Azure Databricks, including development, deployment, and platform-level engineering. Strong software engineering capability across Pyspark, Spark SQL and Azure Data Factory. Solid understanding of DevOps practices including CI/CD and automated testing. Experience with monitoring, logging, and alerting ...

notebooks) Experience building or working within modern data warehouse architectures Ability to get up and running quickly without heavy onboarding Nice to have: Python, PySpark or Spark experience Exposure to APIs and external data integration Experience working in evolving or transforming data environments Most importantly, youll be someone ...

modelling techniques Understanding of metadata management, data governance, and data quality frameworks Proficiency with SQL and ideally one or more programming languages (eg, Python, PySpark) Experience with database technologies and data warehousing principles (star schema, snowflake, data vault) Experience working with cloud data services specifically with AWS (including Redshift ...

manual Excel and macro-driven processes and replacing them with scalable, production-grade data pipelines. Required Skills & Experience Strong commercial Experience with: Python PySpark Hadoop Job Title: Data Engineer Location: Sheffield, UK Rate/Salary: 500.00 - 500.00 GBP Daily Job Type: Contract Trading as TEKsystems. Allegis Group Limited, Maxis ...

lakes, lakehouse, distributed systems) Exposure to proof of concept (PoC) development Knowledge of object storage and distributed processing frameworks Familiarity with technologies such as: PySpark, Dremio, Apache Iceberg, Apache Airflow, S3/object storage concepts, IBM Cloud (or willingness to upskill) Experience in financial services or highly regulated environments ...

deploying the Lakehouse platform in Azure. Owning Databricks engineering, administration and platform optimisation. Designing end-to-end data platform solutions Leading implementation using Databricks, PySpark, Spark SQL and Azure Data Factory. Creating and maintaining CI/CD pipelines and automated testing frameworks. Developing APIs to support integration Implementing monitoring … logging and alerting for platform reliability. YOUR SKILLS AND EXPERIENCE: Deep expertise in Databricks, PySpark, Python and SQL. Proven experience designing and delivering Lakehouse solutions. Strong DevOps capabilities, including CI/CD and automated testing. Experience with Infrastructure as Code and cloud automation. Familiarity with monitoring, logging and alerting ...

data models within the Lakehouse Owning the transformation from enriched to curated datasets, enabling trusted reporting and insight Developing and maintaining robust SQL and PySpark transformation pipelines in Databricks Embedding data quality, testing, reliability and performance into the curated layer Working closely with data engineers, BI teams and business … Engineer within a modern data platform Excellent data modelling capability, including dimensional and semantic modelling Advanced SQL skills and strong hands on experience with PySpark Experience working with Databricks and Lakehouse architectures A solid grounding in engineering best practices, testing and data quality Confidence mentoring others and taking ownership ...

your most recent CV to be considered for telephone screening. SQL/BI/ETL/DATAWAREHOUSE/AZURE/FABRIC/SPARK/PYSPARK/LEAD/MANAGER/HOME/REMOTE/MIDLANDS/BIRMINGHAM/SQL/BI/ETL/DATAWAREHOUSE/AZURE/FABRIC …/SPARK/PYSPARK/LEAD/MANAGER/HOME/REMOTE/MIDLANDS/BIRMINGHAM ...

your most recent CV to be considered for telephone screening. SQL/BI/ETL/DATAWAREHOUSE/AZURE/FABRIC/SPARK/PYSPARK/LEAD/MANAGER/HOME/REMOTE/MIDLANDS/BIRMINGHAM/SQL/BI/ETL/DATAWAREHOUSE/AZURE/FABRIC …/SPARK/PYSPARK/LEAD/MANAGER/HOME/REMOTE/MIDLANDS/BIRMINGHAM ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...

business. Design and own analytics data models, transforming data from enriched layers into curated, analytics ready datasets. Develop and maintain robust SQL and PySpark transformations within Databricks. Work closely with data engineers, BI teams and stakeholders to translate complex requirements into trusted reporting. SKILLS AND EXPERIENCE The successful Analytics … following skills and experience: Strong commercial experience as an analytics focused engineer, rather than an analyst. Advanced data modelling capability, including dimensional modelling. Strong PySpark and SQL skills in production environments. Hands on experience with Databricks, including pipelines and governed data environments. A solid grounding in engineering best practices ...