7 of 7 PySpark Jobs in Derby

cloud providers and collaborate with many technology partners like AWS, GCP, Microsoft, Databricks, Snowflake, Confluent, and others. IF YOU ARE Experienced with Python/PySpark Proficient working with Databricks Lakehouse architecture and principles Having 2+ years of designing data models, building ETL pipelines, and wrangling data to solve business More ❯

and the broader Azure ecosystem. Requirements Proven experience as a Data Engineer working with Microsoft Fabric or related Azure data services. Knowledge of using PySpark in notebooks for data analysis and manipulation. Strong proficiency with SQL and data modelling. Experience with modern ELT/ETL tools within the Microsoft More ❯

ready for deployment. Clear communication and the capacity to articulate technical choices effectively are crucial. Must-Have Skills: 3+ years Databricks (Lakehouse, Delta Lake, PySpark, Spark SQL) 5+ years SQL Python Azure Excellent client-facing communication skills Experience deploying Databricks pipelines Experience provisioning Databricks as code Nice to Have More ❯

I need to apply Expert use of Python Expert use of the full Azure Data Stack ERP exposure Data migration experience MS Fabric, Databricks, PySpark, Power BI are also desirable skills My client have limited interview slots and they are looking to fill this vacancy by then end of More ❯

Utilities sector Experience leading technical projects Skills & Technologies required: Proficiency in cloud-based data engineering tools (ADF, Synapse Analytics, S3, Lamda) Proficiency in using PySpark notebooks for ELT. Fostering and cultivating a culture of best practices Strong analytical and problem-solving skills. Ability to work independently and as part More ❯

our Nottingham office. As a key member of the engineering team, you’ll help design, build, and maintain robust data pipelines using Python and PySpark , enabling powerful analytics and smarter business decisions across the organisation. What You'll Be Doing Design and build scalable ETL/ELT data pipelines … using Python and PySpark Lead and support data migration initiatives across legacy and cloud-based platforms Collaborate with analysts, data scientists, and stakeholders to deliver high-quality, reliable data solutions Ensure best practices in data engineering, including quality, testing, and performance tuning Contribute to the evolution of our data … What We're Looking For 3+ years’ experience as a Data Engineer or in a similar role Strong hands-on experience with Python and PySpark Proven experience in data migration and transformation projects Solid understanding of cloud-based data platforms (e.g., AWS, Azure, GCP – nice to have) Strong problem More ❯

to-target mappings and re-engineer manual data flows to enable scaling and repeatable use. You will use a range of technology including Python, PySpark, Cloudera, Azure Synapse Analytics, Azure Data Factory, Microsoft Fabric and Data Flows. Location/WFH: You can work from home most of the time … within an hour commute to Nottingham). About you: You have experience as a Senior Data Engineer You have strong Python coding skills and PySpark experience You have experience with Azure Data Factory, Azure Synapse Analytics, Data Flows, Data migrations, Microsoft Fabric and Cloudera You have ERP experience - particularly More ❯