4 of 4 Permanent PySpark Jobs in Newport

cloud providers and collaborate with many technology partners like AWS, GCP, Microsoft, Databricks, Snowflake, Confluent, and others. IF YOU ARE Experienced with Python/PySpark Proficient working with Databricks Lakehouse architecture and principles Having 2+ years of designing data models, building ETL pipelines, and wrangling data to solve business More ❯

and the broader Azure ecosystem. Requirements Proven experience as a Data Engineer working with Microsoft Fabric or related Azure data services. Knowledge of using PySpark in notebooks for data analysis and manipulation. Strong proficiency with SQL and data modelling. Experience with modern ELT/ETL tools within the Microsoft More ❯

ready for deployment. Clear communication and the capacity to articulate technical choices effectively are crucial. Must-Have Skills: 3+ years Databricks (Lakehouse, Delta Lake, PySpark, Spark SQL) 5+ years SQL Python Azure Excellent client-facing communication skills Experience deploying Databricks pipelines Experience provisioning Databricks as code Nice to Have More ❯

our Cardiff office. As a key member of the engineering team, you’ll help design, build, and maintain robust data pipelines using Python and PySpark , enabling powerful analytics and smarter business decisions across the organisation. What You'll Be Doing Design and build scalable ETL/ELT data pipelines … using Python and PySpark Lead and support data migration initiatives across legacy and cloud-based platforms Collaborate with analysts, data scientists, and stakeholders to deliver high-quality, reliable data solutions Ensure best practices in data engineering, including quality, testing, and performance tuning Contribute to the evolution of our data … What We're Looking For 3+ years’ experience as a Data Engineer or in a similar role Strong hands-on experience with Python and PySpark Proven experience in data migration and transformation projects Solid understanding of cloud-based data platforms (e.g., AWS, Azure, GCP – nice to have) Strong problem More ❯