101 to 115 of 115 PySpark Jobs

build practical workflows and applications, and turn technical ideas into tools that genuinely get used. What you’ll be doing: Working across Python, SQL, PySpark and modern data tooling Building data pipelines, workflows and user-facing applications Working directly with clients to understand problems and shape solutions Translating complex … looking for: Strong experience in data engineering, software engineering or technical consulting Good hands-on ability with Python, SQL and data workflows Exposure to PySpark, Spark, ETL, data platforms or application development Comfortable working with clients, users and non-technical stakeholders SC clearance, active. Experience in defence, national security ...

experienced delivery team in a fast-paced consulting environment. 🔑 The Role Migrate existing data pipelines and tables into Databricks Build and optimise scalable PySpark-based data workflows Support Lakehouse and Delta architecture implementation Work across ETL orchestration, transformation and optimisation Collaborate directly with technical stakeholders and delivery teams 🎯 Required … must be Databricks Partner Programme vetted to be considered for the role Experience within a Databricks Delivery Partner/consulting environment Databricks Certified Strong PySpark/Spark/SQL capability Experience with ETL and data migration projects Exposure to orchestration tooling such as AWS Glue or Azure Data Factory ...

Lakehouse architecture Design and deliver high-quality, analytics-ready data models that support trusted reporting Translate complex business requirements into robust SQL and PySpark transformation pipelines Shape how data is structured, modelled and served across multiple domains Embed data quality, testing, reliability and performance standards into pipelines Contribute … Experience Strong commercial experience as an Analytics Engineer operating in a modern data platform Advanced data modelling capability, including dimensional and semantic modelling Strong PySpark development experience within a Lakehouse environment Advanced SQL skills for complex transformations Hands-on experience with Databricks, including pipelines and governance tooling A strong ...

Responsibilities Build and maintain scalable data pipelines (full ETL lifecycle) Perform data cleaning, transformation, and integration Work with Microsoft Fabric, Notebooks, Python, and PySpark Manage and develop solutions using SQL Server and Cosmos DB Handle multiple data formats and support data processing workflows Collaborate closely with Data Engineering … Business Intelligence teams across onshore and offshore locations Requirements Proven experience as a Data Engineer Strong skills in Python, PySpark, and Microsoft Fabric Experience with SQL Server and Cosmos DB Ability to design and deliver ETL pipelines Comfortable working in high-pressure environments Desirable Insurance industry experience (ideally 2+ ...

operational efficiency Write high-quality, production-ready Python code and contribute to shared analytics codebases Query and manipulate large datasets using SQL and PySpark in distributed data environments Communicate analytical insights clearly to both technical and non-technical stakeholders Ensure strong governance, risk, and control standards are embedded … experience includes: Strong background in statistical analysis and modelling Advanced programming skills in Python Experience working with large datasets using SQL and/or PySpark Highly desirable skills include: Advanced knowledge of machine learning and AI techniques Experience within financial services or strong understanding of banking products, risk frameworks ...

e.g. Data Science, Mathematics, Statistics, Physics, Computer Science, Informatics or Engineering You have strong experience with analytics and data manipulation software e.g. R, Python, PySpark, SAS, SQL, SPSS You have a strong understanding of financial markets and instruments You take a consultative approach and have polished communication and stakeholder … Diverse and inclusive environment Health and wellbeing support Volunteering opportunities Pension Apply now to find out more about this Senior Data Scientist (R Python PySpark SAS SQL SPSS) opportunity. At Client Server we believe in a diverse workplace that allows people to play to their strengths and continually learn. ...

pricing models with advanced data science techniques using WTW Radar and Emblem. Query and engineer large datasets (e.g., Python/R/SQL/PySpark) on modern platforms (e.g., Azure Databricks). Create innovative data solutions and present actionable insights to stakeholders. Communicate results clearly to key decision-makers … Street Pricing. What we’re looking for: Experience in general insurance pricing with strong modelling skills. Proficiency in programming languages such as R, Python, PySpark, SAS, or SQL. Good knowledge of Azure Databricks and modern data technologies. Experience with WTW Radar software is preferred. A quantitative degree in Mathematics ...

calculations, including netting sets, supervisory factors and collateral/CSA logic.* **Design a modern Databricks architecture** using Delta Lake, Unity Catalog and Spark/PySpark to support versioned, reproducible and regulator‐defensible exposure calculations.* **Develop high‐performance compute pipelines** that support intraday recalculation, scenario testing and rapid exposure analytics … exposure methodology, netting sets, supervisory parameters and collateral/CSA design.* **Strong Databricks engineering capability**, including Delta Lake versioning, Unity Catalog governance, Spark/PySpark optimisation and secure data architecture.* **Experience designing governed, audit‐ready systems**, with a focus on lineage, reproducibility, evidence trails and internal/external audit ...

making at scale. What You'll Be Doing: Building curated, analytics-ready datasets using modern modelling techniques Developing robust transformation pipelines using SQL and PySpark Collaborating with Data Engineers to enhance the data platform Translating business needs into scalable, well-structured data models Embedding data quality, testing, and governance … Looking For: Proven experience as an Analytics Engineer or similar role Strong SQL skills and experience with complex data transformations Hands-on experience with PySpark and modern data platforms (Lakehouse preferred) Solid understanding of dimensional modelling Strong communication skills - able to work across technical and business teams A passion ...

data models within a Lakehouse architecture Develop analytics‐ready datasets that power trusted reporting and dashboards Translate business requirements into well‐structured SQL and PySpark transformations Contribute to data modelling decisions across multiple business domains Apply data quality checks, testing and performance best practices to pipelines Work within existing … Analytics Engineer or in a similar data-focused role Solid data modelling skills, including experience with dimensional models Hands‐on experience writing PySpark in a Lakehouse or big data environment Strong SQL skills for building and maintaining transformation logic Experience working with Databricks or similar modern data platforms ...

data models within the Lakehouse Owning the transformation from enriched to curated datasets, enabling trusted reporting and insight Developing and maintaining robust SQL and PySpark transformation pipelines in Databricks Embedding data quality, testing, reliability and performance into the curated layer Working closely with data engineers, BI teams and business … Engineer within a modern data platform Excellent data modelling capability, including dimensional and semantic modelling Advanced SQL skills and strong hands on experience with PySpark Experience working with Databricks and Lakehouse architectures A solid grounding in engineering best practices, testing and data quality Confidence mentoring others and taking ownership ...

delivered, and used across the business. Responsibilities Design and build end-to-end data solutions within Microsoft Fabric Develop and optimise data pipelines using PySpark and SQL Work across bronze, silver, and gold layers (medallion architecture) Perform initial data analysis and help define requirements Collaborate with analysts, Client … stakeholders Improve and automate existing processes Ensure data is secure, accurate, and scalable Requirements Technical: Strong experience with PySpark/Spark and SQL Hands-on experience with Microsoft Fabric Experience building data pipelines and models Azure Data Factory experience Understanding of modern data architectures Personal: Proactive and self-starting ...

delivered, and used across the business. Responsibilities Design and build end-to-end data solutions within Microsoft Fabric Develop and optimise data pipelines using PySpark and SQL Work across bronze, silver, and gold layers (medallion architecture) Perform initial data analysis and help define requirements Collaborate with analysts, Client … stakeholders Improve and automate existing processes Ensure data is secure, accurate, and scalable Requirements Technical: Strong experience with PySpark/Spark and SQL Hands-on experience with Microsoft Fabric Experience building data pipelines and models Azure Data Factory experience Understanding of modern data architectures Personal: Proactive and self-starting ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...

technical leadership and taking ownership. Key responsibilities include: Designing and building curated datasets using dimensional and semantic modelling techniques Developing and maintaining SQL and PySpark transformation pipelines Partnering closely with Data Engineers Translating business requirements into clear, well-documented data models YOUR SKILLS AND EXPERIENCE: Advanced SQL, including complex … transformations and modelling Databricks PySpark and working within a Lakehouse or modern data platform Dimensional modelling and analytics engineering best practices Communicating effectively with both technical and non-technical stakeholders THE BENEFITS: You will receive a salary, dependent on experience. Salary ...