276 to 300 of 343 PySpark Jobs

data science, statistical modelling and using data to solve problems. Some experience with programming languages or analytical tools, such as Python, SQL, SAS or PySpark, gained through university projects, placements, internships or employment. An understanding of statistical concepts and an interest in predictive modelling or machine learning. Strong analytical ...

experience you will need for success Technical knowledge and experience: Proven experience using Databricks (essential) Strong programming skills in Python (essential) Experience working with: PySpark, Large‐scale data processing environments, Complex behavioural datasets Experience cleaning, preparing and processing: Large datasets, Real‐world data containing inconsistencies and anomalies, Data with ...

scale a global organization through resourcing/location strategy. Qualifications Proven track record delivering solutions in complex organizations. Experience with AWS, Databricks, DBT, PySpark, React, JavaScript Terraform, etc. Fast learner, thrives in ambiguity, translates vision into product scope. Passion for automation and user experience innovation. Builds high-performing teams ...

comfortable with large datasets, distributed processing and applying software engineering discipline to data products; Foundry experience is highly desirable but strong Python/PySpark engineers who can learn Foundry quickly are encouraged to apply. Extensive experience with Python and PySpark/Apache Spark. Proven track record designing ...

This is a hands-on architecture role combining technical leadership, solution design, stakeholder engagement, and delivery oversight. Essential Technical Skills Data Integration & Development Python PySpark SQL and T-SQL Spark SQL XML XSD (XML Schema Definition) XPath XSLT JSON REST APIs Data warehousing methodologies Master Data Management (MDM) Metadata … platforms. Strong hands-on experience with Azure Data Factory. Hands on knowledge of the Microsoft Fabric architecture. Strong hands-on experience with Azure Databricks, PySpark, and Delta Lake. Proven experience architecting complex ETL/ELT data integration solutions. Strong experience working with XML, XSD schema validation, XPath, and XSLT ...

solutions that enhance business decision-making. This is an exciting opportunity for a hands-on engineer with strong expertise in Databricks, Python, SQL, and PySpark , combined with practical experience using modern AI-assisted development tools such as GitHub Copilot, ChatGPT, Claude Code, Cursor, and VS Code . Key Responsibilities … practices. Required Skills & Experience 3+ years of experience within Data Engineering, Analytics Engineering, or Data Analytics. Strong hands-on experience with: Databricks SQL Python PySpark Delta Lake Experience designing ETL/ELT pipelines and data transformation frameworks. Strong understanding of data modelling, performance optimisation, and data quality practices. Experience ...

progressing its implementation and ongoing development. Developing and extending a medallion lakehouse architecture across bronze, silver and gold data layers. Working hands-on with PySpark notebooks, SQL, Dataflows Gen2 and data integration technologies. Developing robust ETL/ELT pipelines, bringing data together from multiple business systems and sources. Applying … ideally bring: Strong hands-on experience with Microsoft Fabric, including Lakehouse architecture and its wider data engineering capabilities. Good working knowledge of PySpark and Spark notebooks, with the ability to understand, troubleshoot and extend existing code. A solid understanding of data warehousing, ETL/ELT processes, data integration ...

understand their needs and translate them into technical solutions Transform data in Lakehouses and deliver clean, high-quality data for analysis and reporting Utilize PySpark to transform raw data into high-quality, analysis-ready products Implement rigorous automated data quality checks and proactive monitoring to ensure clean Data … Built and maintained data products using the Microsoft Data Stack (Azure Data Factory, Data Lake Storage, Fabric or Synapse Analytics) Expert-level proficiency in PySpark/Python Applied experience of DBT, AirFlow, or similar for data transformation and orchestration Deep understanding of data modeling, warehousing concepts, and the Medallion ...

Job Title Senior Data Engineer Job Description Summary Senior Data Engineer | Databricks | Agentic AI | EMEA & APAC We are the team leading the data transformation of our EMEA and APAC business, and we are hiring a ...

Join us, be part of more. We’re so much more than an energy company. We’re a family of brands revolutionising how we power the planet. We’re energisers. One team of 21,000 ...

Description Join us, be part of more. We're so much more than an energy company. We're a family of brands revolutionising how we power the planet. We're energisers. One team of 21 ...

Warehouse, pipelines, Dataflows Gen2, notebooks) Very good knowledge of Power BI: data modeling, DAX, semantic models Good SQL skills and experience with Python/PySpark Experience integrating data from various sources (APIs, files, databases, SaaS platforms) Experience with or a genuine interest in GenAI solutions for data, including text ...

Cognizant in London is seeking a Lead Developer to design, implement and optimize Python and cloud-based solutions using AWS and PySpark for data-intensive, regulatory-focused applications. Hybrid day shift model in Stratford London (3 days a week). You will own end-to-end technical delivery, ensure ...

Senior Data Engineer - Analytics Engineering - Databricks - Pyspark - Dimensional Models - Perm We're looking for a Senior Analytics Engineer to lead the design and delivery of curated, analytics-ready data within our Lakehouse environment. You'll translate complex business requirements into robust SQL and PySpark pipelines, own the data … deliver dimensional and semantic data models for analytics. Define and maintain KPIs, conformed dimensions and consistent data definitions. Develop and optimise SQL and PySpark pipelines using Databricks. Ensure high standards of data quality, testing, performance and observability. Lead modelling reviews and contribute to technical and architectural decisions. Work closely ...

deploying machine learning models in production, alongside strong hands‐on Python skills. You should be comfortable with distributed computing tools such as Spark or PySpark, cloud platforms and modern MLOps practices. Experience managing and developing data scientists is essential, as is the ability to explain technical decisions and work ...

deploying machine learning models in production, alongside strong hands-on Python skills. You should be comfortable with distributed computing tools such as Spark or PySpark, cloud platforms and modern MLOps practices. Experience managing and developing data scientists is essential, as is the ability to explain technical decisions and work ...

onsite capacity in Sheffield. You will focus on robust data pipelines and back-end data plumbing. You will work with Databricks and PySpark to ingest, transform and structure raw data into high-quality Delta tables for enterprise use, delivering scalable data infrastructure to support business decisions. Candidates must ...

Engineer to build and scale modern data platforms, focusing on robust data pipelines and Back End data plumbing. You'll work with Databricks and PySpark to ingest, transform, and structure raw data into high-quality Delta tables for enterprise use. We endeavour to process your personal data ...

support production-grade ETL/ELT pipelines that source, transform and curate data for Internal Audit. Develop maintainable Python solutions using Pandas, Polars and PySpark, selecting fit-for-purpose approaches based on scale, performance and operational needs. Write advanced SQL for data transformation, reconciliation, profiling and analysis across OLTP … computer science, engineering or a related quantitative discipline. A master’s degree is welcome. Hands-on proficiency in Python, including Pandas, Polars and PySpark, with experience writing testable and maintainable code. Strong SQL proficiency and practical understanding of OLTP databases, relational design and query performance. Strong understanding of data ...

ingest, analyse and visualise data, produce robust outputs, and collaborate across teams to meet Ofcom’s objectives. A quantitative degree and strong Python/PySpark skills are essential. #J-18808-Ljbffr ...

Data Science team. The Data Scientist will have strong hands-on experience writing technical code in python and have strong knowledge within PySpark optimisation. The ideal Data Scientist will be able to manage teams of Data Scientists and will be able to work closely with engineers and software developers. ...

engineering, or a related field Experience analysing gambling marketing activities The ability to write clear, well-structured code Hands‐on experience with Python, SQL, PySpark, or similar tools A flair for problem‐solving and storytelling with data — and the confidence to present findings to clients Sound like ...

facing team in London. You will mentor data scientists, oversee complex data products, and ensure analytical excellence. The ideal candidate has strong SQL and PySpark experience, excellent communication skills, and a Bachelor’s degree in a related field. This position offers a collaborative environment, competitive benefits, and a chance ...

maintain production-quality Python and SQL code.* Use Git-based source control and branch management practices across multiple deployment environments.* Work with Spark and PySpark to process and analyse large-scale datasets.* Develop and manage machine learning workflows within an MLOps environment.* Use tooling such as MLflow, VS Code … model validation.* Practical experience with Git, Agile delivery and collaborative software-development workflows.* Experience using distributed data-processing and MLOps tools such as Spark, PySpark, MLflow, JupyterHub or equivalent technologies.* Understanding of data-product lifecycles, data quality, governance, reproducibility and auditable insightful workflows.* Ability to translate operational or business ...

maintain production-quality Python and SQL code. Use Git-based source control and branch management practices across multiple deployment environments. Work with Spark and PySpark to process and analyse large-scale datasets. Develop and manage machine learning workflows within an MLOps environment. Use tooling such as MLflow, VS Code … model validation. Practical experience with Git, Agile delivery and collaborative software-development workflows. Experience using distributed data-processing and MLOps tools such as Spark, PySpark, MLflow, JupyterHub or equivalent technologies. Understanding of data-product lifecycles, data quality, governance, reproducibility and auditable insightful workflows. Ability to translate operational or business ...