126 to 150 of 344 PySpark Jobs

audiences Essential knowledge, skills & experience (must-have): 4+ years of commercial experience in Data Science/Machine Learning Hands-on experience with: Databricks Notebooks PySpark Workflows Deployment through Asset Bundles Proven experience building, deploying, and maintaining production ML solutions Broad experience across multiple ML domains, including: Forecasting/Time ...

Gen2), Purview, Cosmos DB, OpenAI, Azure ML, and AI Foundry Solid understanding of software engineering concepts, with hands‐on experience using Python, Scala or PySpark, data modelling techniques, database technologies, and SQL Confident communicator, able to explain technical concepts to non‐technical audiences and mentor junior colleagues For Senior ...

Gen2), Purview, Cosmos DB, OpenAI, Azure ML, and AI Foundry Solid understanding of software engineering concepts, with hands‐on experience using Python, Scala or PySpark, data modelling techniques, database technologies, and SQL Confident communicator, able to explain technical concepts to non‐technical audiences and mentor junior colleagues For Senior ...

insights clearly to both technical and non-technical audiences. Some other highly valued skills include: Strong SQL and database experience. Knowledge of Python/PySpark and data analytics. Experience working in a Call Centre or Contact Centre environment. Strong communication and stakeholder management skills. Ability to lead technical teams ...

What will you need to succeed? Strong production‐level Python engineering experience, with the ability to build maintainable, tested, and supportable services. Experience with PySpark or equivalent large‐scale data processing frameworks. Hands‐on experience designing and operating CI/CD pipelines using Azure DevOps or similar tooling. Experience ...

making. Key Responsibilities: Lead the design and development of curated, analytics-ready dimensional and semantic data models. Build, maintain and optimise complex SQL and PySpark transformation pipelines within Databricks. Define and maintain KPI definitions, conformed dimensions and consistent business logic across data domains. Ensure data quality, integrity, testing, observability ...

optimisation and leading delivery teams. Strong experience designing and delivering cloud-native data platforms within Azure and/or AWS environments. Advanced experience with PySpark, SparkSQL and large-scale distributed data processing. Strong understanding of modern data architecture, ETL/ELT frameworks and data modelling. Excellent SQL skills ...

taking ownership of data products or deliveries, breaking down work and managing priorities across projects. A strong understanding of CI/CD processes, SQL, pySpark and experience of modern enterprise cloud-based data environments including Azure and Databricks. Sufficient technical understanding to guide engineers and translate delivery requirements into ...

grow your career while helping customers unlock the power of their data. Responsibilities Design, build and optimise scalable data pipelines using Databricks, Apache Spark, PySpark and Delta Lake. Develop and implement modern Lakehouse architectures, applying Medallion (Bronze, Silver, Gold) design principles to support trusted and reusable data products. Build … ongoing evolution of Envitia’s data engineering capability. Essential Skills & Experience Proven hands‐on experience building and supporting production‐grade data pipelines using Databricks, PySpark, Spark SQL and Delta Lake. Experience designing and implementing Lakehouse architectures, including Medallion (Bronze, Silver, Gold) data models. Expertise in developing scalable ETL/ ...

building scalable data pipelines, Databricks lakehouse architectures, and robust data platforms in a modern cloud environment. Strong expertise in Python, Databricks, Spark/PySpark and SQL is required, with hands-on delivery across ETL/ELT, data quality and CI/CD practices. Banking domain experience is a plus ...

Science, Mathematics, or a related field. Applied experience in data science, machine learning, or related areas. Strong programming skills in Python with experience in PySpark, Spark SQL, and manipulating data. Experience LLM Orchestration and Agentic AI libraries Proficiency in using GenAI models (OpenAI or similar) to solve business problems. ...

engineering best practicesYou have experience with Databricks, ideally also AzureYou have experience of working with technologies such as SQL, Apache Spark and Python including PySpark and PandasYou're excited to join a start-up in a role that you can shape and influenceYou're collaborative with excellent communication skillsApply ...

knowledge (you don't need everything) Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/ ...

management, network design and access control; Databricks and OCI, or comparable platforms Strong Python and SQL, and experience building and monitoring production pipelines using PySpark or Spark Experience with infrastructure as code, CI/CD and a Git and GitHub workflow A track record of setting engineering standards ...

that deeply cares about its values. To use a range of different tools and technologies depending on the specific task, these include: Databricks, Python, PySpark, R, Excel, Palantir Foundry, SQL and PowerBI. Qualifications Even if you don’t meet every requirement below, feel free to still apply ...

Python for data processing, pipelines and model serving, alongside the libraries and tooling used by our data science team (such as pandas, Polars and PySpark) What we’re looking for: Significant experience as a senior or principal engineer leading the design and delivery of data‐intensive systems A track ...

Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, AzureML, AIFoundry, Kubernetes Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database technologies, data modelling and SQL Confident communicator who is able to explain technical terms to non‐technical audiences and mentor junior colleagues Leads ...

business stakeholders to deliver dashboards that meet Barclays standards and business needs. Some other highly valued skills may include: Knowledge of Python/PySpark and data analytics. Experience in a Call Centre or Contact Centre environment. Strong communication and stakeholder management skills. Ability to collaborate effectively across technical ...

software or computer engineering, applied math, physics, statistics, or a related field or equivalent experience Technical Skills: Strong knowledge of distributed data processing (Spark, PySpark, SQL) Expertise in data governance, metadata management, lineage, and data modeling Experience with AI/ML platforms and AI‐driven architecture Proven ability ...

/CD, monitoring, deployment patterns such as blue-green and canary) Cloud and data platforms (Azure, AWS or GCP; Databricks, Snowflake); Python, SQL, PySpark Experience leading proposals, solution architecture and commercial estimation in a consulting or services environment Confident communicator able to explain complex AI concepts to senior business ...

Arrow Global Group in Manchester seeks an experienced Data Engineer to design and implement robust data pipelines using Microsoft Fabric, PySpark, and SQL across multiple data sources in a financial services setting. The role focuses on building scalable data ingestion, transformation, and validation workflows, while collaborating with Data Stewards ...

patterns. Proficiency in data quality assurance, data governance, and query optimization. Nice to have: Familiarity with the AWS data ecosystem (S3, Glue, EMR/PySpark, Apache Iceberg). Non-Technical Skills & Competencies Proven sense of ownership, commitment, and personal accountability. Meticulous attention to detail with a proactive problem-solving ...

patterns. Proficiency in data quality assurance, data governance, and query optimization. Nice to have: Familiarity with the AWS data ecosystem (S3, Glue, EMR/PySpark, Apache Iceberg). Non-Technical Skills & Competencies Proven sense of ownership, commitment, and personal accountability. Meticulous attention to detail with a proactive problem-solving ...

quality data products while ensuring compliance with security, governance, and operational standards. Key Responsibilities: Design, develop, and optimise scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake. Build robust ETL/ELT solutions and data ingestion frameworks supporting batch and streaming workloads. Integrate data from multiple … engineering activities, including CI/CD implementation, environment promotion, performance optimisation, and operational support. Skills we can’t do without: Azure Databricks, Apache Spark, PySpark, and Spark SQL expertise. Experience building enterprise-scale ETL/ELT pipelines within Azure environments. Strong Python and SQL development skills. Experience with Azure ...

quality data products while ensuring compliance with security, governance, and operational standards. Key Responsibilities: Design, develop, and optimise scalable data pipelines using Azure Databricks, PySpark, Spark SQL, and Delta Lake. Build robust ETL/ELT solutions and data ingestion frameworks supporting batch and streaming workloads. Integrate data from multiple … engineering activities, including CI/CD implementation, environment promotion, performance optimisation, and operational support. Skills we can’t do without: Azure Databricks, Apache Spark, PySpark, and Spark SQL expertise. Experience building enterprise-scale ETL/ELT pipelines within Azure environments. Strong Python and SQL development skills. Experience with Azure ...