18 of 18 PySpark Jobs in Scotland

would also be highly advantageous, particularly: Azure Data Factory Azure SQL Azure Data Lake/ADLS Azure DevOps Microsoft Fabric Azure Databricks Experience with PySpark, Airflow, Dagster, Prefect or other orchestration technologies would also be useful. We're particularly interested in people who have worked with modern data platforms ...

Databricks. Requirements Required Skills & Technologies Cloud Platforms: Hands-on engineering experience within the AWS ecosystem (S3, IAM, Glue) and deep expertise in Databricks (SparkSQL, PySpark, governed cataloging). Modern Data Stack: Strong proficiency in dbt (Core or Cloud) for data transformation and understanding of modern table formats, specifically Apache ...

Data Engineering Foundation: Practical experience with data modelling, ETL/ELT, and various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow, Spark, Databricks, Fabric. Cloud Capability: Experience with at least one major cloud provider (AWS, Azure ...

teamworkStrong problem-solving and analytical skillsPreferred qualifications, capabilities, and skillsExperience with modern data platforms such as Databricks or SnowflakeHands-on expertise with Spark/PySpark and big data processing technologiesKnowledge of open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks and model serving ...

delivering secure and scalable solutionsPreferred qualifications, capabilities, and skillsExperience with modern data platforms such as Databricks or SnowflakeDeep hands-on experience with Spark/PySpark and other big data processing technologiesExpertise in open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks and model ...

reuse. Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks ...

/Azure/GCPExposure to LLM models like ChatGPT, Google Bard etc.Exposure to Langchain, RAG and Fine Tuning of the LLM Models.Exposure to PySpark and Databricks for Data pipeline creation. Familiarity with modern front-end technologiesExposure to cloud technologiesExperience with ReactJS front-end development is a plusJ.P. Morgan ...

delivering secure and scalable solutionsPreferred qualifications, capabilities, and skillsExperience with modern data platforms such as Databricks or SnowflakeDeep hands-on experience with Spark/PySpark and other big data processing technologiesExpertise in open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks and model ...

safe scaling patterns and reuse.Preferred qualifications, capabilities, and skillsExperience with modern data platforms such as Databricks or SnowflakeDeep hands-on experience with Spark/PySpark and other big data processing technologiesExpertise in open-source table formats and catalog services such as Apache IcebergExperience with LLM orchestration frameworks and model ...

continuous integration/continuous delivery, application resiliency, and securityDemonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, Databricks, PySpark, artificial intelligence, machine learning, mobile, etc.)Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, testing ...

reliable, accurate, and delivered in a timely manner.Write clean, efficient, and well-documented code and test cases using tools like Python, SQL, and Pyspark (optional).Understands containerization and Kubernetes deployment using ArgoCD. Collaborate Across TeamsPartner with Senior Engineers in code reviews, design discussions, planning sessions and team ceremonies, asking ...

troubleshooting, with the ability to think beyond routine approaches to solve technical problems.Design, develop, and maintain scalable data pipelines and processing workflows using Python, PySpark, SQL, and Databricks on AWS, processing and transforming large-scale financial datasets for analytics and reporting.Develop fact and dimension data models for reporting … Code).Required qualifications, capabilities, and skillsProven experience in data management, ETL/ELT pipeline development, and large-scale data processing.Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning.Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar).Experience with AWS cloud services ...

capabilities, and skills Hands-on experience delivering system design, application development, testing, and operational stability at enterprise scale Expertise in Python and/or PySpark Advanced knowledge of software application development and technical processes, with depth in disciplines such as cloud, AI/ML, or data engineering Experience … scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks ...

capabilities, and skills Hands-on experience delivering system design, application development, testing, and operational stability at enterprise scale Expertise in Python and/or PySpark Knowledge of software application development and technical processes, with depth in disciplines such as cloud, AI/ML, or data engineering Experience in large … scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks ...

capabilities, and skills Hands-on experience delivering system design, application development, testing, and operational stability at enterprise scale Expertise in Python and/or PySpark Knowledge of software application development and technical processes, with depth in disciplines such as cloud, AI/ML, or data engineering Experience in large … scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks ...

ability to contribute across the length and breadth of a projectProficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as neededExperience with cloud platforms (preferably AWS) and working knowledge … knowledge of the financial services industry and their IT systemsPreferred qualifications, capabilities, and skillsExperience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelinesIn-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

systems, including LLM-based applications and agentic architectures in regulated environments Proficiency in one or more programming languages, particularly Python and/or PySpark Advanced knowledge of software application development and technical processes in disciplines such as cloud, AI/ML, or data engineering Experience in large-scale data … analytical skills Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Hands-on expertise with Spark/PySpark and big data processing technologies Knowledge of open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model ...

contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as needed Experience with cloud platforms (preferably AWS) and working knowledge … financial services industry and their IT systems Preferred qualifications, capabilities, and skills Experience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelines In-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...