26 to 35 of 35 PySpark Jobs in Scotland

with the ability to think beyond routine approaches to solve technical problems. Design, develop, and maintain scalable data pipelines and processing workflows using Python, PySpark, SQL, and Databricks on AWS, processing and transforming large-scale financial datasets for analytics and reporting. Develop fact and dimension data models for reporting … .Required qualifications, capabilities, and skillsProven experience in data management, ETL/ELT pipeline development, and large-scale data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar).Experience with AWS cloud ...

with the ability to think beyond routine approaches to solve technical problems. Design, develop, and maintain scalable data pipelines and processing workflows using Python, PySpark, SQL, and Databricks on AWS, processing and transforming large-scale financial datasets for analytics and reporting. Develop fact and dimension data models for reporting … qualifications, capabilities, and skills Proven experience in data management, ETL/ELT pipeline development, and large-scale data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar). Experience with ...

Function Data Analytics/Warehousing & Business Intelligence Experience 5-10 years Location United Kingdom - Edinburgh, London, Manchester Skills Python & SQL: Advanced Python (PySpark GlobalLogic is seeking a Data & AI Architect working in our UK & Ireland Go to Market Team to drive pipeline growth and lead enterprise transformation pursuits across … mindset, with experience working across geographies including India, East Europe and North America. Proven track record of acceleration of Business growth Deep expertise in PySpark/Python, Advanced SQL, data modeling, batch/real-time streaming, and CI/CD pipelines (Git, Terraform, Databricks Asset Bundles). Deep knowledge ...

strong experience defining and managing infrastructure as code with Terraform Data platform architecture — proven experience architecting data platforms (data lakes, warehouses, pipelines) at scale PySpark — hands-on experience with PySpark for large-scale data processing CI/CD — experience designing and implementing CI/CD pipelines for infrastructure ...

with analytics colleagues to turn insights into actionable production workflows. Candidates should be strong in Python, ML techniques, and data visualization, with experience in PySpark and SQL. Location is Glasgow (Edinburgh considered) and the role is onsite 2-3 days per week for a #J-18808-Ljbffr ...

capabilities, and skills Hands-on experience delivering system design, application development, testing, and operational stability at enterprise scale Expertise in Python and/or PySpark Advanced knowledge of software application development and technical processes, with depth in disciplines such as cloud, AI/ML, or data engineering Experience … scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks ...

capabilities, and skills Hands-on experience delivering system design, application development, testing, and operational stability at enterprise scale Expertise in Python and/or PySpark Knowledge of software application development and technical processes, with depth in disciplines such as cloud, AI/ML, or data engineering Experience in large … scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks ...

capabilities, and skills Hands-on experience delivering system design, application development, testing, and operational stability at enterprise scale Expertise in Python and/or PySpark Knowledge of software application development and technical processes, with depth in disciplines such as cloud, AI/ML, or data engineering Experience in large … scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks ...

systems, including LLM-based applications and agentic architectures in regulated environments Proficiency in one or more programming languages, particularly Python and/or PySpark Advanced knowledge of software application development and technical processes in disciplines such as cloud, AI/ML, or data engineering Experience in large-scale data … analytical skills Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Hands-on expertise with Spark/PySpark and big data processing technologies Knowledge of open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model ...

contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as needed Experience with cloud platforms (preferably AWS) and working knowledge … financial services industry and their IT systems Preferred Qualifications, Capabilities, And Skills Experience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelines In-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

working partnersTechnical skills preferred in any or all of the following: Microsoft Excel, Google Suite, Atlassian Jira/Confluence, SQL, Python (Jupyter Notebook, Pandas, PySpark, etc.), Databricks, Bloomberg, Pitchbook, or other common financial services systems and applicationsHands-on SQL & Data Warehouse Experience: Strong proficiency using SQL and Databricks (PySpark ...

systems, including LLM-based applications and agentic architectures in regulated environments Proficiency in one or more programming languages, particularly Python and/or PySpark Advanced knowledge of software application development and technical processes in disciplines such as cloud, AI/ML, or data engineering Experience in large-scale data … analytical skills Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Hands-on expertise with Spark/PySpark and big data processing technologies Knowledge of open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model ...

contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as needed Experience with cloud platforms (preferably AWS) and working knowledge … financial services industry and their IT systems Preferred qualifications, capabilities, and skills Experience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelines In-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

ability to contribute across the length and breadth of a projectProficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as neededExperience with cloud platforms (preferably AWS) and working knowledge … knowledge of the financial services industry and their IT systemsPreferred qualifications, capabilities, and skillsExperience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelinesIn-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

ability to contribute across the length and breadth of a projectProficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as neededExperience with cloud platforms (preferably AWS) and working knowledge … knowledge of the financial services industry and their IT systemsPreferred qualifications, capabilities, and skillsExperience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelinesIn-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

years of experience, but you must have used Fabric on at least one real world commercial project• Strong, demonstrable Microsoft Synapse development experience• Excellent PySpark and SQL skills• Experience building and developing data pipelines• Strong data testing, validation and debugging skills• Experience working across data warehouse migrations or modernisation … initial contract offering 400 to 475 per day, Inside IR35, with hybrid working in Edinburgh.If you're a Data Engineer with strong Synapse, PySpark and SQL experience who has already started working commercially with Microsoft Fabric, then please APPLY NOW. ...

years of experience, but you must have used Fabric on at least one real world commercial project • Strong, demonstrable Microsoft Synapse development experience • Excellent PySpark and SQL skills • Experience building and developing data pipelines • Strong data testing, validation and debugging skills • Experience working across data warehouse migrations or modernisation … initial contract offering £400 to £475 per day, Inside IR35, with hybrid working in Edinburgh. If you're a Data Engineer with strong Synapse, PySpark and SQL experience who has already started working commercially with Microsoft Fabric, then please APPLY NOW. ...