18 of 18 PySpark Jobs in Glasgow

services, and scripting and automation using common libraries and frameworks relevant to the role Experience with data engineering and analytics platforms such as PySpark, Databricks, Airflow, or similar orchestration tools Experience with relational databases and SQL; familiarity with NoSQL databases and data modeling concepts Knowledge across the data lifecycle ...

reuse. Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks ...

/GCP Exposure to LLM models like ChatGPT, Google Bard etc. Exposure to Langchain, RAG and Fine Tuning of the LLM Models. Exposure to PySpark and Databricks for Data pipeline creation.Familiarity with modern front-end technologies Exposure to cloud technologies Experience with ReactJS front-end development is a plus ...

successful as a Software Engineer you must have the following essential skills: Strong hands-on experience building data pipelines and streaming solutions using Python, PySpark, Spark Structured Streaming, or similar technologies. Solid understanding of distributed data processing concepts, including event ordering, partitioning, consumer groups, stateful processing, and delivery guarantees. ...

Group Data & AI Office. The role focuses on hands-on data engineering, designing and building scalable data pipelines and data products using Databricks, PySpark and Python. You will collaborate with engineering teams, contribute to governance and standards, and mentor colleagues while delivering high-quality data solutions across the organisation. ...

ingesting, transforming, and distributing event data with a focus on reliability, observability, and performance. Successful candidates will have hands-on experience with Python, PySpark, Kafka, and CI/CD processes, plus strong knowledge of distributed data processing and low-latency systems in financial services contexts. #J-18808-Ljbffr ...

unsupervised techniques Experience with tree-based and boosting algorithms such as XGBoost, LightGBM, and related approaches Experience working with large-scale datasets, ideally using PySpark Strong analytical and SQL skills for handling, querying, and interpreting complex datasets Ability to communicate insights effectively through visualisations using tools such as Matplotlib ...

with the ability to think beyond routine approaches to solve technical problems. Design, develop, and maintain scalable data pipelines and processing workflows using Python, PySpark, SQL, and Databricks on AWS, processing and transforming large-scale financial datasets for analytics and reporting. Develop fact and dimension data models for reporting … qualifications, capabilities, and skills Proven experience in data management, ETL/ELT pipeline development, and large-scale data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar). Experience with ...

consulting and technology services. The candidate will design, build, and maintain scalable data pipelines, data lakes, and data warehouse solutions on AWS, using PySpark, Spark, Python, and AWS services to enable #J-18808-Ljbffr ...

with analytics colleagues to turn insights into actionable production workflows. Candidates should be strong in Python, ML techniques, and data visualization, with experience in PySpark and SQL. Location is Glasgow (Edinburgh considered) and the role is onsite 2-3 days per week for a #J-18808-Ljbffr ...

capabilities, and skills Hands-on experience delivering system design, application development, testing, and operational stability at enterprise scale Expertise in Python and/or PySpark Advanced knowledge of software application development and technical processes, with depth in disciplines such as cloud, AI/ML, or data engineering Experience … scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks ...

capabilities, and skills Hands-on experience delivering system design, application development, testing, and operational stability at enterprise scale Expertise in Python and/or PySpark Knowledge of software application development and technical processes, with depth in disciplines such as cloud, AI/ML, or data engineering Experience in large … scalable solutions Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks ...

data solutions. You’ll play a senior technical role in designing, building and optimising data pipelines and data products, using tools such as Databricks, PySpark and Python. About the role As Senior Data Engineer, you’ll help create, maintain and improve high-quality data products that support key business … mentor colleagues where appropriate. Key responsibilities will include: Designing, building and optimising data pipelines and data products. Developing data engineering solutions using Databricks, PySpark and Python. Creating and maintaining notebooks, frameworks and reusable engineering components. Contributing to data governance, technical standards and engineering best practice. Identifying opportunities to improve ...

contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as needed Experience with cloud platforms (preferably AWS) and working knowledge … financial services industry and their IT systems Preferred qualifications, capabilities, and skills Experience with high‐volume batch and real‐time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large‐scale data pipelines In‐depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

systems, including LLM-based applications and agentic architectures in regulated environments Proficiency in one or more programming languages, particularly Python and/or PySpark Advanced knowledge of software application development and technical processes in disciplines such as cloud, AI/ML, or data engineering Experience in large-scale data … analytical skills Preferred qualifications, capabilities, and skills Experience with modern data platforms such as Databricks or Snowflake Hands-on expertise with Spark/PySpark and big data processing technologies Knowledge of open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model ...

contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as needed Experience with cloud platforms (preferably AWS) and working knowledge … financial services industry and their IT systems Preferred qualifications, capabilities, and skills Experience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelines In-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as needed Experience with cloud platforms (preferably AWS) and working knowledge … financial services industry and their IT systems Preferred qualifications, capabilities, and skills Experience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelines In-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

data warehouse solutions specifically on AWS. You will be at the forefront of developing high-performance data engineering solutions. The focus is on utilising PySpark, Spark, Python, and various AWS services to enable secure, reliable, and efficient data processing and analytics across enterprise platforms. This position is crucial … enhancing data capabilities within Capgemini's extensive operations. Requirements Proven experience in designing, building, and maintaining scalable data pipelines. Strong proficiency with PySpark, Spark, and Python. Extensive experience with AWS services, particularly those related to data engineering. Ability to develop high-performance data solutions for enterprise platforms. Understanding ...