13 of 13 Permanent PySpark Jobs in Scotland

creating Genie Agents, configuring data assets for Natural Language Querying and using Metric Views to create semantic layers. Experience of programming languages: SQL, python & pySpark etc. Experience of development practices: the use of versioning tools such as GitHub, work tracking tools such as Azure DevOps, or equivalents. A proven ...

Foundation: Practical experience with data modelling, ETL/ELT, and a variety of database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and an open-minded approach to tech stacks—ranging from SSIS and stored procedures to Airflow, Spark, Databricks, or Fabric. Cloud Capability: Experience with ...

Data Engineering Foundation: Practical experience with data modelling, ETL/ELT, and various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow, Spark, Databricks, Fabric. Cloud Capability: Experience with at least one major cloud provider (AWS, Azure ...

services, and scripting and automation using common libraries and frameworks relevant to the role Experience with data engineering and analytics platforms such as PySpark, Databricks, Airflow, or similar orchestration tools Experience with relational databases and SQL; familiarity with NoSQL databases and data modeling concepts Knowledge across the data lifecycle ...

APIs and services, and scripting and automation using common libraries and frameworks relevant to the roleExperience with data engineering and analytics platforms such as PySpark, Databricks, Airflow, or similar orchestration toolsExperience with relational databases and SQL; familiarity with NoSQL databases and data modeling conceptsKnowledge across the data lifecycle including ...

/GCP Exposure to LLM models like ChatGPT, Google Bard etc. Exposure to Langchain, RAG and Fine Tuning of the LLM Models. Exposure to PySpark and Databricks for Data pipeline creation. Familiarity with modern front-end technologies Exposure to cloud technologies Experience with ReactJS front-end development ...

CreateFuture is seeking a Senior Data Engineer to lead production data pipelines built on Microsoft Fabric, Python, and PySpark. You will translate data requirements into robust, maintainable solutions while mentoring engineers and shaping architecture with ...

consulting and technology services. The candidate will design, build, and maintain scalable data pipelines, data lakes, and data warehouse solutions on AWS, using PySpark, Spark, Python, and AWS services to enable #J-18808-Ljbffr ...

Function Data Analytics/Warehousing & Business Intelligence Experience 5-10 years Location United Kingdom - Edinburgh, London, Manchester Skills Python & SQL: Advanced Python (PySpark GlobalLogic is seeking a Data & AI Architect working in our UK & Ireland Go to Market Team to drive pipeline growth and lead enterprise transformation pursuits across … mindset, with experience working across geographies including India, East Europe and North America. Proven track record of acceleration of Business growth Deep expertise in PySpark/Python, Advanced SQL, data modeling, batch/real-time streaming, and CI/CD pipelines (Git, Terraform, Databricks Asset Bundles). Deep knowledge ...

with analytics colleagues to turn insights into actionable production workflows. Candidates should be strong in Python, ML techniques, and data visualization, with experience in PySpark and SQL. Location is Glasgow (Edinburgh considered) and the role is onsite 2-3 days per week for a #J-18808-Ljbffr ...

maintainable solutions. What you'll be doing: Take ownership of designing, building, and maintaining scalable, production-ready data pipelines using Microsoft Fabric, Python, and PySpark, with minimal supervision Make sound technical decisions on pipeline architecture, data modelling, and tooling, weighing up trade-offs in performance, cost, and maintainability Mentor … domain-driven modelling) - this is the load‐bearing, provider‐agnostic skill underneath almost all of our pipeline work Have strong proficiency in Python and PySpark for batch data processing, with a track record of writing production‐grade, well‐tested code (this role is focused on batch/ELT pipeline ...

contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude to work across others as needed Experience with cloud platforms (preferably AWS) and working knowledge … financial services industry and their IT systems Preferred qualifications, capabilities, and skills Experience with high-volume batch and real-time data processing using PySpark or similar frameworks, including performance tuning and troubleshooting of large-scale data pipelines In-depth knowledge of relational and distributed databases (e.g., Oracle, Databricks) with ...

data warehouse solutions specifically on AWS. You will be at the forefront of developing high-performance data engineering solutions. The focus is on utilising PySpark, Spark, Python, and various AWS services to enable secure, reliable, and efficient data processing and analytics across enterprise platforms. This position is crucial … enhancing data capabilities within Capgemini's extensive operations. Requirements Proven experience in designing, building, and maintaining scalable data pipelines. Strong proficiency with PySpark, Spark, and Python. Extensive experience with AWS services, particularly those related to data engineering. Ability to develop high-performance data solutions for enterprise platforms. Understanding ...