8 of 8 Data Pipeline Jobs in Scotland

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions … a focused mentality on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science … projects to tight deadlines Ability to work unsupervised and to manage a varied workload efficiently Minimum criteria You'll need all of these. Solid understanding of data pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI More ❯

i am recruiting for a Data Engineer to work in Glasgow 3 days a week, 2 days remote. The role falls inside IR35 so you will have to work through an umbrella company. Banking/Financial Services experience is essential. You will have a number of years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects. Experience in data development and solutions in highly complex data environments with large data volumes. SQL/PLSQL experience with the ability to write ad-hoc and complex queries to perform data analysis. Experience developing data pipelines and data warehousing solutions using Python and … libraries such as Pandas, NumPy, PySpark, etc. You will be able to develop solutions in a hybrid data environment (on-Prem and Cloud). Hands on experience with developing data pipelines for structured, semi-structured, and unstructured data and experience integrating with their supporting stores (e.g. RDBMS, NoSQL DBs, Document DBs, Log Files etc More ❯

Join us as a Data Scientist at Barclays, where you'll be responsible for transforming complex data into actionable insights that drive strategic growth and innovation. You'll harness AI and advanced machine learning techniques to transform raw data into strategic insights that drive business decisions and competitive advantage. To be successful as a … Data Scientist, you should have experience with: Statistical analysis and modelling - Proficiency in applying statistical methods/modelling to data Programming in Python - Ability to code in python and contribute to codebases Data Manipulation - Experience querying large datasets (SQL/Pyspark) Some other highly valued skills may include: Machine learning/AI expertise - Advanced … knowledge of ML/AI algorithms and their applications Financial domain knowledge - Understanding of banking products, risk frameworks, and regulations Data visualization - Ability to create compelling visual representations of complex data insights You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen More ❯

Data Engineer - UK - Remote A leading AI-powered search intelligence platform is hiring a Data Engineer to join their globally recognised data team. If you're passionate about distributed systems, real-time data, and cutting-edge tech, this is your chance to make a real impact at an award-winning AI tech … company. About the role: Build and maintain distributed data systems processing millions of data points daily. Design complex Spark jobs, asynchronous APIs, and scalable data pipelines. Collaborate with Data Science and Web teams to deliver user-centric solutions. Use Gen AI tools to accelerate development and improve quality. Requirements: Strong experience with … and distributed systems (Spark). Hands-on expertise in ETL workflows, orchestration tools, and cloud platforms. Familiarity with Gen AI tools for coding and debugging. Solid understanding of data structures, algorithms, and database technologies. A collaborative mindset and a passion for solving complex problems. Benefits: Trust-Based Vacation Policy - take time off when you need it Private Medical More ❯

Data Engineer - UK - Remote A leading AI-powered search intelligence platform is hiring a Data Engineer to join their globally recognised data team. If you're passionate about distributed systems, real-time data, and cutting-edge tech, this is your chance to make a real impact at an award-winning AI tech … company. About the role: Build and maintain distributed data systems processing millions of data points daily. Design complex Spark jobs, asynchronous APIs, and scalable data pipelines. Collaborate with Data Science and Web teams to deliver user-centric solutions. Use Gen AI tools to accelerate development and improve quality. Requirements: Strong experience with … and distributed systems (Spark). Hands-on expertise in ETL workflows, orchestration tools, and cloud platforms. Familiarity with Gen AI tools for coding and debugging. Solid understanding of data structures, algorithms, and database technologies. A collaborative mindset and a passion for solving complex problems. Benefits: Trust-Based Vacation Policy - take time off when you need it Private Medical More ❯

Senior Data Engineer ESM Contract: 6 months Rate: £500 £550 per day (inside IR35) Location: Glasgow (3 days onsite per week) Start date: ASAP Our client, a large global consultancy, is seeking a Senior Data Engineer to join a Enterprise Systems Management (ESM) team on a contract basis. ESM plays a critical role in developing and … agile squads and contributing to technology solutions that support more than 10,000 developers and production engineers worldwide. Key Responsibilities: Design, develop, and maintain ESM applications across data management, automation, orchestration, and service management. Build and support self-service portals, incident/change management, and capacity management tools. Develop event management solutions, including monitoring, log-collection, correlation, and … large-scale distributed systems. Collaborate with cross-functional teams to design scalable and reliable ETL processes using Python and Databricks. Develop and deploy ETL jobs, extracting and transforming data from multiple sources. Take ownership of the full engineering lifecycle: data extraction, cleansing, transformation, and loading. Create and manage data pipelines with robust error handling More ❯

I am recruiting for a Data Analyst to work on a hybrid basis - 2/3 days in Glasgow, remaining time remote. The role falls inside IR35 so you will need to work through an umbrella company for the duration of the contract. Responsibilities will include collecting and analysing requirements, analysing data and building data pipelines. You must have strong experience of SQL and relational databases. You will have extensive data modelling experience and experience working with data analytics/visualisation software. Strong experience with Python is essential and also experience of working in Unix environments. You will ideally have knowledge of the ServiceNow platform and experience with Agile …/DevOps. Experience of the finance sector would be a bonus. Knowledge of data governance concepts is also preferred. Please apply ASAP if this is of interest. More ❯

Role/Job title ESM- Senior Data Engineer Work Location Glasgow Mode of working Hybrid/office based Hybrid If Hybrid, how many days are required in office? 3 Duration of assignment 6 Months To be published on job boards from below onwards The Role ESM is responsible for developing and maintaining applications ESM Developer Chapter Area comprises … representing a wide range of teams, roles, and cultures. Your responsibilities: (Up to 10, Avoid repetition) ESM is responsible for developing and maintaining applications in the following areas Data Management: asset and configuration management. Service management: automation, orchestration self-service portals, problem/incident/change management, and capacity management. Event Management: monitoring, log-collection at firmwide scales … event correlation, and analysis. Visualization: analytics & user interfaces. Application Performance Management: tracing and performance monitoring across huge distributed systems Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ETL processes using Python and DataBricks Developing and deploying ETL jobs that extract data from various sources, transforming it to meet business More ❯