51 to 75 of 183 Permanent Data Pipeline Jobs in the UK

About the role: My client is seeking an experienced Senior Data Engineer with a specialisation in Snowflake and DBT to own and evolve the company's data stack. The ideal candidate for this role will be a self-starter with a knack for problem-solving and … a strong ability to learn new skills quickly. Key responsibilities include designing and developing scalable data models and warehouses, creating and maintaining database objects, and ETL processes for loading data into Snowflake. Proven proficiency in SQL, database optimisation, and effective database security implementation is a must … working closely with Data Science team). The candidate should also have good communication skills, an approachable personality, and prior knowledge/experience of the media industry will be beneficial. The role provides personal and professional development opportunities for an individual who can take on ownership and responsibility more »

partnering with banks, businesses and fintechs all over the world. Partner with Visa: A Network Working for Everyone. What s it all about? Data Engineering Team at VXBS Our small but dynamic data engineering team we play a pivotal role in managing critical aspects of VXBS … s data ecosystem. AWS : Our cloud computing platform. Snowflake : Our trusted data warehouse platform. DBT Core : We leverage DBT for data transformations and modelling. Matillion : An essential tool for orchestrating ETL workflows. Datadog: For monitoring and alerting. Terraform for our infrastructure, including Snowflake. The … Balancing Act: As we embark on a transformation journey toward a more modern data stack, we find ourselves juggling our current workload while keeping an eye on the future. Our mission: seamlessly transition to a stack that empowers us even further. Join us as we navigate this exciting more »

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

Senior Data Engineer Python, SQL, Big Data FrameworksLondon, Geneva, Dubai - 4x a week (no flex)110-120,000 + bonusSeeking a skilled Data Engineer to join a company specialising in quantitative trading and investment management. This role is pivotal in building and maintaining the … infrastructure that supports their cutting-edge trading strategies.Key Responsibilities:Design and manage scalable data pipelines.Integrate data from various sources and develop ETL processes.Optimize database systems for high performance.Work with data scientists and analysts to meet data needs.Automate data processing tasks … to enhance efficiency.Implement data security measures and ensure compliance with industry standards.Requirements:Master's degree in Computer Science, Engineering, Mathematics, or related field from a top uni.Proven experience as a Data Engineer in the financial services or hedge fund industry.Technical Skills:Proficiency in Python and SQL.Experience more »

new services? We are partnering exclusively with a large organisation to bring you an exciting opportunity for a highly skilled and experienced Lead Data Engineer to be responsible for leading data engineering projects, ensuring the efficient processing and management of data across the organisation. … other benefits. Flexible, hybrid working from Swansea with options for condensed hours. You will get to lead a team working on a modern data platform, collaborating with engineering product teams delivering services and working closely with reporting teams and data scientists to help understand and optimise … their digital services. This role will be instrumental in shaping their data infrastructure, ensuring it supports the strategic objectives. You will leverage cutting-edge technologies, primarily focusing on Microsoft Azure and Databricks, to develop and maintain robust, scalable data solutions. Responsibilities: Leadership and Strategy: Lead the more »

new services? We are partnering exclusively with a large organisation to bring you an exciting opportunity for a highly skilled and experienced Lead Data Engineer to be responsible for leading data engineering projects, ensuring the efficient processing and management of data across the organisation. … other benefits. Flexible, hybrid working from Swansea with options for condensed hours. You will get to lead a team working on a modern data platform, collaborating with engineering product teams delivering services and working closely with reporting teams and data scientists to help understand and optimise … their digital services. This role will be instrumental in shaping their data infrastructure, ensuring it supports the strategic objectives. You will leverage cutting-edge technologies, primarily focusing on Microsoft Azure and Databricks, to develop and maintain robust, scalable data solutions. Responsibilities: Leadership and Strategy: Lead the more »

new services? We are partnering exclusively with a large organisation to bring you an exciting opportunity for a highly skilled and experienced Lead Data Engineer to be responsible for leading data engineering projects, ensuring the efficient processing and management of data across the organisation. … other benefits. Flexible, hybrid working from Swansea with options for condensed hours. You will get to lead a team working on a modern data platform, collaborating with engineering product teams delivering services and working closely with reporting teams and data scientists to help understand and optimise … their digital services. This role will be instrumental in shaping their data infrastructure, ensuring it supports the strategic objectives. You will leverage cutting-edge technologies, primarily focusing on Microsoft Azure and Databricks, to develop and maintain robust, scalable data solutions. Responsibilities: Leadership and Strategy: Lead the more »

Data Engineering Technical Lead Salary - £60,000 - £65,000 This is a great job for someone who has worked as a senior data engineer in data lake/lake house architecture platform and has hands on experience of developing data pipelines using … Pyspark and SQL. The successful individual will have working experience of AWS data eco system and toolsets, with passion to learn and explore new technology stack. A bit about the job: The Data Engineering Technical Lead will provide technical expertise and delivery capability across the development … hands on delivery. Working experience of Cloud Technologies and data eco system, AWS is preferable. Expert in development of data pipeline based on Pyspark and SQL with orchestration tools such as Airflow, Tivoli etc Knowledge of OLAP implementation on any Database technologies (Snowflake preferred) Excellent more »

Rivington Rd, Preston Brook, Runcorn, WA7 3DJ Salary: £46,000 - £49,000 Hours: 37.5 hours per week Are you a seasoned expert in data engineering looking to make a significant impact in the healthcare industry? Phoenix Medical Supplies is seeking a Senior DataOps Engineer to lead our data … services across the region. As a Senior DataOps Engineer, you will be instrumental in architecting and implementing solutions across the entire data pipeline, from ingestion to visualisation. The role will require you to showcase your skills in data ingestion, storage, modelling, transfer, hosting, visualisation, analysis … and consumption, all while mentoring and training team colleagues. Key Responsibilities: Design and develop robust data pipelines for ingestion, storage, processing, and interface creation. Produce both machine consumable interfaces and human consumable data products, including standard and ad hoc reports. Maintain and optimise data more »

Senior Data Engineer (GCP) My client a financial services business are looking for a Senior Data Engineer (GCP), to spearhead global initiatives to migrate complex data systems to GCP. You will design, implement, and optimise data pipelines, ensuring data integrity … during migration and utilising GCP services for scalable and efficient data transformation. Salary: Up to £65K Hybrid: 2 days a week Key Responsibilities: Lead data engineering projects in Europe, working with partners for GCP transition. Design and deploy data pipelines with automated data … GCP. Essential Qualifications: 5 years of SQL. 3 years of GCP and its different services. Experience with microservice architecture and data processing pipeline design. Desired Qualifications: Certification in GCP. Financial Services experience. Experience coaching and mentoring data engineers. If this role is of interest, please more »

team reflective of society improves outcomes. We provide support for any needs or adjustments during the application process. Role Overview: As a Senior Data Engineer, your responsibilities include: Developing modern data systems and platforms to drive decision-making. Collaborating with clients to shape their data strategy. Enabling public sector organizations to adopt a data-driven approach. Owning and managing cloud infrastructure using a DevOps approach. Building data pipelines, handling various data types, and integrating error handling. Implementing data system architectures like Data Warehouse … Data Lakes, and Data Meshes. Creating reusable libraries for data pipelines and documenting end-to-end systems on a cloud environment. Adopting a robust DevOps approach and utilizing tools for DataOps. Ensuring software resilience through testing strategies and best practices. Applying SOLID, DRY, and more »

Senior Azure Data Engineer - 6 Month Contract - Inside IR35 This is an Azure Data Engineer 6 month contract position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as … having strong Azure Data Factory and Databricks experience. Work Involved: Implementing and delivering data pipelines Providing mentorship to junior members of the team Working with the Platform team defining capabilities for the lake … framework Developing business conceptual data models Producing new frameworks using design patterns and data ingestion Requirements: Strong Data Pipeline experience Databricks Azure Data Factory Spark Azure cloud Financial Services If you're interested get in touch ASAP more »

Senior Data Developer Salary – Circa £50,000 This is a great opportunity for someone looking for a new challenge as we expand our Solutions Development Team. We are looking for an enthusiastic and experienced data engineer to bring their technical and teamworking skills to rapidly build … data domain knowledge and capability to support and enhance our constantly expanding portfolio of data assets. A bit about the job: The role resides within the central Data Insights Team that predominantly support the Insurance Wealth & Retirement (IWR) business through the provision of data products, and the role will both support the management and change of the existing data estate alongside design and implementation of new data capability in-line with Aviva project objectives. You will be working collaboratively with colleagues across the wider DI function to ensure more »

Data Engineer Our client based near Manchester is looking for a skilled Data Engineer to join their agile team. In this role, you'll play a pivotal part in designing, building, and maintaining data pipelines, ensuring the integrity and availability of data for various stakeholders, including BI Teams, Analytics, and Data Scientists. Responsibilities: Design, build, and automate data flow processes and ELTs to provide comprehensive data from business systems. Collaborate with product development teams to ensure best practices and data integrity from … source to destination. Assist in integrating data between systems, including third-party platforms. Write specifications and documentation for data processes. Continuously explore new solutions, tools, and processes to enhance data operations. Requirements: Bachelor's or Master's degree in Computer Science, related field, or more »

Data Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established organisation within the education sector who are looking for a Data Engineer to join their established IT team. Their current project is based around the creation and implementation of a … brand new Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. This is an opportunity to join a team who are serious about the way that they use data and work within an organisation who are providing significant investment into all of their data teams. The teams itself are growing in size but the company are also investing in the technology that they use with an emphasis on Microsoft tech such as Azure Synapse, Databricks more »

Lead Data Engineer (Java/Python/AWS/Glue/Dremio). Investment Management. £160,000 - £170,000 25% Bonus Target and Benefits. Hybrid 2 Days a week in St Pauls Office. CANNOT SPONSOR CANNOT SPONSOR My client is a top tier multi asset investment management house … based in Central London. The Data Office team is playing a key role in helping build the future of financial services, working together with business partners to create client experiences that are changing the way people invest. You will work with smart, talented people across our business. We … platform s architectural design Development and testing of the integration, modelling, data persistence and querying tools and analytical systems Data pipeline implementation, maintenance and testing Metadata management processes and tools Monitoring the overall performance and stability of the pipelines Implementing data curation, metadata more »

We are seeking a passionate and driven Junior SQL Data Engineer to join our team. As a Junior SQL Data Engineer, you will work closely with our data engineering and analytics teams to develop, optimize, and maintain SQL databases and data pipelines. … paced, dynamic environment . REQUIRED - 5 years in the UK as a minimum Role and responsibilities: Design, develop and optimize SQL databases and data models to support business requirements. Build and maintain data pipelines for efficient data extraction, transformation, and loading (ETL) processes. Collaborate … with cross-functional teams to understand data requirements and implement solutions that meet business needs. Perform data analysis and troubleshoot issues to ensure data accuracy and integrity. Support Legacy Data Warehouse: Bug fixes, batch ETL processing and data related queries. more »

Group Head of Data Engineering & Governance Are you an accomplished Head of Data Engineering & Governance looking for the next move in your career? InX are currently working on a retained Search basis with a Financial Services organisation to place a Group Head of Data in the CIO's senior management team. The Role As the Group Head of Data Engineering & Governance, you will be responsible for leading the data engineering team in designing, implementing, and maintaining scalable data pipelines and infrastructure. You will collaborate closely with … cross-functional teams to ensure the integrity, availability, and security of the organisation's data, while also driving innovation in data engineering practices. You will work closely with the Data Science and Analytics team (which sits outside of the remit of this position) but more »

Data Engineer - Manchester - £35,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into … their central Microsoft Azure repository. Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power … will not have to use Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you more »

Power BI Specialist - London (SW1) Remote My client a market leading provider grants clients access to bespoke data insights and analytics specific to their needs, providing research, data and expertise to support clients and all lines of business (Advisory, Digital, Search). They is an innovation … and standards for managing Power BI artifacts, including reports, datasets, and dataflows within workspaces. Configure and manage dataflows to ingest, transform, and prepare data from various sources for analysis within Power BI. Develop and implement strategies for automating data refresh processes to keep Power BI reports … deploying numerous dashboards at scale. Power BI development Develop advanced Power BI reports, dashboards, and interactive visualizations that provide actionable insights and drive data-driven decision-making. Design and implement efficient and scalable data models using Power BI Desktop and SQL Server Analysis Services (SSAS). more »

promotion that seen the Head of Engineering promoted into the CTO role there s an opportunity to join the business as the Lead Data Engineer. Working hand in hand with the CTO you will play an instrumental part in shaping and leading the Data Engineering function … used on those days. This is a rare opportunity to work with a well liked and respected CTO and a great business. Lead Data Engineer £80k-£90k Hybrid working 2 days in Glasgow office a week Your New … Role: Platform Development: Build the foundations of the new data platform, leveraging extensive business data for both automation and analytics. Pipeline Design: Create and develop data processing pipelines to support the ingestion, enrichment, and quality control of client and partner data. Data more »

Senior Data Engineer Python, SQL, Big Data Frameworks London - 4x a week £80-90,000 bonuses Seeking a skilled Data Engineer to join a company specialising in quantitative trading and investment management. This role is pivotal in building and maintaining the infrastructure that supports … their cutting-edge trading strategies. Key Responsibilities: Design and manage scalable data pipelines. Integrate data from various sources and develop ETL processes. Optimise database systems for high performance. Work with data scientists and analysts to meet data needs. Automate data processing tasks to enhance efficiency. Implement data security measures and ensure compliance with industry standards. Requirements: Master s degree in Computer Science, Engineering, Mathematics, or related field from a top uni. Proven experience as a Data Engineer, preferably in the financial services or hedge more »

facing web app : presenting the analytics to the customer in a way that surfaces the key insights into their portfolio Data processing pipeline : that ingestion of banking data from our customers and generation of proprietary analytics Tech Stack Frontend: Our web app is React + … re deploying changes to our app multiple times a day with Github and CircleCI Data: Databricks workflows power our data pipeline Your time at ONci As soon as you join you will be contributing to the development of our platform - there s plenty to do more »