26 to 50 of 374 Data Pipeline Jobs in the UK

Contract (Inside IR35) Rate: Market Rate Job Description: Roles & Responsibilities- Must have GCP WAF We are seeking a highly skilled and experienced Cloud Data Architect to join our team. The ideal candidate will have a deep understanding of cloud computing technologies, particularly Google Cloud Platform (GCP) and Amazon … Web Services (AWS), and a proven track record of designing and implementing data solutions in cloud environments. As a Cloud Data Architect, you will be responsible for designing, building, and optimizing data pipelines, data lakes, and data warehouses to support … our organization's data needs. You will collaborate closely with cross-functional teams to understand business requirements and translate them into scalable and efficient data architectures. Responsibilities: Design and implement scalable data architectures on GCP and AWS to support various business use cases. Develop more »

UK (Hybrid: Flexible working arrangements) Salary: Up to £90,000 per annum Are you a seasoned IT professional with expertise in Cyber Security, Data Compliance (GDPR), Data Engineering, Data Warehousing, and Cloud Engineering (AWS)? We have an exciting opportunity for an IT Director to … of IT initiatives alongside our CTO, aligned with business goals. Cyber Security measures, ensuring the protection of our systems and data. compliance with data regulations, particularly GDPR, and … implement best practices for data governance. data engineering projects, including data modeling, ETL processes, and data pipeline development. data warehousing solutions, optimizing for performance, scalability, and reliability. Cloud Engineering efforts, leveraging AWS services for infrastructure and application needs. and more »

Senior Data Engineer Role purpose: The Senior Data Engineer plays a pivotal role within the Data team of the Digital and Information function, assuming a leadership position in ensuring the availability, integrity, quality, and accuracy of data. With a wealth of experience, the Senior … Data Engineer leads the design, development, and maintenance of data pipelines and workflows, driving the organisation's data processing capabilities and enabling the seamless delivery of BI reporting and analytics. In addition to core responsibilities, the Senior Data Engineer takes a proactive … stakeholders, to comprehensively understand data requirements, conduct User Acceptance Testing (UAT), and deliver tailored solutions that align with business objectives. Proactively monitor pipeline performance, swiftly identifying and resolving any potential issues to uphold seamless data processing operations and minimize downtime. Drive comprehensive documentation of data more »

Location : London, Must have SC Clearance Certificate Mode: Hybrid Salary: Competitive Overview: We are seeking a talented Data Engineer with expertise in Azure to join our team. The ideal candidate will be responsible for developing data pipelines, building and maintaining data warehouses and data lakes, implementing data integration and transformation solutions, ensuring data quality and integrity, and optimizing data performance. Responsibilities: Develop data pipelines for ETL/ELT (Extract, Transform, Load) processes using Azure technologies. Build and maintain scalable and efficient data warehouses and data lakes on Azure platforms. Implement data integration and transformation solutions to enable seamless data flow across systems and applications. Ensure data quality and integrity by implementing data validation and cleansing processes. Perform performance tuning and more »

s overall commitment to responsible business practices. Ready to level up your career? Playtech‘s BI Unit is looking for an expert Senior Data Engineer with excellent analytical mind set and problem-solving skills to join our Data Programme team Job Description Your influential mission. You … will... Be designing, implementing, and maintaining scalable and efficient data pipelines, ensuring data quality, and optimizing data processing performance Strength our data stack to bear the load of our ever expanding, data driven business Develop and maintain data models, ETL processes, and data warehousing solutions to support analytics, machine learning, and reporting Ensure data security and compliance with industry regulations and best practices Identify, analyse, and resolve data-related issues to improve data reliability and maintain data more »

management firm that utilizes long-short equities, long-only, fixed income and commodities futures strategies across its funds seek to add a experienced Data Engineer Risk Developer. They have deep expertise in trading, technology and operations and attribute their success to rigorous scientific research. As a technology and … data - driven firm, they design and build their own cutting - edge systems, from high- performance trading platforms to large- scale data analysis and compute farms. The group manages the lifecycle of data used by investment for trading, backtesting and research. Working with quants and … strong understanding of data engineering principles and best practices) experience in database technologies (PostgreSQL, SQL), and query optimization with data pipeline development and automation. coding skills (mainly with Python) knowledge (understanding of risk concepts such as VaR calculations) and good understanding of statistics with version more »

Data Engineer – Hybrid (3 days in Office) Stratford-Upon-Avon £56k + 5% bonus & benefits Do you want to grow your expertise and experience and use your skills in a vibrant environment where teamwork, creativity, diversity, inclusivity, and technical excellence are expected and enjoyed? This SaaS company are … associates to principals, applying your technical and problem-solving capabilities to scale their applications. You’ll contribute to the organisation’s high-quality data engineering practices, participating in technical design, implementation, testing, deployment, and ongoing support and maintenance of the data platform. By going above and … beyond implementing new features, the company focus on customer experience, building a high-quality, secure, and scalable data platform. You'll apply your skills effectively and continue to develop them, while benefiting from the expertise of your more experienced colleagues, including: Pair and mob-programming. Peer code reviews. more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients … Artificial Intelligence and Machine Learning. Our cloud-based platforms - Axtria DataMax™, Axtria InsightsMax™, Axtria SalesIQ™, and Axtria MarketingIQ™ - enable customers to efficiently manage data, leverage data science to deliver insights for sales and marketing planning and manage end-to-end commercial operations. With customers in over … to be the leaders we produce for the industry. Will you be next? Job Description: We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have 5-7 years of recent experience in data engineering and hold a more »

Please note: you need to have the right to work in the UK – no sponsorship, unfortunately About the job Reporting to the Senior Data & Analytics Lead, the BI Developer will be responsible for driving the direction and maintaining the business data model ensuring it aligns with … business activities and processes. The role will work closely with key internal and external stakeholders in organising and creating a data model that makes data and information accessible with appropriate channels of access controls. Fostering a relationship of trust and playing an advisory role in the … integrity, and dependability of the data. Improve the scalability, efficiency, and cost-effectiveness of data pipelines. Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data. Key Requirements Good understanding and competency in technologies currently used (and available in the marketplace more »

Data Engineer – London - £85,000 Description Are you passionate about data engineering and looking for an exciting opportunity in the retail industry? I am seeking a skilled Data Engineer to join my clients team and play a pivotal role in their data-driven decision-making process. As a Data Engineer, you will work closely with data scientists, analysts, and other stakeholders to design, develop, and maintain data infrastructure. Your expertise will contribute to improving data pipelines, optimizing data flows, and … ensuring data quality and consistency. Responsibilities Design and implement scalable data solutions to collect, process, and analyze large volumes of data Collaborate with cross-functional teams to identify and define data requirements Develop and maintain data pipelines and ETL processes more »

Principal Data Engineer Grade: Principal Consultant Location: Belfast – BT6 8DN In-office: 2 days per week Clearance: Must be SC Clearable Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks an influential Principal Data Engineer to help lead across the design, build and … deployment of cloud-based data solutions - transforming raw data into actionable insights that inspire ingenuity. The Company: The Organisation consists of 4000 high-performing Digital Strategists and Engineering Technologists - united in delivering human-centred innovation and making a meaningful impact on global society. Boasting a vast … practices. Extensive AWS experience spanning data engineering, data science, and product development projects. Expertise in AWS cloud technologies for ETL pipeline, data warehouse, data lake design/building, and data movement. Design and deploy production data pipelines more »

Find your magic with us Connecting people to their family stories is special. We’re proud to deliver these magic moments. Through technology, data and insights, we bring people closer to their past, to benefit their future. We’re a fast-growing team of smart people, on a … the agility of a scale-up with the security of real financial backing, in a place where every story matters. Why join our Data Science and Insights team? We’re driven by the desire to create a fantastic customer experience We love nothing more than taking big data … up to date data We have a modern data stack already in place comprising of a Snowplow data pipeline, a Snowflake data warehouse, dbt as the data transformation tool and our BI tool, Looker. We don’t expect you more »

Senior Data Engineer Cullompton (with Hybrid Working) As a result of continued growth, we have a vacancy for a Senior Data Engineer to join the Gregory Group Technology Team. This is an exciting opportunity to make your own within the Gregory Group. The position of Senior … processes using a variety of techniques and technologies including SQL Stored Procedures, Azure Data Factory and other integration/data pipeline tools. Managing, monitoring and optimising both on-premises and Azure SQL servers and other PaaS data products - including indexing, maintenance plans and … with MS SQL/SSRS/SSIS. Experience of Azure Data Factory or other similar cloud-based data management/pipeline/ETL tools. Experience of using Power BI or other similar BI tool desirable. Highly motivated with a curiosity to understand business process and more »

languages, we provide clients with access to individual, professional, and institutional brokerage services in Europe, the Middle East, and Africa. As a Data Architect you will be a part of the Data leadership team and play a pivotal role in the build out of a new … data architecture. Data Architect Responsibilities Apply domain-driven design principles to create unified data models that standardize how data is produced, consumed and interpreted across the enterprise Work closely with the Chief Data Officer to design and build out the … data architecture that facilitates the business’s long-term goals Enable data discovery through metadata management, establishing a data catalog, data dictionaries and business glossaries Develop a comprehensive understanding of all facets of the business, analyse data requirements and provide more »

As the Data Architect, you'll lead data architecture initiatives, establishing standards and practices essential for effective data management. Your focus will be on designing and implementing robust data and information systems, ensuring they meet stringent criteria for modelling, flow, lineage, quality … and security. Working closely with stakeholders and data governance teams, you'll drive adherence to established standards, facilitating data-driven decision-making processes across the organisation. This role encompasses: Developing and maintaining a comprehensive Data Architecture Framework and maturity roadmap. Enforcing best data practices, setting standards, and ensuring compliance. Creating data models and overseeing the implementation of changes to address evolving business needs. Providing leadership in evaluating and implementing master data management and metadata management solutions. Collaborating with IT operations and delivery teams, producing essential data more »

Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business Analysts and Data Architects with discovery and best practices. Self-directed and comfortable supporting the data needs of multiple teams, systems and products. What’s required ? Advanced Azure knowledge and experience working and migrating data products from … on-prem to Azure. Experience building and optimizing ‘big data' data pipelines, architectures and data sets using Py-spark. Experience building real-time data pipelines using Event-hub, storage queues and Azure stream analysis. Strong analytic skills related to working with unstructured more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer. The ideal candidate will have a proven … of large data sets Data quality system and process design and implementation. Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer. The ideal candidate will have a proven … of large data sets Data quality system and process design and implementation. Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer. The ideal candidate will have a proven … of large data sets Data quality system and process design and implementation. Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer. The ideal candidate will have a proven … of large data sets Data quality system and process design and implementation. Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Lead Data Engineer role sits within the Data Services department, you will work actively to unlock the value of data by building and enabling product teams and data practitioners to use the … parties involved to ensure a smooth process with minimal disruption Ensure the accuracy and reliability of data across the data pipeline Advising on product upgrades and Improvements Responsible for coordinating the software development process Work with the team to ensure that features are estimated correctly more »

JOB DESCRIPTION About The Role We are recruiting for a Senior Data Architect to join our team. Our Senior Data Architect will work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. As a Senior … Data Architect , you will be working as part of teams to build solutions that make data accessible to enable solutions to be optimised by using an evidence-based approach. Engaging with our clients you will design and implement data solutions ensuring solutions are integrated … strategy Build and maintain appropriate Enterprise Architecture artefacts including Entity Relationship Models, Data Dictionary, ETL/ELT definitions and Data Pipeline/Lineage Models Be accountable to the client for the rationale of the architecture and detailed solution Define the methods of governance to ensure more »

Head of Data 4 days a week/Gloucestershire Up to 100k Austin Fraser is working with a leading hospitality group, keen to bring on a Head of Data to make the chains within the groups more data driven. This is a new role … through growth and well suited to an individual with a mix of data, analytics and business acumen. They're looking for someone who is keen to remain hands-on and has strong experience working with Python, Azure and a strong understanding of data security and privacy … package which includes 33 days holiday, private medical insurance and stakeholder pension scheme. The role: Work alongside systems engineers to create and deploy data pipelines, data warehouses, and data lakes. Create and implement a robust data architecture strategy that aligns with business more »

Senior Data Analyst/Data Modelling/SQL/Tableau/Python/Databicks Role: Senior Data Analyst Company: Renewable Energy Package: Up to £80,000 Location: London (Hybrid, 1 day a week in office) A world leader in renewable and sustainability energy are … currently in search of a seasoned Senior Data Analyst to join their growing Data team. As the Senior Data Analyst, you will be instrumental in providing comprehensive data analysis, utilizing your expertise in Tableau to unearth actionable insights that inform strategic business … Python. Experience with advanced analytics techniques, including modeling and segmentation. Strong visualization skills, including proficiency with Tableau. Familiarity with cloud-based data pipeline architectures (e.g., Databricks) and platforms (e.g., AWS). Knowledge of Git-based source control methodologies, including branching and pull requests. Proven track record of more »

sharing restrictions to ensure data and reports are only shared with appropriate audiences. Communicating and working with data pipeline engineers to meet data requirements and ensure data quality. Attending meetings to explain/give context/answer questions on … data, to maintain awareness on data/IG/engineering pipeline changes. Role Requirements: Extensive experience in an Analyst role, ideally with experience gained in the Public Sector Experience working in a role with competing demands and the ability to prioritize tasks accordingly Strong communication … verbal and written Experience working with Foundry Strong understanding of Information Governance and data sharing restrictions Experience working with Data Pipeline Engineers Hiring Contact: Laura Vieira Agency: GI Group If you would like any further information about any vacancies before applying, please feel free to more »