51 to 75 of 391 Data Pipeline Jobs in the UK

JOB DESCRIPTION About The Role We are recruiting for a Senior Data Architect to join our team. Our Senior Data Architect will work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. As a Senior … Data Architect , you will be working as part of teams to build solutions that make data accessible to enable solutions to be optimised by using an evidence-based approach. Engaging with our clients you will design and implement data solutions ensuring solutions are integrated … strategy Build and maintain appropriate Enterprise Architecture artefacts including Entity Relationship Models, Data Dictionary, ETL/ELT definitions and Data Pipeline/Lineage Models Be accountable to the client for the rationale of the architecture and detailed solution Define the methods of governance to ensure more »

Head of Data 4 days a week/Gloucestershire Up to 100k Austin Fraser is working with a leading hospitality group, keen to bring on a Head of Data to make the chains within the groups more data driven. This is a new role … through growth and well suited to an individual with a mix of data, analytics and business acumen. They're looking for someone who is keen to remain hands-on and has strong experience working with Python, Azure and a strong understanding of data security and privacy … package which includes 33 days holiday, private medical insurance and stakeholder pension scheme. The role: Work alongside systems engineers to create and deploy data pipelines, data warehouses, and data lakes. Create and implement a robust data architecture strategy that aligns with business more »

Senior Data Analyst/Data Modelling/SQL/Tableau/Python/Databicks Role: Senior Data Analyst Company: Renewable Energy Package: Up to £80,000 Location: London (Hybrid, 1 day a week in office) A world leader in renewable and sustainability energy are … currently in search of a seasoned Senior Data Analyst to join their growing Data team. As the Senior Data Analyst, you will be instrumental in providing comprehensive data analysis, utilizing your expertise in Tableau to unearth actionable insights that inform strategic business … Python. Experience with advanced analytics techniques, including modeling and segmentation. Strong visualization skills, including proficiency with Tableau. Familiarity with cloud-based data pipeline architectures (e.g., Databricks) and platforms (e.g., AWS). Knowledge of Git-based source control methodologies, including branching and pull requests. Proven track record of more »

sharing restrictions to ensure data and reports are only shared with appropriate audiences. Communicating and working with data pipeline engineers to meet data requirements and ensure data quality. Attending meetings to explain/give context/answer questions on … data, to maintain awareness on data/IG/engineering pipeline changes. Role Requirements: Extensive experience in an Analyst role, ideally with experience gained in the Public Sector Experience working in a role with competing demands and the ability to prioritize tasks accordingly Strong communication … verbal and written Experience working with Foundry Strong understanding of Information Governance and data sharing restrictions Experience working with Data Pipeline Engineers Hiring Contact: Laura Vieira Agency: GI Group If you would like any further information about any vacancies before applying, please feel free to more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture … Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors … to build a highly scalable and robust data hub. Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices. Data Integration and Storage Solutions: Implement data more »

A fantastic opportunity has a risen with our Financial Services client, for a Head of Data Engineering to join the team. The Head of Data Engineering will be responsible leading a team of data engineers to architect, build, and maintain a new data lakehouse solution and pipelines that drive the digital transformation initiatives and support business reporting requirements. The Head of Data Engineering will be involved from the very beginning of the project and will have experience of Azure Datalake and Databricks. Key responsibilities for the Head of Data Engineering Define and drive the data engineering strategy and technical roadmap in alignment with the company's digital transformation goals. Lead and mentor a team of data engineers to design, develop, and deploy data pipelines and solutions that meet business needs. Lead more »

Responsibilities: As a pivotal member of our rapidly expanding business, your role involves: Designing and Maintaining Data Architectures and Pipelines: Create and optimize robust data architectures and pipelines. Assemble intricate data sets that align with both functional and non-functional business requirements. Identify opportunities … to acquire new data from various systems. Enhancing Processes: Develop and refine data set processes for effective data modeling, mining, and production. Build the necessary infrastructure for seamless data extraction, transformation, and loading from diverse data sources. Data Reliability and Efficiency: Recommend and implement strategies to enhance data reliability, efficiency, and quality. Collaborate with Data Scientists and Machine Learning Engineers to construct analytics tools that leverage the data pipeline. These tools provide actionable insights related to asset management, operational efficiency more »

Job Role: Azure Data Engineer Location: Central London - Hybrid/3 Days in Office Salary: £60,000 - £70,000 + 12.5% Bonus Key areas: SQL Data Engineer, Azure Data Engineer, Azure Data Factory, Azure Databricks, Azure Data Services, Snowflake, SQL … Server, Data, BI, BI Development, MS BI Chapman Tate is collaborating with a leading Housing Association that is revolutionizing the industry through innovative data-driven solutions. As they continue to expand their operations, they are seeking a talented Azure Data Engineer with strong SQL … expertise to join their dynamic team. Are you passionate about leveraging data to drive business insights and enhance operational efficiency? Do you have experience working with Azure data technologies and a knack for SQL development? If so, this is an exciting opportunity to contribute to the more »

Role: Data Engineer (DV Cleared) Salary: £55,000 - £65,000 Location: Bristol Do you want to be at the heart of some of the biggest and most ambitious programmes undertaken to keep our country safe? We are proud of the impact we have with our Defence & Security clients … and want to grow your career in this sector, we are very keen to hear from you. As a practitioner in AI & Cloud Data Engineering , you are responsible for bridging the gap between our customers' needs and technical solutions. Your primary responsibilities main responsibility is to building large … could include and may require you to: Use data integration tools, integration frameworks, and query engines with limited guidance, following the standard pipeline authoring process Implement optimized solutions to deliver on complex data integration problems independently Design quality software applications, coordinating efforts with other developers more »

making and strategic planning across the organisation through the development, deployment, and maintenance of comprehensive BI solutions. This role will manage the diverse data sources and produce robust and comprehensive reports and dashboards across the organisations key operational areas: • Financial reporting • Risk and Compliance reporting • Operational reporting • Banking … Platform reporting • IT Service, resilience, and cyber reporting Responsibilities Data Management: Design, construct … install, test, and maintain highly scalable data management systems. Data Analytics: Develop analytics tools that utilise the data pipeline to provide actionable insights into key business performance metrics and operational efficiency. Interdepartmental Collaboration: Work closely with department heads and their teams to gather more »

A fantastic opportunity has a risen with our Financial Services client, for a Head of Data Engineering to join the team. The Head of Data Engineering will be responsible leading a team of data engineers to architect, build, and maintain a new data lakehouse solution and pipelines that drive the digital transformation initiatives and support business reporting requirements. The Head of Data Engineering will be involved from the very beginning of the project and will have experience of Azure Data Lake and Databricks. This is a predominantly … office visit will occasionally be required, therefore you must be able to travel to London or Birmingham. Key responsibilities for the Head of Data Engineering Define and drive the data engineering strategy and technical roadmap in alignment with the company's digital transformation goals. Lead and more »

30+ years, Magnit offers the industry’s first holistic platform for the modern workforce. Magnit’s integrated workforce management (IWM) platform supported by data, software, intelligence, and best-in-class services team is key to our clients’ success. It can adapt quickly to regional or industry economic shifts … who collaborate and deliver meaningful results that positively transform the largest companies around the globe. About the Role We are seeking a Sr. Data Engineer with a minimum of 3 plus years of relevant work experience, preferably 5 plus years, to join our team. The ideal candidate has … a strong background in database management and would have the necessary skills to explore, analyze, and manipulate data from diverse sources (SQL, Oracle, etc.). What You Will Do • Explore and analyze data from a wide range of sources to extract actionable insights and drive data more »

extensive array of digitally enhanced products and services, tailored to satisfy the diverse needs of their customers who are looking for a lead data and analytics specialist to join their team. Responsibilities: Lead the upskilling, coaching, and mentoring of fellow data engineers. Establish and reinforce data engineering best practices and guidelines. Conceptualize, build, and sustain data pipelines for the efficient extraction, transformation, and loading of data from various sources into our data warehouse and data lakes. Uphold data integrity, quality, and consistency throughout the … entire process. Create and enhance ETL/ELT workflows capable of handling substantial data volumes. Collaborate with data analysts, data scientists, and other stakeholders to comprehend their data needs. Develop and implement appropriate data models to support efficient data more »

The role As a Data Engineer at Storm you will work alongside other software and cloud infrastructure engineers to design, build and maintain data pipelines, data management solutions and analytics components for our client’s projects across the healthcare, justice and local government sectors. … About you We know that many Data Engineer's will come from a variety of backgrounds, and we encourage and value people who bring unique perspectives and knowledge to our team. Your previous experience will include working daily with disparate data sources, ingesting, transforming and processing … data streams into actionable insights for direct use or for onward processing. You will have a proven track record of delivery and a passion for adherence to best practices in the data engineering discipline. You will be passionate about data in all its forms more »

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on business requirements and priorities As part of … Coding experience with Python/Javascript/C# Familiarity with statistical/machine learning/AI concepts and techniques Understanding of data pipeline/orchestration tools e.g. dbt, dataform Appreciation of GCP’s serverless technologies e.g. Cloud Run/Workflows Understanding of Google’s marketing stack, Google more »

Role: Data Engineer - Tech Lead Job Type: Permanent Location: London, UK Do you strive for engineering excellence and are ready to lead a modern tech transformation ? Do you have experience as a Azure, Pyspark, Cloud? We have the perfect role for you- Data Engineer - Tech Lead … engineers. Work with some of the brightest global minds in the industry. Be exposed to the future of data. The Role Being a Data Engineering Tech Lead, you will be at the forefront of leveraging Azure cloud services to design, develop, and implement cutting-edge data engineering solutions. You will be leading a team of data engineers in harnessing the power of Databricks and Synapse to build scalable and efficient data pipelines, data lakes, and analytical solutions. Lead Data Engineering Solutions Development: Lead the design, development more »

Data Engineer – Pricing/Market Data A leading financial services firm are improving their data product offering and have an opportunity for a Data Engineer paly a key role in the development of key data platforms. You will have expertise … in Microsoft technologies for data engineering including significant ETL development experience, including MS SQL, Azure, Fabric, and .NET technologies. This includes creating data pipelines, ingesting data and data modelling. You will be working in a fast-paced execution environment, with a focus … on providing data solutions for market data and pricing within a financial markets context. You should apply for this role if you are/have: 5+ years data engineering experience within financial services Financial markets (buy or sell side) with pricing and/or more »

Data Engineer Remote working, West Sussex, Manchester Up to £54,000 per annum + Bonus An exciting opportunity has arisen to join a leading company in the Insurance and technology sector, renown for its outstanding working culture, in a Data Engineering role. The role will require … who has strong Pyspark and SQL experience alongside an Azure background. Key responsibilities: Develop low to high complexity, secure, governed, high quality, efficient data pipelinesfrom a variety of on and off premise, internal and external data sources Ensure that data is cleansed, mapped, transformed … and optimised for storage to meet requirements for business and technical use cases. Build data observability and data quality by design into all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. Build solutions that pipe transform data more »

Our client within the Education sector are looking for a Senior Data Engineer to join them on a contract basis. Inside IR35 6 month contract Hybrid 1 – 2 days per week onsite Technical Skills: In depth knowledge of relevant Azure services such as Azure Data Lake … Storage, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL Database, Azure Stream Analytics, etc. Strong Python or Scala with Spark, PySpark experience Experience with relational databases and NoSQL databases Significant experience and in-depth knowledge of creating data pipelines and associated design principles, standards … Data modelling concepts, ETL procedures, and all steps of data production process Experience with unit and integration testing, and data quality frameworks such as Deequ, Great Expectations or Delta Live Experience working with continuous integration Good understanding of data modelling (medallion architectures more »

Data Engineer Salary: £35-70k (plus very attractive bonus on top) Location: London/Leeds (hybrid working of 1 day a week in either the London or Leeds office, if prefered) We are looking to fill 2 or 3 roles at various seniority levels. PLEASE only apply … recruiting for a Sports Analytics company - a clear leader in their market with considerable expansion plans. Purpose of role: The purpose of the Data Engineer is to implement and … maintain data infrastructure that facilitates data-driven decision making, innovation and operational efficiency while ensuring that the data pipeline is secure, reliable, and scalable. The role holder will build and maintain high-performance data systems that are foundational to driving business more »

using your expertise to uncover valuable insights that drive strategic decision-making and fuel business growth? Do you thrive in a high volume data-oriented environment, where every record holds the potential to uncover radical insights and opportunities? Do you have exceptional skills in big data technologies, real-time data processing, and advanced analytics, and would be capable of handling and extracting insights from a highly dynamic dataset growing by 8 billion records each day? If youre a Big Data Analyst used to working with big data and … high-volume records, and have what it takes to transform complex data into actionable recommendations, informed decisions, and impactful outcomes, then this could be the perfect position for you! Salary & Benefits: Competitive salary between £60,000 - £80,000 per annum depending on relevant technical skills and experience Fully more »

Data Engineer - Advanced Analytics Remote Essential Skills: Computer Science or equivalent education and experience BPSS (SC desired) 2+ years of data experience with data analysis and preparation, including experience with very large data sets Data manipulation and extraction using Python … SQL, AWS Redshift Skills required: Python, SQL, AWS Glue, AWS Redshift, AWS Lambda, AWS Step Functions, AWS App Config Understanding of data migration, migration of existing data platforms to new environment Strong understanding of Python (other languages an advantage), AWS technologies (as above) Strong understanding Data Governance tooling Strong experience in SQL, database development & data modeling Solid business and collaboration skills, and responsive to service needs and operational demands Day to day activities: Act as a liaison between consumer teams and source system/data owners Assess and understand data more »

nineDots are excited to be helping Cloudsmith ramp up their data engineering function. They are on a truly amazing upward trajectory with fantastic seasoned pros at the helm. It's gonna be a fun journey. Are you ready to lead the design and implementation of a best-in … class data platform on AWS?Doyou have a deep understanding of data engineering principles and a passion for creating scalable, efficient, and secure data solutions? If you're seeking a challenging and rewarding role, join Cloudsmith as our Principal Data Engineer! We … engineering (e.g., Redshift, S3, Glue, Lambda, Kinesis). ● Strong Programming Skills: Proficiency in languages like Python, SQL, and experience with data pipeline tools. ● DataModeling and Warehousing: Expertise in data modeling techniques and experience with data warehousing solutions. ● Excellent Problem-Solving Skills: Ability more »

Data Engineer Location: London, 3 days per week in the office Salary range: £50,000-£70,000 + benefits Purpose: Design, build, and maintain scalable data architectures, including pipelines and cloud-based data warehouses. Tech: Python (NumPy, Pandas), SQL, ETL, Cloud (AWS, Azure or … consultancy who solely specialise in the Maritime trading industry. You will work onsite with 1 specific client to design, build and maintain scalable data architectures working with key stakeholders in their business to shape their data-driven strategies. The Company: They have a long history providing … ETL Processes: Deep expertise in developing and optimising ETL pipelines. Version Control: Experience with Git for code collaboration and change tracking. Data Pipeline Tools: Proficiency with tools such as Apache Airflow. Cloud Platforms: Familiarity with AWS, Azure, Snowflake, and GCP. Visualisation: Tableau or PowerBI Delivery Tools: Familiarity more »

We Want We are looking for a Staff Backend Engineer to join our Insights Back-End team to help build out data pipeline, data store and API layer of Bazaarvoice data that will power our various client-facing dashboards, raw data reporting, product performance reporting. The ideal candidate has built and operated systems that aggregate and share data sets to support new product offerings and is well experienced in evaluating the right technologies to build those data sets. Success in the role is underpinned by … a strong understanding of the business cases of the product portfolio and building relevant data sets, API layer and access methodologies that support the portfolio goals. What You’ll Be Doing Own, design, implement and support of major components of the unified back end data. Define how data more »