51 to 75 of 363 Data Pipeline Jobs in the UK

Responsibilities: As a pivotal member of our rapidly expanding business, your role involves: Designing and Maintaining Data Architectures and Pipelines: Create and optimize robust data architectures and pipelines. Assemble intricate data sets that align with both functional and non-functional business requirements. Identify opportunities … to acquire new data from various systems. Enhancing Processes: Develop and refine data set processes for effective data modeling, mining, and production. Build the necessary infrastructure for seamless data extraction, transformation, and loading from diverse data sources. Data Reliability and Efficiency: Recommend and implement strategies to enhance data reliability, efficiency, and quality. Collaborate with Data Scientists and Machine Learning Engineers to construct analytics tools that leverage the data pipeline. These tools provide actionable insights related to asset management, operational efficiency more »

Job Role: Azure Data Engineer Location: Central London - Hybrid/3 Days in Office Salary: £60,000 - £70,000 + 12.5% Bonus Key areas: SQL Data Engineer, Azure Data Engineer, Azure Data Factory, Azure Databricks, Azure Data Services, Snowflake, SQL … Server, Data, BI, BI Development, MS BI Chapman Tate is collaborating with a leading Housing Association that is revolutionizing the industry through innovative data-driven solutions. As they continue to expand their operations, they are seeking a talented Azure Data Engineer with strong SQL … expertise to join their dynamic team. Are you passionate about leveraging data to drive business insights and enhance operational efficiency? Do you have experience working with Azure data technologies and a knack for SQL development? If so, this is an exciting opportunity to contribute to the more »

Role: Data Engineer (DV Cleared) Salary: £55,000 - £65,000 Location: Bristol Do you want to be at the heart of some of the biggest and most ambitious programmes undertaken to keep our country safe? We are proud of the impact we have with our Defence & Security clients … and want to grow your career in this sector, we are very keen to hear from you. As a practitioner in AI & Cloud Data Engineering , you are responsible for bridging the gap between our customers' needs and technical solutions. Your primary responsibilities main responsibility is to building large … could include and may require you to: Use data integration tools, integration frameworks, and query engines with limited guidance, following the standard pipeline authoring process Implement optimized solutions to deliver on complex data integration problems independently Design quality software applications, coordinating efforts with other developers more »

making and strategic planning across the organisation through the development, deployment, and maintenance of comprehensive BI solutions. This role will manage the diverse data sources and produce robust and comprehensive reports and dashboards across the organisations key operational areas: • Financial reporting • Risk and Compliance reporting • Operational reporting • Banking … Platform reporting • IT Service, resilience, and cyber reporting Responsibilities Data Management: Design, construct … install, test, and maintain highly scalable data management systems. Data Analytics: Develop analytics tools that utilise the data pipeline to provide actionable insights into key business performance metrics and operational efficiency. Interdepartmental Collaboration: Work closely with department heads and their teams to gather more »

30+ years, Magnit offers the industry’s first holistic platform for the modern workforce. Magnit’s integrated workforce management (IWM) platform supported by data, software, intelligence, and best-in-class services team is key to our clients’ success. It can adapt quickly to regional or industry economic shifts … who collaborate and deliver meaningful results that positively transform the largest companies around the globe. About the Role We are seeking a Sr. Data Engineer with a minimum of 3 plus years of relevant work experience, preferably 5 plus years, to join our team. The ideal candidate has … a strong background in database management and would have the necessary skills to explore, analyze, and manipulate data from diverse sources (SQL, Oracle, etc.). What You Will Do • Explore and analyze data from a wide range of sources to extract actionable insights and drive data more »

The role As a Data Engineer at Storm you will work alongside other software and cloud infrastructure engineers to design, build and maintain data pipelines, data management solutions and analytics components for our client’s projects across the healthcare, justice and local government sectors. … About you We know that many Data Engineer's will come from a variety of backgrounds, and we encourage and value people who bring unique perspectives and knowledge to our team. Your previous experience will include working daily with disparate data sources, ingesting, transforming and processing … data streams into actionable insights for direct use or for onward processing. You will have a proven track record of delivery and a passion for adherence to best practices in the data engineering discipline. You will be passionate about data in all its forms more »

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on business requirements and priorities As part of … Coding experience with Python/Javascript/C# Familiarity with statistical/machine learning/AI concepts and techniques Understanding of data pipeline/orchestration tools e.g. dbt, dataform Appreciation of GCP’s serverless technologies e.g. Cloud Run/Workflows Understanding of Google’s marketing stack, Google more »

Data Engineer – Pricing/Market Data A leading financial services firm are improving their data product offering and have an opportunity for a Data Engineer paly a key role in the development of key data platforms. You will have expertise … in Microsoft technologies for data engineering including significant ETL development experience, including MS SQL, Azure, Fabric, and .NET technologies. This includes creating data pipelines, ingesting data and data modelling. You will be working in a fast-paced execution environment, with a focus … on providing data solutions for market data and pricing within a financial markets context. You should apply for this role if you are/have: 5+ years data engineering experience within financial services Financial markets (buy or sell side) with pricing and/or more »

Data Engineer Slough - Hybrid - 1 day per week Up to £70,000 We are currently recruiting for a Data engineer to join our client in the financial/food industry as they are embarking on a major transformation. This opportunity will be a fast paced role … working directly with Decision makers and Data scientists. As a Data Engineer you will have experience working with Azure Technologies, SQL, good python skills and experience in finance would be advantageous. The Role: Build robust and reliable data platforms that organises data … in Azure services like Synapse, SQL, and Purview. Experienced with SQL Server stack and optimisation. Skilled in PySpark and Python for data pipeline development. Designed warehouses, lakes, and models. Implemented data governance tools and ensured data quality. Familiar with both relational and NoSQL more »

Data Engineer Salary: £35-70k (plus very attractive bonus on top) Location: London/Leeds (hybrid working of 1 day a week in either the London or Leeds office, if prefered) We are looking to fill 2 or 3 roles at various seniority levels. PLEASE only apply … recruiting for a Sports Analytics company - a clear leader in their market with considerable expansion plans. Purpose of role: The purpose of the Data Engineer is to implement and … maintain data infrastructure that facilitates data-driven decision making, innovation and operational efficiency while ensuring that the data pipeline is secure, reliable, and scalable. The role holder will build and maintain high-performance data systems that are foundational to driving business more »

using your expertise to uncover valuable insights that drive strategic decision-making and fuel business growth? Do you thrive in a high volume data-oriented environment, where every record holds the potential to uncover radical insights and opportunities? Do you have exceptional skills in big data technologies, real-time data processing, and advanced analytics, and would be capable of handling and extracting insights from a highly dynamic dataset growing by 8 billion records each day? If youre a Big Data Analyst used to working with big data and … high-volume records, and have what it takes to transform complex data into actionable recommendations, informed decisions, and impactful outcomes, then this could be the perfect position for you! Salary & Benefits: Competitive salary between £60,000 - £80,000 per annum depending on relevant technical skills and experience Fully more »

Azure Data Engineer (SC Cleared) Location: Bristol Salary: £50,000 - £60,000 We're seeking Azure Data Engineer with active SC Clearance. This is a fantastic opportunity to join one of the most reputable digital solution provider's in the United Kingdom providing exposure to the … biggest and most ambitious programmes undertaken to keep our country safe. The SC Cleared Azure Data Engineer will be joining the Defence & Security arena, where you will help digitise defence with new thinking on technology capabilities and adoption processes, so we need someone who is sensitively able to … combine the latest thinking with traditional military functions. *Must have Active SC Clearance* Role requirements Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including more »

Data Engineer Location: London, 3 days per week in the office Salary range: £50,000-£70,000 + benefits Purpose: Design, build, and maintain scalable data architectures, including pipelines and cloud-based data warehouses. Tech: Python (NumPy, Pandas), SQL, ETL, Cloud (AWS, Azure or … consultancy who solely specialise in the Maritime trading industry. You will work onsite with 1 specific client to design, build and maintain scalable data architectures working with key stakeholders in their business to shape their data-driven strategies. The Company: They have a long history providing … ETL Processes: Deep expertise in developing and optimising ETL pipelines. Version Control: Experience with Git for code collaboration and change tracking. Data Pipeline Tools: Proficiency with tools such as Apache Airflow. Cloud Platforms: Familiarity with AWS, Azure, Snowflake, and GCP. Visualisation: Tableau or PowerBI Delivery Tools: Familiarity more »

We Want We are looking for a Staff Backend Engineer to join our Insights Back-End team to help build out data pipeline, data store and API layer of Bazaarvoice data that will power our various client-facing dashboards, raw data reporting, product performance reporting. The ideal candidate has built and operated systems that aggregate and share data sets to support new product offerings and is well experienced in evaluating the right technologies to build those data sets. Success in the role is underpinned by … a strong understanding of the business cases of the product portfolio and building relevant data sets, API layer and access methodologies that support the portfolio goals. What You’ll Be Doing Own, design, implement and support of major components of the unified back end data. Define how data more »

SENIOR DATA SCIENTIST (NLP & LLM) Up to £85,000 LONDON Ready to elevate your career to new heights? Join a team of experienced Data Scientists and Data Engineers to create impactful LLM's models and work with cutting-edge NLP technologies. The Role: Work … performance, and make informed solution selections. Conduct comprehensive work spanning the entire data lifecycle, including data exploration, data pipeline development, insights and feature extraction, machine learning model creation, and deployment. Collaborate on consulting-style pilot projects aimed at helping clients gain a deep … understanding of their data and identifying problems that can be addressed through the platform. Collaborate closely with data scientists and data engineers to construct and implement machine learning models. Take an active role in leading team meetings and client workshops. Assist in establishing software more »

Data Engineer Grade: Consultant Analyst/Consultant Location: Belfast – BT6 8DN In-Office: 2 days per week Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks a highly ambitious and technically astute AWS Data Engineer to help design, build and deploy cloud-based … data solutions - transforming raw data into actionable insights that inspire ingenuity. The Company: The Organisation consists of 4000 high-performing Digital Strategists and Engineering Technologists - united in delivering human-centred innovation and making a meaningful impact on global society. Boasting a vast network of FTSE … Defence and security, Energy and utilities, Financial Services, Government and Public Services, Healthcare, Life Sciences, and Transport. Essential Skills & Experience: Design and deploy data pipelines in big data architecture using Java, Python, Scala, Spark, and SQL. Execute tasks involving scripting, API data extraction, and more »

developer 6 months contract – Competitive market rates – Inside IR35 - London – 3 days on-site Key Skills: Python, Power BI, SQL, Experience with Big Data pipelines, DAX, Excel, Financial services background The Role: A global trading organisation is looking a Python/Power BI to join their Data … be working with the business helping to build Apps using Python and Power BI for the output dashboards. Key Responsibilities: Develop and construct data pipelines to facilitate efficient extraction, transformation, and loading of data from diverse sources. Create and implement Business Information Access portals, comprising dashboards … continued deployment and enhancements. Innovate existing solutions and forecast future demands to meet evolving business needs. Develop analytics tools leveraging the data pipeline to offer actionable insights across various business functions, thereby enhancing key performance metrics. Emphasize automation and adopt an early feedback approach to streamline processes. more »

Principal Data Engineer – National Salary Circa £80,000. London Salary Circa £100,000. Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity for an Engineer Manager with significant experience of managing data pipelines. As … well as being an expert in cloud platform, you’ll have a strong background in Data Ingestion and Integration, designing and implementing ETL pipelines on various technologies, Data Quality monitoring and a rounded understanding of data operations. Aviva believes strongly in experimentation leading to … teams across multiple areas. Coding Mastery: Proficient in writing clean, robust code in SQL and Python, with a strong foundation in data pipeline software engineering, testing, version control, and debugging. Experience of mentoring and supporting development of junior engineers. Data Analysis and Processing: Skilled in more »

Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to … support the organisation's data processing needs and facilitate BI reporting and analytics delivery. Responsibilities for the Senior Data Engineer Design, develop, and maintain scalable data pipelines and workflows using Azure … Data Factory and Databricks Implement data quality checks and validation processes to ensure accuracy, completeness, and consistency of data. Monitor pipeline performance and troubleshoot issues promptly to ensure uninterrupted data processing. Key Skills & Experience for the Senior Data Engineer Essential Hands more »

Stott and May has partnered with a global healthcare organisation within the private sector, to source a senior data engineer to join their growing tech team. Hybrid (3/4 days per month in London or Manchester) Salary: Circa £80k p/annum Key Responsibilities: Lead the consolidation … and migration of legacy data to our new cloud-based data platform. Design and implement master and transactional data models to ensure data integrity and consistency. Develop ETL pipelines and cloud data storage solutions that meet business requirements and non … functional needs. Collaborate closely with data analysts, visualization engineers, and project managers to deliver data solutions. Surface data for analytical consumption and prepare data for ML/predictive and prescriptive models. What we are looking for: Proficiency with Databricks and building data more »

Job title: Lead Data Engineer Client: Data Driven Hedge Fund Salary: Up to £160,000 Location: London/Hybrid My client are seeking a Lead Data Engineer to own delivery of scalable data pipelines that are critical to the entire firms infrastructure. … Being a Lead Data Engineer at a truly elite hedge fund, you will join an environment that prides themselves on working with the most cutting edge technologies and boast a world class technical team where you will work with and learn from the best. Responsibilities: As a Lead … based on very specifically tailored data requirements. Architect and implement data ingestion, transformation, and storage processes. Optimise data pipeline performance. Keep up with market developments in the data engineering and AI space and implement these best practices. Requirements and Skills: Bachelor more »

A Financial Service Company is currently seeking a Lead Data Engineer to join its EMEA Technology team. This person will lead the design, development, and maintenance of scalable and efficient data pipelines to support data-driven applications The Lead Data Engineer will … also collaborate with cross-functional teams, including data scientists, software engineers, an product managers, to understand data requirements and deliver high-quality solutions as well as architecting data ingestion, transformation, and storage … processes using tools such as Apache Spark, Azure Data Factory, and other similar technologies. Other core duties include optimizing data pipeline performance, ensuring data accuracy, reliability, and timely delivery. Requirements; Significant experience working as a Lead Data Engineer within Financial Services more »

Data Engineer - 5 Month Remote Contract Interviewing now for a Data Engineer for a remote project (Outside IR35.) We are seeking an experienced Data Engineer responsible to develop and deliver data solutions, optimising data to ensure data availability … and accuracy. You will extract data from the Datalake using Big Query. You will Build data pipelines from gathered requirements to support delivery of data solutions. You will also track down discrepancies with data across the integration points and report data … Market Rates (Outside IR35) Location: Remote/UK Start: ASAP Skills -Previous experience in database services, design, implementation and experience at enterprise level data platforms, data lake concepts and data handling. - Proficient with SQL, joins, PKs, FKs, referential integrity. -Previous data warehouse more »

Data Engineer £35,000 To £45,000 (Dependent on Experience) Norwich Hybrid (2/3 Days per Week Onsite) An exciting opportunity for a data engineering professional to take full ownership of new projects. Join a longstanding business with a talented and dedicated internal IT team … as well as an environment that fosters personal progression. This job role is ideal for someone with a strong background in data engineering and an interest in data analysis. Duties: Lead the implementation and ongoing management of data strategy and analysing raw data … build robust data systems Conduct advanced data analysis Participate in Agile ceremonies and practices Required Skills: ETL Data Pipeline development experience Designing, developing and maintaining data lakes and warehouses SQL Database Design, Coding and Maintenance Programming languages such as SQL and more »

Data Engineer – Salary National up to £35,000/London up to £45,000 Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity to join our highly skilled Data Engineer community. Within one of … our Data Engineering teams, we are looking for an individual who is passionate about data to work within our multi cloud environment to h elp shape the future of insurance through cutting-edge predictive analytics and Data Science. A bit about the job: Data … maintainable, and robust code in SQL or Python. Scala, Java or similar languages would be advantageous but not required. Experience in data pipeline engineering and best practice with CI/CD setup. Working with Oracle and Snowflake are desirable. Knowledge and expertise of data engineering more »