51 to 75 of 322 Data Pipeline Jobs in England

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

Data Engineer £50k - £60k + 15% Bonus Letchworth/Hybrid (a couple of days onsite per month) Our client is currently searching for a Data Engineer to join their team. As a Data Engineer, you will assist in establishing a new data platform for our client, working with other parts of the business to migrate data from legacy systems and establish pipelines to move data from new applications to the data platform while adopting standard best practices. In your first few weeks in this … Data Engineer role, you can expect to: Participate in data development processes, data modelling, data analysis and synthesis and be responsible for ingesting data from different sources and transforming the data Be responsible for the Tableau Platform setup more »

Azure Data Engineers wanted by a London based company at the forefront of revolutionising healthcare through cutting-edge technology and data-driven solutions. Our mission is to improve patient outcomes and streamline healthcare processes by leveraging the power of data. We are looking for a talented … Azure Data Engineer to join our dynamic team and help us drive our mission forward. As an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining the data infrastructure. You will work closely with our data science … analytics, and engineering teams to ensure that data systems are robust, scalable, and secure. Your expertise will help us harness the full potential of our data to deliver innovative healthtech solutions. The business is already a well established leader within their domain. However, they like to more »

Data Visualisation Engineer Location: UK Salary: £41,000 per annum We are Forward, the social enterprise that empowers people to break the cycle of crime or addiction to move forward with their lives. For more than 25 years we have been working with people to build positive and … make positive changes and build productive lives with a job, family, friends and a sense of community. What you will be doing The Data Visualisation Engineer (DVE) is responsible for designing, developing, and maintaining data visualisation systems and dashboards. Using a variety of tools and technologies … to create interactive and visually appealing representations of data that enable users to quickly and easily understand complex data sets. Services are designed to deliver a range of interventions, programmes, workshops, advice and guidance for our clients. As a member of the Data & Performance more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture … Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors … to build a highly scalable and robust data hub. Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices. Data Integration and Storage Solutions: Implement data more »

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our … client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data streams to our client's Data Platforms. Shape data from various sources into a transactional ODS for detailed reporting and a Kimball-modelled Data Warehouse for analytics and dashboards. Define and embed data quality measures within data pipelines. more »

Job Role: Principal Data Engineer Job Type: Contract IR35 : Inside IR35 Day Rate: £600/Day Contract Duration: 6 months Working Hours: 5 days per week Remote Working : 4 days remote working. 1 day on-site in London Location: Hybrid Remote/London (UK only) Reference : BH-299c … Role Overview: We are seeking an experienced Principal Data Engineer to join our client's team. You will lead the Data Engineering Acceleration initiative, designing, building, and transitioning a robust data management system that optimises data lifecycle management. Key Responsibilities: A cross … discipline professional who can collaborate with multiple teams, such as DataOps, Data Analytics, Software Development teams, to design solutions with them Provide expert advice and support in designing efficient processes for data discovery, profiling, quality, encryption, and pipelines. Document compliance, security, and data sovereignty more »

inside IR35 Our client is currently working on several end-client programmes, for several Government technical Consultancies to support various public body Government Data Engineering departments as part of their respective cloud migration strategies. The Data Platform Engineer will be assigned to one (perhaps more depending … on project timelines) of our client's data engineering projects based on data engineering and technical skills. The successful candidate will fulfil the following responsibilities: Requirements analysis and design of solutions for the data platform; Integration and analysis of solutions; Understanding of toolsets including … AWS hosted databases (Postgres, S3 based data lake, AWS glue MySQL, Athena); Integration services (AWS API gateway, lambda functions), nice to have MuleSoft or Axway; ETL services (AWS Glue, Step functions); Infrastructure a management tool such as Terraform and extensive use of SQLs, Python, and Node JS. The more »

Data Engineer – London - £100,000 Description My client, a prominent figure in the insurance industry are on the hunt for a Data Engineer to join there ever growing Data team. The right individual will have a passion for Data as well as … being able to communicate to non-technical stakeholders. The right Data Engineer will ideally have experience working with Azure however my client are open to seeing people equally AWS/GCP. Responsibilities Designing and implementing scalable and efficient data storage solutions on Azure. Building and maintaining … with data scientists and analysts to understand their requirements and develop optimized data models. Monitoring and troubleshooting data pipeline performance issues. Implementing security measures to protect our data assets. Conducting regular data quality checks and applying necessary fixes. Keeping more »

We are seeking an experienced Python Data Engineer Consultant to join a leading hedge fund. The ideal candidate should have a proven ability to design and implement data solutions, with expertise in extracting, transforming, and loading (ETL) data from various sources, including websites, PDFs … and Real Time data streams. Role: Python Data Engineer Client: Leading Hedge Fund Type of role: contract (6 months) Location: London office Rate: up to £1500/day Key Responsibilities: Architect, develop, and optimize data pipelines for extracting, transforming, and loading data from diverse alternative data sources, such as web scrapes, PDF files, and Real Time data infrastructures. Implement and manage database solutions in SQL Server and various cloud-based environments, ensuring data integrity, efficiency, and accessibility. Build and maintain Real Time data more »

Senior Data Engineer Salary Negotiable to £70,000 DoE Hybrid working with 2 days in London Job Reference J12785 Work with an award-winning independent protection adviser. Develop the data engineering capabilities. Data is a key enabler for the business and developing enterprise grade … data engineering services is a central pillar in the digital transformation program. The data pipelines and models that you will develop will underpin all Business Intelligence, Machine Learning and CRM capabilities. The role holder must ensure that the data is well-managed and ready … for consumption by the business, which will require the integration of multiple data sources (both cloud and on-prem) and developing data transformations pipelines in an Azure Synapse environment. The role will be aligned to a specific area of the business e.g. the digital teams or more »

Senior Data Engineer Salary Negotiable to £70,000 DoE Hybrid working with 2 days in London Job Reference J12785 Work with an award-winning independent protection adviser. Develop the data engineering capabilities. Data is a key enabler for the business and developing enterprise grade … data engineering services is a central pillar in the digital transformation program. The data pipelines and models that you will develop will underpin all Business Intelligence, Machine Learning and CRM capabilities. The role holder must ensure that the data is well-managed and ready … for consumption by the business, which will require the integration of multiple data sources (both cloud and on-prem) and developing data transformations pipelines in an Azure Synapse environment. The role will be aligned to a specific area of the business e.g. the digital teams or more »

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work … a detail-oriented innovator and team player, we’re excited to hear from you. Responsibilities Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. Integrate data management technologies and software … databases, as well as NoSQL databases Familiarity with cloud services (preferably GCP ) and understanding of its ETL frameworks. Desired : experience with data pipeline and workflow management (Airflow, Composer). Desired : Familiarity with machine learning algorithms and data science principles is a plus. Qualifications Degree in more »

understand client requirements and provide technical expertise during pre-sales engagements. Design and implement Proof of Concepts (POCs) to showcase the potential of data integration solutions and demonstrate value to clients. Prepare technical proposals and cost estimates for data integration projects. Conduct client presentations and answer … technical questions effectively. Design, develop, and deploy data pipelines for ingesting, transforming, and loading data from various sources into target systems (cloud and on-premises). Implement data cleansing, quality checks, and transformation logic to ensure data integrity and … accuracy. Configure and manage data integration tools, including cloud-based platforms and on-premises solutions. Automate workflows and schedule data pipeline execution for efficient data processing. Monitor data pipelines for performance and troubleshoot any issues. Collaborate with data analysts more »

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on business requirements and priorities As part of … Coding experience with Python/Javascript/C# Familiarity with statistical/machine learning/AI concepts and techniques Understanding of data pipeline/orchestration tools e.g. dbt, dataform Appreciation of GCP’s serverless technologies e.g. Cloud Run/Workflows Understanding of Google’s marketing stack, Google more »

experienced AWS Cloud Architect to design AWS reference architecture for our services-led client. Responsibilities: Design and implement scalable, secure, and high-performance data architectures on AWS. Develop data models and database designs that align with business requirements and ensure data integrity. Proficiency in … or AWS CodePipeline. Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform, or similar. Create and maintain ETL processes, data pipelines, and data integration workflows using AWS services. Implement data storage solutions, including data lakes, data warehouses, and operational databases. Provide technical leadership and guidance on AWS data services and architecture to the team. Requirements: Proven experience as an AWS Data Architect or similar role, with a strong focus on data architecture and management. In-depth knowledge of more »

Data Scientist/Engineer - Hybrid/Bristol Job Title : Data Scientist/Engineer Location : Hybrid/Bristol Remuneration : £50,000 - £60,000 per annum Contract Type : Permanent Role will be based with the modelling team. 25% Data Submission and Cleansing (Data Engineer … Process Improvement (Data Science). Ideally, seeking someone with strong Data Science exposure but Data Engineering skills. Responsibilities : Play a pivotal role in crafting, enhancing, and managing intricate data ingestion pipelines, ensuring their efficiency, scalability, and dependability. Integrate advanced machine learning elements … into data pipelines to elevate data processing and analytical capabilities. Devise and implement data quality metrics and dashboards for monitoring, ensuring the fidelity and precision of ingested data. Collaborate closely with data scientists, engineers, and cross-functional team members in an agile more »

Azure Data Engineer (SC Cleared) Location: Bristol Salary: £50,000 - £60,000 We're seeking Azure Data Engineer with active SC Clearance. This is a fantastic opportunity to join one of the most reputable digital solution provider's in the United Kingdom providing exposure to the … biggest and most ambitious programmes undertaken to keep our country safe. The SC Cleared Azure Data Engineer will be joining the Defence & Security arena, where you will help digitise defence with new thinking on technology capabilities and adoption processes, so we need someone who is sensitively able to … combine the latest thinking with traditional military functions. *Must have Active SC Clearance* Role requirements Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including more »

timeline. The ability to hit the deck running and make valuable contributions quickly will be critical.0-12 months you’ll deliverSupport Head of Data Engineering and contribute to establish/enforce best practices, coding standards, and development methodologies for the data engineering team. Drive continuous improvement … in data engineering processes to enhance efficiency, reliability and scalability.Manage a team of skilled data engineers, providing guidance, mentorship, and support to ensure the team's success in delivering high-quality solutions.Contribute to defining and executing the data engineering roadmap, collaborating with other technical … and business leaders to align data initiatives with overall business goals.Possess and maintain a deep understanding of the technical stack, including Scala, Python, SQL, Snowflake, and DBT. Provide technical guidance and expertise to the team when facing complex challenges.Collaborate with data architects and analysts to design more »

Data Engineer Location: London, 3 days per week in the office Salary range: £60,000-£65,000 + benefits Purpose: Design, build, and maintain scalable data architectures, including pipelines and cloud-based data warehouses. Tech: Python (NumPy, Pandas), SQL, ETL, Cloud (AWS, Azure or … consultancy who solely specialise in the Maritime trading industry. You will work onsite with 1 specific client to design, build and maintain scalable data architectures working with key stakeholders in their business to shape their data-driven strategies. The Company: They have a long history providing … ETL Processes: Deep expertise in developing and optimising ETL pipelines. Version Control: Experience with Git for code collaboration and change tracking. Data Pipeline Tools: Proficiency with tools such as Apache Airflow. Cloud Platforms: Familiarity with AWS, Azure, Snowflake, and GCP. Visualisation: Tableau or PowerBI Delivery Tools: Familiarity more »

We Want We are looking for a Staff Backend Engineer to join our Insights Back-End team to help build out data pipeline, data store and API layer of Bazaarvoice data that will power our various client-facing dashboards, raw data reporting, product performance reporting. The ideal candidate has built and operated systems that aggregate and share data sets to support new product offerings and is well experienced in evaluating the right technologies to build those data sets. Success in the role is underpinned by … a strong understanding of the business cases of the product portfolio and building relevant data sets, API layer and access methodologies that support the portfolio goals. What You’ll Be Doing Own, design, implement and support of major components of the unified back end data. Define how data more »

safe, and designed for the future.Our human touch sets us apart from other consultancies, system integrators and software houses - with people, technology, and data at the heart of who we are, we believe in creating value and sustainability through everything we do for our clients, staff, communities, and … public-sector, Methods is now building a significant private sector client portfolio.Methods was acquired by the Alten Group in early 2022.As a Lead Data Engineer at Methods you will be expected to get involved with projects from conception to delivery - leading and supervising other engineers to meet requirements … and deliver quality data products. On a day-to-day basis, you will own best practice for data management and data engineering - providing support to other members of the team and raising awareness across the organisation for data issues and solutions.When contributing more »

Lead Data Engineer - Snowflake/DBT/Python - ecommerce - £95k Leading eCommerce client are now searching for a Lead Data Engineer to play a pivotal role in delivering their innovative data strategy. This role will shape our client’s data function, delivering … end to end data requirements and designing data pipelines/warehouses to ensure data is streamlined and enhances overall business success. The role: Design, develop and test an array of data migration processes to streamline the conversation from existing system to a … new Snowflake infrastructure. Manage the end-to-end data lifecycle, enabling the use of data to influence overall business decisions. Streamline our client’s data processes to ensure that customer journeys are personalised. Ensure the accuracy and reliability of data. Collaborate on business projects more »

knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. … Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data more »

A Data Engineer is sought to drive impactful data initiatives within a high performing organisation. The Data Engineer will spearhead data strategies and foster innovation across the operations. The organisation is a premier provider of essential products and services across Europe, dedicated … to improving quality and reliability in the sector. In this role, the data engineer will be pivotal in designing and executing solutions for the entire data lifecycle, including data acquisition, storage, modeling, transfer, hosting, visualisation, analysis, and consumption. The Data Engineer will … also be responsible for guiding and developing the skills of team members. Key Responsibilities: Architect and implement comprehensive data pipelines for efficient data acquisition, storage, processing, and interface creation. Generate both machine-readable interfaces and user-friendly data products, encompassing standard and custom reports. more »