1 to 25 of 116 Data Pipeline Jobs in England with Remote Work Options

Senior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great … opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely … Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as needed. Modern tech stack - Python, AWS more »

Data Engineer Location: London – Hybrid Employment: Full Time All applicants must hold a DV (Developed Vetting) clearance to apply. The Opportunity: For the Ministry of Defence (MOD), maintaining National Security is a 24-hour-a-day, 365-day-a-year mission. For this reason, it partners with this … Big 4 Firm to support its multidisciplinary AI & Cloud Data Engineering Capabilities. The Role: As an AI & Cloud Data Engineering practitioner, you’ll build large-scale data pipelines and infrastructure, utilising data integration tools to optimise complex data solutions. Collaborating … with high-performing Data Science and ML Engineering teams to drive innovation and insight through AI and Data across the Defence & Security sector. Required Skills/Experience: British Passport Holder with active DV (Developed Vetting Clearance) End-to-end development with data pipelines, ETL more »

Senior Data Engineer Financial Services London (Hybrid) £90K plus bonuses and benefits Harrington Starr has partnered with leading data and analytics firm on the forefront of capital markets innovation as they seek to hire an experienced Data Engineer. Our client extends its services to … global exchange groups, banks, brokers, asset managers, and hedge funds. They are seeking to hire a dynamic and highly motivated data engineer for its London team. This individual should have an entrepreneurial mindset and the adaptability to thrive in an extremely fast paced environment. Within this role, you … will be responsible for building data pipelines for a cloud-based warehouse using Azure and Snowflake, enhancing data capabilities for analytics and science. What you need: 3+ years of hands-on experience as a Data Engineer, building ETL pipelines and managing data more »

are looking for an BI Analyst position for a large business based in Liverpool. The Business Intelligence Analyst is responsible for maintaining the data architecture and data pipelines that support business intelligence systems. This includes ensuring that the data architecture is scalable, secure, and … optimized for performance. They also work closely with other teams to ensure that data is properly integrated and available for analysis. The Business Intelligence Analyst will work closely with the analysts for reporting requirements and ensuring the correct data structure is in place for implementing newly … awarded contracts. The role will be responsible for designing processes and controls to ensure all data presented is tested, and accurate. Good communication skills is crucial for this role as you will need to present key information to managers across the business. It is essential you have strong more »

Node.JS) - would you like the opportunity to work for a EdTech organisation, with almost five decades of unparalleled expertise in their sector? Their data and benchmarking tools are used by many of the world's most prestigious institutions to help them achieve strategic targets. Unlike other tech firms … this organisation provides insightful data to help consumers make important decisions in the educational sector. You should be a competent Full-stack Engineer who enjoys working with React and Node.js, as well as wanting to self-develop. As a Full-stack Engineer, you will be fundamental in the … design and have a chance to build data pipelines to fuel their products. The company has grown significantly in the last few years and are looking for someone who can join in the process of growing their brand, user base and products. This EdTech organisation prides itself in more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

Managers to build, operate and evolve the technical stack; you'll be developing modular systems to tackle a range of challenges such as data pipelines, intraday signal research tools, high frequency trading and back-testing, real-time market data systems, monitoring systems as well as data storage, times series data and event correlation. You'll work across the full development lifecycle, from requirements analysis through to solution delivery; there's lots of problem solving within a fast paced environment. Location/WFH: You'll join a highly talented team in the London … strong knowledge of Linux OS/Systems Administration You have a good understanding of computer architecture, databases, real-time systems, distributed computing, OOP, Data Structures, Design Patterns, Algorithms You're collaborative with excellent English language communication skills You are degree educated, likely to MSc/PhD level - Computer more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

be working with a London-based B2B SaaS startup who are looking to expand the engineering team by bringing in a business-savvy data engineer to be the third member of the data team. The role: This role primarily covers building out the core product by … create a scalable SaaS product. Once this has achieved a certain level of product maturity, this role will also involve building their own data platform. We they offer: • Senior mentorship • Competitive compensation package, incl. stock options • Flexible hours and hybrid working, typically 3 days a week in the … a net-zero CO2 company and donate 1% of their revenues to social impact causes. Requirements: • A proven level of commercial experience in data engineering • Experience at seed to series A/B stage companies or an excitement to experience first-hand the joys and pains the come more »

Job Title: Data Engineer Job Type: Full Time, Permanent Working location: London, Hybrid Role Purpose At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. Our data architecture is becoming more service-oriented and … for you to solve. Our work is fast-paced although our team remains collaborative and flexible even when delivering fast. Your role as data engineer has a wide remit: working with product owners, subject matter experts and managers across the company, to design and deliver new components of … to the traditional data engineering type! Significant hands-on experience with AWS, especially AWS services focused on data flow, pipelines, data transformation, storage and streaming. Excellent data engineering skills, for example with SQL, Python, DBT and Airflow. Good understanding of service-oriented more »

differentiators that puts Omnicom ahead of the competition. Specific responsibilities of the team are listed below: 1. To scope and deliver all Omni Data Ops and Reporting work for Omnicom clients, including: Data Taxonomies design & maintenance Data Governance and QA Dashboard design, build and … maintenance Data Pipelines design & delivery Media Planning Tool Deployment and Maintenance The Data Ops and Reporting team works very closely with the US Marketing Intelligence team and the Annalect India team to deliver scalable solutions at a global level. ROLE SUMMARY: We are looking for a … Data Operations and Reporting Director, who will work on supporting the Head of Marketing Intelligence and Reporting, EMEA in scoping and delivering all team solutions for one or more of Omnicom s clients. KEY RESPONSIBILITIES: Strong oversight across business responsibilities, to the extent that challenges and opportunities are more »

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our … client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data streams to our client's Data Platforms. Shape data from various sources into a transactional ODS for detailed reporting and a Kimball-modelled Data Warehouse for analytics and dashboards. Define and embed data quality measures within data pipelines. more »

Our client, an exciting start-up customer obsessed behavioural agency founded by two huge names in the data space (that have grown teams previously to 400), is looking for a personable and hard-working Junior Data Engineer to design, build, and maintain a variety of solutions … real business results, a stark contrast to the generic approaches often found at larger agencies. Leading with Relationships and Results As a Junior Data Engineer, you'll leverage your knowledge of data warehousing and Google Cloud Platform (GCP) to design and build data pipelines. … You'll combine your technical skills in data modelling and transformation with your expertise in cloud-based data services like BigQuery and Dataflow. What will you be doing? Data Engineering in Google BigQuery: Design, build, test, and deploy data models and transformations more »

Data Engineer required for a 6 month initial contract with a leading commodities trading firm. Outside of IR35 Hybrid working - 2/3 days in London office Experience Required: - Commodities industry … experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »

the strategic DevOps approach of their ML applications, used by thousands of customers a day. This role would see you collaborate with the Data Science team to design and implement scalable infrastructure for machine learning model deployment and data processing. Whilst also deploying machine learning models … and data pipelines to production environments, ensuring robust monitoring and optimal performance. you will also take on th and develop and maintain automation scripts and tools to streamline ML model deployment and ensure reproducible. Implement security best practices and ensure compliance with data privacy regulations in … all processes. Whilst working with cross-functional with Data Scientists, Software Engineers, and DevOps team members for efficient model development, testing, and deployment. The successful DevOps/MLOps engineer will have the following skills: 1+ years working as a DevOps Engineer Proven experience in DevOps/MLOps with more »

The role: In this role, you will play a lead role in the conception, planning, and execution of Brompton Bicycle's data infrastructure. You will be working directly with diverse data sets from multiple systems, orchestrating their seamless integration and optimisation to enable our business to … derive valuable insights. This process will encompass everything from the raw development of data pipelines to the management and optimisation of these pipelines using all tools available in the Azure Cloud. A significant aspect of your role will be the migration of our existing on-premises databases to … Cloud, a complex project requiring a deep understanding of cloud architecture and database management, as well as change management, ensuring the continuation of data as a product to your stakeholders through a smooth data infrastructure transition As a vital part of our team, you will collaborate more »

SIEM environment, utilizing OpenSearch. The SIEM Onboarding Engineer will work closely with business units to identify devices for onboarding, manage the data pipeline, and assist other engineers in configuring their data sources to provide a resilient pipeline.The SIEM Onboarding Engineer will approach each system to … to identify devices and data sources that need to be onboarded to our SIEM (OpenSearch with Security Analytics). Data Pipeline Management: Configure and manage data collection agents to ensure data is reliably ingested into the SIEM. Automation: Leverage automation scripts … with security engineers and other stakeholders to ensure seamless integration and optimal performance of the SIEM. Monitoring and Troubleshooting: Monitor the data pipeline for issues, troubleshoot problems, and implement fixes to maintain data integrity and system reliability. Documentation: Maintain comprehensive documentation on the onboarding processes more »

contributions are valued. We offer world class learning and career development opportunities, while we celebrate an inclusive culture. The role As a Lead Data Scientist (NLP & GenAI) at Allianz Commercial, you will work closely with our team of data scientists, data engineers, ML engineers … their strategic objectives. Research, design, and develop solutions using NLP models and algorithms to extract insights from unstructured text data. Collaborate closely with data engineers to pre-process and clean text data, ensuring data quality and compatibility with NLP models. Apply machine learning and … utilize LLMs, such as GPT, BERT or open source foundational LLM's (Llama2), for natural language understanding and generation tasks. Conduct thorough exploratory data analysis to gain insights into text data characteristics and develop effective pre-processing strategies. Collaborate with data engineers and MLops more »

experience in: In-depth understanding of design patterns and software engineering best practices Experience in different levels of architecture design e.g., software, application, data Proven ability in providing technical leadership in an agile environment. Previous experience in full stack development. This may be in any language, although JavaScript … Glue, Athena, CloudFront, AppStream. Knowledge of building data pipelines (ETL and/or analytical pipelines) and understanding of the design of ETL Pipeline development experience in AWS Excellent communication skills, both written and verbal, to effectively convey technical concepts to team members and stakeholders. Key Responsibilities: Produce more »

designing and building In the Macro Quant Engineering group , you will work directly with Portfolio Management, Traders, Quant Researchers, High Performance Software and Data Engineering teams. Your work will be varied and include - Develop Software solutions for Quant Research and Trading communities Automated Research workflows to support idea … generation and strategy development Design and build Backtesting solutions Build Data Pipelines for collection of new Alternate datasets Design and Build Market Data APIs Design and build bespoke Analytics and Risk tools Implementation of new Trading Strategies into Production Skills and Academics required Minimum 3 years … Mathematics/Probability, et al., and Software Development/Computer Science. Expert Python (inc. Pandas, NumPy, SciPy, et al) Excellent understanding of Advanced Data Structures and Algorithms Experience of AWS, GCP or Azure Experience of high performance languages such as C++, C#, (JVM based) is beneficial more »

unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not … science, and engineering discipline. Experience performing data warehouse architecture development and management. Remarkable experience with Development and maintenance of data pipeline and ETL processes using Azure data Factory, Azure Data Lake and Azure Databricks. Exceptional experience developing codes, testing for quality more »

UK (Hybrid: Flexible working arrangements) Salary: Up to £90,000 per annum Are you a seasoned IT professional with expertise in Cyber Security, Data Compliance (GDPR), Data Engineering, Data Warehousing, and Cloud Engineering (AWS)? We have an exciting opportunity for an IT Director to … of IT initiatives alongside our CTO, aligned with business goals. Cyber Security measures, ensuring the protection of our systems and data. compliance with data regulations, particularly GDPR, and … implement best practices for data governance. data engineering projects, including data modeling, ETL processes, and data pipeline development. data warehousing solutions, optimizing for performance, scalability, and reliability. Cloud Engineering efforts, leveraging AWS services for infrastructure and application needs. and more »

Job Title: Cloud Data Engineer Location: Northampton,UK Hybrid work: 2-3 days a week Capgemini is seeking a Cloud Data Engineer t o join Capgemini Financial Services I&D Practice. This is a permanent, full-time position in Northampton, UK and this represents a unique … opportunity for someone to enhance their I&D Consulting career. What you’ll do and bring: Proficiency in AWS services relevant to data engineering such as S3, Glue, EMR, Athena, and Lambda. Hands-on experience with Snowflake, Redshift cloud data warehousing solutions. Familiarity with DBT (Data … Glue, Starburst, Snowflake, Redshift, Starburst, Hybrid(on-prem to cloud) for building data pipelines and ETL processes. Experience with data pipeline orchestration tools like Apache Airflow . Knowledge of SQL and ability to write complex queries for data transformation and analysis. Understanding of more »

Job Title: Cloud Data Engineer Location: Knutsford, UK Hybrid work: 2-3 days a week Capgemini is seeking a Cloud Data Engineer t o join Capgemini Financial Services I&D Practice. This is a permanent, full-time position in Knutsford, UK and this represents a unique … opportunity for someone to enhance their I&D Consulting career. What you’ll do and bring: Proficiency in AWS services relevant to data engineering such as S3, Glue, EMR, Athena, and Lambda. Hands-on experience with Snowflake, Redshift cloud data warehousing solutions. Familiarity with DBT (Data … Glue, Starburst, Snowflake, Redshift, Starburst, Hybrid(on-prem to cloud) for building data pipelines and ETL processes. Experience with data pipeline orchestration tools like Apache Airflow . Knowledge of SQL and ability to write complex queries for data transformation and analysis. Understanding of more »

Senior Data Engineer Location: Hybrid, with 2 days per month to be onsite (Abingdon) We have the pleasure to be representing a business that is on a mission to increase the number of people who can live longer, healthier lives and reduce unnecessary medical costs while doing so. … To help with the success of this strategy They are recruiting for a Senior Data Engineer that will take a pivotal role in driving the Data team forward. Responsibilities: Lead Cloud Data Warehouse Project : Take charge of leading the Cloud data warehouse … project through its next phase of development, ensuring its scalability, reliability, and performance meet the highest standards. Ownership of Data Management : Assume ownership of all aspects of data management, serving as the go-to person for any data queries from the internal team. Your more »