1 to 25 of 60 Data Pipeline Jobs in London with Remote Work Options

Azure Synapse Data Engineer - £75K - Remote (London) My client a market leading provider grants clients access to bespoke data insights and analytics specific to their needs, providing research, data and expertise to support clients and all lines of business (Advisory, Digital, Search). They … and loading of data from a wide variety of data sources using Azure Synapse tools and technologies. Data pipeline development/testing. Test the reliability and performance of each part of a system during the development phase. Identify, design, and implement process improvements … automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability and data quality. Track pipeline stability. Monitor the overall performance and stability of the system and ensure automated parts/scheduled tasks are monitored. Manage structured and unstructured data and more »

Algolia is looking for a Senior Manager to lead a team of Analytics Engineers, who work at the intersection of Business Teams, Data Analytics, and Data Engineering. You will be responsible for bringing robust, efficient, and integrated data models and analytical reports to life. … Our Analytics Engineers speak the language of business teams and technical teams, they are able to translate data insights and analysis needs into models powered by Algolia’s Data Platform. You will work closely together with the Senior Manager, Data Engineering Team who have … a particular focus on data movement and orchestration. This with an analytical and business-oriented mindset with the ability to implement rigorous database solutions and best practices in order to produce and influence the adoption of strong quality data insights to drive business decisions in all more »

This is an exciting opportunity to join one of Europe's fastest growing health-tech startups, working in a Data team that has made huge steps in moving our innovative platform forwards This role is Hybrid but only requires 1-2 days a month in our London office … the UK leader in revolutionising affordable care for the better, for our service users and society and the perfect coordination across care practice, data, science and technology is how we’ll get there. About Data at Cera Data has a critical role to play … in two distinct areas. First, data about our operations, covering everything from hiring and retaining carers to the delivery of care, helps us to observe and understand how we are performing, what is working and what we could do to better deliver care. Second, data about more »

Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Finance Analytics technology team, tasked with developing, managing, and optimizing data pipelines within our data ecosystem. The Data Engineer will leverage cutting-edge technology in Snowflake, Python, Informatica, and Azure to improve our data capabilities and support our Finance business partners in their decision-making processes. Key responsibilities include: Design, build, and maintain efficient, reliable data pipelines … use within our subsidized onsite canteen Must have skills Experience as a Data Engineer, with a solid background in data pipeline construction and data architecture using Snowflake, Python, and Informatica Familiarity with Azure and other cloud-native technologies Understanding of finance industry data more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … to provide great customer service and grow through the provision of superior data services As a Technical Lead for our Data Team, you will play a critical role in shaping our data strategy, driving technical excellence, and ensuring the successful delivery of data more »

unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not … science, and engineering discipline. Experience performing data warehouse architecture development and management. Remarkable experience with Development and maintenance of data pipeline and ETL processes using Azure data Factory, Azure Data Lake and Azure Databricks. Exceptional experience developing codes, testing for quality more »

be a developer in the Client Reporting Product Team within Distribution Technology. The Client Reporting Product team partners with Marketing, Reporting Operations and Data Management teams in Technology to build data integration solutions for the automation of a wide variety and high volume of reports. This … software development skills and can pick up new technologies and assist in all aspects of the team’s work such as development using data warehouse and master data vendor platform tools. You will not only need excellent problem-solving skills, but you should also be able … to see the strategic impacts of any cross-team dependencies and escalate where necessary. You will require strong teamwork skills. The distribution data space is in a transition period. Significant data assets are located in on-premise hardware and software, such as Oracle, Informatica, Autosys, and more »

Role Overview The successful candidate will set and execute the data engineering roadmap for International systems to align with the goals of the Lyra global data strategy and Lyra International Technology roadmap. You will be responsible for running a small data engineering team, planning … team members’ workloads and utilising your experience to guide the team to solutions to complex problems. You will be responsible for ensuring that data shared across borders, whether to our parent company, subsidiaries, or approved third parties, observes expected safeguards, technical controls, and minimization techniques to comply with … Manage, scale, and mentor team of data engineers Work with stakeholders on priorities and roadmap for data analytics, customer pipelines, data models, and data infrastructure Design and develop new data flows and integrations to support the international migration to a more »

Role: Mid-Level Data Engineer Business Area: Engineering/Technology Reporting to: Head of Data Location: Hybrid/Remote About Validis Validis is a dynamic fintech company with a leading software platform, built for the extraction and standardisation of accounting data. Validis is both a B2B … and SasS with operations across the UK, US & Australia. We specialize in providing quality data for both audits and financial services, with the guarantee that our product will streamline processes for the financial industry. Our current client base holds a number of blue- chip companies, mainly comprising audit … implementing CI/CD workflows for data engineering projects. Proven ability to leverage CI/CD tools to streamline data pipeline development and deployment. Experience designing and implementing ETL pipelines using tools like Apache Airflow, Luigi, Spark, or similar frameworks (familiarity is a plus). more »

x1 day a week in the office (Thursday)Salary 90,000 - 95,000 per annumAbout the roleWhich? is currently seeking an exceptional Lead Data Engineer to take the helm in driving our innovative data strategy forward. In this role, you'll be at the forefront of … crafting and executing our data vision, operating within a dynamic Greenfield environment. The successful candidate will have the unique opportunity to form a diverse, talented team, while also spearheading the development of our data function from inception to fruition across various projects.Our forthcoming data … experience designing and implementing scalable data models for both relational and NoSQL databases.Strong Python skills with a focus on data pipeline development and automation of data-related tasks.Extensive experience designing, building, optimising, and monitoring complex ELT pipelines, ensuring data quality and more »

Role: Senior Data Engineer Business Area: Engineering/Technology Reporting to: Head of Data Location: Hybrid/Remote About Validis Validis is a dynamic fintech company with a leading software platform, built for the extraction and standardisation of accounting data. Validis is both a B2B and … SasS with operations across the UK, US & Australia. We specialize in providing quality data for both audits and financial services, with the guarantee that our product will streamline processes for the financial industry. Our current client base holds a number of blue- chip companies, mainly comprising audit firms … implementing CI/CD workflows for data engineering projects. Proven ability to leverage CI/CD tools to streamline data pipeline development and deployment. Proven expertise in designing and implementing ETL pipelines using tools like Apache Airflow, Luigi, Spark, or similar frameworks. Strong understanding of more »

and annual plan for delivering this is available on our website. Our new team are embarking on a piece of work to monitor data to identify and respond to patterns indicative of potential fraud. This will support our current work that reduces the likelihood of fraud occurring. We … will bring in data science capabilities to be deployed in counter fraud activity and work closely with partners across health and government to further maximise the preventative impact of proactive counter fraud analysis. We will combine this with our range of counter fraud and domain expertise to maximise … Utilise expertise in data management, analytics and stakeholder engagement and management to facilitate and secure datasets and/or data pipeline partnerships across the NHS. Actively work with project managers, functions and workstreams to define detailed and problem centric data requirements for delivery more »

Job Role: Principal Data Engineer Job Type: Contract IR35 : Inside IR35 Day Rate: £600/Day Contract Duration: 6 months Working Hours: 5 days per week Remote Working : 4 days remote working. 1 day on-site in London Location: Hybrid Remote/London (UK only) Reference : BH-299c … Role Overview: We are seeking an experienced Principal Data Engineer to join our client's team. You will lead the Data Engineering Acceleration initiative, designing, building, and transitioning a robust data management system that optimises data lifecycle management. Key Responsibilities: A cross … discipline professional who can collaborate with multiple teams, such as DataOps, Data Analytics, Software Development teams, to design solutions with them Provide expert advice and support in designing efficient processes for data discovery, profiling, quality, encryption, and pipelines. Document compliance, security, and data sovereignty more »

Senior Data Engineer Salary Negotiable to £70,000 DoE Hybrid working with 2 days in London Job Reference J12785 Work with an award-winning independent protection adviser. Develop the data engineering capabilities. Data is a key enabler for the business and developing enterprise grade … data engineering services is a central pillar in the digital transformation program. The data pipelines and models that you will develop will underpin all Business Intelligence, Machine Learning and CRM capabilities. The role holder must ensure that the data is well-managed and ready … for consumption by the business, which will require the integration of multiple data sources (both cloud and on-prem) and developing data transformations pipelines in an Azure Synapse environment. The role will be aligned to a specific area of the business e.g. the digital teams or more »

Data & Analytics Permanent - Full Time London, GB, W1A 1AA BBC PUBLIC SERVICE B'CAST Job Closing Date: 02/05/2024 THE ROLE Job Band Package description Band: D Contract Permanent Salary : £65,000 to £85,000 depending on level of experience Location: London Our comprehensive benefits … that the BBC online becomes a valued daily habit for all audiences just as television and radio have been over the last century. Data is fundamental to our future: both in helping us prioritise and shape our work and in creating richer, more personalised experiences for our audiences. … we’ve got one of the widest, most diverse, and most exciting datasets to work within the UK. The role responsibilities The Principal Data Engineer is a new role that will support the newly created Product Data Domain teams. You will help to build ETL pipelines more »

timeline. The ability to hit the deck running and make valuable contributions quickly will be critical.0-12 months you’ll deliverSupport Head of Data Engineering and contribute to establish/enforce best practices, coding standards, and development methodologies for the data engineering team. Drive continuous improvement … in data engineering processes to enhance efficiency, reliability and scalability.Manage a team of skilled data engineers, providing guidance, mentorship, and support to ensure the team's success in delivering high-quality solutions.Contribute to defining and executing the data engineering roadmap, collaborating with other technical … and business leaders to align data initiatives with overall business goals.Possess and maintain a deep understanding of the technical stack, including Scala, Python, SQL, Snowflake, and DBT. Provide technical guidance and expertise to the team when facing complex challenges.Collaborate with data architects and analysts to design more »

safe, and designed for the future.Our human touch sets us apart from other consultancies, system integrators and software houses - with people, technology, and data at the heart of who we are, we believe in creating value and sustainability through everything we do for our clients, staff, communities, and … public-sector, Methods is now building a significant private sector client portfolio.Methods was acquired by the Alten Group in early 2022.As a Lead Data Engineer at Methods you will be expected to get involved with projects from conception to delivery - leading and supervising other engineers to meet requirements … and deliver quality data products. On a day-to-day basis, you will own best practice for data management and data engineering - providing support to other members of the team and raising awareness across the organisation for data issues and solutions.When contributing more »

knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. … Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data more »

Data Engineer London - Hybrid working £55,000 - £60,000 A global leading HR staffing organisation based in London is currently looking to recruit a Data Engineer who will play a crucial role in designing, developing, and maintaining the data infrastructure that powers innovative solutions … within the client. We require an engineer who has a passion for data and has a good background in Azure, synapse, Databricks, SQL, Python and DataOps. This is a fantastic opportunity for a Data Engineer to gain exposure to different business areas from Visualisation, Machine Learning … Alongside this my client is going to be going through a cloud migration to Azure. Responsibilities : Collaborate with cross-functional teams to understand data requirements and design efficient data pipelines. Develop and maintain scalable data models and databases. Design and implement data more »

Data Engineer required for a 6 month initial contract with a leading commodities trading firm. Outside of IR35 Hybrid working - 2/3 days in London office Experience Required: - Commodities industry … experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »

Senior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great … opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely … Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as needed. Modern tech stack - Python, AWS more »

Lead Data Engineer. What’s it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. As the … Lead Data Engineer you will also oversee the quality, performance, and security of the data integration solutions. How you’ll make a difference? By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data … that improve the services the client provides for their customers. How you’ll do it? Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

Lead Data Engineer. What's it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. The Lead … Data Engineer will also oversee the quality, performance, and security of the data integration solutions. How you'll make a difference By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data-driven … that improve the services the client provides for their customers. How you'll do it Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data more »

Job Title: Data Engineer Job Type: Full Time, Permanent Working location: London, Hybrid Role Purpose At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. Our data architecture is becoming more service-oriented and … for you to solve. Our work is fast-paced although our team remains collaborative and flexible even when delivering fast. Your role as data engineer has a wide remit: working with product owners, subject matter experts and managers across the company, to design and deliver new components of … to the traditional data engineering type! Significant hands-on experience with AWS, especially AWS services focused on data flow, pipelines, data transformation, storage and streaming. Excellent data engineering skills, for example with SQL, Python, DBT and Airflow. Good understanding of service-oriented more »