1 to 25 of 110 Data Pipeline Jobs in London with Remote Work Options

seizing energy investment opportunities. Job Summary The job holder will be responsible for expanding and optimising our data and data pipeline architecture, as well as optimising data flow and collection for cross functional teams. The Data Engineer will support our software … developers, database architects, and Trading teams with data initiatives that will ensure optimal data delivery architecture is consistent throughout ongoing projects. This role requires the jobholder to be self-directed and comfortable supporting the data needs of multiple teams, systems and products. They will … architecture to support our next generation of products and data initiatives. Key Responsibilities: Create and maintain optimal data pipeline architecture Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key more »

seizing energy investment opportunities. Job Summary The job holder will be responsible for expanding and optimising our data and data pipeline architecture, as well as optimising data flow and collection for cross functional teams. The Data Engineer will support our software … developers, database architects, and Trading teams with data initiatives that will ensure optimal data delivery architecture is consistent throughout ongoing projects. This role requires the jobholder to be self-directed and comfortable supporting the data needs of multiple teams, systems and products. They will … architecture to support our next generation of products and data initiatives. Key Responsibilities: Create and maintain optimal data pipeline architecture Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key more »

Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look … to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so … lifecycle design, data ontology alignment, annotated datasets, and elastic search approaches Developing, creating and maintaining a reliable data pipeline and schemas that feed other data processes; includes both technical processes and business logic to transform data from disparate sources more »

Azure Synapse Data Engineer - £75K - Remote (London) My client a market leading provider grants clients access to bespoke data insights and analytics specific to their needs, providing research, data and expertise to support clients and all lines of business (Advisory, Digital, Search). They … and loading of data from a wide variety of data sources using Azure Synapse tools and technologies. Data pipeline development/testing. Test the reliability and performance of each part of a system during the development phase. Identify, design, and implement process improvements … automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability and data quality. Track pipeline stability. Monitor the overall performance and stability of the system and ensure automated parts/scheduled tasks are monitored. Manage structured and unstructured data and more »

Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Investments Data, Technology team, tasked with developing, managing, and optimizing data pipelines within … our data ecosystem. Reporting to the Investments Data Lead, this role is instrumental in implementing the data strategy that supports front office stakeholders, systems, and clients. The Data Engineer will leverage cutting-edge technology in Snowflake, Python, SQL, and Azure to enhance … within our subsidized onsite canteen Must have skills Proven experience as a Data Engineer, with a strong background in data pipeline construction, data architecture, and data warehousing. Expertise in Snowflake, Python, SQL, and cloud-native ETL/ELT tools. Familiarity with more »

Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Investments Data, Technology team, tasked with developing, managing, and optimizing data pipelines within … our data ecosystem. Reporting to the Investments Data Lead, this role is instrumental in implementing the data strategy that supports front office stakeholders, systems, and clients. The Data Engineer will leverage cutting-edge technology in Snowflake, Python, SQL, and Azure to enhance … within our subsidized onsite canteen Must have skills Proven experience as a Data Engineer, with a strong background in data pipeline construction, data architecture, and data warehousing. Expertise in Snowflake, Python, SQL, and cloud-native ETL/ELT tools. Familiarity with more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … to provide great customer service and grow through the provision of superior data services As a Technical Lead for our Data Team, you will play a critical role in shaping our data strategy, driving technical excellence, and ensuring the successful delivery of data more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … to provide great customer service and grow through the provision of superior data services As a Technical Lead for our Data Team, you will play a critical role in shaping our data strategy, driving technical excellence, and ensuring the successful delivery of data more »

unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not … science, and engineering discipline. Experience performing data warehouse architecture development and management. Remarkable experience with Development and maintenance of data pipeline and ETL processes using Azure data Factory, Azure Data Lake and Azure Databricks. Exceptional experience developing codes, testing for quality more »

unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not … science, and engineering discipline. Experience performing data warehouse architecture development and management. Remarkable experience with Development and maintenance of data pipeline and ETL processes using Azure data Factory, Azure Data Lake and Azure Databricks. Exceptional experience developing codes, testing for quality more »

be a developer in the Client Reporting Product Team within Distribution Technology. The Client Reporting Product team partners with Marketing, Reporting Operations and Data Management teams in Technology to build data integration solutions for the automation of a wide variety and high volume of reports. This … software development skills and can pick up new technologies and assist in all aspects of the team’s work such as development using data warehouse and master data vendor platform tools. You will not only need excellent problem-solving skills, but you should also be able … to see the strategic impacts of any cross-team dependencies and escalate where necessary. You will require strong teamwork skills. The distribution data space is in a transition period. Significant data assets are located in on-premise hardware and software, such as Oracle, Informatica, Autosys, and more »

be a developer in the Client Reporting Product Team within Distribution Technology. The Client Reporting Product team partners with Marketing, Reporting Operations and Data Management teams in Technology to build data integration solutions for the automation of a wide variety and high volume of reports. This … software development skills and can pick up new technologies and assist in all aspects of the team’s work such as development using data warehouse and master data vendor platform tools. You will not only need excellent problem-solving skills, but you should also be able … to see the strategic impacts of any cross-team dependencies and escalate where necessary. You will require strong teamwork skills. The distribution data space is in a transition period. Significant data assets are located in on-premise hardware and software, such as Oracle, Informatica, Autosys, and more »

Role Overview The successful candidate will set and execute the data engineering roadmap for International systems to align with the goals of the Lyra global data strategy and Lyra International Technology roadmap. You will be responsible for running a small data engineering team, planning … team members’ workloads and utilising your experience to guide the team to solutions to complex problems. You will be responsible for ensuring that data shared across borders, whether to our parent company, subsidiaries, or approved third parties, observes expected safeguards, technical controls, and minimization techniques to comply with … Manage, scale, and mentor team of data engineers Work with stakeholders on priorities and roadmap for data analytics, customer pipelines, data models, and data infrastructure Design and develop new data flows and integrations to support the international migration to a more »

Role Overview The successful candidate will set and execute the data engineering roadmap for International systems to align with the goals of the Lyra global data strategy and Lyra International Technology roadmap. You will be responsible for running a small data engineering team, planning … team members’ workloads and utilising your experience to guide the team to solutions to complex problems. You will be responsible for ensuring that data shared across borders, whether to our parent company, subsidiaries, or approved third parties, observes expected safeguards, technical controls, and minimization techniques to comply with … Manage, scale, and mentor team of data engineers Work with stakeholders on priorities and roadmap for data analytics, customer pipelines, data models, and data infrastructure Design and develop new data flows and integrations to support the international migration to a more »

Role: Mid-Level Data Engineer Business Area: Engineering/Technology Reporting to: Head of Data Location: Hybrid/Remote About Validis Validis is a dynamic fintech company with a leading software platform, built for the extraction and standardisation of accounting data. Validis is both a B2B … and SasS with operations across the UK, US & Australia. We specialize in providing quality data for both audits and financial services, with the guarantee that our product will streamline processes for the financial industry. Our current client base holds a number of blue- chip companies, mainly comprising audit … implementing CI/CD workflows for data engineering projects. Proven ability to leverage CI/CD tools to streamline data pipeline development and deployment. Experience designing and implementing ETL pipelines using tools like Apache Airflow, Luigi, Spark, or similar frameworks (familiarity is a plus). more »

Role: Mid-Level Data Engineer Business Area: Engineering/Technology Reporting to: Head of Data Location: Hybrid/Remote About Validis Validis is a dynamic fintech company with a leading software platform, built for the extraction and standardisation of accounting data. Validis is both a B2B … and SasS with operations across the UK, US & Australia. We specialize in providing quality data for both audits and financial services, with the guarantee that our product will streamline processes for the financial industry. Our current client base holds a number of blue- chip companies, mainly comprising audit … implementing CI/CD workflows for data engineering projects. Proven ability to leverage CI/CD tools to streamline data pipeline development and deployment. Experience designing and implementing ETL pipelines using tools like Apache Airflow, Luigi, Spark, or similar frameworks (familiarity is a plus). more »

Job Responsibilities The Data Analytics Tester works closely with business stakeholders and the technology team to review and test Business Intelligence (BI) solutions firmwide including but not limited to validating the quality accuracy, reliability, compliance and performance of reports, dashboards, data pipelines, and general data analysis solutions. Develop and execute comprehensive test scenarios for BI reports and dashboards. Ensure data accuracy, security and compliance around legal performance metrics are accurately presented on BI reports and dashboards. Verify, validate, and analyse accuracy of data models used in reports to ensure … data synchronization and consistency across different platforms. Review data specifications and requirements with data analytics developers, business analysts and enterprise architects, and develop test plans, test cases, and test scripts. Perform functional, regression, integration and performance testing of reports, dashboards and data more »

Senior Data Engineer About us HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning. … Our team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and … best of open-source data engineering and scientific Python toolset. Our tech stack includes Airbyte for data ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data more »

Role: Senior Data Engineer Business Area: Engineering/Technology Reporting to: Head of Data Location: Hybrid/Remote About Validis Validis is a dynamic fintech company with a leading software platform, built for the extraction and standardisation of accounting data. Validis is both a B2B and … SasS with operations across the UK, US & Australia. We specialize in providing quality data for both audits and financial services, with the guarantee that our product will streamline processes for the financial industry. Our current client base holds a number of blue- chip companies, mainly comprising audit firms … implementing CI/CD workflows for data engineering projects. Proven ability to leverage CI/CD tools to streamline data pipeline development and deployment. Proven expertise in designing and implementing ETL pipelines using tools like Apache Airflow, Luigi, Spark, or similar frameworks. Strong understanding of more »

Role: Senior Data Engineer Business Area: Engineering/Technology Reporting to: Head of Data Location: Hybrid/Remote About Validis Validis is a dynamic fintech company with a leading software platform, built for the extraction and standardisation of accounting data. Validis is both a B2B and … SasS with operations across the UK, US & Australia. We specialize in providing quality data for both audits and financial services, with the guarantee that our product will streamline processes for the financial industry. Our current client base holds a number of blue- chip companies, mainly comprising audit firms … implementing CI/CD workflows for data engineering projects. Proven ability to leverage CI/CD tools to streamline data pipeline development and deployment. Proven expertise in designing and implementing ETL pipelines using tools like Apache Airflow, Luigi, Spark, or similar frameworks. Strong understanding of more »

and annual plan for delivering this is available on our website. Our new team are embarking on a piece of work to monitor data to identify and respond to patterns indicative of potential fraud. This will support our current work that reduces the likelihood of fraud occurring. We … will bring in data science capabilities to be deployed in counter fraud activity and work closely with partners across health and government to further maximise the preventative impact of proactive counter fraud analysis. We will combine this with our range of counter fraud and domain expertise to maximise … Utilise expertise in data management, analytics and stakeholder engagement and management to facilitate and secure datasets and/or data pipeline partnerships across the NHS. Actively work with project managers, functions and workstreams to define detailed and problem centric data requirements for delivery more »

Job Role: Azure Data Engineer Location: Central London - Hybrid/3 Days in Office Salary: £60,000 - £70,000 + 12.5% Bonus Key areas: SQL Data Engineer, Azure Data Engineer, Azure Data Factory, Azure Databricks, Azure Data Services, Snowflake, SQL … Server, Data, BI, BI Development, MS BI Chapman Tate is collaborating with a leading Housing Association that is revolutionizing the industry through innovative data-driven solutions. As they continue to expand their operations, they are seeking a talented Azure Data Engineer with strong SQL … expertise to join their dynamic team. Are you passionate about leveraging data to drive business insights and enhance operational efficiency? Do you have experience working with Azure data technologies and a knack for SQL development? If so, this is an exciting opportunity to contribute to the more »

Job Role: Azure Data Engineer Location: Central London - Hybrid/3 Days in Office Salary: £60,000 - £70,000 + 12.5% Bonus Key areas: SQL Data Engineer, Azure Data Engineer, Azure Data Factory, Azure Databricks, Azure Data Services, Snowflake, SQL … Server, Data, BI, BI Development, MS BI Chapman Tate is collaborating with a leading Housing Association that is revolutionizing the industry through innovative data-driven solutions. As they continue to expand their operations, they are seeking a talented Azure Data Engineer with strong SQL … expertise to join their dynamic team. Are you passionate about leveraging data to drive business insights and enhance operational efficiency? Do you have experience working with Azure data technologies and a knack for SQL development? If so, this is an exciting opportunity to contribute to the more »

Role: Senior Data Engineer Job Type: Permanent Location: London (Hybrid) Ready to utilize your experience in Data Engineering, Solution designing and Cloud Computing? Are you passionate about Azure Cloud and Python? Are you keen to build your career with a dynamic global IT Consultancy implementing cutting … edge data engineering solutions? Make a meaningful impact as a Senior Data Engineer! Careers at TCS: It means more. TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful … and identify opportunities to support their strategy and improve their processes across functions. access to endless learning opportunities. The Role As a Senior Data Engineer , you will be at the forefront of leveraging Azure cloud services to design, develop, and implement cutting-edge data engineering solutions. more »

Role: Senior Data Engineer Job Type: Permanent Location: London (Hybrid) Ready to utilize your experience in Data Engineering, Solution designing and Cloud Computing? Are you passionate about Azure Cloud and Python? Are you keen to build your career with a dynamic global IT Consultancy implementing cutting … edge data engineering solutions? Make a meaningful impact as a Senior Data Engineer! Careers at TCS: It means more. TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful … and identify opportunities to support their strategy and improve their processes across functions. access to endless learning opportunities. The Role As a Senior Data Engineer , you will be at the forefront of leveraging Azure cloud services to design, develop, and implement cutting-edge data engineering solutions. more »