1 to 25 of 311 Permanent Data Pipeline Jobs in England

Key Responsibilities As a Data Architect, you will support the clients in their journey to become data-driven, by capturing and understanding their business needs, and defining and implementing Data and Analytics reference architectures, solutions and roadmaps. Furthermore, you will actively help our practice … in its objective to stay a Leader in Data & Analytics. • Define, guide and advise clients in developing data strategies • Engage with the clients to understand their business needs, pain points and realities • Gather, challenge and prioritize clients data requirements • Define and design innovative Data … architectures and solutions that leverage the right trade-off between clients realities, latest and disruptive technologies, current and future business needs, budget constraints, data availability and resource requirements. • Oversee the design of the data architecture and the technical architecture for the old-fashion and modern data more »

Job summary This is an exciting opportunity to join Humber and North Yorkshire Integrated Care Board as a Lead Data Engineer. In this role, you'll utilise your expertise to provide a range of data engineering, modelling and evaluation support to ICB and ICS data … the organisations values, the responsibilities of the job description and person specification. The ideal candidate will have an awareness of a range of data engineering techniques, methods and a sound knowledge of health care data and the business of health. The Lead Data Engineer … will identify opportunities on available technology (Microsoft Fabric and associated technology), reuse of existing data flows, lead the development of the ICBs data warehouse, optimise code to ensure processes perform optimally and take the lead in management and creation of data views and models more »

seizing energy investment opportunities. Job Summary The job holder will be responsible for expanding and optimising our data and data pipeline architecture, as well as optimising data flow and collection for cross functional teams. The Data Engineer will support our software … developers, database architects, and Trading teams with data initiatives that will ensure optimal data delivery architecture is consistent throughout ongoing projects. This role requires the jobholder to be self-directed and comfortable supporting the data needs of multiple teams, systems and products. They will … architecture to support our next generation of products and data initiatives. Key Responsibilities: Create and maintain optimal data pipeline architecture Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key more »

Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look … to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so … lifecycle design, data ontology alignment, annotated datasets, and elastic search approaches Developing, creating and maintaining a reliable data pipeline and schemas that feed other data processes; includes both technical processes and business logic to transform data from disparate sources more »

Azure Synapse Data Engineer - £75K - Remote (London) My client a market leading provider grants clients access to bespoke data insights and analytics specific to their needs, providing research, data and expertise to support clients and all lines of business (Advisory, Digital, Search). They … and loading of data from a wide variety of data sources using Azure Synapse tools and technologies. Data pipeline development/testing. Test the reliability and performance of each part of a system during the development phase. Identify, design, and implement process improvements … automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability and data quality. Track pipeline stability. Monitor the overall performance and stability of the system and ensure automated parts/scheduled tasks are monitored. Manage structured and unstructured data and more »

Senior Data Engineer Location: London, UK Duration: 9 months Role/Position Overview As a Senior Data Engineer, you will lead the team’s thinking when it comes to building, deploying, and hosting data engineering pipelines and solutions in production. You will be responsible … for designing and implementing scalable data pipelines, managing data infrastructure, and tooling, and working closely with stakeholders to deliver quality solutions. This role will be a key contributor to the ongoing development of our data architecture and data governance capabilities. We want … to minimize manual processes and strong software engineering proficiency in this role is key. Key Responsibilities: - Design and implement scalable data pipelines that extract, transform and load data from various sources into the data lakehouse. - Help teams push the boundaries of analytical insights, creating more »

experience we're looking for, please go ahead and apply. We'd love to hear from you! About the role As the Senior Data Management Analyst, you will be responsible for continuous evolution of the data quality life cycle practices. This includes defining and proposing data … and their current levels under each dimension. You will take a leading role in supporting the organisation in improving the quality of its data by acquiring data to be brought under governance and perform data profiling analysis to understand it's origination, definition, lineage … into wider data management subjects e.g. Data Quality Insight, Data Quality Management, Data Quality in the pipeline, Master Data Management etc. Design, implement & maintain data quality technology Partner with key project initiatives and act as escalation point more »

Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Investments Data, Technology team, tasked with developing, managing, and optimizing data pipelines within … our data ecosystem. Reporting to the Investments Data Lead, this role is instrumental in implementing the data strategy that supports front office stakeholders, systems, and clients. The Data Engineer will leverage cutting-edge technology in Snowflake, Python, SQL, and Azure to enhance … within our subsidized onsite canteen Must have skills Proven experience as a Data Engineer, with a strong background in data pipeline construction, data architecture, and data warehousing. Expertise in Snowflake, Python, SQL, and cloud-native ETL/ELT tools. Familiarity with more »

promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. The Role The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data analytics tool. You are the first … schedules so that pipelines run effectively. up and maintaining health checks on different data pipelines Triage, and debug the data pipeline when broken. code and writing code changes and/or modifying the monitoring set-up and understanding how to navigate the data … providers when data is incorrect or not received on time. outages with the end users of a data pipeline What We Value reading and writing code in Python, Pyspark and Java. understanding of Spark and interested in learning the basics of tuning Spark more »

Your new company You will be working for a welcoming and engaging organisation which is currently going through a comprehensive data transformation programme, designed to establish a robust approach to modernising the use and management of all data, to inform decision-making and support regulatory activity. … Your new role As a data engineer, you will help build and maintain the data infrastructure and systems that collect, manage and transform raw data for onward use by data analysts and data scientists. You will implement efficient data … of database design and development, data management and systems integration Knowledge of automation testing as part of a data engineering pipeline Knowledge of software development approaches, disciplines and best practice Awareness of how data is used by Analysts, Data Scientists and more »

the uptake and success of electric vehicles with GRIDSERVE Car Leasing. Everything we do is underpinned and connected by a technology-agnostic, proprietary data platform that grows and improves every day. Get in touch ROLE OVERVIEW Join GRIDSERVE as the Head of Data. This will be a critical … member of our leadership team, responsible for establishing and driving the data vision and strategy across the company. This role involves harnessing the power of data to optimize our operations, enhance decision-making, and unlock innovative solutions in the renewable energy space. You will lead our … journey towards becoming a data-mature organisation, building a team to leverage data for operational excellence, strategic insights, and market innovations.You will be able to communicate complex data concepts in simple business language, cutting out the jargon and getting to the point of what more »

Are you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future! With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that transcend … surpassing expectations drives them to explore every avenue for growth, harnessing opportunities that benefit their teams, projects, communities, and industry. As an Azure Data Engineer, you will play a pivotal role in the data engineering and business intelligence journey of global and regional operations. Collaborating with … cross-functional teams, you'll lead the charge in designing and implementing scalable azure data engineering and Power BI data visualisation solutions that meet diverse business needs. Your experience as an Azure Data Engineer and BI Developer will be key to optimizing data more »

Job Purpose As a Data Engineer, you'll be at the forefront of enhancing our client's data capabilities, ensuring every bit is optimised for success. You will be collaborating closely with their visionary Data Scientists, crafting intricate data models and stunning … visualisations that will drive strategic decision-making to new heights. Your expertise in programming languages and data analysis tools will be the key to unlocking their data's full potential. Your contributions will be pivotal in driving strategic decision-making, fueling various impactful use cases. Harness … your prowess in programming languages and data analysis tools, while showcasing your formidable analytical and communication skills. Responsibilities Support the design and maintenance of data integrity checks across our client's various systems. Collaborate with the Data Scientists to understand data needs more »

Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great scope for career progression & you’ll be leading and managing a small team of Data … from the Data Engineering work to contribute towards the Data Science/Analytics. Work across the whole Data pipeline (Data Engineering, Data Warehousing, Analytics) Help shape the strategy and roadmap for whole Data function and contribute towards … Engineering pipeline. Preferably someone who is capable of ‘wearing many hats’ and getting hands on in other areas across the Data Engineering pipeline if necessary! Experience leading team of Data Engineers/Scientists. Min. Bachelors’ degree in STEM subject (ideally from UK university). THE more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … to provide great customer service and grow through the provision of superior data services As a Technical Lead for our Data Team, you will play a critical role in shaping our data strategy, driving technical excellence, and ensuring the successful delivery of data more »

be a developer in the Client Reporting Product Team within Distribution Technology. The Client Reporting Product team partners with Marketing, Reporting Operations and Data Management teams in Technology to build data integration solutions for the automation of a wide variety and high volume of reports. This … software development skills and can pick up new technologies and assist in all aspects of the team’s work such as development using data warehouse and master data vendor platform tools. You will not only need excellent problem-solving skills, but you should also be able … to see the strategic impacts of any cross-team dependencies and escalate where necessary. You will require strong teamwork skills. The distribution data space is in a transition period. Significant data assets are located in on-premise hardware and software, such as Oracle, Informatica, Autosys, and more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £55,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … re seeking a Data Engineer with a focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including … but not limited to Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Stream Analytics, and Azure Synapse Analytics. A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Designing and deploying production data more »

Job Responsibilities The Data Analytics Tester works closely with business stakeholders and the technology team to review and test Business Intelligence (BI) solutions firmwide including but not limited to validating the quality accuracy, reliability, compliance and performance of reports, dashboards, data pipelines, and general data analysis solutions. Develop and execute comprehensive test scenarios for BI reports and dashboards. Ensure data accuracy, security and compliance around legal performance metrics are accurately presented on BI reports and dashboards. Verify, validate, and analyse accuracy of data models used in reports to ensure … data synchronization and consistency across different platforms. Review data specifications and requirements with data analytics developers, business analysts and enterprise architects, and develop test plans, test cases, and test scripts. Perform functional, regression, integration and performance testing of reports, dashboards and data more »

Senior Data Engineer About us HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning. … Our team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and … best of open-source data engineering and scientific Python toolset. Our tech stack includes Airbyte for data ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

Templeton and Partners are currently on the look for an Data Engineer to join one of our clients within the Emerging Tech space on a 12month contract (PAYE), fully remote. You will be responsible for processing and managing our high-quality multimedia datasets for use by our researchers … in data engineering, experience in data processing and management, and proficiency in working with developers to optimise data pipeline tooling. Responsibilities: Data processing: Using online workflows and command line tools/scripts to clean and transform our multimedia datasets to make … sharing other relevant information. This requires collaboration with multiple internal teams and working with spreadsheets, documents, internal wikis, and similar tools. Data pipeline: Support improvements to our data pipeline tooling by working closely with developers to provide feedback and make modifications to optimise data more »

Role: Senior Data Engineer Business Area: Engineering/Technology Reporting to: Head of Data Location: Hybrid/Remote About Validis Validis is a dynamic fintech company with a leading software platform, built for the extraction and standardisation of accounting data. Validis is both a B2B and … SasS with operations across the UK, US & Australia. We specialize in providing quality data for both audits and financial services, with the guarantee that our product will streamline processes for the financial industry. Our current client base holds a number of blue- chip companies, mainly comprising audit firms … implementing CI/CD workflows for data engineering projects. Proven ability to leverage CI/CD tools to streamline data pipeline development and deployment. Proven expertise in designing and implementing ETL pipelines using tools like Apache Airflow, Luigi, Spark, or similar frameworks. Strong understanding of more »

Lead Data Engineer I'm currently working on a dynamic opportunity which is looking for a Lead Data Engineer to join and lead their team! You'll play a pivotal role in bridging engineering best practices with their data domain. Thier team is committed … to transforming data into actionable insights, aiding decision-making processes and enhancing our products. Your expertise will drive advancements in our data engineering practices, leading the development of new data products with a focus on data backends, infrastructure, and DataOps. If you … integrations and click-stream ingestion. Proven ability in stakeholder management and project leadership. Proficiency in SQL, Python, PySpark. Solid background in data pipeline orchestration, data access, and retention tooling. Demonstrable impact on infrastructure scalability and data privacy initiatives. A collaborative spirit, innovative problem more »

We're now recruiting a Senior BI Developer to work in the D2C business area of AJ Bell. The Data and Insights team is a small but dynamic and experienced group of SMEs who work across Google Analytics, Bloomreach CDP and BI/data engineering. The … drive business decisions by product and marketing teams, as well as the Senior Management Team. Youll be responsible for owning and developing our data model for the Direct-to-consumer business as well as creating custom solutions and fulfilling data analysis requests for key stakeholders at … of the role are as follows: Working closely with engineering and streaming teams across Tech Services and Operations to ensure reliable and accurate data is available for D2C data and insights team to develop solutions from. Be subject matter expert in D2C team for cloud-based more »