1 to 25 of 199 Data Pipeline Jobs in the UK excluding London

Required: Data Architect Location: Remote Duration: 6 months + IR35 Status: Inside IR35 As a minimum you will have existing or prior experience in the following areas: * A strong background in Data Engineering (perhaps as a prior DBA or Data Engineer); * A high level … of exposure and hands-on familiarity with database technology; * A solid understanding of Cloud Infrastructure; * Experience of Linux platforms; * Knowledge and experience of Data Warehousing; * Strong Data Analysis skills; * Data Platform Modernisation; * Data Migration; * Data Security (at-rest/in … transit); * Architecting Data Pipelines; * Data Modelling and Database Design; * Metadata Management; * Stakeholder Management & Data Governance; * Excellent communication skills; * Willingness to learn and expand your Data and architectural skills. * Pre-sales content contribution and pricing for new business pursuits. Highly Desirable skills: * Cloud more »

Job Description We are looking for a Data Engineer to join our Y Combinator backed start-up. They are using AI and ML technology to build a SaaS product. You will be working closely with the Data Scientists and wider engineering teams. Responsibilities Maintaining Python/… capabilities Collaborate with several teams to provide technical solutions Requirements Early-stage start-up passion Strong Python knowledge Experience building and optimizing "big data" pipelines more »

Azure Data Engineer (SC Cleared) Location: Bristol Salary: £50,000 - £60,000 We're seeking Azure Data Engineer with active SC Clearance. This is a fantastic opportunity to join one of the most reputable digital solution provider's in the United Kingdom providing exposure to the … biggest and most ambitious programmes undertaken to keep our country safe. The SC Cleared Azure Data Engineer will be joining the Defence & Security arena, where you will help digitise defence with new thinking on technology capabilities and adoption processes, so we need someone who is sensitively able to … combine the latest thinking with traditional military functions. *Must have Active SC Clearance* Role requirements Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including more »

Data Engineer Grade: Consultant Analyst/Consultant Location: Belfast – BT6 8DN In-Office: 2 days per week Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks a highly ambitious and technically astute AWS Data Engineer to help design, build and deploy cloud-based … data solutions - transforming raw data into actionable insights that inspire ingenuity. The Company: The Organisation consists of 4000 high-performing Digital Strategists and Engineering Technologists - united in delivering human-centred innovation and making a meaningful impact on global society. Boasting a vast network of FTSE … Defence and security, Energy and utilities, Financial Services, Government and Public Services, Healthcare, Life Sciences, and Transport. Essential Skills & Experience: Design and deploy data pipelines in big data architecture using Java, Python, Scala, Spark, and SQL. Execute tasks involving scripting, API data extraction, and more »

Azure Data Engineer | Cheltenham | £50,000-£70,000 Locke & McCloud are working with a leading Cyber Security Consultancy that is home to over 4000 specialists who support clients across manufacturing, defence and security, energy and utilities, financial services and many other industries. They have offices globally and are … recognised for the impressive high standard of work they conduct. They are looking for an Azure Data Engineer, you will play a pivotal role in this journey, leveraging your expertise to architect, design, and implement scalable data solutions on the Azure platform. You will collaborate closely … with stakeholders to understand business requirements, design data solutions, and deliver value-added insights. You will be responsible for architecting data pipelines, optimizing data storage and retrieval, and ensuring the integrity and security of our data ecosystem. Additionally, you will have the more »

the uptake and success of electric vehicles with GRIDSERVE Car Leasing. Everything we do is underpinned and connected by a technology-agnostic, proprietary data platform that grows and improves every day. Get in touch ROLE OVERVIEW Join GRIDSERVE as the Head of Data. This will be a critical … member of our leadership team, responsible for establishing and driving the data vision and strategy across the company. This role involves harnessing the power of data to optimize our operations, enhance decision-making, and unlock innovative solutions in the renewable energy space. You will lead our … journey towards becoming a data-mature organisation, building a team to leverage data for operational excellence, strategic insights, and market innovations.You will be able to communicate complex data concepts in simple business language, cutting out the jargon and getting to the point of what more »

are looking for an BI Analyst position for a large business based in Liverpool. The Business Intelligence Analyst is responsible for maintaining the data architecture and data pipelines that support business intelligence systems. This includes ensuring that the data architecture is scalable, secure, and … optimized for performance. They also work closely with other teams to ensure that data is properly integrated and available for analysis. The Business Intelligence Analyst will work closely with the analysts for reporting requirements and ensuring the correct data structure is in place for implementing newly … awarded contracts. The role will be responsible for designing processes and controls to ensure all data presented is tested, and accurate. Good communication skills is crucial for this role as you will need to present key information to managers across the business. It is essential you have strong more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

business information accessible to all. Twenty-five years later, we’ve not only realised this dream, changed the market for the better, made data intelligence accessible to all businesses big and small but most importantly, opened new avenues of data intelligence for businesses with machine learning … AI and connected data. From risk management through to opportunity identification, our industry-leading solutions, power decisions for companies by turning their data into actionable insights that help them become stronger, grow faster and thrive. THE TEAM This opportunity is to join a team of highly technically skilled … engineers, who are redesigning Creditsafe data platform with high throughput and scalability as primary goal. The data delivery platform is being built upon AWS redshift and S3 cloud storage. The platform expected to manage over billion objects along with daily increment of more than 10 million more »

Job Title: Data Analyst - Bristol - £50K We are working with a growing digital agency client based in Bristol who are looking for a talented Data Analyst to join their team. This is a hybrid role with at least 2 days a week in their local office … hub (Bristol or London). As the Data Analyst, you will be responsible for providing structure and process around data collection and analysis as the company scales. You will have a passion for data and enjoy using it to support decision making. Your key … reports that improve performance, formulating and documenting requirements for outputs, performing data analysis on datasets, troubleshooting issues in the data pipeline and establishing standard reports on key business areas. You will also need to maintain and enhance datasets, review data collection processes and more »

Senior Data Engineer Glasgow Based/Hybrid working 1 day a week in office. About the Opportunity: MBN are partnered with a growing Glasgow based company to find them a Senior data Engineer. They are entering a new phase of development aimed at refining their product … platform for the future as part of a long-term business expansion strategy. They are looking for a Data Engineer to join and lead the development and strategy of their platform and functionality. You new role : Act as the Subject Matter Expert for Data Engineering, helping … to set the standards for data engineering and analytics best-practice for the business. Lay the foundations of the new data platform as a hands-on practitioner, building on the rich data sets we have in the business for both automation and analytics. Design more »

Forge is an international company with offices in the UK, Portugal, UAE, Canada and the US. We are experts in designing and developing data driven software solutions for the cloud and we are currently looking for a talented Data Engineer to join our team and work … Maintaining and enhancing data pipelines to support business reporting processes Formulating test cases and test plan to validate all data pipeline changes Investigating potential data quality issues in the data pipeline to identify true root cause along with an action … and continually enhancing data quality and data governance of data pipelines Maintaining documentation of the data pipeline process to ensure business continuity Maintaining documentation of the data stored in BigQuery to support business Essential Skills: + 4 years of more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

Azure Data Engineer An Azure Data Engineer is required by Whitehall Resources for our client based in the south of England. This is a permanent role and can be done from the comfort of the successful candidate’s home with travel into the office one to … two times a month. The successful candidate will come from a Data Engineering background and have experience with the latest Microsoft technologies. Strong knowledge of MS SQL Server on Azure with proficiency in SQL will also be needed. Do you have? Azure Data Engineering experience? Strong … knowledge of MS SQL Server on Azure? A background in the design, build, and maintenance of ADF data pipelines to extract, transform, and load (ETL) data from various sources into Data Warehouses? Exposure to Azure Synapse Analytics? Excellent communication skills? Would you like? Work more »

making and strategic planning across the organisation through the development, deployment, and maintenance of comprehensive BI solutions. This role will manage the diverse data sources and produce robust and comprehensive reports and dashboards across the organisations key operational areas: • Financial reporting • Risk and Compliance reporting • Operational reporting • Banking … Platform reporting • IT Service, resilience, and cyber reporting Responsibilities Data Management: Design, construct … install, test, and maintain highly scalable data management systems. Data Analytics: Develop analytics tools that utilise the data pipeline to provide actionable insights into key business performance metrics and operational efficiency. Interdepartmental Collaboration: Work closely with department heads and their teams to gather more »

Our client, a leading MCR innovator, is seeking a skilled Data Engineer with expertise in GCP, SQL and Python. You'll join a team leveraging the latest advancements in Machine Learning and Google Cloud Platform to build game-changing tech that will help direct the future trajectory of … be based in the UK without visa/sponsorship requirements) It should go without saying, but a technical mindset and passion for the data engineering space an absolute must, with the ideal applicant being adept at delivering and optimising data pipelines. Some of the key things … you’ll be doing include: Build reliable data pipelines to move data from internal systems Keep the data pipelines running smoothly and ensure the data is accurate, complete, and accessible. Make the pipelines work faster and cheaper by improving their efficiency. Understand more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £65,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … re seeking a Data Engineer with a focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including … but not limited to Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Stream Analytics, and Azure Synapse Analytics. A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Designing and deploying production data more »

in the last Series C funding round in January 2023. Your Team Autonomous vehicles depend on sensor data. The quality and dependability. Sensor data is central to performance and safety. The Sensor & Compute team is therefore at the very heart of Oxa’s software and platform development. This … team makes it possible for vehicles to know where they are and what is around them. Furthermore, by analysing the quality of data at run-time, the products of Sensor & Compute team allows vehicles to gauge and predict their own performance and safety margins. The diversity of sensor … peer coding reviews. Maintaining and updating drivers and diagnostic systems, with a focus on applications on low-power embedded devices Developing data pipeline capabilities to ensure that sensor data is high-fidelity and the autonomy system it serves can leverage the full capability of a more »

Principal Data Engineer Northwest Up to £76,000 VIQU are seeking Principal Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a dedicated team … across numerous specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will … include data ingestion, quality, modelling, transformation, security, and monitoring. The Principal Data Engineer will also be involved in automation, process improvement, mentoring engineers, setting coding standards, and optimising queries. The Principal Data Engineer will work in collaboration with the Principal Cloud Engineer and Data more »

two days) at our Leeds, Edinburgh, or Bristol locations. About this opportunity Join IP&I as we embark on a transformative journey in data engineering. We are seeking a dynamic and experienced Senior Manager within Advanced Analytics to lead our team in architecting and implementing cutting-edge data solutions. If you are passionate about driving innovation and possess a proven track record in cloud and legacy data engineering leadership, we want to hear from you! You will be at the forefront of our data engineering initiatives. You'll lead a talented team … in designing, developing, and optimizing scalable data solutions. Your role will involve providing technical leadership, driving innovation, and ensuring the successful delivery of complex data projects. Here's where you'll make the difference: Lead and mentor a team of data engineers Architect and more »

Responsibilities: As a pivotal member of our rapidly expanding business, your role involves: Designing and Maintaining Data Architectures and Pipelines: Create and optimize robust data architectures and pipelines. Assemble intricate data sets that align with both functional and non-functional business requirements. Identify opportunities … to acquire new data from various systems. Enhancing Processes: Develop and refine data set processes for effective data modeling, mining, and production. Build the necessary infrastructure for seamless data extraction, transformation, and loading from diverse data sources. Data Reliability and Efficiency: Recommend and implement strategies to enhance data reliability, efficiency, and quality. Collaborate with Data Scientists and Machine Learning Engineers to construct analytics tools that leverage the data pipeline. These tools provide actionable insights related to asset management, operational efficiency more »

experience we're looking for, please go ahead and apply. We'd love to hear from you! About the role As the Senior Data Management Analyst, you will be responsible for continuous evolution of the data quality life cycle practices. This includes defining and proposing data … and their current levels under each dimension. You will take a leading role in supporting the organisation in improving the quality of its data by acquiring data to be brought under governance and perform data profiling analysis to understand it's origination, definition, lineage … into wider data management subjects e.g. Data Quality Insight, Data Quality Management, Data Quality in the pipeline, Master Data Management etc. Design, implement & maintain data quality technology Partner with key project initiatives and act as escalation point more »

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

ML systems, CI/CD and data pipelines. Participate in enterprise-wide architecture initiatives for AI/ML. Understand the workflow and pipeline architectures of ML and deep learning workloads. Conduct security risk assessments and threat modeling for AI/ML and other business projects performed thorough … test specification, development, and execution. Define and enforce robust access controls, authentication mechanisms, and encryption standards to safeguard AI/ML systems, training data, provenance, and any sensitive data. Stay abreast of emerging AI security threats, trends, and technologies, evaluating their impact and proactively adapting security measures to … tools, technologies, and frameworks to enhance the overall security posture of AI/ML and other business systems. Develop and maintain relationships between data scientists, data engineers, developers, operations (DevOps, DataOps, MLOps) and business unit leaders to govern and support scalability of the ML and AI more »

We're now recruiting a Senior BI Developer to work in the D2C business area of AJ Bell. The Data and Insights team is a small but dynamic and experienced group of SMEs who work across Google Analytics, Bloomreach CDP and BI/data engineering. The … drive business decisions by product and marketing teams, as well as the Senior Management Team. Youll be responsible for owning and developing our data model for the Direct-to-consumer business as well as creating custom solutions and fulfilling data analysis requests for key stakeholders at … of the role are as follows: Working closely with engineering and streaming teams across Tech Services and Operations to ensure reliable and accurate data is available for D2C data and insights team to develop solutions from. Be subject matter expert in D2C team for cloud-based more »