101 to 125 of 190 Permanent Data Pipeline Jobs in the UK excluding London

our work in digital avatars and human clones. Role: MLOps EngineerLocation: LondonSalary: Up to £100,000Responsibilities:Develop ML Pipelines: Build and maintain scalable data processing systems. Ensure data quality and integrity.Automate ML Processes: Integrate machine learning solutions into existing systems and automate workflows.Deploy and Scale Models … performance and implementation practices.Ensure Security: Adhere to security and compliance standards in ML deployments.Requirements:Education: Bachelor’s or Master’s in Computer Science, Data Science, or related field.Experience: 2-3 years in ML, data engineering, or MLOps.Abilities: Strong analytical … problem-solving, and communication skills.Skills:Proficient in Python, ML frameworks like TensorFlow or PyTorch.Experienced with CI/CD, Docker, Kubernetes, and data pipeline tools like Airflow. more »

Data Engineer Our growing client based in Manchester is currently looking for a skilled Data Engineer to contribute to the development of our clients' cloud-native data platform in AWS. In this role, you'll collaborate with stakeholders to architect and implement data solutions that drive business outcomes. Responsibilities: Collaborate with stakeholders to translate requirements into scalable data solutions. Architect and oversee the migration to a cloud-native data platform in AWS. Utilise Agile methodologies to manage the development lifecycle. Design and implement data pipelines … ensuring data quality and integrity. Requirements: Proficiency in ETL tools such as SQL, SSIS, AWS, Lambda, and Python. Strong understanding of data warehouse concepts. Excellent problem-solving and communication skills. Benefits: Competitive salary and benefits package. Opportunities for career growth and development. Collaborative and inclusive work more »

Data Engineer | Bristol (Hybrid) | £50,000 - £60,000 Peaple Talent have partnered exclusively with a family-owned farming and dairy company located in the heart of the picturesque Somerset countryside. With a legacy spanning over four generations, they are dedicated to producing delicious, organic dairy products while maintaining … our commitment to sustainability and environmental stewardship. Position Overview: We are seeking a talented and experienced Data Engineer with expertise in Azure to join our dynamic team. As a Data Engineer, you will play a crucial role in transforming raw data into actionable insights … that drive business decisions and enhance operational efficiency. You will work closely with cross-functional teams to design, develop, and implement robust data pipelines and solutions that support our growing data needs. Responsibilities: Build data pipelines that clean, transform, and aggregate data more »

Job DescriptionAs people increasingly move across channels and platforms, Kantar Media’s data and audience measurement, targeting, analytics and advertising intelligence services unlock insights to inform powerful decision-making. Working with panel and first-party data in over 80 countries, we have the world’s fastest … Middle East, Asia Pacific, North America, and Africa to understand audiences and help the world’s leading organisations succeed and grow.Job Title: Senior Data Scientist Location: London, Grays Inn RoadSalary: CompetitiveFull time/PermanentKantar is the leader in providing audience and advertising measurement tools and intelligence. With a … the forefront of technological developments in audience measurement in the media industry, working with broadcasters and advertisers, media agencies and industry committees. The data science team provides research and technical expertise, support, oversight, and methodological development to our global operating services and sits within the Global Product team.About more »

A new opportunity has risen for a Data and Insights Manager to join our D2C team. The Data and Insights team is a small but dynamic and experienced group of SMEs who work across Google Analytics, Bloomreach CDP and BI/data engineering. The … and segmented approach to every customer touchpoint to empower our customers to reach their financial goals. Plus, we know the best decisions are data-driven so we give our senior management team the best business intelligence data at their fingertips. Were looking for an experienced, driven … be responsible for managing the day-to-day work of the team, working with the team to triage incoming requests, gather requirements for data tasks (whether that be dashboards, new functionality, analysis pieces or tracking requests) and manage the teams backlog on JIRA. Youll take on running sprint more »

Data Engineer Overview: An Exciting opportunity has arisen with one of the UK’s largest life insurance brokers to join as a Data Engineer. Reporting to the Data Platform Manager, you will be responsible for ensuring that all of the raw data … to develop and maintain products Working cross-functionally across the business to understand the requirements of the products Designing and implementing performance related data ingestion pipelines from multiple sources using Apache Spark Integrating end-to-end data pipelines ensuring a high level of quality is maintained … Working with an Agile delivery/DevOps methodology to deliver additional data products Delivering and presenting proofs of concept of key technology components to the wider data team and relevant stakeholders Essential Skills & Experience: Strong experience with SQL & Python Competent with designing and delivering solutions using more »

Senior Data Engineer - 6 Months £600 - £650 Inside IR35 Wiltshire/Hybrid Sanderson are seeking a Senior Data Engineer for a leading financial services business as they embark on a major change and transformation journey. Key Responsibilities: Design and deliver data pipelines onto a … Data Platform using ETL tools. Assist with the day-to-day management of the business's data infrastructure. Drive innovative Data Engineering Solutions. Migrate data from a Snowflake warehouse to a SQL warehouse. Key Skills: SSIS Snowflake SQL Matillion Expertise in building … data pipelines and ETL processes. Strong modeling and data warehousing background. Experience in the financial services sector or regulated environments. more »

We are currently seeking a Data Engineer to join our client, a unique scale-up business who have received significant investment, that is entering a phase of large scale growth. This role will be a pivotal role in shaping the organisation’s data operations, as the … company grows and matures. As a Data Engineer you will design and build data pipelines that will fuel our client’s groundbreaking product lines. You'll collaborate across multiple disciplines to ensure seamless data flow, and go beyond pipelines to champion data … of what the successful candidate will require (don’t worry if you don’t tick all the boxes!): Python for building and automating data pipelines. A solid understanding of ETL processes for data extraction, transformation, and loading. Experience with relational databases ( SQL ) and database design principles more »

Sheffield, mainly remote or something in-between, believe that your best work happens when you have the freedom to create your ideal workspace Data Scientist Salary: £30-50,000 Location: UK - Remote/Hybrid/Sheffield HQ Twinkl is embarking on an exciting journey, and we're at … the beginning of something extraordinary. As we reshape the future of educational resources, data-driven decisions will be at the heart of our transformation. Join our team of over 20 data enthusiasts and contribute to shaping what the future of learning looks like! Why You'll … of education We are a high-spirited, conscientious team that celebrates inclusivity and where work is rewarding and fun! Your Role: As a Data Scientist, you're not just crunching numbers - you're influencing the educational landscape. Our work ranges from ensuring the entire business has the data more »

companies to GPs and individuals to get people the support they need to feel better. We are looking for an expert in cloud data solutions to Lead our Data Team as part of a 6 month fixed term contract. As a Senior Data Engineer … together a single view of the client journey spanning a number of sources. You will be responsible for implementing the right architecture and data pipelines to enable the company to utilise its data assets. To be successful in this role you will need to: Ensure that … the business’s information architecture, entity modelling, intersystem data consolidation at an enterprise level and pipelines are well designed and fulfil current and future business requirements Ensure that good development and architectural practices are adhered to Monitor and refine data pipelines to ensure adherence to expected more »

Role: Senior Data Engineer Location: Southampton Structure: Full time Hybrid 3 days in office 2 WFH Salary: up to 80k Description: You will be a subject matter expert and use your prior Data Engineering expertise and skill set to perform hands-on development as well as … managing a team of developers, providing consulting services and specialist technical support on data management and database administration. Responsibilities will include: Providing data architectural and design input to strategic direction for the development of data products Making recommendations for the enhancement of the data architecture Designing and enabling the delivery of modern, efficient, and robust data pipelines and data products Analysis of the business data solution requirements, and writing detailed technical requirement Experience required: As a Senior Data Engineer you will be required to more »

Are you a Data Engineer with a passion for engineering various data tools ? We would love to hear from you! Careers at TCS: It means more. TCS is a purpose-led transformation company, built on belief. We don’t just help businesses to transform through technology. … you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation. Be exposed to the future of data Work with some of the brightest global minds in the industry Lead definition and implementation of standards and best practices in Enterprise The Role … This role will support the design, management, checking, and engineering of a diverse range of data using a variety of tools to achieve consistent data sharing across the organization. Your Profile Key responsibilities: Design, create, test and maintain data pipelines to support Digital projects more »

a-day, 365-day-a-year mission. For this reason, it partners with this Big 4 Firm to support its multidisciplinary AI & Cloud Data Engineering Capabilities.The Role:As an AI & Cloud Data Engineering practitioner, you’ll build large-scale data pipelines and infrastructure, utilising … data integration tools to optimise complex data solutions.Collaborating with high-performing Data Science and ML Engineering teams to drive innovation and insight through AI and Data across the Defence & Security sector. Required Skills/Experience:British Passport Holder with active DV (Developed … Vetting Clearance)End-to-end development with data pipelines, ETL processes, and workflow orchestration - using core concepts that apply across tech stacks.Working with diverse data sources and types - batch, streaming, real-time, and unstructured.Systems thinking and architectural design skills for building scalable, high-performance data more »

Data Engineer - Belfast - £55 - 60k + Bonus Want to help drive the Data function with one of the most reputable employers in Belfast? This company is known for it’s innovation, delivery, and culture. Their Belfast hub is at the centre of the tech community, promoting … learning and diversity at all levels. They have a new opportunity for a Data Engineer to join their Digital function. AWS is a huge growth area for this company, so it's a great opportunity to really develop your cloud skills. The person Experienced in designing and deploying … production data pipelines within a big data architecture Strong technical skills in Python, SQL and AWS (though they’re very open to any cloud experience) Experience processing large volumes of structured and unstructured data Knowledge of data cleaning, wrangling, visualization and reporting more »

Role: Senior Data Analyst Salary: £35,000 - £40,000 Location: Peterborough – onsite. Our client, a leading retail fashion brand, are looking to recruit a Senior Data Analyst into the team. With Data at the core, they are looking for someone to really help drive … forward the data strategy for the business. Having recently implemented Snowflake, this role will be well suited to those comfortable with creating data pipelines, using various ETL tools, testing data and writing queries. Please take look at some of the core requirements below and … with this role** Key Responsibilities: · Generate and maintain reports on sales performance and marketing activity across various channels. · Extract, manipulate, and analyse commercial data to provide actionable insights. · Create informative dashboards using Tableau. · Identify and resolve data discrepancies. · Maintain reporting for the marketplaces team. · Mentor junior more »

support of BTs Strategic SIEM development. We are seeking a skilled Software Engineer with expertise in Elasticsearch (or other SIEM and/or Data platforms) to join our dynamic team. As a Software Engineer you will play a critical role in designing, developing, and maintaining our security information … will be on leveraging Elasticsearch and related technologies to enhance threat detection, incident response, and overall security posture. What you’ll be doing • Data Ingestion and Enrichment: o Configure Elasticsearch pipelines for data ingestion from various sources, primarily from Kafka o Enhance data enrichment … Lead for the year and work towards achieving these. You'll have the following experience • ETL Processes with Logstash Design, develop, and maintain data pipelines using Logstash, part of the Elastic Stack. Automate data ingestion, transformation, and loading tasks. • Beats for Data Collection Configure more »

Job DescriptionData EngineerLocation: London, 3 days per week in the officeSalary range: £50,000-£70,000 + benefitsPurpose: Design, build, and maintain scalable data architectures, including pipelines andcloud-based data warehouses.Tech: Python (NumPy, Pandas), SQL, ETL, Cloud (AWS, Azure or GCP), Snowflake, Airflow, BigQuery, PowerBI/… consultancy who solely specialise in the Maritime trading industry. You will work onsite with 1 specific client to design, build and maintain scalable data architectures working with key stakeholders in their business to shape their data-driven strategies. The Company:They have a long history providing … models for scalability and performance.ETL Processes: Deep expertise in developing and optimising ETL pipelines.Version Control: Experience with Git for code collaboration and change tracking.Data Pipeline Tools: Proficiency with tools such as Apache Airflow.Cloud Platforms: Familiarity with AWS, Azure, Snowflake, and GCP.Visualisation: Tableau or PowerBIDelivery Tools: Familiarity with agile backlogs more »

Azure Data Engineer An Azure Data Engineer is required by Whitehall Resources for our client based in the south of England. This is a permanent role and can be done from the comfort of the successful candidate’s home with travel into the office one to … two times a month. The successful candidate will come from a Data Engineering background and have experience with the latest Microsoft technologies. Strong knowledge of MS SQL Server on Azure with proficiency in SQL will also be needed. Do you have? Azure Data Engineering experience? Strong … knowledge of MS SQL Server on Azure? A background in the design, build, and maintenance of ADF data pipelines to extract, transform, and load (ETL) data from various sources into Data Warehouses? Exposure to Azure Synapse Analytics? Excellent communication skills? Would you like? Work more »

Role: Data Insights Manager ( SQL ) Salary: £45,000 - £55,000 Location: Peterborough – onsite. Our client, a leading retail fashion brand, are looking to recruit a Data Insights Manager into the team. With Data at the core, they are looking for someone to really help … drive forward the data strategy for the business. Having recently implemented Snowflake, this role will be well suited to those comfortable with creating data pipelines, using various ETL tools, testing data and writing queries, whilst managing and growing small teams. Please take look at … some of the core requirements below and apply for a more detailed conversation. **No sponsorship is offered with this role** Key Responsibilities: Data Warehousing Lead the team in building out reports. Use extensive SQL skills to extract and analyse data at a deeper level Move buying more »

in the UK and abroad. This will be s a great opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real … Data Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse.Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as needed.Modern tech stack - Python, AWS, Airflow … several teams, this is key as you will be reporting directly to the CTO.2 + years of programming language experience (e.g. Python, SQL)Data modeling/ETL tool experience A startup/greenfield mentalityWhat's in it for you?:Hybrid workingPrivate healthcare and wellness supportEmployee Discount: 75% discount more »

to enhance their technical skills, fostering a culture of continuous learning and professional growth. Collaborate closely with cross-functional teams , including ML Engineers, Data Scientists, and Product Managers, to architect, refine, and deploy sophisticated AI solutions. Act as an ambassador of innovation , delivering keynote speeches, hosting webinars, and … authoring insightful publications that influence the industry and drive transformation. Qualifications A robust foundation in computer science , emphasizing AI and Data infrastructure design. A minimum of 10 years’ experience as an engineer, designing and executing large-scale solutions in cloud environments, ensuring seamless integration with legacy systems. S … model development, deployment, and mastery of MLOps practices. Experienced in crafting enterprise-scale cloud-native AI/ML solutions Proficiency in data pipeline orchestration across hybrid environments, leveraging the latest in Azure and allied technologies. Expertise in data processing with tools like Spark or Dask more »

Role: Senior Data Engineer Start: ASAP (ideally end of May) Location: Bristol/Hybrid - 2 days per week Salary: £73k Our market leading Financial Services client is looking for an experienced Data Engineer as they embark on a major change and transformation journey. Key Responsibilities: Design … and Deliver Data Pipelines onto a new Data Platform Act as Principle Data Expert to build out standards and mentor junior analysts Drive Data Engineering Solutions Key Skills Matillion Snowflake SQL Expert in building data pipelines ETL Strong Modelling and … Data warehousing background Financial Services/experience of working in a regulated environment Benefits: 10% non contributory pension Healthy holiday entitlement Health Insurance Life Assurance Share Incentive Scheme Attractive Bonus EV Hire Scheme more »

LondonOverview:We are working with one of the market leaders and most exciting organisations within the retail sector. We’re seeking an experienced Data Engineer who is analytically focused with expertise and proven experience with SnowflakeYou will be part of a high performing team and gather requirements from … scalable and efficient databases to support internal enterprise applications.Collaborate closely with development and infrastructure teams to ensure seamless integration and optimal database performance.Lead data strategy aligned with organizational objectives, including data governance, architecture, quality management, and integration initiatives.Develop and support data warehouse, customer data platform (CDP), and associated data pipelines using Matillion and Snowflake.Gather requirements from the Business Intelligence team and translate them into technical specifications for implementation by the software development team.Define software requirements for data maintenance and dashboard requirements for displaying insights to relevant users.Essential Skills more »

in the last Series C funding round in January 2023. Your Team Autonomous vehicles depend on sensor data. The quality and dependability. Sensor data is central to performance and safety. The Sensor & Compute team is therefore at the very heart of Oxa’s software and platform development. This … team makes it possible for vehicles to know where they are and what is around them. Furthermore, by analysing the quality of data at run-time, the products of Sensor & Compute team allows vehicles to gauge and predict their own performance and safety margins. The diversity of sensor … peer coding reviews. Maintaining and updating drivers and diagnostic systems, with a focus on applications on low-power embedded devices Developing data pipeline capabilities to ensure that sensor data is high-fidelity and the autonomy system it serves can leverage the full capability of a more »

are looking for an BI Analyst position for a large business based in Liverpool. The Business Intelligence Analyst is responsible for maintaining the data architecture and data pipelines that support business intelligence systems. This includes ensuring that the data architecture is scalable, secure, and … optimized for performance. They also work closely with other teams to ensure that data is properly integrated and available for analysis. The Business Intelligence Analyst will work closely with the analysts for reporting requirements and ensuring the correct data structure is in place for implementing newly … awarded contracts. The role will be responsible for designing processes and controls to ensure all data presented is tested, and accurate. Good communication skills is crucial for this role as you will need to present key information to managers across the business. It is essential you have strong more »