26 to 50 of 76 Data Pipeline Jobs in the UK excluding London with Remote Work Options

Converted code is causing failures/performance issues. Your responsibilities; As a Spark Scala Engineer you will be working for the GDT (Global Data Technology) Team, you will be responsible for: Designing, building, and maintaining data pipelines using Apache Spark and Scala Working on an Enterprise … Cloud Services in one of the Clouds (GCP). Mandatory Skills; At least 8+ Years of IT Experience with designing, building, and maintaining data pipelines . At least 4+ Years of experience with designing, building, and maintaining data pipelines using Apache Spark and Scala. Programming languages … Proficiency in Scala and Spark is essential. Familiarity with Python and SQL is often a plus. Big Data technologies: Understanding of HDFS, Kafka, Hive, and cloud platforms is valuable. Data engineering concepts: Knowledge of data warehousing, data pipelines, data modeling more »

new services? We are partnering exclusively with a large organisation to bring you an exciting opportunity for a highly skilled and experienced Lead Data Engineer to be responsible for leading data engineering projects, ensuring the efficient processing and management of data across the organisation. … other benefits. Flexible, hybrid working from Swansea with options for condensed hours. You will get to lead a team working on a modern data platform, collaborating with engineering product teams delivering services and working closely with reporting teams and data scientists to help understand and optimise … their digital services. This role will be instrumental in shaping their data infrastructure, ensuring it supports the strategic objectives. You will leverage cutting-edge technologies, primarily focusing on Microsoft Azure and Databricks, to develop and maintain robust, scalable data solutions. Responsibilities: Leadership and Strategy: Lead the more »

Review clients' requirements Working closely with key business stakeholders Experience: Around 3 years' experience developing with SQL MSSQL, T-SQL Troubleshooting and resolving data quality issues Documentation Advantageous: Telecoms billing systems or processes Knowledge of Java or Kotlin NoSQL Databases Experience of CRM systems Azure Data Lake/Data Pipelines This role offers a salary of up to £40,000 including generous benefits including a company bonus, remote working, private healthcare, and much more! Hit apply, email or call 02380 765 301 Spectrum IT Recruitment (South) Limited is acting as an Employment more »

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our … client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data streams to our client's Data Platforms. Shape data from various sources into a transactional ODS for detailed reporting and a Kimball-modelled Data Warehouse for analytics and dashboards. Define and embed data quality measures within data pipelines. more »

Lead Data Engineer (Contract/ASAP Start) Location| Workplace policy: Fully Remote (Must be based in the UK without visa/sponsorship requirements ) Day Rate: up to £600 (outside IR35) Contract Length: 6-month term initially An exciting market-leading tech-savvy organization that works directly alongside some … of the biggest brands in the retail sector is seeking a contract Lead Data Engineer with hands-on experience working directly with C-Suite execs. Technical Expertise Needed At least 4 years recent Databricks (must have) At least 10+ years experience in a Lead Data Engineer … Educated to degree level in a QS top 100 university Proven experience delivering scalable data pipelines PySpark SQLDevOps/DataOps/CICD Expertise in designing, constructing, administering, and maintaining data warehouses and data lakes Data Modelling/Data Architecture Data more »

Data Analyst - Hybrid Working Are you a talented Data Analyst seeking a challenging and business critical role within a highly successful global product company who have developed a world renowned brand? Are you looking for the next phase of your career through progressing your technical knowledge … and joining an established and accomplished data management team ? If so this could be the role for you... Why Would you Join? Competitive salary with annual reviews Generous Bonus Scheme Private medical care Finish early on a Friday 25 days holiday Hybrid working - 3 days in the office … days WFH (work from home) Beautiful brand new refurbished office The Opportunity As a data analyst you will conduct data analysis having first selected appropriate statistical methods and provide insights and recommendations based on investigations including deep dives into any relevant metrics. The successful data more »

promotion that seen the Head of Engineering promoted into the CTO role there’s an opportunity to join the business as the Lead Data Engineer. Working hand in hand with the CTO you will play an instrumental part in shaping and leading the Data Engineering function … used on those days. This is a rare opportunity to work with a well liked and respected CTO and a great business. Lead Data Engineer £80k-£90k Hybrid working 2 days in Glasgow office a week Your New … Role: Platform Development: Build the foundations of the new data platform, leveraging extensive business data for both automation and analytics. Pipeline Design: Create and develop data processing pipelines to support the ingestion, enrichment, and quality control of client and partner data. Data more »

Are you an experienced Data Engineer ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a Hybrid working role and you will be based from either their London, Leeds, Manchester or Edinburgh office, typically 3 days a … site. Preferred skills: SAS Data Engineering Proficiency in SQL and/or similar data technologies Familiarity with data pipeline tools and ETL processes Knowledge of cloud platforms and data architecture Experience working in the Retail Banking sector or financial services would more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Leading ecommerce client now requires a Data Engineer to join their innovative Machine Learning team. This role will focus on increasing overall data efficiency using Machine Leaning, streamlining data processes to increase overall profitability, and ensuring our clients operations and customer teams can increase … strong exposure to Machine learning principles/practices and technologies such as ML flow/Sage Maker. The role: Develop robust and scalable data pipelines. Collaborate with cross-functional teams to develop and deploy Machine Learning models and algorithms to solve business challenges and create opportunities. Contribute to … the development of our clients in-house Machine Learning operations framework. Support the data science and analytics team in deploying pipelines. Coach and mentor the team to improve development standards. Key requirements: Strong hands-on experience with Databricks, Spark, SQL or Scala. Proven experience designing and building data more »

created role within the Business Improvement & Change function responsible for delivering and driving business change across the organisation. Candidate Profile: A passionate experienced data and business intelligence professional with ideally experienced within a highly regulated industry. Skilled in Power BI, DAX, Excel and MS SQL, with hands on … experience developing and designing end user reports Strong management and leadership skills Experience and understanding of data architecture and infrastructure to include data pipelines, data warehousing and ETL Knowledge in supporting regulatory reporting and experience of data governance. If you are interested … experience and skills evidenced on the CV. For information on how your personal details may be used by Sellick Partnership, please review our data processing notice on our website. more »

their way to becoming a billion dollar organisation. Key Responsibilities: Oversee the creation, implementation, and maintenance of scalable analytic solutions, working closely with data scientists, software engineers, and other team members. Provide strategic technical direction, support, and mentorship, fostering a culture of continuous learning and innovation. Lead the … improvement initiatives, and address any customer-related challenges. Desirable Technical Experience: Proficiency in Java, Kotlin, or Python. Experience with NLP, ML-Ops, and data pipelines. Familiarity with ML frameworks such as TensorFlow or PyTorch Strong understanding of ML algorithms, statistical techniques, and data analysis. Experience with more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

are looking for an BI Analyst position for a large business based in Liverpool. The Business Intelligence Analyst is responsible for maintaining the data architecture and data pipelines that support business intelligence systems. This includes ensuring that the data architecture is scalable, secure, and … optimized for performance. They also work closely with other teams to ensure that data is properly integrated and available for analysis. The Business Intelligence Analyst will work closely with the analysts for reporting requirements and ensuring the correct data structure is in place for implementing newly … awarded contracts. The role will be responsible for designing processes and controls to ensure all data presented is tested, and accurate. Good communication skills is crucial for this role as you will need to present key information to managers across the business. It is essential you have strong more »

UK (Hybrid: Flexible working arrangements) Salary: Up to £90,000 per annum Are you a seasoned IT professional with expertise in Cyber Security, Data Compliance (GDPR), Data Engineering, Data Warehousing, and Cloud Engineering (AWS)? We have an exciting opportunity for an IT Director to … of IT initiatives alongside our CTO, aligned with business goals. Cyber Security measures, ensuring the protection of our systems and data. compliance with data regulations, particularly GDPR, and … implement best practices for data governance. data engineering projects, including data modeling, ETL processes, and data pipeline development. data warehousing solutions, optimizing for performance, scalability, and reliability. Cloud Engineering efforts, leveraging AWS services for infrastructure and application needs. and more »

Are you an experienced Data Engineer ? Do you have a passion for Data and experienced with the Microsoft stack ? Do you have SQL, Microsoft Fabric and Azure skills ? If so I have a fantastic new role with my client, with offices in Edinburgh and Glasgow and … its hybrid working. You will be part of a team that works in an Agile environment, contributing to the companies wider data strategy. Responsibilities include: * Modernising existing key business solutions by reverse engineering and rearchitecting for Azure. * Be involved in designing and implementing systems to effectively handle large … whilst maintaining data integrity and provenance. * Experience designing and building robust, production ready, scalable data pipelines * Familiarity with optimising strategies, pipeline architectures, data sets and ETL/ELT processes * Have experience of selecting the appropriate tools to deliver the solution * Coding skills, could more »

Job Title: Cloud Data Engineer Location: Knutsford, UK Hybrid work: 2-3 days a week Capgemini is seeking a Cloud Data Engineer t o join Capgemini Financial Services I&D Practice. This is a permanent, full-time position in Knutsford, UK and this represents a unique … opportunity for someone to enhance their I&D Consulting career. What you’ll do and bring: Proficiency in AWS services relevant to data engineering such as S3, Glue, EMR, Athena, and Lambda. Hands-on experience with Snowflake, Redshift cloud data warehousing solutions. Familiarity with DBT (Data … Glue, Starburst, Snowflake, Redshift, Starburst, Hybrid(on-prem to cloud) for building data pipelines and ETL processes. Experience with data pipeline orchestration tools like Apache Airflow . Knowledge of SQL and ability to write complex queries for data transformation and analysis. Understanding of more »

Job Title: Cloud Data Engineer Location: Northampton,UK Hybrid work: 2-3 days a week Capgemini is seeking a Cloud Data Engineer t o join Capgemini Financial Services I&D Practice. This is a permanent, full-time position in Northampton, UK and this represents a unique … opportunity for someone to enhance their I&D Consulting career. What you’ll do and bring: Proficiency in AWS services relevant to data engineering such as S3, Glue, EMR, Athena, and Lambda. Hands-on experience with Snowflake, Redshift cloud data warehousing solutions. Familiarity with DBT (Data … Glue, Starburst, Snowflake, Redshift, Starburst, Hybrid(on-prem to cloud) for building data pipelines and ETL processes. Experience with data pipeline orchestration tools like Apache Airflow . Knowledge of SQL and ability to write complex queries for data transformation and analysis. Understanding of more »

Job Title: Technical Lead Data Engineer Location: Edinburgh, Scotland (Hybrid) - All employees must be eligible to work without sponsorship Salary: £70,000 - £85,000 The Role: Lead the Data team to deliver ETL processes, build and maintain data pipelines, enhance scalability, performance, maintainability, configurability … and usability Be involved in the entire life-cycle of the Data Strategy, including idea creation, deployment, and longer term updates and enhancements Support the product and Software Development Managers in prioritisation, scoping and leading delivery of Data Strategy features in the exciting world of Future … State Architecture Manage company data, monitor accuracy and completeness, and advise ways that data quality can be improved Able to zero-in on bugs without looking at the code Technical Lead Data Engineer Requirements: Good SQL and NoSQL experience Expert-level ability in TSQL more »

Senior Data Engineer Location: Hybrid, with 2 days per month to be onsite (Abingdon) We have the pleasure to be representing a business that is on a mission to increase the number of people who can live longer, healthier lives and reduce unnecessary medical costs while doing so. … To help with the success of this strategy They are recruiting for a Senior Data Engineer that will take a pivotal role in driving the Data team forward. Responsibilities: Lead Cloud Data Warehouse Project : Take charge of leading the Cloud data warehouse … project through its next phase of development, ensuring its scalability, reliability, and performance meet the highest standards. Ownership of Data Management : Assume ownership of all aspects of data management, serving as the go-to person for any data queries from the internal team. Your more »

Data Engineer Pearson Carter are currently working with a Education consultancy based in Sheffield who are looking for a Data Engineer who has strong AWS cloud, SQL and Python experience. They offer … a base salary of £50,000 and £60,000 Get in touch if you are looking for your next opportunity! Responsibilities: Data pipeline development in Python Development of the data warehouse stack Integrate additional data sources Experience: SQL Python AWS, Glue and Lambda more »

Our client, an exciting start-up customer obsessed behavioural agency founded by two huge names in the data space (that have grown teams previously to 400+), is looking for a personable and hard-working Junior Data Engineer to design, build, and maintain a variety of solutions … real business results, a stark contrast to the generic approaches often found at larger agencies. “Leading with Relationships and Results” As a Junior Data Engineer, you'll leverage your knowledge of data warehousing and Google Cloud Platform (GCP) to design and build data pipelines. … You'll combine your technical skills in data modelling and transformation with your expertise in cloud-based data services like BigQuery and Dataflow. What will you be doing? Data Engineering in Google BigQuery: Design, build, test, and deploy data models and transformations more »