26 to 50 of 142 Permanent Data Pipeline Jobs in the UK excluding London

Description Who we are At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in fair and equitable way. … and you can bring your dog to the office! Job Description The job at a glance As a Director of Product Analytics and Data Science, you will responsible for leading an organisation comprising several Product Analytics, Data Analytics and Data Science teams, covering the … Analytics and Data Science needs in the Product organisation at Stepstone. You will be working closely with Senior Leaders in Product, Tech, Marketing and other areas to ensure we turn our data and product strategy into reality. Equally important, you will enable the managers to foster more »

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our … client's data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data streams to our client's Data Platforms. Shape data from various sources into a transactional ODS for detailed reporting and a Kimball-modelled Data Warehouse for analytics and dashboards. Define and embed data quality measures within data pipelines. more »

About Us: iOpt Ltd is a IoT technology company using sensors to capture property data to help build smart solutions for sustainable and efficient living. The company works with a range of clients across different sectors. We are an innovative and rapidly growing company and we now require … a talented and motivated Data Analyst to join our team and contribute to our exciting journey. Job Purpose This role has been created to support the growth in our Data team in iOpt. You will be responsible for making sure we have a strong understanding of … Project Management: Apply knowledge and experience of project management methodologies. Utilize appropriate tools and techniques to contribute effectively to project success. Data Pipeline Development: Design, build, test, and deploy data pipelines to support analytic products. Ensure the efficiency and reliability of data flows more »

business critical reporting systems across the Protein Works including marketing, trading, operations and finance. You will have a strong understanding and appreciation of data engineering concepts and how to apply them using the Google Cloud Platform. You will possess an unwavering passion for data and how … Engineer Immediate Responsibilities Managing and delivering end to end BI reporting projects from initial brief/requirement gathering to data pipeline development (APIs/ETL/ELT/SQL) to visualization Undertaking ad hoc BI tasks based on business requirements and priorities As part of … Coding experience with Python/Javascript/C# Familiarity with statistical/machine learning/AI concepts and techniques Understanding of data pipeline/orchestration tools e.g. dbt, dataform Appreciation of GCP’s serverless technologies e.g. Cloud Run/Workflows Understanding of Google’s marketing stack, Google more »

experienced AWS Cloud Architect to design AWS reference architecture for our services-led client. Responsibilities: Design and implement scalable, secure, and high-performance data architectures on AWS. Develop data models and database designs that align with business requirements and ensure data integrity. Proficiency in … or AWS CodePipeline. Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform, or similar. Create and maintain ETL processes, data pipelines, and data integration workflows using AWS services. Implement data storage solutions, including data lakes, data warehouses, and operational databases. Provide technical leadership and guidance on AWS data services and architecture to the team. Requirements: Proven experience as an AWS Data Architect or similar role, with a strong focus on data architecture and management. In-depth knowledge of more »

Lead Data Engineer (Contract/ASAP Start) Location| Workplace policy: Fully Remote (Must be based in the UK without visa/sponsorship requirements ) Day Rate: up to £600 (outside IR35) Contract Length: 6-month term initially An exciting market-leading tech-savvy organization that works directly alongside some … of the biggest brands in the retail sector is seeking a contract Lead Data Engineer with hands-on experience working directly with C-Suite execs. Technical Expertise Needed At least 4 years recent Databricks (must have) At least 10+ years experience in a Lead Data Engineer … Educated to degree level in a QS top 100 university Proven experience delivering scalable data pipelines PySpark SQLDevOps/DataOps/CICD Expertise in designing, constructing, administering, and maintaining data warehouses and data lakes Data Modelling/Data Architecture Data more »

Data Analyst - Hybrid Working Are you a talented Data Analyst seeking a challenging and business critical role within a highly successful global product company who have developed a world renowned brand? Are you looking for the next phase of your career through progressing your technical knowledge … and joining an established and accomplished data management team ? If so this could be the role for you... Why Would you Join? Competitive salary with annual reviews Generous Bonus Scheme Private medical care Finish early on a Friday 25 days holiday Hybrid working - 3 days in the office … days WFH (work from home) Beautiful brand new refurbished office The Opportunity As a data analyst you will conduct data analysis having first selected appropriate statistical methods and provide insights and recommendations based on investigations including deep dives into any relevant metrics. The successful data more »

promotion that seen the Head of Engineering promoted into the CTO role there’s an opportunity to join the business as the Lead Data Engineer. Working hand in hand with the CTO you will play an instrumental part in shaping and leading the Data Engineering function … used on those days. This is a rare opportunity to work with a well liked and respected CTO and a great business. Lead Data Engineer £80k-£90k Hybrid working 2 days in Glasgow office a week Your New … Role: Platform Development: Build the foundations of the new data platform, leveraging extensive business data for both automation and analytics. Pipeline Design: Create and develop data processing pipelines to support the ingestion, enrichment, and quality control of client and partner data. Data more »

DATA ENGINEER – UP TO £60,000! Location : Sheffield Benefits: 25 Days + Bank Holidays! Life Assurance! Flexible Working! Company: A chance to have a positive societal impact if you launch yourself into a fast growing, but firmly established, company in the much sought after EdTech sector APPLY NOW … Responsibilities: To build and maintain scalable data pipelines To gather requirements and deliver data projects To document processes and data pipelines To maintain a backlog of future improvements/… features in Jira To build effective relationships with technical and non-technical colleagues Requirements: Should have exceptional SQL skills Should have data pipeline development experience in Python Should have experience with AWS tools including Glue & Lambda Should have an understanding of CI/CD concepts Should have more »

Are you an experienced Data Engineer ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a Hybrid working role and you will be based from either their London, Leeds, Manchester or Edinburgh office, typically 3 days a … site. Preferred skills: SAS Data Engineering Proficiency in SQL and/or similar data technologies Familiarity with data pipeline tools and ETL processes Knowledge of cloud platforms and data architecture Experience working in the Retail Banking sector or financial services would more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Amazon Redshift, Amazon EMR, Amazon Athena, Amazon Sagemaker and more. Help our customers to remove the constraints that prevent them from leveraging their data to develop business insights Create white papers, writing blogs, build demos and other reusable collateral that can be used by our customers. Work closely … with our Solution Architects, Data Scientists and Service Engineering teams Experience with design, development and operations that leverages deep knowledge in the use of services like Amazon Kinesis, Apache Kafka, Apache Spark, Amazon Sagemaker, Amazon EMR, NoSQL technologies and other 3rd parties Develop and define key business questions … needs of enterprises Basic understanding of machine learning fundamentals Ability to take Machine Learning models and implement them as part of data pipeline IT platform implementation experience Experience with one or more relevant tools ( Flink, Spark, Sqoop, Flume, Kafka, Amazon Kinesis) Experience developing software code in one more »

Exciting Opportunity: Senior Data Analyst Role 🌟 Are you a seasoned data professional looking for your next challenge? We have an exceptional opportunity for a Senior Data Analyst to join a leading global financial institution’s dynamic Risk Analytics team. 🔍 Role Focus: Data provisioning and ensuring seamless access to vital data sources. Managing and optimizing data storage solutions. Automating processes to enhance efficiency and accuracy. Conducting comprehensive data analytics to support risk management and strategic decision-making. 🎯 Key Responsibilities: Develop and maintain data pipelines and infrastructure. Implement and oversee data governance and best practices. Collaborate with cross-functional teams to drive data-driven insights. Utilize advanced analytics techniques to solve complex business problems. Utilize SQL and Python. 💼 What We Offer: A collaborative and innovative work environment. Opportunities more »

We're representing a dynamic business dedicated to extending healthy lifespans and cutting unnecessary medical costs. They're seeking a Senior Data Engineer to propel their Data team forward. Key Responsibilities: Lead Cloud Data Warehouse Project: Oversee the next development phase, ensuring top-notch … scalability, reliability, and performance. Data Management Ownership: Be the go-to expert for data management, ensuring smooth operations and accessibility. Support BAU Workloads: Assist in prioritising and managing day-to-day tasks for efficiency and alignment with goals. Set Technical Direction: Define the systems and tools … technical direction, advancing towards ML and AI integration. Required Experience: Snowflake: Proficiency in setup, configuration, and optimisation. DBT (Data Build Tool): Strong skills in managing transformations and data pipelines. Python: Expertise in scripting, automation, and data manipulation. Beneficial Experience: Dagster/Airflow: Managing complex more »

SENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement both Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly … organisation. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years of commercial work as a Senior Data Engineer (responsible for taking decisions, rather than just writing code) An ability to write production quality Python code. Strong SQL Skills Experienced creating data more »

Leading ecommerce client now requires a Data Engineer to join their innovative Machine Learning team. This role will focus on increasing overall data efficiency using Machine Leaning, streamlining data processes to increase overall profitability, and ensuring our clients operations and customer teams can increase … strong exposure to Machine learning principles/practices and technologies such as ML flow/Sage Maker. The role: Develop robust and scalable data pipelines. Collaborate with cross-functional teams to develop and deploy Machine Learning models and algorithms to solve business challenges and create opportunities. Contribute to … the development of our clients in-house Machine Learning operations framework. Support the data science and analytics team in deploying pipelines. Coach and mentor the team to improve development standards. Key requirements: Strong hands-on experience with Databricks, Spark, SQL or Scala. Proven experience designing and building data more »

Data Engineer | Yorkshire | up to £45,000 basic | Flexible Working A regular feature in the "UK's Top 10 places to work", my client is an award-winning business with a reputable brand and is widely respected for investing in their employees, placing importance on personal development and … career progression. The Environment you'll be joining: You'll join a friendly 10+ Data Engineering team as the business undergoes a complete greenfield re-architecture from the ground up in Microsoft Azure. The Tech you'll be playing with: Azure Data Factory Azure Databricks PySpark … SQL DBT What you need to bring: 1-3 year's experience in building Data Pipelines SQL experience in data warehousing Python experience would be desirable Experience in Azure/GCP/AWS is a bonus Why join? Joining an award-winning business comes with its more »

team. This team is responsible for and enhancing the business’s lead management and CRM capabilities BI analysts with accurate and relevant application data business insights and predictive models developed by the BI team into self-optimising, productionised systems within the wider business. The ideal candidate will be … responsible for developing and maintaining data pipelines and queries to extract complex datasets needed for our business intelligence and reporting needs. Additionally, the candidate will be involved in writing production-level code to support the organisation’s various CRM and lead-management applications and systems. Key Responsibilities: 1. … Data Extraction and Transformation: Design and develop data pipelines and queries, for efficient data extraction and transformation. Collaborate with cross-functional teams to understand data requirements and ensure accurate and timely delivery of BI solutions. 2. Business Intelligence: Work closely with business more »

About The Role We are recruiting for a Principal Data Engineer to join our team. Principal Data Engineers work in multi-disciplinary teams that build, support, and maintain user-centered digital solutions that offer real value and work for everyone. Our Principal Data Engineers … are experts in their field. You will act as a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships, and be passionate about developing and upskilling others. Your role in a … and ensuring that challenges are overcome. Lead in the recruitment of other engineers, and support other consultants in their professional development. Ensure our Data and Engineering communities contribute to our business at a strategic level. Lead on new business opportunities, writing technical bids and proposals. Promote our Data more »

We are looking for an experienced Senior Data Engineer passionate about designing and building high-quality data pipelines to power cutting-edge genAI products. The ideal person would have a strong background and expertise in real-time data streaming and cloud technologies. They would … The person we’re looking for We are looking for a self-starter who can see the big picture and understand how our data points are connected. You should be able to use your excellent communication skills to simplify and explain concepts to others. You will also be … bringing out the best in them, have excellent communication skills and enjoy fostering best practices. You’ll be responsible for Serving as a data engineering subject matter expert Owning and shaping our data streaming roadmap Collecting use cases and requirements from the wider data more »

created role within the Business Improvement & Change function responsible for delivering and driving business change across the organisation. Candidate Profile: A passionate experienced data and business intelligence professional with ideally experienced within a highly regulated industry. Skilled in Power BI, DAX, Excel and MS SQL, with hands on … experience developing and designing end user reports Strong management and leadership skills Experience and understanding of data architecture and infrastructure to include data pipelines, data warehousing and ETL Knowledge in supporting regulatory reporting and experience of data governance. If you are interested … experience and skills evidenced on the CV. For information on how your personal details may be used by Sellick Partnership, please review our data processing notice on our website. more »

their way to becoming a billion dollar organisation. Key Responsibilities: Oversee the creation, implementation, and maintenance of scalable analytic solutions, working closely with data scientists, software engineers, and other team members. Provide strategic technical direction, support, and mentorship, fostering a culture of continuous learning and innovation. Lead the … improvement initiatives, and address any customer-related challenges. Desirable Technical Experience: Proficiency in Java, Kotlin, or Python. Experience with NLP, ML-Ops, and data pipelines. Familiarity with ML frameworks such as TensorFlow or PyTorch Strong understanding of ML algorithms, statistical techniques, and data analysis. Experience with more »

and also offer you a chance to work in a highly motivated and smart team of engineers? You'll work as a Senior Data Engineer building a data and analytics platform that's used by the hedge fund's trading desks. You'll join at a … time where the fund are diversifying into new markets and therefore you'll play a crucial part in all aspects of data operations in this new area for them. You'll work extremely closely with Portfolio Managers/Quants - You'll work with them to understand exactly what … they need from the data and work fully end to end to create solutions that present data in a way that can be consumed effectively by them. Qualifications: Strong experience with Python for data engineering. Experience building custom Data Pipelines Strong SQL more »