101 to 125 of 154 Data Pipeline Jobs in the UK excluding London

new solutions : Be comfortable with research, exploration, experimentation and uncertainty as we are always pushing the boundaries and capabilities of our capabilities. Perform data analysis and mining with your preferred tools to model data structures and concepts Master Data Curation - Enrich our central data repositories ensuring they are up to date while increasing the depth and breadth of what is captured. Codified data pipelines and Business Rules that automate outcomes and data freshness Data implementation of new vendors/customers/products etc into relevant systems more »

Role: Senior Data Engineer Start: ASAP (ideally end of May) Location: Bristol/Hybrid - 2 days per week Salary: £73k Our market leading Financial Services client is looking for an experienced Data Engineer as they embark on a major change and transformation journey. Key Responsibilities: Design … and Deliver Data Pipelines onto a new Data Platform Act as Principle Data Expert to build out standards and mentor junior analysts Drive Data Engineering Solutions Key Skills Matillion Snowflake SQL Expert in building data pipelines ETL Strong Modelling and … Data warehousing background Financial Services/experience of working in a regulated environment Benefits: 10% non contributory pension Healthy holiday entitlement Health Insurance Life Assurance Share Incentive Scheme Attractive Bonus EV Hire Scheme more »

are looking for an BI Analyst position for a large business based in Liverpool. The Business Intelligence Analyst is responsible for maintaining the data architecture and data pipelines that support business intelligence systems. This includes ensuring that the data architecture is scalable, secure, and … optimized for performance. They also work closely with other teams to ensure that data is properly integrated and available for analysis. The Business Intelligence Analyst will work closely with the analysts for reporting requirements and ensuring the correct data structure is in place for implementing newly … awarded contracts. The role will be responsible for designing processes and controls to ensure all data presented is tested, and accurate. Good communication skills is crucial for this role as you will need to present key information to managers across the business. It is essential you have strong more »

SENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement both Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly … organisation. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years of commercial work as a Senior Data Engineer (responsible for taking decisions, rather than just writing code) An ability to write production quality Python code. Strong SQL Skills Experienced creating data more »

Leading ecommerce client now requires a Data Engineer to join their innovative Machine Learning team. This role will focus on increasing overall data efficiency using Machine Leaning, streamlining data processes to increase overall profitability, and ensuring our clients operations and customer teams can increase … strong exposure to Machine learning principles/practices and technologies such as ML flow/Sage Maker. The role: Develop robust and scalable data pipelines. Collaborate with cross-functional teams to develop and deploy Machine Learning models and algorithms to solve business challenges and create opportunities. Contribute to … the development of our clients in-house Machine Learning operations framework. Support the data science and analytics team in deploying pipelines. Coach and mentor the team to improve development standards. Key requirements: Strong hands-on experience with Databricks, Spark, SQL or Scala. Proven experience designing and building data more »

Data Architect + Salary: £85,000 - £100,000 + Security Clearance: Must hold SC or DV + Location: Romsey or Woking (Hybrid) *UK Eyes only - Dual Citizenship or overseas card not eligible due to nature of projects Areas of Responsibility/Tasks: Help Defence customers develop their strategy … for data as a strategic asset and define the appropriate level of governance needed and the appropriate processes. Communicate the data strategy to non-technical stakeholders and technical experts. Define and the architecture for data software and analytics solutions, either as standalone engagements or … high level technical requirements. Provide technical guidance and coaching to junior members of the team. Essential skills/experience: Alongside your skills with Data specific technologies, you have a broad technical background which allows you to rapidly understand new systems and domains, and prototype solutions based on your more »

Data Architect + Salary: £85,000 - £100,000 + Security Clearance: Must hold SC or DV + Location: Romsey or Woking (Hybrid) *UK Eyes only - Dual Citizenship or overseas card not eligible due to nature of projects Areas of Responsibility/Tasks: Help Defence customers develop their strategy … for data as a strategic asset and define the appropriate level of governance needed and the appropriate processes. Communicate the data strategy to non-technical stakeholders and technical experts. Define and the architecture for data software and analytics solutions, either as standalone engagements or … high level technical requirements. Provide technical guidance and coaching to junior members of the team. Essential skills/experience: Alongside your skills with Data specific technologies, you have a broad technical background which allows you to rapidly understand new systems and domains, and prototype solutions based on your more »

and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions, machine learning, DevOps optimization, and modernization of applications, data, and platforms. We work with incredible clients in all types of industries such as smart home devices, space exploration, beer manufacturing, finance, ecology, and logistics. We work with some of the sharpest minds in … collaboration while inclusivity strengthens our community. As part of our team, you'll be tasked with: Here at Ascent, we believe that using data in the right way doesn't just help companies perform better; it transforms entire industries. You'll help world-leading brands transform the way more »

AWS Data Engineer | £50-60k | Fintech | Hybrid Leeds Want to work for a business that uses Data to create predictions that shape the future of fintech decision making? If so, AWS Data Engineers this one is for you... About the business 🚀 G.Digital has … how the everyday person gets closer to financial freedom! They've kicked off some exciting new projects including the development of a new Data Lakehouse and the implementation of an iPaaS solution and now they're looking to hire a Data Engineer to join their small … Python Any exposure to Terraform would be great Liaising with other areas across the business to help define requirements for new projects, including both pipeline and ETL requests What’s on offer to you? 💰 £50-60k Bonus of up to 10% Flexible working (core hours) Private health more »

hybrid role 80% homeworking available and 20% in Stratford Upon Avon About the role We are seeking a skilled Developer to join our Data Engineering team. In this role, you will play a pivotal part inmaintainingand enhancing our technical service offerings, ensuring operational efficiency and effectiveness. As a … Developer in our Data Engineering team, you willbe responsible formanaging technical service operationssupporting data pipelines throughout the Cloud Data Platform. With a focus on problem-solving, adaptability, and analytical skills. Collaborating closely with stakeholders, you will gain a deep understanding of business imperatives and … Experience in data management, with an understanding of data storage and extraction principles. Azure Data Factory (error handling, pipeline triggers), Azure Storage, Azure Synapse and Azure SQL Server. Previous experience in technical service operations or a related field Strong problem-solving abilities, adaptability more »

Data Engineer | Yorkshire | up to £45,000 basic | Flexible Working A regular feature in the "UK's Top 10 places to work", my client is an award-winning business with a reputable brand and is widely respected for investing in their employees, placing importance on personal development and … career progression. The Environment you'll be joining: You'll be joining a friendly 10+ Data Engineering team as the business undergoes a complete greenfield re-architecture from the ground up in Microsoft Azure. The Tech you'll be playing with: Azure Data Factory Azure Databricks … PySpark SQL DBT What you need to bring: 1-3 year's experience in building Data Pipelines SQL experience in data warehousing Python experience would be desirable Experience in Azure/GCP/AWS is a bonus Why join? Joining an award-winning business comes with more »

in the resolution of complex user requests and ensuring a minimum of the agreed service level agreements. Maintain confidentiality in accordance with our data protection policies and procedures. Delivering to service quality KPI's that underpin the management of Masteks services Demonstrate knowledge of the specific technologies necessary … software applications, systems, and networks. Knowledge of programming languages Java, JVM, DynamoDB, AWS IAM, CloudWatch, PagerDuty, Tooling TypeScript, Node.js, SRE, AWS Data Pipeline & Visualisation and scripting is a plus. Excellent problem-solving skills with the ability to analyse complex scenarios. Outstanding communication skills, both written and verbal more »

An opportunity for an experienced product manager to join a leading organisation focused on the product lifecycle of a range of monitoring/data products. You will be focused on discovery, long term strategy, and ensuring released products are constantly monitored and roadmaps are up to date and … understanding user requirements, converting these into products whilst driving development and strategy alongside Business Development. We are seeking a Product Manager experienced in data collection and visualization products with knowledge on how and what data is collected in challenging environments by low power, remote and diverse … sensors; how this collected data flows through standard data pipelines and to understand how and why the data collected data aids the user in interpreting the subsea environment. To be successful in your application you will have worked in a product Management more »

ML systems, CI/CD and data pipelines. Participate in enterprise-wide architecture initiatives for AI/ML. Understand the workflow and pipeline architectures of ML and deep learning workloads. Conduct security risk assessments and threat modeling for AI/ML and other business projects performed thorough … models, LLM and development of trustworthiness, safety, fairness, bias and inappropriateness detection, as well as adversarial test specification, development, and execution. Collaborate with data scientists, engineers, and other stakeholders to embed security controls and measures into AI/ML applications, models, algorithms, and data pipelines. Define … and enforce robust access controls, authentication mechanisms, and encryption standards to safeguard AI/ML systems, training data, provenance, and any sensitive data. Stay abreast of emerging AI security threats, trends, and technologies, evaluating their impact and proactively adapting security measures to mitigate potential risks. Provide technical guidance more »

ML systems, CI/CD and data pipelines. Participate in enterprise-wide architecture initiatives for AI/ML. Understand the workflow and pipeline architectures of ML and deep learning workloads. Conduct security risk assessments and threat modeling for AI/ML and other business projects performed thorough … test specification, development, and execution. Define and enforce robust access controls, authentication mechanisms, and encryption standards to safeguard AI/ML systems, training data, provenance, and any sensitive data. Stay abreast of emerging AI security threats, trends, and technologies, evaluating their impact and proactively adapting security measures to … tools, technologies, and frameworks to enhance the overall security posture of AI/ML and other business systems. Develop and maintain relationships between data scientists, data engineers, developers, operations (DevOps, DataOps, MLOps) and business unit leaders to govern and support scalability of the ML and AI more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … Azure or AWS cloud services, and a proven track record in delivering high quality work to tight deadlines. You will work closely with data scientists, software engineers, and domain experts, to gather the business needs and translate them into AI applications. Designing, testing, evaluating, and deploying cutting-edge … efficiency of various domains. There will also be the opportunity to research and implement best practices and standards for AI development, such as data quality, scalability, security, and ethics. SC Clearance/Eligibility required. Qualifications Experience in developing and deploying AI solutions using Python, TensorFlow, PyTorch, Keras, Snowflake more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … Azure or AWS cloud services, and a proven track record in delivering high quality work to tight deadlines. You will work closely with data scientists, software engineers, and domain experts, to gather the business needs and translate them into AI applications. Designing, testing, evaluating, and deploying cutting-edge … efficiency of various domains. There will also be the opportunity to research and implement best practices and standards for AI development, such as data quality, scalability, security, and ethics. SC Clearance/Eligibility required. Qualifications Experience in developing and deploying AI solutions using Python, TensorFlow, PyTorch, Keras, Snowflake more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … Azure or AWS cloud services, and a proven track record in delivering high quality work to tight deadlines. You will work closely with data scientists, software engineers, and domain experts, to gather the business needs and translate them into AI applications. Designing, testing, evaluating, and deploying cutting-edge … efficiency of various domains. There will also be the opportunity to research and implement best practices and standards for AI development, such as data quality, scalability, security, and ethics. SC Clearance/Eligibility required. Qualifications Experience in developing and deploying AI solutions using Python, TensorFlow, PyTorch, Keras, Snowflake more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … Azure or AWS cloud services, and a proven track record in delivering high quality work to tight deadlines. You will work closely with data scientists, software engineers, and domain experts, to gather the business needs and translate them into AI applications. Designing, testing, evaluating, and deploying cutting-edge … efficiency of various domains. There will also be the opportunity to research and implement best practices and standards for AI development, such as data quality, scalability, security, and ethics. SC Clearance/Eligibility required. Qualifications Experience in developing and deploying AI solutions using Python, TensorFlow, PyTorch, Keras, Snowflake more »

to Friday. As a DevOps/MLOps Engineer you will be operationalising machine learning effectively. You will support the architectural needs of their Data Science team to ensure the seamless deployment, monitoring, and maintenance of machine learning models and data pipelines. You will work in close … collaboration with the Data Science team to design and implement scalable and reliable infrastructure for machine learning model deployment and data processing. The successful candidate will deploy machine learning models and data pipelines to production environments and establish robust monitoring and alerting systems to … machine learning model deployment process and ensure reproducibility. The DevOps/MLOps Engineer will implement security best practices and ensure compliance with relevant data privacy regulations in all processes as well as work cross-functionally with Data Scientists, Software Engineers and DevOps team members to facilitate more »

week in the office to collaborate with key stakeholders. This role has a broad remit, as you'll be working closely with their Data Engineering Team in the US, and their Analytics Team in the UK, as well as board-level stakeholders, to ensure they have timely access … to the data they need and deliver effective data-driven solutions. You'll develop and maintain complex datasets, and design data pipelines and complex queries to extract data for the Analytics team to create their Power BI reports. All data … subject to successful background checks including a DBS and Credit Check. Nigel Frank are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, Power more »

week in the office to collaborate with key stakeholders. This role has a broad remit, as you'll be working closely with their Data Engineering Team in the US, and their Analytics Team in the UK, as well as board-level stakeholders, to ensure they have timely access … to the data they need and deliver effective data-driven solutions. You'll develop and maintain complex datasets, and design data pipelines and complex queries to extract data for the Analytics team to create their Power BI reports. All data … subject to successful background checks including a DBS and Credit Check. Nigel Frank are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, Power more »

week in the office to collaborate with key stakeholders. This role has a broad remit, as you'll be working closely with their Data Engineering Team in the US, and their Analytics Team in the UK, as well as board-level stakeholders, to ensure they have timely access … to the data they need and deliver effective data-driven solutions. You'll develop and maintain complex datasets, and design data pipelines and complex queries to extract data for the Analytics team to create their Power BI reports. All data … subject to successful background checks including a DBS and Credit Check. Nigel Frank are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, Power more »

week in the office to collaborate with key stakeholders. This role has a broad remit, as you'll be working closely with their Data Engineering Team in the US, and their Analytics Team in the UK, as well as board-level stakeholders, to ensure they have timely access … to the data they need and deliver effective data-driven solutions. You'll develop and maintain complex datasets, and design data pipelines and complex queries to extract data for the Analytics team to create their Power BI reports. All data … subject to successful background checks including a DBS and Credit Check. Nigel Frank are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, Power more »

week in the office to collaborate with key stakeholders. This role has a broad remit, as you'll be working closely with their Data Engineering Team in the US, and their Analytics Team in the UK, as well as board-level stakeholders, to ensure they have timely access … to the data they need and deliver effective data-driven solutions. You'll develop and maintain complex datasets, and design data pipelines and complex queries to extract data for the Analytics team to create their Power BI reports. All data … subject to successful background checks including a DBS and Credit Check. Nigel Frank are the go-to recruiter for Power BI and Azure Data Platform roles in the UK, offering more opportunities across the country than any other. We're the proud sponsor and supporter of SQLBits, Power more »