126 to 150 of 158 Data Pipeline Jobs in the UK excluding London

Senior Data Engineer Scottish Based, 1/2 office visits per month £50,000 - £58,000 + bonus & package AI Connect have partnered with a well-regarded Scottish data consultancy who are looking for a Senior Data Engineer to join the team. You will … be developing robust cloud data environments within financial clients across the Central Belt, as a Senior member of a friendly and talented team. This role would be suitable for someone who is looking for leadership responsibilities whilst still being a hands-on developer. You will have the opportunity … to develop data pipelines into Azure & AWS, as well as contributing to some SAS development on legacy projects when required. Python or PySpark and SQL will be your bread and butter, with any experience of Airflow being a great bonus. The core skillset: Python/PySpark for building more »

We are looking for an experienced Senior Data Engineer passionate about designing and building high-quality data pipelines to power cutting-edge genAI products. The ideal person would have a strong background and expertise in real-time data streaming and cloud technologies. They would … The person we’re looking for We are looking for a self-starter who can see the big picture and understand how our data points are connected. You should be able to use your excellent communication skills to simplify and explain concepts to others. You will also be … bringing out the best in them, have excellent communication skills and enjoy fostering best practices. You’ll be responsible for Serving as a data engineering subject matter expert Owning and shaping our data streaming roadmap Collecting use cases and requirements from the wider data more »

Data Engineer Global Tech Business Paying up to £55k Hybrid – 2 days a week in Belfast but they are very flexible You must be based within a commutable distance to Belfast La Fosse have partnered with a standout tech business, which has been at the heart of driving … innovation and transformation in some of the biggest brands globally. They're currently hiring across the board for Mid, Senior & Principal Data Engineers into their Belfast office, which has a headcount of 110 in the team already. As part of the Digital team, you’ll be tasked to … centric service design, and agile engineering practices, then this is the opportunity for you! Requirements: Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python or Scala and SQL. Previous experience with cloud computing more »

created role within the Business Improvement & Change function responsible for delivering and driving business change across the organisation. Candidate Profile: A passionate experienced data and business intelligence professional with ideally experienced within a highly regulated industry. Skilled in Power BI, DAX, Excel and MS SQL, with hands on … experience developing and designing end user reports Strong management and leadership skills Experience and understanding of data architecture and infrastructure to include data pipelines, data warehousing and ETL Knowledge in supporting regulatory reporting and experience of data governance. If you are interested … experience and skills evidenced on the CV. For information on how your personal details may be used by Sellick Partnership, please review our data processing notice on our website. more »

Financial Services firm looking for a heavy hitting Data engineer where some of your Key Responsibilities will include: Develop new pipelines based on business needs or to improve the current system. Maintain existing data pipelines, anticipating and addressing issues promptly and professionally. Monitor critical processes effectively. … and ETL. Essential Skills and Qualifications Technical Proficiency : Expertise in SQL (Postgres, Athena Presto SQL) and proficiency in Python for building and managing data pipelines. AWS Experience : Skilled in using serverless architecture, including Lambda, Glue, Step Functions, SNS, SQS, and S3. Data Engineering Expertise : Over … years of experience in data engineering, creating data pipelines in a cloud environment, with a solid understanding of best practices. Effective Communication : Ability to clearly convey and gather requirements from non-technical business stakeholders. Deployment and Documentation : Proficient in controlled deployment and documentation practices using GitHub more »

Machine Learning Engineer My client is looking for a Machine Learning Engineer to join their growing data science team. This role involves building back-end systems and web apps to develop, test, and deploy ML tools, and managing data pipelines and infrastructure. The position is part … Models, with direct reporting to the executive team. About the Company: They are a rapidly expanding firm with a successful track record in data science projects, particularly in decision-support neural networks. The team is dedicated to developing cutting-edge ML tools with the goal of commercializing them. … Leveraging extensive data and strong funding, they aim to create specialized ML tools, focusing initially on NLP tools and decision-support systems. The Role: The Machine Learning Engineer will: Develop web apps and back-end platforms for ML and data analytics tools. Create ETL pipelines from more »

Lead Data Engineer Want to help drive the Data function with one of the most reputable employers in Belfast? This company is known for it’s innovation, delivery, and culture. Their Belfast hub is at the centre of the tech community, promoting learning and diversity at … all levels. They have a new opportunity for a Lead Data Engineer – this function is still relatively young in this region, and they’re looking for a thought leader in the industry to come in to this blank page and help write a new story. The person Experienced … in designing and deploying production data pipelines within a big data architecture Strong technical skills in Python, SQL and AWS (though they’re very open to any cloud experience) Experience processing large volumes of structured and unstructured data Experience of leading teams, mentoring junior more »

retail retirement and insurance businesses, we’re a fast-growing division with big, customer-centred ambitions. Job Description Legal and General Retail’s Data Operations team are currently hiring three Lead Data Engineers following the merger of internal divisions resulting in them expanding into a new … area. These positions are to focus on the retirements side of the Retail division and will build out new data pipelines utilising tools such as Synapse, DBT, Azure Devops and Snowflake. This role will see you responsible for designing, building, and implementing a variety of data … Facilitating the refinement of the tasks in the Product Backlog and guide and support your team as you break deliveries down into technical data engineering components. Converting user stories in to technical, quality, testing and documentation tasks in the chosen work-flow management tool. Liaising with the end more »

and also offer you a chance to work in a highly motivated and smart team of engineers? You'll work as a Senior Data Engineer building a data and analytics platform that's used by the hedge fund's trading desks. You'll join at a … time where the fund are diversifying into new markets and therefore you'll play a crucial part in all aspects of data operations in this new area for them. You'll work extremely closely with Portfolio Managers/Quants - You'll work with them to understand exactly what … they need from the data and work fully end to end to create solutions that present data in a way that can be consumed effectively by them. Qualifications: Strong experience with Python for data engineering. Experience building custom Data Pipelines Strong SQL more »

hands-on Machine Learning Engineering Manager to lead an agile team of talented ML Engineers. How will you contribute? Technical Leadership: Collaborate with data scientists, software engineers and other stakeholders to design dynamically scalable and efficient Analytic services leveraging in-house and third-party models. Lead by example … assigned. Technical Requirements Good experience and Proficiency with JVM language (Java/Kotlin) and experience in Python Experience in NLP, ML-Ops and data pipelines Experience with ML frameworks/libraries such as TensorFlow, PyTorch, scikit-learn Strong understanding of ML Algorithms, Statistical techniques, and data analysis methodologies Experience with Data processing, feature engineering and model evaluation techniques. Experience in cloud platforms like Amazon Web Services & Google Cloud Experience with Amazon Sagemaker and Jupyter Notebooks Experience with Model Servers such as Triton Inference server Experience working in AI/ML based Analytics more »

About the role While people will always be at the heart of our Society, we also recognise the increasingly powerful role data will play in our future success. So as we grow, were continuing to strengthen our capabilities and now have an exciting opportunity for a Senior Data Engineering Capability Manager. Working on our data modernisation ecosystem project, this person will play a pivotal role in maturing the Societys data engineering capabilities and will be responsible for defining new approaches for data engineering. As well as assisting in shaping the … data engineering framework in the Society, the person in post will also be responsible for coaching our team of data engineers to use modern day, state-of-the art practices. The Senior Data Engineering Capability Manager will work closely with business stakeholders to understand more »

Responsibilities: Design, build, and maintain scalable data pipelines using Python, Pandas, and PySpark. Develop, deploy, and manage containerized applications using Kubernetes. Create and manage RESTful APIs to facilitate data access and integration. Implement and manage data storage solutions using AWS S3. Orchestrate and monitor … data workflows using Apache AirFlow. Collaborate with cross-functional teams to gather requirements and deliver data solutions that meet business needs. Ensure data quality, integrity, and security across all data processes. Troubleshoot and optimize data processes for performance and cost more »

Overview: We are seeking a highly skilled SOC Engineer to join our team. The ideal candidate will be responsible for developing and maintaining data pipelines, managing cyber defence applications, and collabora... more »

already hold active DV or SC clearance to be considered for this position. Role Outline: Assist with the continued development and maintenance of data pipelines using NiFi and signature updates using Elastic/Kibana . System administration on specific cyber defence applications and systems to include installation, configuration more »

the UK or those who do not possess clearance already. The Role! You will be assisting with the continued development and maintenance of data pipelines using NiFi and signature updates using Elastic/Kibana. Alongside System Administration on specific cyber defence applications and systems to include installation, configuration more »

Azure Data Engineer- Birmingham - £500pd Outside I'm currently looking for a Data Engineer to join a company that is based in Birmingham. They need someone to start in the next few weeks. Location: Birmingham (on site 2 times a week) Length: 6 months Day Rate … per day. IR35 Status: Outside of IR35 Required experience will include: Expertise in designing and implementing data pipelines using Azure services such as Azure Data Factory and Azure Databricks. Hands-on experience with SQL database design Experience of product lifecycle management principles and tools (e.g. DevOps … terraform ) and relational database manipulation and interrogation. Experience working with Power BI If you are interested in this Data Engineer role please apply with your most recent CV. Alternatively email me on George . batson @ Randstad . co . uk Azure Data Engineer- Birmingham - £500pd Outside more »

business information accessible to all. Twenty-five years later, we’ve not only realised this dream, changed the market for the better, made data intelligence accessible to all businesses big and small but most importantly, opened new avenues of data intelligence for businesses with machine learning … AI and connected data. From risk management through to opportunity identification, our industry-leading solutions, power decisions for companies by turning their data into actionable insights that help them become stronger, grow faster and thrive. THE TEAM This opportunity is to join a team of highly technically skilled … engineers, who are redesigning Creditsafe data platform with high throughput and scalability as primary goal. The data delivery platform is being built upon AWS redshift and S3 cloud storage. The platform expected to manage over billion objects along with daily increment of more than 10 million more »

the strategic DevOps approach of their ML applications, used by thousands of customers a day. This role would see you collaborate with the Data Science team to design and implement scalable infrastructure for machine learning model deployment and data processing. Whilst also deploying machine learning models … and data pipelines to production environments, ensuring robust monitoring and optimal performance. you will also take on th and develop and maintain automation scripts and tools to streamline ML model deployment and ensure reproducible. Implement security best practices and ensure compliance with data privacy regulations in … all processes. Whilst working with cross-functional with Data Scientists, Software Engineers, and DevOps team members for efficient model development, testing, and deployment. The successful DevOps/MLOps engineer will have the following skills: 1+ years working as a DevOps Engineer Proven experience in DevOps/MLOps with more »

Stride Recruitment is working with a leading data consultancy focused on delivering Data & Analytics Solutions for clients in markets such as Financial Services, Retail, CPG, and Telco. They specialise in the delivery of Modern Data Solutions for firms in their chosen target markets. Using … innovative technologies, they deliver data pipelines, cloud data architectures, advanced analytical and AI/M... more »

software and systems, architect low latency infrastructure solutions, proactively guard against cyber threats, and leverage machine learning alongside financial engineering to continuously turn data into action. Create new businesses, transform finance, and explore a world of opportunity at the speed of markets . Engineering, which is comprised of … of digital possibilities? Start here. Who We Look For Goldman Sachs Engineers are innovators and problem-solvers, building solutions in risk management, big data, mobile and more. We look for creative collaborators who evolve, adapt to change and thrive in a fast-paced global environment. Wealth Management Goldman … LOOKING FOR Computer Science, Mathematics, Engineering or other related degree at bachelors level Java, Scripting, REST, Spring Boot, Jersey Familiarity with Gradle and Gitlab pipeline automation Familiarity with performance testing frameworks such as JMeter Kafka, MongoDB, ElasticSearch, MemSQL, Sybase IQ/ASE 5+ years of hands on experience on more »

AI solutions that enhance, organise, and enrich their data, cost-effectively, accurately, and scalably Plan and manage their ML/AI delivery pipeline Mentor and coach team members on ML engineering best practices Advise senior management on their ML/AI strategy. Key skills: Python for Machine … Learning and Data Science Computer Vision Frameworks used in Machine Learning and Data Science such as TensorFlow, PyTorch, and scikit-learn. Data Science and Visualisation libraries including Pandas, NumPy, scikit-learn, matplotlib, Seaborn. Cloud services used in machine learning and data science … such as Azure, OpenAI, Hugging Face, AWS ML/AI. Machine Learning Applications development life cycle processes and tools - MLOps, including building ETL data pipelines. Cutting-edge approaches to Machine Learning, including transformer models, diffusion models, and adversarial machine learning. Experience in fine-tuning off-the-shelf Large more »

analytics and process automation; select and integrate optimal AI technologies, conduct training workshops for employees at all levels and partner with software and data engineering teams to ensure the infrastructure and data pipelines are in place to support the needs of Generative AI applications. This is … environment with casual dress code and a range of facilities. About you: You are degree educated in a relevant discipline i.e. Computer Science, Data Science or closely related, likely to have MSc in Artificial Intelligence or Machine Learning You're tech savvy with experience of integrating emerging technologies more »

do things differently. We re focused on our core values using these we ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … implementing cloud solutions for different applications, automating cloud operations and cloud deployments Assume responsibility for the architecture of solutions that leverage advanced analytics, data pipelines, web portals, statistical models, Machine Learning and AI, through our technology platform Draw on the strength and experience of a wider team of more »

DOE Vision of the role: This is an exciting role which will drive impactful growth through advanced segmentation, personalisation, and data management. As a key member of our marketing team, you will implement sophisticated techniques to optimise funnel conversion rates, ensuring that every subscriber receives timely and relevant … messaging. Your role will also focus on maintaining and enhancing our data management processes, ensuring that campaign data is up-to-date and accurately mapped. This isn't just another job; it's an opportunity to leave your mark and shape something exciting. Join us in … transforming how we engage with our audiences and deliver exceptional value through targeting and strategic data techniques. Traits & Characteristics: In this role, you'll be instrumental in optimising and managing our data using Salesforce and SQL. Taking full responsibility for data configuration and performance more »

DOE Vision of the role: This is an exciting role which will drive impactful growth through advanced segmentation, personalisation, and data management. As a key member of our marketing team, you will implement sophisticated techniques to optimise funnel conversion rates, ensuring that every subscriber receives timely and relevant … messaging. Your role will also focus on maintaining and enhancing our data management processes, ensuring that campaign data is up-to-date and accurately mapped. This isn't just another job; it's an opportunity to leave your mark and shape something exciting. Join us in … transforming how we engage with our audiences and deliver exceptional value through targeting and strategic data techniques. Traits & Characteristics: In this role, you'll be instrumental in optimising and managing our data using Salesforce and SQL. Taking full responsibility for data configuration and performance more »