1 to 25 of 164 Data Pipeline Jobs with Hybrid or WFH Options

secure operation of AI and ML systems. Develop and own robust enterprise security architecture for AI/ML systems, CI/CD and data pipelines. Participate in enterprise-wide architecture initiatives for AI/ML. This is a hybrid role with multiple UK locations Salary up to more »

Role: Senior Data Engineer Location: Southampton Structure: Full time Hybrid 3 days in office 2 WFH Salary: up to 80k Description: You will be a subject matter expert and use your prior Data Engineering expertise and skill set to perform hands-on development as well as … managing a team of developers, providing consulting services and specialist technical support on data management and database administration. Responsibilities will include: Providing data architectural and design input to strategic direction for the development of data products Making recommendations for the enhancement of the data architecture Designing and enabling the delivery of modern, efficient, and robust data pipelines and data products Analysis of the business data solution requirements, and writing detailed technical requirement Experience required: As a Senior Data Engineer you will be required to more »

We are partnered with a reputable global consultancy that are recruiting AWS DATA ENGINEERS to work on a very exciting LONG-TERM CONTRACT within the financial service sector. Role: AWS Data Engineer Rate: Up to £425 per day (inside IR35) Location: London Hybrid Duration: 6 months … backlog grooming. Key skills: Extensive experience in developing Bigdata pipelines in cloud using Bigdata technologies such as Apache Spark Expertise in performing complex data transformation using Spark SQL queries Experience in orchestrating data pipelines using Apache Airflow Proficiency in Git based version control tools Proficiency with … Linux commands and Bash Scripting Working experience in AWS Bigdata services (EMR, Glue, Data Pipelines, Athena, S3, Step Functions etc.) & AWS CLI Experience with CI/CD tools such as Jenkins Experience working with relational and/or MPP databases Knowledge of Data warehousing concepts Experience more »

A new opportunity has risen for a Data and Insights Manager to join our D2C team. The Data and Insights team is a small but dynamic and experienced group of SMEs who work across Google Analytics, Bloomreach CDP and BI/data engineering. The … and segmented approach to every customer touchpoint to empower our customers to reach their financial goals. Plus, we know the best decisions are data-driven so we give our senior management team the best business intelligence data at their fingertips. Were looking for an experienced, driven … be responsible for managing the day-to-day work of the team, working with the team to triage incoming requests, gather requirements for data tasks (whether that be dashboards, new functionality, analysis pieces or tracking requests) and manage the teams backlog on JIRA. Youll take on running sprint more »

AWS Data Architect - Insight & Data Services - Permanent Salary guideline: £90,000 - £100,000 pa (DOE) + 10% Bonus, Pension up to 6% contributory, Health Insurance, Life Assurance etc. Base Location: UK Wide - Hybrid model - Onsite/Remote The Role: The Cloud Data Platforms team … is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety of projects and sectors. Cloud Data Platforms is the home of the Data Engineers, Platform Engineers, Solutions Architects and Business Analysts who are focused … on driving our customers digital and data transformation journey using the modern cloud platforms. We specialise on using the latest frameworks, reference architectures and technologies using AWS, Azure and GCP. Essential Skills and Experience: * AWS (e.g., Athena, Redshift, Glue, EMR) * Strong AWS Data Solution Architect Experience more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

We are seeking a highly skilled Senior Data Engineer with expertise in SQL, Python and PySpark, with extensive knowledge and practical experience in utilizing AWS services. The ideal candidate will have a strong background in data engineering, with a focus on building scalable and efficient data pipelines. The person in this role will work with a wide array of healthcare data for ingestion, processing and consumption including but not limited to eligibility, claims, payments and risk adjustment. KEY DUTIES AND RESPONSIBILITIES: Design, develop, and maintain robust data pipelines using Python … and PySpark to process large volumes of healthcare data efficiently in a multitenant analytics platform. Collaborate with cross-functional teams to understand data requirements, implement data models, and ensure data integrity throughout the pipeline. Optimize data workflows for performance and more »

As a Cloud Services Manager, you will play a pivotal role in overseeing Convey's public cloud, Big Data, and DevOps portfolios. This is a leadership position responsible for managing a team of highly skilled technologists in the areas outlined above. You will be responsible for designing, implementing … CI/CD pipelines, and ensuring the scalability, security, and reliability of our cloud and DevOps services, with a specific focus on Big Data technologies. The Cloud Services Manager will continuously identify areas of improvement with existing solutions and lead the implementation of new projects while overseeing day … Python (or similar scripting languages). Must demonstrate effective team leadership skills along with the ability to successfully run a team. Data pipeline and automation experience within the AWS and Azure ecosystems. 3-5+ years of Project Management experience. 3-5 years of CI/CD more »

Data Engineer – Hybrid Working £50,000 - £55.000 30 Days Holidays + 4 Days Christmas + Bank Holidays Great Pension Career Development Flexible Working - (Hybrid) A Great Working Environment Excellent Sport & Leisure Facilities Training and Personnel Development Offerings Office Location is close to A45, A46, M1, M6, M40, M42 … implement data security measures Design and implement data quality checks and validation processes within the pipelines using expectations with the pipeline, or dedicated testing tools (SODA) Collaborate with data governance, architects, system/product owners and end users to ensure quality issues are … addressed as needed. Create and maintain technical documentation, including data pipeline specifications, data models, and transformation logic Contribute to data modelling and schema design standards and related documentation. Qualifications & Requirements Degree in Computer Science, Data Engineering, or a related field or more »

Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Investments Data, BI & Analytics Technology team, tasked with developing, managing, and optimizing data pipelines within our data ecosystem. Reporting directly to the Head of Investments Data, BI & Analytics, this role is instrumental in implementing the data strategy that supports front office stakeholders, systems, and clients. The Data Engineer will leverage cutting-edge technology … within our subsidized onsite canteen Must have skills Proven experience as a Data Engineer, with a strong background in data pipeline construction, data architecture, and data warehousing. Expertise in Snowflake, Python, SQL, and cloud-native ETL/ELT tools. Familiarity with more »

Job Role: Azure Data Engineer Location: Central London - Hybrid/3 Days in Office Salary: £60,000 - £70,000 + 12.5% Bonus Key areas: SQL Data Engineer, Azure Data Engineer, Azure Data Factory, Azure Databricks, Azure Data Services, Snowflake, SQL … Server, Data, BI, BI Development, MS BI Chapman Tate is collaborating with a leading Housing Association that is revolutionizing the industry through innovative data-driven solutions. As they continue to expand their operations, they are seeking a talented Azure Data Engineer with strong SQL … expertise to join their dynamic team. Are you passionate about leveraging data to drive business insights and enhance operational efficiency? Do you have experience working with Azure data technologies and a knack for SQL development? If so, this is an exciting opportunity to contribute to the more »

Job Role: Azure Data Engineer Location: Central London - Hybrid/3 Days in Office Salary: £60,000 - £70,000 + 12.5% Bonus Chapman Tate is collaborating with a leading property management company that is revolutionizing the industry through innovative data-driven solutions. As they continue to … expand their operations, they are seeking a talented Azure Data Engineer with strong SQL expertise to join their dynamic team. Are you passionate about leveraging data to drive business insights and enhance operational efficiency? Do you have experience working with Azure data technologies and … so, this is an exciting opportunity to contribute to the success of a forward-thinking property management company. Responsibilities: Design, develop, and maintain data pipelines and ETL processes using Azure Data Factory. Optimize data storage and retrieval processes to ensure scalability, reliability, and performance. more »

means providing exceptional service and using state-of-the-art tech to do it. We're on the lookout for two accomplished Senior Data Analysts to join our dynamic team! Specifically, we're recruiting one Senior Data Analyst with operational expertise, and another with a regulatory … focus, ideally with experience in the energy sector. Both roles require exceptional Tableau skills and proficiency in Databricks. As a Senior Data Analyst, you'll bring over six years of hands-on experience to the table, leveraging your mastery of Tableau to provide actionable insights crucial for strategic … and Python. Experience with advanced analytics techniques, including modeling and segmentation. Strong visualisation skills, particularly with Tableau. Familiarity with cloud-based data pipeline architectures, such as Databricks, and platforms like AWS. Excellent communication and presentation skills. Proven track record of translating technical findings into actionable business insights. more »

means providing exceptional service and using state-of-the-art tech to do it. We're on the lookout for two accomplished Senior Data Analysts to join our dynamic team! Specifically, we're recruiting one Senior Data Analyst with operational expertise, and another with a regulatory … focus, ideally with experience in the energy sector. Both roles require exceptional Tableau skills and proficiency in Databricks. As a Senior Data Analyst, you'll bring over six years of hands-on experience to the table, leveraging your mastery of Tableau to provide actionable insights crucial for strategic … and Python. Experience with advanced analytics techniques, including modeling and segmentation. Strong visualisation skills, particularly with Tableau. Familiarity with cloud-based data pipeline architectures, such as Databricks, and platforms like AWS. Excellent communication and presentation skills. Proven track record of translating technical findings into actionable business insights. more »

Job Title: Junior Data Engineer Company: Krystal Clarity Location: London/Remote Job Type: Full-Time About Us: Krystal Clarity is a rapidly emerging data engineering consultancy that helps businesses leverage data to achieve their strategic objectives. As a lean, fast-paced, and dynamic … company, we are looking for a Junior Data Engineer who is passionate about data and eager to learn and grow in an entrepreneurial environment. Position Overview: We are seeking a dedicated and motivated Junior Data Engineer with some experience or qualifications in Azure or … Databricks. The successful candidate will have the opportunity to work on diverse and exciting data-centric projects, collaborating closely with senior engineers and making meaningful contributions. This role provides an excellent platform to further develop your skills and gain valuable experience in a vibrant entrepreneurial environment. Responsibilities: Assist more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Omni client solutions. These solutions are major differentiators that puts Omnicom ahead of the competition. Specific responsibilities of the team are listed below. Data Taxonomies design & maintenance Data Governance and QA Dashboard design, build and maintenance Data Pipelines design & delivery TW/Planit (& TrackIT … for maintaining and improving tables and business logic for a reporting platform. The Business Intelligence Manager will support an MI Director with all data operations and reporting workstreams for one of Omnicom’s largest global autotive clients and work closely with our engineering team; TSOC. This role will … ensure our AWS data infrastructure is supporting a best-in-class reporting platform for one our our largest accounts within Omnicom Media Group, and will be reporting into the Senior Marketing Intelligence and Reporting Director. Communication skills and the ability to prioritize tasks across projects to meet deadlines more »

Data Engineer/Remote working/£50,000 DOE/Great benefit package - 11 Month FTC Corecom are currently partnered with one of the UK’s leading environmental charities looking for an Azure Data Engineer to join the IT team. They are currently undergoing a multi … the Azure platform Collaborate with cross-functional teams to understand integration requirements and design scalable and efficient solutions to meet business needs. Implement data pipelines, ETL processes, and data transformations Strong experience with Azure Databricks, PySpark, and Python Integrate diverse data sources and formats … including structured and unstructured data, streaming data, and APIs. Technical skills: Strong proficiency in Python Extensive hands-on experience with Azure Databricks Experience with Azure services such as Azure Data Factory, Azure Functions, Azure SQL Database, Azure Storage, etc. Knowledge of RESTful APIs, JSON more »

Senior Data Engineer (Databricks) Hybrid working - 3 days onsite in Manchester Up to £70,000 I'm currently working with a data-centric organisation who are looking for a Senior Data Engineer with strong Databricks experience to join their team. The primary focus of … the role is Databricks data engineering. You will be building data pipelines using Databricks, coding using PySpark, and supporting internal applications. You will also be using Python for Data Transformations and work across the Azure Data Platform. Must Have Strong Databricks Data Engineering skills, not just admin but actually building data pipelines in Databricks and using it regularly. Strong coding experience with Pyspark. Strong experience in SQL Server and Python coding. Knowledge of Azure Data Factory. Strong 3-5 years working as a Data more »

learning models through research, such as reviewing academic papers and adapting them for our use. Drive the development of the cutting-edge 3D AI pipeline, leveraging the latest breakthroughs in 3D data processing, 3D vision, and machine learning techniques. This entails system design and comprehensive testing. Identify … and address bottlenecks in data, pipeline, and operations, proactively devising and implementing agile solutions to enhance scalability and optimize performance. Take ownership of project management for AI/Vision initiatives, overseeing end-to-end execution and effectively coordinating data operations. Mentor and empower junior team more »

Role: Senior Data Engineer Start: ASAP (ideally end of May) Location: Bristol/Hybrid - 2 days per week Salary: £73k Our market leading Financial Services client is looking for an experienced Data Engineer as they embark on a major change and transformation journey. Key Responsibilities: Design … and Deliver Data Pipelines onto a new Data Platform Act as Principle Data Expert to build out standards and mentor junior analysts Drive Data Engineering Solutions Key Skills Matillion Snowflake SQL Expert in building data pipelines ETL Strong Modelling and … Data warehousing background Financial Services/experience of working in a regulated environment Benefits: 10% non contributory pension Healthy holiday entitlement Health Insurance Life Assurance Share Incentive Scheme Attractive Bonus EV Hire Scheme more »