22 Data Pipeline Jobs in the South West

experience we're looking for, please go ahead and apply. We'd love to hear from you! About the role As the Senior Data Management Analyst, you will be responsible for continuous evolution of the data quality life cycle practices. This includes defining and proposing data … and their current levels under each dimension. You will take a leading role in supporting the organisation in improving the quality of its data by acquiring data to be brought under governance and perform data profiling analysis to understand it's origination, definition, lineage … into wider data management subjects e.g. Data Quality Insight, Data Quality Management, Data Quality in the pipeline, Master Data Management etc. Design, implement & maintain data quality technology Partner with key project initiatives and act as escalation point more »

Azure Data Engineer Perm Cheltenham/Hybrid working (2/3 days per week onsite) Up to £65,000pa Candidates must be eligible for SC Clearance We're in search of an exceptional Azure Data Engineer to join our Engineering Team. As a member of our … re seeking a Data Engineer with a focus on Azure, showcasing proficiency in: · Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. · Utilizing Azure data and analytics services, including … but not limited to Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Stream Analytics, and Azure Synapse Analytics. · A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. · Designing and deploying production data more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £55,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … re seeking a Data Engineer with a focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including … but not limited to Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Stream Analytics, and Azure Synapse Analytics. A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Designing and deploying production data more »

Salary: Up to £100,000 depending on experience Location: Hybrid working in either Swansea, Bristol, Manchester, London. Are you a skilled Data Engineer who can deliver Data Platforms? Are you familiar of working on agile delivery-led projects? Data Engineers at Made Tech help … build data platforms to enable predictive government services that make a positive impact on the people in the UK. So, if you are looking to be part of this mission, we would love to hear from you. Support in applying If you need this job description in another … interviews and any other needs. We also welcome any feedback on how we can improve the experience for future candidates. As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by more »

Head of Data 4 days a week/Gloucestershire Up to 100k Austin Fraser is working with a leading hospitality group, keen to bring on a Head of Data to make the chains within the groups more data driven. This is a new role … through growth and well suited to an individual with a mix of data, analytics and business acumen. They're looking for someone who is keen to remain hands-on and has strong experience working with Python, Azure and a strong understanding of data security and privacy … package which includes 33 days holiday, private medical insurance and stakeholder pension scheme. The role: Work alongside systems engineers to create and deploy data pipelines, data warehouses, and data lakes. Create and implement a robust data architecture strategy that aligns with business more »

Responsibilities: As a pivotal member of our rapidly expanding business, your role involves: Designing and Maintaining Data Architectures and Pipelines: Create and optimize robust data architectures and pipelines. Assemble intricate data sets that align with both functional and non-functional business requirements. Identify opportunities … to acquire new data from various systems. Enhancing Processes: Develop and refine data set processes for effective data modeling, mining, and production. Build the necessary infrastructure for seamless data extraction, transformation, and loading from diverse data sources. Data Reliability and Efficiency: Recommend and implement strategies to enhance data reliability, efficiency, and quality. Collaborate with Data Scientists and Machine Learning Engineers to construct analytics tools that leverage the data pipeline. These tools provide actionable insights related to asset management, operational efficiency more »

Role: Data Engineer (DV Cleared) Salary: £55,000 - £65,000 Location: Bristol Do you want to be at the heart of some of the biggest and most ambitious programmes undertaken to keep our country safe? We are proud of the impact we have with our Defence & Security clients … and want to grow your career in this sector, we are very keen to hear from you. As a practitioner in AI & Cloud Data Engineering , you are responsible for bridging the gap between our customers' needs and technical solutions. Your primary responsibilities main responsibility is to building large … could include and may require you to: Use data integration tools, integration frameworks, and query engines with limited guidance, following the standard pipeline authoring process Implement optimized solutions to deliver on complex data integration problems independently Design quality software applications, coordinating efforts with other developers more »

Data Scientist/Engineer - Hybrid/Bristol Job Title : Data Scientist/Engineer Location : Hybrid/Bristol Remuneration : £50,000 - £60,000 per annum Contract Type : Permanent Role will be based with the modelling team. 25% Data Submission and Cleansing (Data Engineer … Process Improvement (Data Science). Ideally, seeking someone with strong Data Science exposure but Data Engineering skills. Responsibilities : Play a pivotal role in crafting, enhancing, and managing intricate data ingestion pipelines, ensuring their efficiency, scalability, and dependability. Integrate advanced machine learning elements … into data pipelines to elevate data processing and analytical capabilities. Devise and implement data quality metrics and dashboards for monitoring, ensuring the fidelity and precision of ingested data. Collaborate closely with data scientists, engineers, and cross-functional team members in an agile more »

Azure Data Engineer (SC Cleared) Location: Bristol Salary: £50,000 - £60,000 We're seeking Azure Data Engineer with active SC Clearance. This is a fantastic opportunity to join one of the most reputable digital solution provider's in the United Kingdom providing exposure to the … biggest and most ambitious programmes undertaken to keep our country safe. The SC Cleared Azure Data Engineer will be joining the Defence & Security arena, where you will help digitise defence with new thinking on technology capabilities and adoption processes, so we need someone who is sensitively able to … combine the latest thinking with traditional military functions. *Must have Active SC Clearance* Role requirements Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

Azure Data Engineer | Cheltenham | £50,000-£70,000 Locke & McCloud are working with a leading Cyber Security Consultancy that is home to over 4000 specialists who support clients across manufacturing, defence and security, energy and utilities, financial services and many other industries. They have offices globally and are … recognised for the impressive high standard of work they conduct. They are looking for an Azure Data Engineer, you will play a pivotal role in this journey, leveraging your expertise to architect, design, and implement scalable data solutions on the Azure platform. You will collaborate closely … with stakeholders to understand business requirements, design data solutions, and deliver value-added insights. You will be responsible for architecting data pipelines, optimizing data storage and retrieval, and ensuring the integrity and security of our data ecosystem. Additionally, you will have the more »

Job Title: Data Analyst - Bristol - £50K We are working with a growing digital agency client based in Bristol who are looking for a talented Data Analyst to join their team. This is a hybrid role with at least 2 days a week in their local office … hub (Bristol or London). As the Data Analyst, you will be responsible for providing structure and process around data collection and analysis as the company scales. You will have a passion for data and enjoy using it to support decision making. Your key … reports that improve performance, formulating and documenting requirements for outputs, performing data analysis on datasets, troubleshooting issues in the data pipeline and establishing standard reports on key business areas. You will also need to maintain and enhance datasets, review data collection processes and more »

Azure Data Engineer I am currently working with a client in Bristol who is looking for an experienced Azure Data Engineer to provide assistance on an ongoing project for the next 6 months! Role: Azure Data Engineer Rate: £500 - £650 per day Duration … Months Location: Bristol - 5 days a week onsite work Status: Inside IR35 Role Overview: As a Azure Data Engineer, you'll be at the forefront of crafting, innovating, and sustaining data solutions within the Azure ecosystem. Your mastery will be instrumental in steering data initiatives towards success, ensuring they're finely tuned for performance, scalability, and dependability. Key Responsibilities: Craft, refine, and deploy data pipelines and ETL workflows within Azure's expansive framework. Leverage Azure's suite of services, including Azure Data Factory, Azure Databricks, and Azure Synapse more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Senior Data Engineer - 6 Months £600 - £650 Inside IR35 Wiltshire/Hybrid Sanderson are seeking a Senior Data Engineer for a leading financial services business as they embark on a major change and transformation journey. Key Responsibilities: Design and deliver data pipelines onto a … Data Platform using ETL tools. Assist with the day-to-day management of the business's data infrastructure. Drive innovative Data Engineering Solutions. Migrate data from a Snowflake warehouse to a SQL warehouse. Key Skills: SSIS Snowflake SQL Matillion Expertise in building … data pipelines and ETL processes. Strong modeling and data warehousing background. Experience in the financial services sector or regulated environments. more »

Role: Senior Data Engineer Start: ASAP (ideally end of May) Location: Bristol/Hybrid - 2 days per week Salary: £73k Our market leading Financial Services client is looking for an experienced Data Engineer as they embark on a major change and transformation journey. Key Responsibilities: Design … and Deliver Data Pipelines onto a new Data Platform Act as Principle Data Expert to build out standards and mentor junior analysts Drive Data Engineering Solutions Key Skills Matillion Snowflake SQL Expert in building data pipelines ETL Strong Modelling and … Data warehousing background Financial Services/experience of working in a regulated environment Benefits: 10% non contributory pension Healthy holiday entitlement Health Insurance Life Assurance Share Incentive Scheme Attractive Bonus EV Hire Scheme more »

and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions, machine learning, DevOps optimization, and modernization of applications, data, and platforms. We work with incredible clients in all types of industries such as smart home devices, space exploration, beer manufacturing, finance, ecology, and logistics. We work with some of the sharpest minds in … collaboration while inclusivity strengthens our community. As part of our team, you'll be tasked with: Here at Ascent, we believe that using data in the right way doesn't just help companies perform better; it transforms entire industries. You'll help world-leading brands transform the way more »

hybrid role 80% homeworking available and 20% in Stratford Upon Avon About the role We are seeking a skilled Developer to join our Data Engineering team. In this role, you will play a pivotal part inmaintainingand enhancing our technical service offerings, ensuring operational efficiency and effectiveness. As a … Developer in our Data Engineering team, you willbe responsible formanaging technical service operationssupporting data pipelines throughout the Cloud Data Platform. With a focus on problem-solving, adaptability, and analytical skills. Collaborating closely with stakeholders, you will gain a deep understanding of business imperatives and … Experience in data management, with an understanding of data storage and extraction principles. Azure Data Factory (error handling, pipeline triggers), Azure Storage, Azure Synapse and Azure SQL Server. Previous experience in technical service operations or a related field Strong problem-solving abilities, adaptability more »

Power Bi skills some Azure knoweldge would be ideal or other cloud technology and DevOps pipelines experience Our client is looking for a Data Engineer who is technically minded who will have the opportunity to have a broad and varied workload of interesting data enginees, covering … JSON Maintain a rigorous and scalable CI/CD process across multiple DevOps projects Maintain and develop Azure Modules to maturise our automated data pipelines and analyses This is a great opportunity to join a technology focused Insurance firm and a great way to break into the Insurance more »

Principal Data Engineer - Bristol This Digital Services Partner revolutionises how people engage with technology. They pride themselves on delivering innovative solutions that enhance user experiences and drive measurable results. People are genuinely at the heart of this business, and they're looking for a Principal Data Engineer to join. This role will provide technical expertise in data engineering practices both internally and to clients, and provides great opportunity to develop and upskill. The role: Act as a technical SME to help produce user centred software Design and manage software deployment and development … teams to prioritise workload and realign where needed Be a strong communicator, present prototypes and solutions to stakeholders The person: Strong experience in Data Engineering, with python being your primary language Strong cloud exposure - AWS, GCP or Azure Excellent SQL and relational database skills - NoSQL desirable Experienced in more »

you play a key role in enhancing the machine learning infrastructure. Additionally, you will work closely with the Biology team to integrate microscopy data and protocols for cell differentiation. What the company hiring is looking for 5+ years of experience as a Machine Learning Engineer, including experience working … of a team of ML and software engineers, including project planning, mentoring, and implementing agile methodology. Experience in supporting/leading MLOps and Data Engineer operations and teams. Strong background in computer vision ML models and using modern frameworks for deploying these models. Experience of working within a … distributed systems, and familiar with continuous integration, unit testing, and code review practices. Experience in architecting and maintaining scalable ML infrastructure, including big data pipelines, large-scale model training/inference, and serving infrastructure, as well as experience implementing best practices for retraining, version control, reproducibility, and automation. more »