1 to 25 of 132 Data Pipeline Jobs in the UK excluding London

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Sheffield, mainly remote or something in-between, believe that your best work happens when you have the freedom to create your ideal workspace Data Scientist Salary: £30-50,000 Location: UK - Remote/Hybrid/Sheffield HQ Twinkl is embarking on an exciting journey, and we're at … the beginning of something extraordinary. As we reshape the future of educational resources, data-driven decisions will be at the heart of our transformation. Join our team of over 20 data enthusiasts and contribute to shaping what the future of learning looks like! Why You'll … of education We are a high-spirited, conscientious team that celebrates inclusivity and where work is rewarding and fun! Your Role: As a Data Scientist, you're not just crunching numbers - you're influencing the educational landscape. Our work ranges from ensuring the entire business has the data more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Are you a seasoned Data Engineer looking to make a significant impact in the renewable energy sector? Look no further! We're seeking a Senior Data Engineer to spearhead our migration to Databricks, one of the most exciting projects in the UK energy market. Job Title … Senior Data Engineer (Migration to Databricks) Duration: Initially 3 months Location: Predominantly remote with occasional onsite travel to nearest site Contract Type: Outside of IR35 Immediate Start Job Overview: As a Senior Data Engineer, you'll play a pivotal role in our data transformation … journey. You'll implement scalable data pipelines within Databricks, ensuring adherence to best practices and data governance principles. Your responsibilities will include: Building and maintaining efficient data pipelines within Databricks, evolving them as requirements evolve. Developing and maintaining an enterprise data model more »

Job title – Analyst Developer (Data engineering, Databricks, python) Location – Birmingham We will consider new graduates with some knowledge or classwork in SQL and python who are passionate about data engineering and learning Azure Databricks, but may not have a full complement of relevant work experience. About … FederatedHermes.com. Main Function of Role: Working as part of a team responsible for the development and maintenance of the Federated Hermes Global Enterprise Data Platform, the candidate will be expected to contribute to all aspects of the development lifecycle including support. The primary focus for this candidate will … be on data engineering, using Azure Data Lake, Azure Databricks with python and other related Azure Data services to support the strategic and tactical goals of Federated Hermes’ data and analytics projects. The successful candidate will have the initiative and incentive to more »

Please note: you need to have the right to work in the UK – no sponsorship, unfortunately About the job Reporting to the Senior Data & Analytics Lead, the BI Developer will be responsible for driving the direction and maintaining the business data model ensuring it aligns with … business activities and processes. The role will work closely with key internal and external stakeholders in organising and creating a data model that makes data and information accessible with appropriate channels of access controls. Fostering a relationship of trust and playing an advisory role in the … integrity, and dependability of the data. Improve the scalability, efficiency, and cost-effectiveness of data pipelines. Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data. Key Requirements Good understanding and competency in technologies currently used (and available in the marketplace more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Description Due to continued growth we are currently looking for Senior Data Engineer to join our Professional Services division - you will be part of a cross functional Data consulting team spanning data engineering, visualisation, analytics and science. You will be working with our clients … across multiple sectors, helping them to explore next-generation data techniques and tools to drive incremental business value from their data assets. A day in the life of an Aiimi Senior Data Engineer: You will be responsible for collaborating with business subject matter experts … to discover the information hidden in various sources of content and data, helping our clients make smarter decisions to reduce service failure and deliver better outcomes to their customer base Your primary focus will be in connecting to and extracting data from source systems, applying business more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Python or TensorFlow ) Familiarity with natural language processing or AI technologies ( e.g LLMs such as ChatGPT or BARD , Embeddings , Prompt Engineering ) Experience with data pipelines and preferably processing of document s ( e.g using Google Cloud Fusion/Azure Data Factory ) Strong background in either Python/… Service Orientated Architecture, API-Centric Design, Twelve-Factor App, FAIR, etc.). Experience supporting digital platforms, including Integrations, Release Management, Regression Testing, Integrations, Data Obfuscation, etc. Knowledge of Azure Data Factory/GCP Cloud Data Fusion , Microsoft Azure Machine Learning or GCP Cloud ML … Engine , Azure Data Lake , Azure Databricks or GCP Cloud Dataproc . Familiarity with big data technologies and distributed computing frameworks, such as Hadoop, Spark, or Apache Flink. Experience scaling an “API-Ecosystem ”, designing, and implementing “API-First” integration patterns. Experience working with authentication and authorisation protocols more »

our team with people just like you! We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … get to work with a wide range of tools and technologies and there are always new things to learn. About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Responsibilities: As a pivotal member of our rapidly expanding business, your role involves: Designing and Maintaining Data Architectures and Pipelines: Create and optimize robust data architectures and pipelines. Assemble intricate data sets that align with both functional and non-functional business requirements. Identify opportunities … to acquire new data from various systems. Enhancing Processes: Develop and refine data set processes for effective data modeling, mining, and production. Build the necessary infrastructure for seamless data extraction, transformation, and loading from diverse data sources. Data Reliability and Efficiency: Recommend and implement strategies to enhance data reliability, efficiency, and quality. Collaborate with Data Scientists and Machine Learning Engineers to construct analytics tools that leverage the data pipeline. These tools provide actionable insights related to asset management, operational efficiency more »

Data Scientist - Hybrid/Bristol Job Title : Mid-Level Data Scientist Location : Hybrid/Bristol Remuneration : £50,000 - £60,000 per annum Contract Type : Permanent Responsibilities : Play a pivotal role in crafting, enhancing, and managing intricate data ingestion pipelines, ensuring their efficiency, scalability, and … dependability. Integrate advanced machine learning elements into data pipelines to elevate data processing and analytical capabilities. Devise and implement data quality metrics and dashboards for monitoring, ensuring the fidelity and precision of ingested data. Collaborate closely with data scientists, engineers, and cross … functional team members in an agile development setting to meet project objectives and deadlines. Harness modern NLP techniques to enrich data comprehension and processing. Stay abreast of the latest advancements in data science and engineering to continuously refine our systems and methodologies. About Us : Situated in more »

A fantastic opportunity has a risen with our Financial Services client, for a Head of Data Engineering to join the team. The Head of Data Engineering will be responsible leading a team of data engineers to architect, build, and maintain a new data lakehouse solution and pipelines that drive the digital transformation initiatives and support business reporting requirements. The Head of Data Engineering will be involved from the very beginning of the project and will have experience of Azure Datalake and Databricks. Key responsibilities for the Head of Data Engineering Define and drive the data engineering strategy and technical roadmap in alignment with the company's digital transformation goals. Lead and mentor a team of data engineers to design, develop, and deploy data pipelines and solutions that meet business needs. Lead more »

Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to … support the organisation's data processing needs and facilitate BI reporting and analytics delivery. Responsibilities for the Senior Data Engineer Design, develop, and maintain scalable data pipelines and workflows using Azure … Data Factory and Databricks Implement data quality checks and validation processes to ensure accuracy, completeness, and consistency of data. Monitor pipeline performance and troubleshoot issues promptly to ensure uninterrupted data processing. Key Skills & Experience for the Senior Data Engineer Essential Hands more »

Senior Data Engineer Cullompton (with Hybrid Working) As a result of continued growth, we have a vacancy for a Senior Data Engineer to join the Gregory Group Technology Team. This is an exciting opportunity to make your own within the Gregory Group. The position of Senior … processes using a variety of techniques and technologies including SQL Stored Procedures, Azure Data Factory and other integration/data pipeline tools. Managing, monitoring and optimising both on-premises and Azure SQL servers and other PaaS data products - including indexing, maintenance plans and … with MS SQL/SSRS/SSIS. Experience of Azure Data Factory or other similar cloud-based data management/pipeline/ETL tools. Experience of using Power BI or other similar BI tool desirable. Highly motivated with a curiosity to understand business process and more »

Role: Data Engineer (Azure) Location: Bristol (hybrid on-site/remote) Salary: Up to £55,000 + package DOE Requirements: Active and Current UK SC Clearance Skills: Azure stack, Python, Java, ETL Company: Join a dynamic IT transformation consultancy at the forefront of innovation, delivering cutting-edge solutions … re seeking a Data Engineer with a focus on Azure, showcasing proficiency in: Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including … but not limited to Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Stream Analytics, and Azure Synapse Analytics. A solid foundation in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Designing and deploying production data more »

Data Engineer – Hybrid (3 days in Office) Stratford-Upon-Avon £56k + 5% bonus & benefits Do you want to grow your expertise and experience and use your skills in a vibrant environment where teamwork, creativity, diversity, inclusivity, and technical excellence are expected and enjoyed? This SaaS company are … associates to principals, applying your technical and problem-solving capabilities to scale their applications. You’ll contribute to the organisation’s high-quality data engineering practices, participating in technical design, implementation, testing, deployment, and ongoing support and maintenance of the data platform. By going above and … beyond implementing new features, the company focus on customer experience, building a high-quality, secure, and scalable data platform. You'll apply your skills effectively and continue to develop them, while benefiting from the expertise of your more experienced colleagues, including: Pair and mob-programming. Peer code reviews. more »

really easy. That means providing exceptional service and using state-of-the-art tech to do it. As we undertake a fast paced data transformation into Databricks at E.ON Next using best practice data governance and architectural principles, we are growing our data engineering … capability within the Data Team. At E.ON Next we’re looking for the most ambitious, talented, and creative people out there to join our brand new, fresh, start-up business. E.ON Next is one of the biggest energy providers in the UK and plays a crucial role in … your data pipelines, taking advantage of templating and parameterisation where needed. You should be able to make recommendations for data pipeline design based on business requirements. You will need to be open to new ways of working, and open to working with new technologies. You more »

Role: Data Engineer (DV Cleared) Salary: £55,000 - £65,000 Location: Bristol Do you want to be at the heart of some of the biggest and most ambitious programmes undertaken to keep our country safe? We are proud of the impact we have with our Defence & Security clients … and want to grow your career in this sector, we are very keen to hear from you. As a practitioner in AI & Cloud Data Engineering , you are responsible for bridging the gap between our customers' needs and technical solutions. Your primary responsibilities main responsibility is to building large … could include and may require you to: Use data integration tools, integration frameworks, and query engines with limited guidance, following the standard pipeline authoring process Implement optimized solutions to deliver on complex data integration problems independently Design quality software applications, coordinating efforts with other developers more »

Data Engineer Remote working, West Sussex, Manchester Up to £54,000 per annum + Bonus An exciting opportunity has arisen to join a leading company in the Insurance and technology sector, renown for its outstanding working culture, in a Data Engineering role. The role will require … who has strong Pyspark and SQL experience alongside an Azure background. Key responsibilities: Develop low to high complexity, secure, governed, high quality, efficient data pipelinesfrom a variety of on and off premise, internal and external data sources Ensure that data is cleansed, mapped, transformed … and optimised for storage to meet requirements for business and technical use cases. Build data observability and data quality by design into all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. Build solutions that pipe transform data more »

Role : Data Product Owner Location : Leeds UK- Hybrid Type of resource : Contract 6+ Months Must Have : Primary POC to Stake holders, Strong Understand of Azure Data Lake & Data Bricks Data product owner responsibilities includes the following: Act as the primary point of … contact for the data product, understanding and representing the needs of stakeholders. Assisting the development team in clarifying requirements and helping them to understand the business side- Mortgage and Savings. Collaborate with stakeholders to gather and prioritize requirements. Develop and maintain a product roadmap, aligning it with business … goals and technical capabilities. Play a crucial role in establishing robust data pipelines, defining data models, setting up data governance systems, and ensuring the secure and efficient processing of data in the lakehouse. Oversee the execution of data projects, ensuring more »

Data Engineer/Architect (GCP) Google Cloud Platform | Fully Remote | £55,000 The Role: My client are a leading digital consultancy, specializing in delivering innovative solutions to businesses worldwide. With a focus on leveraging cutting-edge technologies and strategic insights, they empower our clients to thrive in the … digital age. Position Overview: We are seeking a talented Data Engineer/Architect with expertise in Google Cloud Platform (GCP) to join our team. This position is fully remote, with the option to work from offices based in Cardiff, United Kingdom. As a Data Engineer/… Architect, you will play a pivotal role in designing, implementing, and optimizing data solutions that drive business value for our clients. You will collaborate closely with cross-functional teams to understand business requirements, architect scalable data solutions, and ensure the successful delivery of projects. Key Responsibilities more »