26 to 50 of 132 Data Pipeline Jobs in the UK excluding London

Data Engineer Remote working, West Sussex, Manchester Up to £54,000 per annum + Bonus An exciting opportunity has arisen to join a leading company in the Insurance and technology sector, renown for its outstanding working culture, in a Data Engineering role. The role will require … who has strong Pyspark and SQL experience alongside an Azure background. Key responsibilities: Develop low to high complexity, secure, governed, high quality, efficient data pipelinesfrom a variety of on and off premise, internal and external data sources Ensure that data is cleansed, mapped, transformed … and optimised for storage to meet requirements for business and technical use cases. Build data observability and data quality by design into all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies. Build solutions that pipe transform data more »

using your expertise to uncover valuable insights that drive strategic decision-making and fuel business growth? Do you thrive in a high volume data-oriented environment, where every record holds the potential to uncover radical insights and opportunities? Do you have exceptional skills in big data technologies, real-time data processing, and advanced analytics, and would be capable of handling and extracting insights from a highly dynamic dataset growing by 8 billion records each day? If youre a Big Data Analyst used to working with big data and … high-volume records, and have what it takes to transform complex data into actionable recommendations, informed decisions, and impactful outcomes, then this could be the perfect position for you! Salary & Benefits: Competitive salary between £60,000 - £80,000 per annum depending on relevant technical skills and experience Fully more »

nineDots are excited to be helping Cloudsmith ramp up their data engineering function. They are on a truly amazing upward trajectory with fantastic seasoned pros at the helm. It's gonna be a fun journey. Are you ready to lead the design and implementation of a best-in … class data platform on AWS?Doyou have a deep understanding of data engineering principles and a passion for creating scalable, efficient, and secure data solutions? If you're seeking a challenging and rewarding role, join Cloudsmith as our Principal Data Engineer! We … engineering (e.g., Redshift, S3, Glue, Lambda, Kinesis). ● Strong Programming Skills: Proficiency in languages like Python, SQL, and experience with data pipeline tools. ● DataModeling and Warehousing: Expertise in data modeling techniques and experience with data warehousing solutions. ● Excellent Problem-Solving Skills: Ability more »

Role : Data Product Owner Location : Leeds UK- Hybrid Type of resource : Contract 6+ Months Must Have : Primary POC to Stake holders, Strong Understand of Azure Data Lake & Data Bricks Data product owner responsibilities includes the following: Act as the primary point of … contact for the data product, understanding and representing the needs of stakeholders. Assisting the development team in clarifying requirements and helping them to understand the business side- Mortgage and Savings. Collaborate with stakeholders to gather and prioritize requirements. Develop and maintain a product roadmap, aligning it with business … goals and technical capabilities. Play a crucial role in establishing robust data pipelines, defining data models, setting up data governance systems, and ensuring the secure and efficient processing of data in the lakehouse. Oversee the execution of data projects, ensuring more »

My Prop-Fintech client is looking for a Data Engineer to join the Head of Data and 2 data analysts in the building, extraction, and refining of new and innovative datasets. This Geospatial Dataset contains billions of datapoints and has infinite possibilities of growth. … bonus, private healthcare for you and the family, Gym Benefits, and home office equipment. KEY RESPONSIBILITY Design and uphold an efficient data pipeline architecture. Enhance data storage platforms for optimal speed, scalability, reliability, and performance. Oversee critical functions such as data acquisition, extraction … preparation, and processing of extensive datasets for predictive modelling purposes. Conduct web scraping and proficiently manipulate data as required. Take the lead in pioneering modelling techniques utilising emerging technologies. Collaborate closely with data subject specialists to enhance data functionality and accessibility. Provide technical support more »

My Prop-Fintech client is looking for a Data Engineer to join the Head of Data and 2 data analysts in the building, extraction, and refining of new and innovative datasets. This Geospatial Dataset contains billions of datapoints and has infinite possibilities of growth. … bonus, private healthcare for you and the family, Gym Benefits, and home office equipment. KEY RESPONSIBILITY Design and uphold an efficient data pipeline architecture. Enhance data storage platforms for optimal speed, scalability, reliability, and performance. Oversee critical functions such as data acquisition, extraction … preparation, and processing of extensive datasets for predictive modelling purposes. Conduct web scraping and proficiently manipulate data as required. Take the lead in pioneering modelling techniques utilising emerging technologies. Collaborate closely with data subject specialists to enhance data functionality and accessibility. Provide technical support more »

Our client, a well-known and market-leading Financial Services company, is currently recruiting for a Senior Data Engineer to join their Data engineering team. The Senior Data Engineer will be responsible for designing, developing, and maintaining data pipelines and workflows to … support the organisation's data processing needs and facilitate BI reporting and analytics delivery. Responsibilities for the Senior Data Engineer Design, develop, and maintain scalable data pipelines and workflows using Azure … Data Factory and Databricks Implement data quality checks and validation processes to ensure accuracy, completeness, and consistency of data. Monitor pipeline performance and troubleshoot issues promptly to ensure uninterrupted data processing. Key Skills & Experience for the Senior Data Engineer Essential Hands more »

Data Engineer £35,00o To £45,000 (Dependent on Experience) Norwich Hybrid (2/3 Days per Week) An exciting opportunity for a data engineering professional to take full ownership of new projects. Join a longstanding business with a talented and dedicated internal IT team as … well as an environment that fosters personal progression. This job role is ideal for someone with a strong background in data engineering and an interest in data analysis. Duties: Lead the implementation and ongoing management of data strategy and analysing raw data … build robust data systems Conduct advanced data analysis Participate in Agile ceremonies and practices Required Skills: ETL Data Pipeline development experience Designing, developing and maintaining data lakes and warehouses SQL Database Design, Coding and Maintenance Programming languages such as SQL and more »

Role: Graduate Data Engineer Type: 12 months fixed-term Location: Peterborough Ready to utilise your skills to process and extract value from large datasets? Are you passionate about performing root cause analysis on various data? We have an exciting role for you – Graduate Data … and thought leadership. Be part of an exciting team where you will be challenged every day. Work closely with different teams to develop data pipelines. Grow your career, while being exposed to new technologies. The Role As a Graduate Data Engineer , you will help design and … platform services: EC2, EMR, RDS, Redshift, Glue. Ability to work with object-oriented scripting languages: Python, Pyspark. Knowledge of data pipeline and workflow management and their tools such as Airflow. Strong understanding of relational SQL and NoSQL databases, including MongoDB and stream-processing systems: Spark more »

Data Engineer/Architect (GCP) Google Cloud Platform | Fully Remote | £55,000 The Role: My client are a leading digital consultancy, specializing in delivering innovative solutions to businesses worldwide. With a focus on leveraging cutting-edge technologies and strategic insights, they empower our clients to thrive in the … digital age. Position Overview: We are seeking a talented Data Engineer/Architect with expertise in Google Cloud Platform (GCP) to join our team. This position is fully remote, with the option to work from offices based in Cardiff, United Kingdom. As a Data Engineer/… Architect, you will play a pivotal role in designing, implementing, and optimizing data solutions that drive business value for our clients. You will collaborate closely with cross-functional teams to understand business requirements, architect scalable data solutions, and ensure the successful delivery of projects. Key Responsibilities more »

Data Engineer Hybrid, West- Midlands £56k + bonus & great benefits Our client are a fast growing SaaS scale-up, revolutionising supply chain ecosystems and increasing revenue for their customers. You'll contribute to the organisation's high-quality data engineering practices, participating in technical design, implementation … testing, deployment and ongoing support and maintenance of the data platform. By going above and beyond implementing new features, the company focus on customer experience, building a high-quality data platform. You'll apply your skills effectively and continue to develop them, while benefiting from the … expertise of your more experienced colleagues, including: Skill set & Experience: • Data Modelling and Querying - Proficiency in designing and implementing data models, including star schemas and snowflake schemas. Expertise in SQL. • Data Storage Technologies - Experience in SQL, NoSQL, Blob, Delta Lake , and/or other more »

really easy. That means providing exceptional service and using state-of-the-art tech to do it. We are seeking a seasoned Senior Data Analyst with over six years of extensive experience to join our expanding Data team. As the Senior Data Analyst, you … will play a pivotal role in delivering comprehensive data analysis, leveraging your expertise in Tableau to generate actionable insights that drive strategic business decisions. A crucial aspect of this role involves fostering strong stakeholder engagement, collaborating closely with various teams to understand their data needs and … Python Experienced with advanced analytics techniques including modelling, and segmentation Strong visualisation skills including experience with Tableau Experience with cloud-based data pipeline architectures (eg. Databricks) and platforms (eg. AWS) Familiarity with Git-based source control methodologies, including branching and pull requests Excellent communication and presentation skills more »

get the chance to get matched to this role and other similar roles, click on Apply to set up your free profile. Their Data Team is made up of 50+ people, covering data engineering, data science, and data architecture specialisms. The team … works with a range of public and private sector clients, building production grade cloud solutions focussed on streaming, graph, big data, and data science use cases. Job Description Due to the nature of the client engagements, every employee needs to be able to achieve Security Clearance. … and are proud to have an organisational culture where employees can bring their authentic selves to work. Team They are constructing the top data engineering practice in the UK, and their team build bespoke, mission critical data solutions for the UK Government as well as bluechip more »

Senior Data Engineer Hybrid AND Flexible Up to £75,000 + 10% bonus + share scheme MBN Solutions are delighted to have been retained to secure a Data Engineer (Big Data Technologies) for our client who are firmly positioned in the "Tech For Good … space. This is a key hire for the client during the early stages of the growth of their Data team and it is therefore essential this person is highly experienced in all the areas of skills required. Our client are a start up/scale up and we … are ideally looking for a Senior Data Engineer who has previous experience and success in this environment previously. Your Role: Building reusable data pipelines at scale with the capability of integrating data from multiple sources automatically. Work with structured and unstructured data more »

Title: Snowflake Data Engineer - 6-Month Contract (Inside IR35) Remote Pay rate: (Apply online only) per day dependent on skill set Position Overview: As a Snowflake Data Engineer, you will play a pivotal role in designing, developing, and maintaining our Snowflake data platform. Your … expertise will be critical in ensuring efficient data ingestion, transformation, and storage, enabling seamless data access and analytics across the organization. This position offers an excellent opportunity to work with cutting-edge technology and make a significant impact in a fast-paced environment. Responsibilities: Collaborate with … partitioning strategies. Develop and maintain documentation, including data models, ETL processes, and system configurations. Troubleshoot issues related to data quality, pipeline failures, and performance bottlenecks. Stay updated on industry best practices and emerging trends in Snowflake and data engineering. Requirements: Proven experience as more »

Senior Data Engineer- Fast growing SaaS Scale up 🚀 West Midlands- hybrid working Up to £86K base with bonus and benefits The client SaaS Software business platform which is revolutionising financial management for their customers. Responsibility: Working to ensure a high-quality data platform. Design, develop, test … and deploy data pipelines and integrations using IPaaS technology Collaborate on engineering platform ingestion, orchestration, data warehouse/data lake and API strategies for the data management ecosystem Willingness and an enthusiastic attitude to work within existing processes/methodologies. Collaborate with … the DevOps team to provide high availability data solutions that scale geographically. Big data processing - Expertise in processing enterprise-scale volumes of data, ideally with proficiency in Snowflake. Experience Data Stores - Technical excellence in SQL, NoSQL, Blob,Delta Lake, and other enterprise more »

Senior Data Engineer Luton/Hybrid Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast paced organisation. You will join as a Senior Data Engineer providing technical leadership to the Data Engineering team. You will play a major role in adhering to big data best practices whilst building and maintaining reliable data pipelines and products across a range of exciting projects. Bringing a wealth of technical experience in big data platforms combined with excellent skills in development. This role will support the business on the journey from a greenfield big data estate to a mature data more »

Data Analyst/Engineer - £50,000 - £60,000/Carmarthenshire (South Wales) + Hybrid 2 days on-site Are you looking to join an exciting business as they continue their scale-up plans in 2024? This is a fantastic opportunity with a business proud to be expanding in … Wales. This is a great opportunity for a Data Engineer or Data Analyst/BI dev who wants to develop their skills in Data Engineering. If you have a background in creating dashboards in Power BI feel free to apply or reach out for … ll be doing: You’ll be the brain behind developing and putting into action strategies to gather, process, and dissect large sets of data, all aimed at giving clients actionable insights. You’ll focus on crafting and maintaining data pathways to ensure data accuracy more »

Are you a seasoned Data Engineer looking to make a significant impact in the renewable energy sector? Look no further! We're seeking a Senior Data Engineer to spearhead our migration to Databricks, one of the most exciting projects in the UK energy market. Job Title … Senior Data Engineer (Migration to Databricks) Duration: Initially 3 months Location: Predominantly remote with occasional onsite travel to nearest site Contract Type: Outside of IR35 Immediate Start Job Overview: As a Senior Data Engineer, you'll play a pivotal role in our data transformation … journey. You'll implement scalable data pipelines within Databricks, ensuring adherence to best practices and data governance principles. Your responsibilities will include: Building and maintaining efficient data pipelines within Databricks, evolving them as requirements evolve. Developing and maintaining an enterprise data model more »

About Us Airtime Rewards is delivering the leading data-led rewards technology globally. We believe every shopper should feel great about their daily spend. Our app is loved by our members (>3.5m!) and we're continually building new features that drive towards our vision that sees hundreds of … and insight that transforms their understanding of their customers. We do all this with our cutting-edge proprietary technology, utilising real-time purchase data and AI learning to delight our members and maintain relationships with >200 retailers (including Boots, Aldi, Tesco, Greggs, Selfridges, and Halfords to name a … ourselves on culture, are solving new problems, and need great people to join us on our international journey as we deliver the leading data-led rewards technology globally. The Opportunity We are looking to recruit a Data Engineer to join and strengthen our existing team and more »

Data Scientist - Hybrid/Bristol Job Title : Mid-Level Data Scientist Location : Hybrid/Bristol Remuneration : £50,000 - £60,000 per annum Contract Type : Permanent Responsibilities : Play a pivotal role in crafting, enhancing, and managing intricate data ingestion pipelines, ensuring their efficiency, scalability, and … dependability. Integrate advanced machine learning elements into data pipelines to elevate data processing and analytical capabilities. Devise and implement data quality metrics and dashboards for monitoring, ensuring the fidelity and precision of ingested data. Collaborate closely with data scientists, engineers, and cross … functional team members in an agile development setting to meet project objectives and deadlines. Harness modern NLP techniques to enrich data comprehension and processing. Stay abreast of the latest advancements in data science and engineering to continuously refine our systems and methodologies. About Us : Situated in more »

Job title – Analyst Developer (Data engineering, Databricks, python) Location – Birmingham We will consider new graduates with some knowledge or classwork in SQL and python who are passionate about data engineering and learning Azure Databricks, but may not have a full complement of relevant work experience. About … FederatedHermes.com. Main Function of Role: Working as part of a team responsible for the development and maintenance of the Federated Hermes Global Enterprise Data Platform, the candidate will be expected to contribute to all aspects of the development lifecycle including support. The primary focus for this candidate will … be on data engineering, using Azure Data Lake, Azure Databricks with python and other related Azure Data services to support the strategic and tactical goals of Federated Hermes’ data and analytics projects. The successful candidate will have the initiative and incentive to more »

change the status quo, we’ll help you make your moment. Join Team Purple. Join IFS. Job Description As a Principal/Senior Data Engineer, you will spearhead our data initiatives, transforming raw data into strategic assets that propel our business forward. This role … who excel in a dynamic environment, offering the freedom to innovate and the responsibility to deliver. Core Responsibilities: Identify and harness high-value data opportunities within our product suite, converting raw data into impactful features and reusable assets. Act as the authoritative voice on data … Strong programming skills in Python, Scala, C#, or Java, and adeptness with cloud SDKs and APIs. Deep understanding of AI/ML to enhance pipeline efficiency, with experience in TensorFlow, PyTorch, AutoML, Python/R, and MLOps platforms like MLflow and Kubeflow. Solid background in DevOps , including CI/ more »

Senior Data Engineer Location: Hybrid, with 2 days per month to be onsite (Abingdon) We have the pleasure to be representing a business that is on a mission to increase the number of people who can live longer, healthier lives and reduce unnecessary medical costs while doing so. … To help with the success of this strategy They are recruiting for a Senior Data Engineer that will take a pivotal role in driving the Data team forward. Responsibilities: Lead Cloud Data Warehouse Project : Take charge of leading the Cloud data warehouse … project through its next phase of development, ensuring its scalability, reliability, and performance meet the highest standards. Ownership of Data Management : Assume ownership of all aspects of data management, serving as the go-to person for any data queries from the internal team. Your more »

Senior Data Engineer Manchester (Hybrid Role) £90,000 per annum Position Summary: We are seeking a talented Senior Data Engineer to spearhead the design and implementation of robust data pipelines and advanced scripts. You will play a key role in architecting dynamic data warehousing systems on the Azure platform, harnessing the power of data lakes, Databricks, and Synapse Analytics. Your contributions will significantly propel this organisation into a new era of data-driven excellence, driving innovation and delivering impactful solutions. Key Responsibilities: Collaborate closely with cross-functional … teams, including Data Scientists, Software Engineers, and Business Analysts, to deliver impactful solutions aligned with business goals. Develop and deploy scalable data pipelines for the ingestion, incremental loading, transformation, and modeling of data. Architect agile data warehousing systems on the Azure platform, utilising data more »