76 to 100 of 372 Data Pipeline Jobs in the UK

Data Engineer - 5 Month Remote Contract Interviewing now for a Data Engineer for a remote project (Outside IR35.) We are seeking an experienced Data Engineer responsible to develop and deliver data solutions, optimising data to ensure data availability … and accuracy. You will extract data from the Datalake using Big Query. You will Build data pipelines from gathered requirements to support delivery of data solutions. You will also track down discrepancies with data across the integration points and report data … Market Rates (Outside IR35) Location: Remote/UK Start: ASAP Skills -Previous experience in database services, design, implementation and experience at enterprise level data platforms, data lake concepts and data handling. - Proficient with SQL, joins, PKs, FKs, referential integrity. -Previous data warehouse more »

Data Engineer £35,000 To £45,000 (Dependent on Experience) Norwich Hybrid (2/3 Days per Week Onsite) An exciting opportunity for a data engineering professional to take full ownership of new projects. Join a longstanding business with a talented and dedicated internal IT team … as well as an environment that fosters personal progression. This job role is ideal for someone with a strong background in data engineering and an interest in data analysis. Duties: Lead the implementation and ongoing management of data strategy and analysing raw data … build robust data systems Conduct advanced data analysis Participate in Agile ceremonies and practices Required Skills: ETL Data Pipeline development experience Designing, developing and maintaining data lakes and warehouses SQL Database Design, Coding and Maintenance Programming languages such as SQL and more »

Data Engineer – Salary National up to £35,000/London up to £45,000 Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity to join our highly skilled Data Engineer community. Within one of … our Data Engineering teams, we are looking for an individual who is passionate about data to work within our multi cloud environment to h elp shape the future of insurance through cutting-edge predictive analytics and Data Science. A bit about the job: Data … maintainable, and robust code in SQL or Python. Scala, Java or similar languages would be advantageous but not required. Experience in data pipeline engineering and best practice with CI/CD setup. Working with Oracle and Snowflake are desirable. Knowledge and expertise of data engineering more »

Role: Graduate Data Engineer Type: 12 months fixed-term Location: Peterborough Ready to utilise your skills to process and extract value from large datasets? Are you passionate about performing root cause analysis on various data? We have an exciting role for you – Graduate Data … and thought leadership. Be part of an exciting team where you will be challenged every day. Work closely with different teams to develop data pipelines. Grow your career, while being exposed to new technologies. The Role As a Graduate Data Engineer , you will help design and … platform services: EC2, EMR, RDS, Redshift, Glue. Ability to work with object-oriented scripting languages: Python, Pyspark. Knowledge of data pipeline and workflow management and their tools such as Airflow. Strong understanding of relational SQL and NoSQL databases, including MongoDB and stream-processing systems: Spark more »

Data Engineer Embark on a Rewarding Journey with MIKI Travel: Where Your Career Takes Flight. At MIKI Travel, our 55+ years of expertise make us a trailblazing wholesale travel provider, curating unforgettable global adventures. As a premier private travel company with a presence in 36 offices, we invite … your career with opportunities for growth, powered by values of quality, innovation, and commitment that shape the Miki way. Job Purpose As a Data Engineer you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to enable efficient data ingestion, processing … storage, and analysis. The ideal candidate will have a strong background in data engineering, including expertise in building and optimizing ETL processes, data warehousing, and working with big data technologies. Main Responsibilities ● Collaborate with business stakeholders to gather and analyse business requirements, translating them more »

Data Architect (Azure) Our client, a leading analytics and consulting firm, is seeking an experienced Data Architect to join their dynamic team. In this role, you will be responsible for designing and implementing robust data solutions leveraging the power of Microsoft Azure. Key Responsibilities … Analyse business requirements and translate them into scalable, secure, and efficient data architectures Design and implement data pipelines, data lakes, and data warehouses on the Microsoft Azure platform Ensure data integrity, reliability, and performance through the effective use of Azure … services such as Data Factory, Synapse Analytics, Cosmos DB, and more Collaborate with cross-functional teams to identify and address data-related challenges Stay up-to-date with the latest Azure technologies and best practices, and recommend innovative solutions to drive business value Qualifications: Bachelor's more »

Data Engineer Hybrid, West- Midlands £56k + bonus & great benefits Our client are a fast growing SaaS scale-up, revolutionising supply chain ecosystems and increasing revenue for their customers. You'll contribute to the organisation's high-quality data engineering practices, participating in technical design, implementation … testing, deployment and ongoing support and maintenance of the data platform. By going above and beyond implementing new features, the company focus on customer experience, building a high-quality data platform. You'll apply your skills effectively and continue to develop them, while benefiting from the … expertise of your more experienced colleagues, including: Skill set & Experience: • Data Modelling and Querying - Proficiency in designing and implementing data models, including star schemas and snowflake schemas. Expertise in SQL. • Data Storage Technologies - Experience in SQL, NoSQL, Blob, Delta Lake , and/or other more »

Australia. It’s official: Bazaarvoice is a Great Place to Work in the US , Australia, India, Lithuania, France, Germany and the UK! Staff Data Engineer (P7) - Global Data Platform (Enablement) team What is the BV Data team at Bazaarvoice? Authentic data is … the lifeblood of the Bazaarvoice business. It is imperative that our data is consumable, interpretable, and instantly available to fuel insights across our brand, retailer and consumer customers. The BV Data team works closely with Product, Engineering, Business Development, and Account teams to consistently find new … ways to use data across the business. Who We Want Are you ready to combine your talent for crafting solid data systems and enthusiasm for cutting-edge technology to harness the power of data at Bazaarvoice? We’re looking for a strong data more »

Lead Data Engineer Investment Bank London (Hybrid) Up to £125,000 plus bonus and benefits Join an investment bank's Data Science team as the first hire as a Data Engineer to lead the build, scaling, and optimisation of all data pipelines. … SQL will be crucial in manipulating and analysing data, while your experience with Kubernetes and Docker will help create scalable and efficient pipeline infrastructure. You will also get exposure to working with Front and Back office teams to identify their data requirements, to design and … experience with CI/CD and Orchestration tools eg. Airflow, Jenkins, Bamboo, etc. Experience with MongoDB is highly beneficial Knowledge of data pipeline development and optimization Familiarity with data science principles and workflows is a plus The Package: This is an exciting opportunity to lead more »

Data Engineer London - Hybrid working £55,000 - £60,000 A global leading HR staffing organisation based in London is currently looking to recruit a Data Engineer who will play a crucial role in designing, developing, and maintaining the data infrastructure that powers innovative solutions … within the client. We require an engineer who has a passion for data and has a good background in Azure, synapse, Databricks, SQL, Python and DataOps. This is a fantastic opportunity for a Data Engineer to gain exposure to different business areas from Visualisation, Machine Learning … Alongside this my client is going to be going through a cloud migration to Azure. Responsibilities : Collaborate with cross-functional teams to understand data requirements and design efficient data pipelines. Develop and maintain scalable data models and databases. Design and implement data more »

Senior Data Engineer London (Hybrid Role) £80,000 per annum About: We are partnering with a hyper-growth financial services firm. This firm, highly regarded in the industry, is seeking a Senior Data Engineer to join their dynamic IT team and play a pivotal role in … shaping the future Role Overview: As a Senior Data Engineer, you will contribute significantly to the development and maintenance of data infrastructure and analytics solutions, driving data-based decision-making across the organisation. Working in collaboration with cross-functional teams, including Heads of Departments … Analysts, and Product Managers, you will be at the forefront of designing and implementing scalable, efficient, and reliable data pipelines and systems. Responsibilities: Design, build, and maintain scalable data pipelines and systems. Develop and optimize data integration, transformation, and cleansing processes. Collaborate with cross more »

Data Engineer | Hybrid | £70,000 - £85,000 + Bonus | Professional Services Are you looking to join a global professional services organisation? Are you looking to join a technical team full of driven and passionate people? Are you looking to work with cutting-edge technology? As a Senior Data Engineer, you will play a crucial role in designing, implementing, and maintaining our data infrastructure on the Azure cloud platform. You will be responsible for building and optimizing data pipelines, integrating various data sources, and ensuring the reliability and scalability of our … data solutions. This role requires expertise in Azure services, data lakes architecture, and Snowflake data warehouse. Key Responsibilities: Design, develop, and deploy scalable data pipelines on Azure cloud platform. Integrate and transform data from diverse sources into a unified data more »

really easy. That means providing exceptional service and using state-of-the-art tech to do it. We are seeking a seasoned Senior Data Analyst with over six years of extensive experience to join our expanding Data team. As the Senior Data Analyst, you … will play a pivotal role in delivering comprehensive data analysis, leveraging your expertise in Tableau to generate actionable insights that drive strategic business decisions. A crucial aspect of this role involves fostering strong stakeholder engagement, collaborating closely with various teams to understand their data needs and … Python Experienced with advanced analytics techniques including modelling, and segmentation Strong visualisation skills including experience with Tableau Experience with cloud-based data pipeline architectures (eg. Databricks) and platforms (eg. AWS) Familiarity with Git-based source control methodologies, including branching and pull requests Excellent communication and presentation skills more »

really easy. That means providing exceptional service and using state-of-the-art tech to do it. We are seeking a seasoned Senior Data Analyst with over six years of extensive experience to join our expanding Data team. As the Senior Data Analyst, you … will play a pivotal role in delivering comprehensive data analysis, leveraging your expertise in Tableau to generate actionable insights that drive strategic business decisions. A crucial aspect of this role involves fostering strong stakeholder engagement, collaborating closely with various teams to understand their data needs and … Python Experienced with advanced analytics techniques including modelling, and segmentation Strong visualisation skills including experience with Tableau Experience with cloud-based data pipeline architectures (eg. Databricks) and platforms (eg. AWS) Familiarity with Git-based source control methodologies, including branching and pull requests Excellent communication and presentation skills more »

really easy. That means providing exceptional service and using state-of-the-art tech to do it. We are seeking a seasoned Senior Data Analyst with over six years of extensive experience to join our expanding Data team. As the Senior Data Analyst, you … will play a pivotal role in delivering comprehensive data analysis, leveraging your expertise in Tableau to generate actionable insights that drive strategic business decisions. A crucial aspect of this role involves fostering strong stakeholder engagement, collaborating closely with various teams to understand their data needs and … Python Experienced with advanced analytics techniques including modelling, and segmentation Strong visualisation skills including experience with Tableau Experience with cloud-based data pipeline architectures (eg. Databricks) and platforms (eg. AWS) Familiarity with Git-based source control methodologies, including branching and pull requests Excellent communication and presentation skills more »

really easy. That means providing exceptional service and using state-of-the-art tech to do it. We are seeking a seasoned Senior Data Analyst with over six years of extensive experience to join our expanding Data team. As the Senior Data Analyst, you … will play a pivotal role in delivering comprehensive data analysis, leveraging your expertise in Tableau to generate actionable insights that drive strategic business decisions. A crucial aspect of this role involves fostering strong stakeholder engagement, collaborating closely with various teams to understand their data needs and … Python Experienced with advanced analytics techniques including modelling, and segmentation Strong visualisation skills including experience with Tableau Experience with cloud-based data pipeline architectures (eg. Databricks) and platforms (eg. AWS) Familiarity with Git-based source control methodologies, including branching and pull requests Excellent communication and presentation skills more »

Data Engineer/Scientist London (Hybrid) £50,000-£60,000 (+bens) 83DATA are partered with a leading Internet provider seeking the skills of a Data Engineer/Scientist. The successful candidate can expect to be tasked to connect data sources to pre-existing Azure … data infrastructure. You will lead projects with a data centric approach, for this reason, a passion and aptitude for critical analysis of large and complex datasets is vital. The role will directly report to the Head of Data - a high degree of resilience is … required to provide solutions to the executive board thus enabling data driven decisions. Responsibilites: Build data engineering pipelines to ingest, transform, store, and serve high quality data for Data Scientists Writing and tuning complex data pipelines, workflows, and data more »

Data Engineer/Scientist London (Hybrid) £50,000-£60,000 (+bens) 83DATA are partnered with a leading Internet provider seeking the skills of a Data Engineer/Scientist. The successful candidate can expect to be tasked to connect data sources to pre-existing Azure … data infrastructure. You will lead projects with a data centric approach, for this reason, a passion and aptitude for critical analysis of large and complex datasets is vital. Responsibilities: Build data engineering pipelines to ingest, transform, store, and serve high quality data for Data Scientists Writing and tuning complex data pipelines, workflows, and data structures. Identify opportunities for increasing performance, minimising costs and increase platform monitoring. Experience with components such as Azure Active Directory, Management Groups, Subscriptions, vNets, Route Tables, NSG’s and Azure more »

get the chance to get matched to this role and other similar roles, click on Apply to set up your free profile. Their Data Team is made up of 50+ people, covering data engineering, data science, and data architecture specialisms. The team … works with a range of public and private sector clients, building production grade cloud solutions focussed on streaming, graph, big data, and data science use cases. Job Description Due to the nature of the client engagements, every employee needs to be able to achieve Security Clearance. … and are proud to have an organisational culture where employees can bring their authentic selves to work. Team They are constructing the top data engineering practice in the UK, and their team build bespoke, mission critical data solutions for the UK Government as well as bluechip more »

Senior Data Platform Engineer Up to £80,000 1 day a week in office (flexible) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of … Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly … Azure ML. Data Engineering: Guarantee data access, Data quality, ETL, Data pipelines Platform administration: Help set up accesses, infrastructure, create new storage, enforce best practices Production: Help the preparation of the data science pipelines, interact with data scientists more »

Senior Data Engineer Hybrid AND Flexible Up to £75,000 + 10% bonus + share scheme MBN Solutions are delighted to have been retained to secure a Data Engineer (Big Data Technologies) for our client who are firmly positioned in the "Tech For Good … space. This is a key hire for the client during the early stages of the growth of their Data team and it is therefore essential this person is highly experienced in all the areas of skills required. Our client are a start up/scale up and we … are ideally looking for a Senior Data Engineer who has previous experience and success in this environment previously. Your Role: Building reusable data pipelines at scale with the capability of integrating data from multiple sources automatically. Work with structured and unstructured data more »

Lead Data Engineer. What's it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. The Lead … Data Engineer will also oversee the quality, performance, and security of the data integration solutions. How you'll make a difference By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data-driven … that improve the services the client provides for their customers. How you'll do it Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data more »

New 1 year contract opportunity for a mid-senior (outside IR35) Data Engineer to join an independent Civil Society with immediate effect. Data Engineer Responsibilities Design and implement scalable data architectures for large-scale web-scraping tools. Develop and optimize data pipelines … for ETL from online platforms, including textual and unstructured data, and REST APIs. Test, validate, and secure acquired data to ensure accuracy and quality. Work closely with the AI/ML Engineer to ensure seamless integration and alignment of data and AI … models. Data Engineer Required Experience Data engineering experience (2+ years) Cloud platform proficiency (e.g., AWS, Azure, GCP) Data pipeline development (e.g., Airflow, Apache Spark) SQL proficiency, database design Visualization tools knowledge (e.g., Tableau, PowerBI, Looker) Data Engineer Application Process This is more »

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »