1 to 25 of 554 Data Pipeline Jobs in the UK

Building a sustainable tomorrow BAM UK and Ireland is recruiting a Data Engineer to join the team. This role can be based out of any of our UK & Ireland offices. BAM operates a flexible working policy. Your mission • Collaborate with stakeholders to understand their requirements and translate them … into effective data integrations and/or Power App solutions. • Create and maintain ETL processes for extracting, transforming and loading data from various sources into our systems – integrate diverse data sources to provide a unified view ensuring seamless data availability to various … business applications. • Create entity relationship diagrams, write database queries, maintain data warehouses and data lakes. • Ensure data accuracy, consistency, security, scalability and reliability in the ETL processes. • Optimise and enhance existing Power BI reports, DAX and dashboards and pipelines and PowerApps for improved performance more »

Are you an experienced Data Engineer ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a hybrid working role and you will be based from either their London, Leeds, Manchester or Edinburgh office, typically 3 days a … skills: * Data Engineering with SAS proficiency * Proficiency in SQL and/or similar data technologies * Familiarity with data pipeline tools and ETL processes * Knowledge of cloud platforms and data architecture Experience working in the Retail Banking sector or financial services would more »

and mapping technology. Key Responsibilities: Create and optimise front-end user interfaces for web and mobile platforms. Develop and enhance core algorithms and data pipelines using C++ and Python. Collaborate on both front-end and back-end development. Work with hardware platforms, including mobile robots and hand-held … like lidar, vision, GPS, and IMUs. Understanding of modern algorithms for visual and laser odometry and reconstruction. Knowledge of perception pipelines involving 3D data such as point clouds and mesh reconstructions. Experience with AutoDesk's Revit application in engineering design. Experience in developing Android applications. If you are more »

Palantir Data Engineer £85,000 - £95,000 UK Wide Must be able to be eligible for SC clearance! Travel to client site when required! A leading consultancy-based organisation is currently looking to grow their cloud platforms team and wanting to add a Palantir Data Engineer … to their practice. The successful Palantir data engineer will be passionate about cloud technology being involved in using Palantir data focussed reference architecture to assist in designing and building data engineering solutions supporting planning and implementations. Skills and Experience Experience of developing enterprise grade … and deliver the data solutions in Palantir Strong experience with Palantir Data Engineering features such as Code Repo, Code Workbook, Pipeline Builder, migration techniques, Data Connection and Security setup Developing data integration pipelines, transformations, pipeline scheduling, Ontology, and applications in more »

Your new role A Global Bank is looking for a Technical Business Analyst with a solid background in data to join their transformation team. What you'll need to succeed Extensive SQL developer experience. Experienced at dealing with data quality errors. Hadoop/Big Data … Hive, Impala, and Spark ecosystem technologies. Excellent knowledge of HDFS, Apache Spark, Spark-SQL, UDF, Sqoop, Python. Extensive experience creating and enhancing Big Data pipelines, architectures and data sets. Extensive experience working in Investment Banking and financial services. What you'll get in return Access to more »

Palantir Data Engineer £85,000 - £95,000 UK Wide Must be able to be eligible for SC clearance! Travel to client site when required! A leading consultancy-based organisation is currently looking to grow their cloud platforms team and wanting to add a Palantir Data Engineer … to their practice. The successful Palantir data engineer will be passionate about cloud technology being involved in using Palantir data focussed reference architecture to assist in designing and building data engineering solutions supporting planning and implementations. Skills and Experience Experience of developing enterprise grade … and deliver the data solutions in Palantir Strong experience with Palantir Data Engineering features such as Code Repo, Code Workbook, Pipeline Builder, migration techniques, Data Connection and Security setup Developing data integration pipelines, transformations, pipeline scheduling, Ontology, and applications in more »

DOE Vision of the role: This is an exciting role which will drive impactful growth through advanced segmentation, personalisation, and data management. As a key member of our marketing team, you will implement sophisticated techniques to optimise funnel conversion rates, ensuring that every subscriber receives timely and relevant … messaging. Your role will also focus on maintaining and enhancing our data management processes, ensuring that campaign data is up-to-date and accurately mapped. This isn't just another job; it's an opportunity to leave your mark and shape something exciting. Join us in … transforming how we engage with our audiences and deliver exceptional value through targeting and strategic data techniques. Traits & Characteristics: In this role, you'll be instrumental in optimising and managing our data using Salesforce and SQL. Taking full responsibility for data configuration and performance more »

Principal Data Engineer - Northwest £70,000 to £75,000 VIQU are seeking Principal Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a dedicated … across numerous specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will … include data ingestion, quality, modelling, transformation, security, and monitoring. The Principal Data Engineer will also be involved in automation, process improvement, mentoring engineers, setting coding standards, and optimising queries. The Principal Data Engineer will work in collaboration with the Principal Cloud Engineer and Data more »

Azure Data Engineer- Birmingham - £350pd Outside I'm currently looking for a Data Engineer to join a company that is based in Birmingham. They need someone to start in the next few weeks. Location: Birmingham (on site 2 times a week) Length: 6 months Day Rate … per day. IR35 Status: Outside of IR35 Required experience will include: Expertise in designing and implementing data pipelines using Azure services such as Azure Data Factory and Azure Databricks. Hands-on experience with SQL database design Experience of product lifecycle management principles and tools (e.g. DevOps … terraform ) and relational database manipulation and interrogation. If you are interested in this Data Engineer role please apply with your most recent CV. Alternatively email me on George . batson @ Randstad . co . uk Azure Data Engineer- Birmingham - £350pd Outside Randstad Technologies is acting as more »

work in an environment that's fun, fast paced, customer focused and commercial with fantastic development opportunities? Look no further than the Asda Data team! If you have recently graduated or are due to graduate this year, come and join us on a 2-year Data graduate programme, working in the Geospatial & Market Team. Joining Asda as a Data Graduate, you will be working within the Geospatial & Market team, who provide geospatial and market intelligence and insight across Asda. We work most closely with our property team, supporting location planning and finding … at an exciting time as were looking at opening hundreds of new convenience stores over the next couple of years. Furthermore, we provide data to support our Marketing and Buying teams to deliver targeted marketing campaigns and support operational decision-making. For example, we provide insight and analytics more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

consultancy that are recruiting SECURITY ARCHITECTS to work on a very exciting LONG-TERM CONTRACT within the financial service sector. Role: Security Architect (Data Solutions) Rate: Up to £500 per day (inside IR35) Location: Swindon/London Hybrid (2 days onsite) Duration: 6 months (initially view to extend … integrations team, you will play a crucial role in ensuring the security and integrity of systems related to service mesh, container platforms, and data solutions. Your responsibilities will involve designing, implementing, and maintaining robust security measures to protect sensitive data, prevent unauthorized access, and mitigate risks. … Key responsibilities: Collaborate with development and operations teams to design secure and scalable architectures for containerized applications, data mesh, and Kafka. Assess and implement security controls for container platforms (e.g., Kubernetes, Docker). Define and enforce container image security practices, including vulnerability scanning, image signing, and runtime security. more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

Responsibilities: As a pivotal member of our rapidly expanding business, your role involves: Designing and Maintaining Data Architectures and Pipelines: Create and optimize robust data architectures and pipelines. Assemble intricate data sets that align with both functional and non-functional business requirements. Identify opportunities … to acquire new data from various systems. Enhancing Processes: Develop and refine data set processes for effective data modeling, mining, and production. Build the necessary infrastructure for seamless data extraction, transformation, and loading from diverse data sources. Data Reliability and Efficiency: Recommend and implement strategies to enhance data reliability, efficiency, and quality. Collaborate with Data Scientists and Machine Learning Engineers to construct analytics tools that leverage the data pipeline. These tools provide actionable insights related to asset management, operational efficiency more »

EU. We are looking for a Sr. DSP Insights Manager who is ready to roll up their sleeves and help us develop actionable, data-driven insights, using various quantitative tools and core project management skills. Key job responsibilities Core responsibilities include : Managing our organizations AWS account, including a … data warehouse in Redshift. Manage permissions structure by eg administrating IAM settings. Owning reporting for strategic roadmaps by working with business leaders; driving expansion and optimization of new business units in our DSP program. Developing and maintaining performance dashboards with key metrics for review with senior leadership and … business teams; synthesizing large quantities of data to help create new, step-change initiatives for the organization. Onboarding data to our data warehouse by building automated data pipelines utilizing eg Python in Lambda or Sagemaker to invoke API calls. Using statistical techniques more »

hybrid role 80% homeworking available and 20% in Stratford Upon Avon About the role We are seeking a skilled Developer to join our Data Engineering team. In this role, you will play a pivotal part inmaintainingand enhancing our technical service offerings, ensuring operational efficiency and effectiveness. As a … Developer in our Data Engineering team, you willbe responsible formanaging technical service operationssupporting data pipelines throughout the Cloud Data Platform. With a focus on problem-solving, adaptability, and analytical skills. Collaborating closely with stakeholders, you will gain a deep understanding of business imperatives and … Experience in data management, with an understanding of data storage and extraction principles. Azure Data Factory (error handling, pipeline triggers), Azure Storage, Azure Synapse and Azure SQL Server. Previous experience in technical service operations or a related field Strong problem-solving abilities, adaptability more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

experience we're looking for, please go ahead and apply. We'd love to hear from you! About the role As the Senior Data Management Analyst, you will be responsible for continuous evolution of the data quality life cycle practices. This includes defining and proposing data … and their current levels under each dimension. You will take a leading role in supporting the organisation in improving the quality of its data by acquiring data to be brought under governance and perform data profiling analysis to understand it's origination, definition, lineage … into wider data management subjects e.g. Data Quality Insight, Data Quality Management, Data Quality in the pipeline, Master Data Management etc. Design, implement & maintain data quality technology Partner with key project initiatives and act as escalation point more »

Your new company You will be working for a welcoming and engaging organisation which is currently going through a comprehensive data transformation programme, designed to establish a robust approach to modernising the use and management of all data, to inform decision-making and support regulatory activity. … Your new role As a data engineer, you will help build and maintain the data infrastructure and systems that collect, manage and transform raw data for onward use by data analysts and data scientists. You will implement efficient data … of database design and development, data management and systems integration Knowledge of automation testing as part of a data engineering pipeline Knowledge of software development approaches, disciplines and best practice Awareness of how data is used by Analysts, Data Scientists and more »

seizing energy investment opportunities. Job Summary The job holder will be responsible for expanding and optimising our data and data pipeline architecture, as well as optimising data flow and collection for cross functional teams. The Data Engineer will support our software … developers, database architects, and Trading teams with data initiatives that will ensure optimal data delivery architecture is consistent throughout ongoing projects. This role requires the jobholder to be self-directed and comfortable supporting the data needs of multiple teams, systems and products. They will … architecture to support our next generation of products and data initiatives. Key Responsibilities: Create and maintain optimal data pipeline architecture Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key more »

Senior Data Engineer Location: London, UK Duration: 9 months Role/Position Overview As a Senior Data Engineer, you will lead the team’s thinking when it comes to building, deploying, and hosting data engineering pipelines and solutions in production. You will be responsible … for designing and implementing scalable data pipelines, managing data infrastructure, and tooling, and working closely with stakeholders to deliver quality solutions. This role will be a key contributor to the ongoing development of our data architecture and data governance capabilities. We want … to minimize manual processes and strong software engineering proficiency in this role is key. Key Responsibilities: - Design and implement scalable data pipelines that extract, transform and load data from various sources into the data lakehouse. - Help teams push the boundaries of analytical insights, creating more »

Senior Data Engineer Location: London, UK Duration: 9 months Role/Position Overview As a Senior Data Engineer, you will lead the team’s thinking when it comes to building, deploying, and hosting data engineering pipelines and solutions in production. You will be responsible … for designing and implementing scalable data pipelines, managing data infrastructure, and tooling, and working closely with stakeholders to deliver quality solutions. This role will be a key contributor to the ongoing development of our data architecture and data governance capabilities. We want … to minimize manual processes and strong software engineering proficiency in this role is key. Key Responsibilities: - Design and implement scalable data pipelines that extract, transform and load data from various sources into the data lakehouse. - Help teams push the boundaries of analytical insights, creating more »

Lead Data Engineer I'm currently working on a dynamic opportunity which is looking for a Lead Data Engineer to join and lead thier team! You'll play a pivotal role in bridging engineering best practices with thier data domain. Thier team is committed … integrations and click-stream ingestion. Proven ability in stakeholder management and project leadership. Proficiency in SQL, Python, PySpark. Solid background in data pipeline orchestration, data access, and retention tooling. Demonstrable impact on infrastructure scalability and data privacy initiatives. A collaborative spirit, innovative problem … integrations and click-stream ingestion | Proven ability in stakeholder management and project leadership | Proficiency in SQL, Python, PySpark | Solid background in data pipeline orchestration, data access, and retention tooling | Demonstrable impact on infrastructure scalability and data privacy initiatives | Collaborative spirit | Innovative problem-solving more »

Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Investments Data, Technology team, tasked with developing, managing, and optimizing data pipelines within … our data ecosystem. Reporting to the Investments Data Lead, this role is instrumental in implementing the data strategy that supports front office stakeholders, systems, and clients. The Data Engineer will leverage cutting-edge technology in Snowflake, Python, SQL, and Azure to enhance … within our subsidized onsite canteen Must have skills Proven experience as a Data Engineer, with a strong background in data pipeline construction, data architecture, and data warehousing. Expertise in Snowflake, Python, SQL, and cloud-native ETL/ELT tools. Familiarity with more »