176 to 200 of 1,219 Permanent Data Engineering Jobs

Data Architect -Contract Inside IR35 UST are seeking an experienced Data Architect with strong expertise in Google Cloud Platform (GCP) to design and implement scalable data solutions. Location Leeds or London Duration 3 Months Contract Inside IR35 About the role The ideal candidate will have a solid background in data engineering, cloud data architecture … and ETL pipeline development, with a focus on enabling data-driven decision-making across the organization. Key Responsibilities: Design, build, and maintain scalable data pipelines and ETL processes using GCP services such as Cloud Dataflow, Cloud Dataproc, and BigQuery. Implement and optimize data storage solutions utilizing Cloud Storage, Cloud SQL, and Cloud Spanner. Develop and manage data lakes and data warehouses on GCP, ensuring high standards of data quality, availability, and security. Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver efficient data access solutions. Implement robust data governance and security controls to meet regulatory requirements and industry best practices. Automate data workflows and More ❯

Data Architect -Contract Inside IR35 UST are seeking an experienced Data Architect with strong expertise in Google Cloud Platform (GCP) to design and implement scalable data solutions. Location Leeds or London Duration 3 Months Contract Inside IR35 About the role The ideal candidate will have a solid background in data engineering, cloud data architecture … and ETL pipeline development, with a focus on enabling data-driven decision-making across the organization. Key Responsibilities: Design, build, and maintain scalable data pipelines and ETL processes using GCP services such as Cloud Dataflow, Cloud Dataproc, and BigQuery. Implement and optimize data storage solutions utilizing Cloud Storage, Cloud SQL, and Cloud Spanner. Develop and manage data lakes and data warehouses on GCP, ensuring high standards of data quality, availability, and security. Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver efficient data access solutions. Implement robust data governance and security controls to meet regulatory requirements and industry best practices. Automate data workflows and More ❯

Our client a London based Technology and Data Engineering leader have an opportunity in a high growth AI Lab for an ‘AI Engineering Researcher' A UK based 'Enterprise' Artificial Intelligence organisation, focussing on helping accelerate their clients journey towards becoming 'AI-Optimal' - starting with significantly enhancing its abilities in leveraging AI & machine intelligence to outperform traditional competition. … rapidly expanding research team of exceptional PhD computer scientists, software engineers, mathematicians & physicists, to use a unique multi-disciplinary approach to solving enterprise-AI problems. Principal Activities of role: Data Pipeline Development: • Design, develop, and maintain ETL processes to efficiently ingest data from various sources into data warehouses or data lakes. • Data Integration and Management … Integrate data from disparate sources, ensuring data quality, consistency, and security across systems. Implement data governance practices and manage metadata. • System Architecture: Design robust, scalable, and high-performance data architectures using cloud-based platforms (e.g., AWS, Google Cloud, Azure). • Performance Optimization: Monitor, troubleshoot, and optimize data processing workflows to improve performance and reduce latency. More ❯

Our client a London based Technology and Data Engineering leader have an opportunity in a high growth AI Lab for an ‘AI Engineering Researcher' A UK based 'Enterprise' Artificial Intelligence organisation, focussing on helping accelerate their clients journey towards becoming 'AI-Optimal' - starting with significantly enhancing its abilities in leveraging AI & machine intelligence to outperform traditional competition. … rapidly expanding research team of exceptional PhD computer scientists, software engineers, mathematicians & physicists, to use a unique multi-disciplinary approach to solving enterprise-AI problems. Principal Activities of role: Data Pipeline Development: • Design, develop, and maintain ETL processes to efficiently ingest data from various sources into data warehouses or data lakes. • Data Integration and Management … Integrate data from disparate sources, ensuring data quality, consistency, and security across systems. Implement data governance practices and manage metadata. • System Architecture: Design robust, scalable, and high-performance data architectures using cloud-based platforms (e.g., AWS, Google Cloud, Azure). • Performance Optimization: Monitor, troubleshoot, and optimize data processing workflows to improve performance and reduce latency. More ❯

Net Talent are partnering with a well-known technology business in Edinburgh who are looking to grow their hugely successful data team and are looking for a Staff/Lead Data Engineer to lead the technical design and implementation of their most critical data infrastructure and products. This is a senior level individual contributor role and will … have responsibility for designing scalable systems, setting data architecture standards and solving complex technical challenges that power analytics, data science and business function use cases across the company. The need someone to provide Technical leadership and guidance to other Data Engineers and contribute to the teams growth as well as lead technical design and code reviews, mentoring … peers and raising the bar for engineering excellence. Experience 8+ years of experience in data engineering or a related field, with a focus on building scalable data systems and platforms. Strong expertise in modern data tools and frameworks such as Spark, dbt, Airflow, Kafka, Databricks, and cloud-native services (AWS, GCP, or Azure) Deep understanding More ❯

Data Engineer – Databricks About the Role We’re looking for a Databricks Champion to design, build, and optimize data pipelines using Databricks. You’ll work with clients and internal teams to deliver scalable, efficient data solutions tailored to business needs. Key Responsibilities Develop ETL/ELT pipelines with Databricks and Delta Lake Integrate and process data from diverse sources Collaborate with data scientists, architects, and analysts Optimize performance and manage Databricks clusters Build cloud-native solutions (Azure preferred, AWS/GCP also welcome) Implement data governance and quality best practices Automate workflows and maintain CI/CD pipelines Document architecture and processes What We’re Looking For Required: 5+ years in data engineering with hands-on Databricks experience Databricks Champion Status (Solution Architect/Partner) Proficient in Databricks, Delta Lake, Spark, Python, SQL Cloud experience (Azure preferred, AWS/GCP a plus) Strong problem-solving and communication skills Databricks Champion More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full development … cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with the business and … delivering complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practises, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional/Tabular), Power BI Python, MDX, DAX Responsibilities The Data Manager will be responsible for supporting Head of Data and Analytics More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full development … cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with the business and … delivering complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practises, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional/Tabular), Power BI Python, MDX, DAX Responsibilities The Data Manager will be responsible for supporting Head of Data and Analytics More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full development … cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with the business and … delivering complex requirements to tight timescales. Strong interest in latest data engineering technologies, best practises, techniques and trends in the data industry Required Toolsets: Kimball data modelling Microsoft SQL Server Analysis Services (Multidimensional/Tabular), Power BI Python, MDX, DAX Responsibilities The Data Manager will be responsible for supporting Head of Data and Analytics More ❯

Responsibilities: Develop, optimize, and maintain data ingest flows using Apache Kafka, Apache Nifi and MySQL/PostGreSQL Develop within the components in the AWS cloud platform using services such as RedShift, SageMaker, API Gateway, QuickSight, and Athena Communicate with data owners to set up and ensure configuration parameters Document SOP related to streaming configuration, batch configuration or API … management depending on role requirement Document details of each data ingest activity to ensure they can be understood by the rest of the team Develop and maintain best practices in data engineering and data analytics while following Agile DevSecOps methodology Desired Skills: Strong analytical skills, including statistical analysis, data visualization, and machine learning techniques Strong … understanding of programming languages like Python, R, and Java Expertise in building modern data pipelines and ETL (extract, transform, load) processes using tools such as Apache Kafka and Apache Nifi Proficient in programming languages like Java, Scala, or Python Experience or expertise using, managing, and/or testing API Gateway tools and Rest APIs Experience in traditional database and More ❯

Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Company: Royal London Group Job Title: Data Engineer Contract Type: Permanent Location: Edinburgh or Glasgow or Alderley Edge Working style: Hybrid 50% home/office based We have a fantastic opportunity for a Data Engineer to join Royal London. The … successful candidate will be responsible for identifying, defining, managing, and delivering data, tools, and other technical assets to enable analytics, data science, and machine learning projects. These initiatives aim to generate insights, address key business questions, solve business problems, and support decision-making at all levels of the organisation. In addition to these responsibilities, the Data Engineer … will assist junior team members, promoting engineering best practices and maintaining technical standards. The role also involves supporting the delivery of multiple projects across the team, being involved in data, tooling, and technical practices related to data engineering for business intelligence, analytics, data science, and machine learning. About the role Source and prepare data More ❯

Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Company: Royal London Group Job Title: Data Engineer Contract Type: Permanent Location: Edinburgh or Glasgow or Alderley Edge Working style: Hybrid 50% home/office based We have a fantastic opportunity for a Data Engineer to join Royal London. The … successful candidate will be responsible for identifying, defining, managing, and delivering data, tools, and other technical assets to enable analytics, data science, and machine learning projects. These initiatives aim to generate insights, address key business questions, solve business problems, and support decision-making at all levels of the organisation. In addition to these responsibilities, the Data Engineer … will assist junior team members, promoting engineering best practices and maintaining technical standards. The role also involves supporting the delivery of multiple projects across the team, being involved in data, tooling, and technical practices related to data engineering for business intelligence, analytics, data science, and machine learning. About the role Source and prepare data More ❯

Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Company: Royal London Group Job Title: Data Engineer Contract Type: Permanent Location: Edinburgh or Glasgow or Alderley Edge Working style: Hybrid 50% home/office based We have a fantastic opportunity for a Data Engineer to join Royal London. The … successful candidate will be responsible for identifying, defining, managing, and delivering data, tools, and other technical assets to enable analytics, data science, and machine learning projects. These initiatives aim to generate insights, address key business questions, solve business problems, and support decision-making at all levels of the organisation. In addition to these responsibilities, the Data Engineer … will assist junior team members, promoting engineering best practices and maintaining technical standards. The role also involves supporting the delivery of multiple projects across the team, being involved in data, tooling, and technical practices related to data engineering for business intelligence, analytics, data science, and machine learning. About the role Source and prepare data More ❯

Data Engineers - Permanent Opportunity Location Reading: 1-2 days per week A major UK organization is expanding their Data Engineering team to drive forward their ambitious data platform transformation initiative. Are you an experienced Data Engineer ready to tackle complex data challenges at scale? This established organization is building their next-generation Enterprise Data Platform and needs skilled professionals to accelerate their journey toward becoming a data-centric organization. About Our Client Our client operates critical infrastructure serving millions of customers across the UK. They're investing significantly in modernizing their data capabilities, creating a centralized data lakehouse architecture that will transform how they leverage information across the business. Join … their Digital Data division during this exciting period of growth and innovation. Your Role as Data Engineer Design and implement robust data pipelines using Azure Data Factory to integrate operational systems with analytical platforms Analyze business data requirements and create comprehensive documentation following established protocols Transform legacy manual processes into automated, scalable data workflows More ❯

technology and a desire to make a real impact in the financial services industry, we would love to hear from you. About this role We are seeking a skilled Data Engineer - Data Lakehouse to join our team. The ideal candidate should be experienced in designing and building data pipelines, performing ETL operations, and managing databases. The candidate … will also need to have knowledge and experience in using AWS services for data processing, storage, and analysis. Responsibilities Design, build and maintain efficient and scalable data pipelines to support data processing and analysis. Develop and implement ETL processes to ensure data quality and integrity. Manage and optimize databases, including designing schema and indexing strategies, data partitioning and data archival. Work closely with data scientists and business analysts to understand data requirements and translate them into technical solutions. Collaborate with DevOps and IT teams to deploy, monitor and troubleshoot data systems. Develop and maintain documentation on data infrastructure and processes. Stay current with the latest data engineering technologies More ❯

by Fast Track and published in The Sunday Times each September, celebrates Britain's private mid-market growth companies with the biggest performance. Purpose : We are seeking an experienced Data Engineer to join our growing team. In this role, you will be responsible for overseeing the planning, development, and design of data engineering processes within a customer … facing data warehousing product. This product plays a critical role in delivering analytics solutions for both the State and Commercial sectors. To be successful in this role you will work with the product and engineering team to identify valuable data sources and analyse trends in the data for our customers. You will build predictive models and … work with the engineering team to provide further insights to our customers. You will of course be competent in agile data development, with a focus on innovation and positive disruption. You’ll know how to get the best from a customer facing data warehouse solutions and be able to improve the value of data through research More ❯

combine private and commercial banking, wealth planning and investment management. We believe in traditional relationship and service-led banking powered by modern technology. Job purpose Develop and maintain complex data systems that support the Bank's operations and reporting needs, ensuring they meet all essential data requirements, following strong engineering and automation best practices and collaborating with … the Technical Lead for Data Engineering to develop innovative solutions that address business needs. As a Senior Data Engineer this person will also play a key role in the development of less experienced members of the team day to day. To place the interests of customers at the centre of all activities, act in a way that … is consistent with achieving good outcomes for consumers; and to comply with the FCA and PRA's Conduct Rules. Key Responsibilities: The development of data ingest, transformation, analytics, and data publishing pipelines, facilitating complex data transformations to meet business requirements, ensuring optimal performance and efficiency of the data platform. Support for the live platform day to More ❯

We are looking for a hands-on, technically driven Data Engineer to join our expanding data team. This role is ideal for someone with a strong foundation in SQL and data management, who has recently graduated from a Data Science or Data Engineering programme and is eager to apply their skills in a modern … forward-thinking environment. You will be responsible for developing and maintaining robust data solutions that support reporting, automation, and strategic decision-making across the business. The successful candidate will have up-to-date knowledge of data tooling and methodologies, particularly in SQL, Power BI, and data automation, with an interest in modern data architecture such as … As the role sits within a relatively new department, where methodologies and processes are still evolving, there is a significant opportunity to help shape the future of OEG’s data management practices. Key Responsibilities: Database and Data Engineering Design, develop, and maintain SQL-based solutions and data pipelines. Manage relational databases, ensuring data can be More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization of diverse … business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯

to ESPN and ESPN+, and much more. Innovation: We develop and execute groundbreaking products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news. The Data Reliability Engineering team for Disney's Product and Data Engineering team is responsible for maintaining and improving the reliability of Disney Entertainment's big data platform, which processes hundreds of terabytes of data and billions of events daily. Job Summary: The Senior Software Engineer will help us in the ongoing mission of delivering outstanding services to our users allowing Disney Entertainment to be more data-driven. You will work closely with our partner teams to monitor and drive improvements for reliability and … observability of their critical data pipelines and deliverables. This is a high-impact role where your work informs decisions affecting millions of consumers, with a direct tie to The Walt Disney Company's revenue. You will be making an outsized impact in an organization that values data as its top priority. We are a tight and driven team More ❯

My FTSE 100 Client is urgently recruiting for a Data Solutions Architect, the chosen Candidate will be at the forefront of shaping end-to-end data architectures that support analytics, AI, and enterprise reporting across the organisation. You will lead solution design, champion best practices, and work closely with business and technical stakeholders to deliver robust, scalable, and … secure data platforms. Key Responsibilities Design and implement modern data architectures using Azure Synapse , Data Lake , Data Factory , Databricks , and Microsoft Fabric . Lead the development of integrated data solutions supporting BI, advanced analytics, and real-time data processing. Define data governance, security, and compliance standards across the data lifecycle. Collaborate with … cross-functional teams to translate business requirements into technical blueprints. Stay ahead of emerging trends in cloud, data, and AI, bringing innovative thinking into the organisation. About You Proven experience as a Data Architect or similar role in cloud data solutions. Expert in Microsoft Azure data services and hands-on with Microsoft Fabric (OneLake, Lakehouse, DirectLake More ❯

My FTSE 100 Client is urgently recruiting for a Data Solutions Architect, the chosen Candidate will be at the forefront of shaping end-to-end data architectures that support analytics, AI, and enterprise reporting across the organisation. You will lead solution design, champion best practices, and work closely with business and technical stakeholders to deliver robust, scalable, and … secure data platforms. Key Responsibilities Design and implement modern data architectures using Azure Synapse , Data Lake , Data Factory , Databricks , and Microsoft Fabric . Lead the development of integrated data solutions supporting BI, advanced analytics, and real-time data processing. Define data governance, security, and compliance standards across the data lifecycle. Collaborate with … cross-functional teams to translate business requirements into technical blueprints. Stay ahead of emerging trends in cloud, data, and AI, bringing innovative thinking into the organisation. About You Proven experience as a Data Architect or similar role in cloud data solutions. Expert in Microsoft Azure data services and hands-on with Microsoft Fabric (OneLake, Lakehouse, DirectLake More ❯

and careers grow. Join us as we shape the future of public transport and make a real difference to everyday journeys. About the role We are looking for a Data Engineering & Operations Lead to join our growing Data team at First Bus. This is a critical leadership role at the heart of our data transformation journey. … You'll be responsible for designing, developing, and maintaining the core data infrastructure that underpins decision-making across the business. As we continue to scale our use of data, your leadership will ensure our Azure-based platform is robust, scalable, and fully aligned with the needs of the business. You'll play a key role in evolving our … Azure environment into a modern, business-ready data platform – shaping its technical architecture, setting engineering standards, and delivering high-impact data solutions. You'll also lead and mentor a team of data engineers, providing direction on priorities, driving best practices, and ensuring the delivery of high-quality, reliable data pipelines and services. This is an More ❯

application. We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Senior Manager of Software Engineering at JPMorgan Chase within the Corporate Technology, you will serve in a leadership role by providing technical coaching and advisory for multiple agile technical teams. You will anticipate the … for the team. Create a culture of diversity, equity, inclusion, and respect for team members, prioritizing diverse representation. Required Qualifications, Capabilities, and Skills Formal training or certification on software engineering concepts and advanced applied experience. In addition, proven experience leading technologists to manage and solve complex technical items within your domain of expertise. Experience leading large feature teams of … software engineers to deliver intensive data driven applications. Ability to guide and coach teams on approaches to achieve goals aligned with strategic initiatives. In-depth knowledge of agile practices and delivering agile programs. In-depth knowledge of the financial industry and their IT systems. In-depth knowledge and experience in a last JAVA, Python, Databricks, AWS/Azure. Experience More ❯

Salary: £49,100-£64,600 with an average profit share of £3,532-£10,861. Softwire is one of the UK's leading digital technology consultancies, offering services in data, AI, cloud, CX, innovation, design, and software engineering. We deliver high-profile, mission-critical, and transformational projects for household names across the public and private sectors. Founded on the … clients. Our culture and values emphasize doing jobs properly, making work fulfilling and fun, extending kindness, and trusting each other to reduce bureaucracy. In brief We seek well-rounded data engineers capable of tackling complex data challenges, impressing clients, and impacting team output. We offer a supportive environment with career development, mentorship, and diverse project opportunities. You will … work with talented developers and data engineers, supported by a Technical Lead, on projects such as: Data modeling for Moorfields Eye Hospital's INSIGHT programme Maintaining data pipelines and dashboards on Elexon's Azure platform Implementing AI transcription services for the BBC using GenAI Migrating legacy Excel workflows for a financial services firm Modeling data for More ❯