Lead DataEngineer (Databricks) - Leeds (Lead DataEngineer, Team Lead, Technical Lead, Senior DataEngineer, DataEngineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead DataEngineer, Team Lead, Technical Lead, Senior DataEngineer, DataEngineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead DataEngineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide … technical leadership through coaching and mentorship. We are seeking a Lead DataEngineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge More ❯
CONTRACT DATAENGINEER - eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATAENGINEER WITH eDV CLEARANCE Contract job opportunity for a DataEngineer National Security client Palantir Foundry Outside IR35 Central London based organisation in an easily accessible location To apply please call/or email … WHO WE ARE? We are recruiting a contract DataEngineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATAENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATAENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply More ❯
Manchester, North West, United Kingdom Hybrid / WFH Options
We Are Dcoded Limited
Senior DataEngineer - Azure, Data Factory, Datalakes, SQL - £65,000 - Remote Industry: Retail & eCommerce Role: Senior DataEngineer Location: Remote Salary: £65,000 Benefits The Company We're working with one of the UK's leading retail and e-commerce brands; a business that's experiencing rapid growth and investing heavily in data, analytics … and technology to stay ahead of the competition. With millions of customers, an ever-expanding online presence, and a dynamic product offering, data is at the heart of every decision they make. Their mission is to transform how data is captured, engineered, and consumed across the organisation. Enabling & empowering smarter insights and creating seamless customer experiences. The Role … As a Senior DataEngineer, you'll be a key player in building and evolving a modern Azure-based data platform that underpins decision-making across the business. The Senior DataEngineer will design, deliver, and optimise scalable data solutions, ensuring the right data is available at the right time to drive value. More ❯
BIG DATAENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATAENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big DataEngineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATAENGINEER BE DOING? You will be joining a leading SME who is … working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATAENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such as Hadoop, Cloudera More ❯
Lead Azure DataEngineer The Lead Azure DataEngineer will play a pivotal role in managing and optimising data solutions within the financial services sector. This position focuses on leveraging Azure-based technologies to support the analytics department in delivering high-performing data solutions. Client Details Lead Azure DataEngineer The organisation … within the financial services industry, known for its focus on innovation and technology-driven solutions. It offers a collaborative environment, fostering growth within the analytics field. Description Lead Azure DataEngineer Design and implement scalable data solutions using Azure technologies. Collaborate with the analytics team to align data architecture with business objectives. Develop and maintain robust … ETL pipelines for data processing and integration. Ensure data security and compliance with industry standards and regulations. Monitor and optimise data storage and processing performance within Azure environments. Provide technical leadership and mentoring to junior team members. Document processes, system designs, and workflows for future reference. Stay updated on emerging trends and technologies in data engineering More ❯
Reading, Berkshire, South East, United Kingdom Hybrid / WFH Options
Bowerford Associates
We are searching for a remote working Senior DataEngineer to join our clients high-performing Data Engineering team. This role is ideal for an experienced, hands-on professional Senior DataEngineer who thrives on technical leadership, innovation, and delivery. You can be based anywhere in the UK to be considered for the role but … you MUST be UK based as overseas working is not possible with our client. Our client is a 100% data-driven company who pride themselves on engineering excellence and delivering impactful solutions to their clients. You will play a crucial role in driving the team's vision and objectives and you will be expected to provide technical leadership, own … the solution, ensure the reliability of data products, and collaborate closely with the team and customers in order to optimise data solutions. This is a unique opportunity for a highly skilled and hard-working Senior DataEngineer with deep hands-on expertise in data engineering and architecture, a strong coding background, and a strategic mindset More ❯
Reading, Berkshire, South East, United Kingdom Hybrid / WFH Options
Bowerford Associates
We are searching for an experienced Lead DataEngineer for an exciting data-driven business with multiple office locations across the UK. The role is offered as a remote position, but you MUST be based in the UK to be considered for the opportunity. In this role you will be involved in determining the future direction and … impact of data engineering within the business. This is an extremely exciting Lead Data Engineering role, a fantastic opportunity for an experienced, innovative and hands-on data professional to help shape our client's products and solutions. Reporting directly to the Head of Data Engineering, you will play a crucial role in driving the team's … vision and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions. This is a fantastic opportunity for highly skilled and motivated Lead DataEngineer with strong expertise in data architecture, ETL More ❯
Bedford, Bedfordshire, South East, United Kingdom Hybrid / WFH Options
AWD Online
Data Lead/BI Business Intelligence & Insights Manager/Principal DataEngineer who has proven leadership in a technology environment, managing teams of Data Engineers, BI Developers and Data Analysts is required for a well-established company based in Bedford, Bedfordshire. IS THIS YOU? Can you lead the companys data strategy, build cutting-edge … can be based in either UK or Portugal Local Salary Ranges Will Apply JOB TYPE: Full-Time, Permanent JOB OVERVIEW We have a fantastic new job opportunity for a Data Lead/BI Business Intelligence & Insights Manager/Principal DataEngineer who has proven leadership in a technology environment, managing teams of Data Engineers, BI Developers … and Data Analysts. Working as the Data Lead/BI Business Intelligence & Insights Manager/Principal DataEngineer youll be the driving force behind ensuring the companys data is accurate, secure, and fully leveraged. As the Data Lead/BI Business Intelligence & Insights Manager/Principal DataEngineer youll create a single More ❯
company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯
Are you a DataEngineer, seeking a new challenge? Do you have passion for future vehicle development? If so, Expleo have an opportunity for you! Our client, a prestigious Automotive Manufacturer, is currently recruiting for a DataEngineer to join their Customer Relationship Centre team. As a DataEngineer you will play a key … part in enabling data-driven decision-making by building and maintaining robust data pipelines, integrating customer service systems, and ensuring high-quality data is available for analysis and insights. Based in Warwickshire, you will be supporting, a dedicated and enthusiastic team, on a contract basis. You will work closely with analysts, developers, and operational teams to support … customer experience initiatives. . Responsibilities of the DataEngineer will include: * Design, build, and maintain scalable data pipelines to support customer service operations * Migrate and modernise legacy data systems to cloud-based solutions * Integrate data from CRM systems and customer touchpoints into cloud platforms * Ensure data quality, consistency, and availability for reporting and analytics More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
McGregor Boyall
DataEngineer Location: London - Hybrid Working Employment Type: Permanent Salary: £40k-£50k DataEngineer About the Role We're seeking a DataEngineer to collaborate with business stakeholders in designing, building, and maintaining innovative data solutions. You'll play a key role in developing their cloud-based analytics platform on Azure whilst facilitating … seamless integration with various systems, including AWS environments. Your expertise will be crucial in creating robust data pipelines that transform raw information into actionable insights for business intelligence, advanced analytics, and strategic modelling. DataEngineer - The Team & Environment Join during an exciting period of digital transformation as we harness data and analytics to drive informed decision … making across the organisation. The Data, Analytics and Insight division is pioneering a customer-centric approach to data utilisation, ensuring we continuously evolve and deliver exceptional value. Their diverse team encompasses: Business Intelligence - crafting intuitive data visualisations and dashboards that make complex information accessible Customer Research - leveraging empathy-driven research, surveys, and digital analytics to understand user More ❯
Reading, Berkshire, United Kingdom Hybrid / WFH Options
Bowerford Associates
We are searching for a Principal Geospatial DataEngineer to join our clients high-performing Data Engineering Team. This role is ideal for an experienced, hands-on professional who thrives on technical leadership, innovation, and delivery. As a 100% data-driven company, our customer prides itself on engineering excellence and delivering impactful solutions and services to … time and fully remote with very occasional trips to the office. You will also receive an extensive benefits package and a competitive salary. Reporting directly to the Head of Data Engineering , you will play a crucial role in driving the team's vision and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure … the reliability of data products, and collaborate closely with your team and customers to optimise data solutions. To be considered for this role you MUST have Geospatial Data experience, good knowledge of QGIS & FME , programming/coding abilities in at least two (2) languages and considerable experience of AWS . This really is a unique opportunity for More ❯
Employment Type: Temporary
Salary: £80000 - £500000/annum Pension, Good Holiday, Insurances
Are you a DataEngineer, seeking a new challenge? Do you have passion for future vehicle development? If so, Expleo have an opportunity for you! Our client, a prestigious Automotive Manufacturer, is currently recruiting for a DataEngineer to join their Customer Relationship Centre team. As a DataEngineer you will play a key … part in enabling data-driven decision-making by building and maintaining robust data pipelines, integrating customer service systems, and ensuring high-quality data is available for analysis and insights. Based in Warwickshire, you will be supporting, a dedicated and enthusiastic team, on a contract basis. You will work closely with analysts, developers, and operational teams to support … customer experience initiatives. . Responsibilities of the DataEngineer will include: Design, build, and maintain scalable data pipelines to support customer service operations Migrate and modernise legacy data systems to cloud-based solutions Integrate data from CRM systems and customer touchpoints into cloud platforms Ensure data quality, consistency, and availability for reporting and analytics More ❯
DataEngineer Sr - Informatica ETL Expert page is loaded DataEngineer Sr - Informatica ETL Expert Apply locations Two PNC Plaza (PA374) Birmingham - Brock (AL112) Dallas Innovation Center - Luna Rd (TX270) Strongsville Technology Center (OH537) time type Full time posted on Posted 3 Days Ago job requisition id R185351 Position Overview Job Description Summary At PNC, our … each day to foster an inclusive workplace culture where all of our employees feel respected, valued and have an opportunity to contribute to the company's success. As a DataEngineer within PNC's Technology organization, you will be based in Pittsburgh, PA; Cleveland, OH; Birmingham, AL or Dallas, TX. The position is primarily based in a PNC … the manager's discretion. PNC will not provide sponsorship for employment visas or participate in STEM OPT for this position Key responsibilities - - Design, Develop and maintain scalable and efficient data pipelines and ETL processes - Collaborate with analysts and stakeholders to gather requirements and implement data solutions that meet business needs - Proposes & designs data solutions to address complex More ❯
Cloud DataEngineer Remote (with potential travel to the Washington D.C. metro area on special occasions) Public Trust- Can start with it pending Looking for an opportunity to make an impact? Client is seeking a seeking a customer experience focused Cloud DataEngineer to work with a team of subject matter experts and developers to design … and implement full lifecycle data pipeline services for Azure cloud based data lake, SQL, and NoSQL data stores. As a dataengineer, you will translate business requirements to data engineering solutions to support an enterprise scale Microsoft Azure based data analytics and reporting platform. You will support continued maintenance of legacy SQL Server … solve the world's toughest challenges in the defense, intelligence, civil, and health markets. Client Civil Group helps the government modernize operations with leading edge AI/ML driven data management and analytics solutions. We are a trusted partner to both government and highly-regulated commercial customers looking for transformative solutions in mission IT, security, software, engineering, and operations. More ❯
Central London, London, United Kingdom Hybrid / WFH Options
Singular Recruitment
DataEngineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a DataEngineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, youll not only be part of a creative and open work culture focused on innovation and … making it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of DataEngineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. Integrate … data management technologies and software tools into existing structures. Create data tools to support sport data modelling, prediction and analytics. Work with data and analytics experts to strive for greater functionality in our data systems. As the selected DataEngineer, your background will include: 3+ years industry experience in a DataEngineerMore ❯
Job Title: DataEngineer (Microsoft Fabric & Synapse) Job Summary We are seeking a skilled and experienced DataEngineer to join our team, focusing on the Microsoft data platform. The ideal candidate will have extensive hands-on experience in designing, building, and maintaining robust and scalable data pipelines using Microsoft Fabric, Azure Synapse Analytics, and … Python. You will be responsible for orchestrating the flow of data from diverse sources into our analytical platform, enabling data-driven decision-making across the organization. Key Responsibilities Pipeline Development: Design, develop, and maintain efficient ETL/ELT data pipelines using Microsoft Fabric and its components, including Fabric Pipelines and Spark jobs. Notebook-based Transformation: Write, test … and optimize Python notebooks (PySpark) within the Fabric/Synapse environment to perform complex data ingestion, cleansing, and transformation tasks. Data Warehouse and Lakehouse Management: Implement and manage data storage solutions, leveraging Azure Data Lake and Fabric's OneLake for a modern lakehouse architecture. Data Integration: Integrate data from a wide variety of sources More ❯
Our client is seeking a DataEngineer for contract opportunity (with possibility of going permanent). The DataEngineer builds and optimizes the association's data and data pipeline architecture. This includes data flow and collection, ensuring consistent architecture throughout. The incumbent's work is varied, supporting multiple teams, systems, and projects. Staying … up-to-date with data engineering tools and technologies, including cloud-based data services, is essential for this position. DUTIES: Data StorageDesigns, optimizes, and maintains databases for efficient data storage and retrieval. Manages data warehouses or data lakes to ensure accessibility and reliability of data. Develops and maintains data models and schemas that … support analytics and reporting. Manages our Snowflake instance to provide business and regulatory report on our portfolio and ancillary services from initial contact to post loan closure. Data ArchitectureBuilds and maintains data pipelines to move, transform, and load data from various sources to a centralized repository. Optimizes data infrastructure and pipelines for speed, scalability, and cost More ❯
Title: DataEngineer (Azure Data Services) Location: Spring, TX 7789 (Hybrid: 3 days onsite/2 days remote) Duration: 6+ month contract role Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. Job Description The DataEngineer analyzes complex and unstructured data using advanced data engineering techniques to develop … and maintain data and deployment pipelines. This role uses knowledge of data processing, prototyping, and architecture methods to help solve real-world problems. The DataEngineer will work with Data Scientists and internal/external customers to collect and understand diverse types of data, perform wrangling, and develop and integrate applications at scale. What … You Will Do: Utilize knowledge of modern data-driven methods and domain understanding to support the creation of new products, services, and insights using predictive models. Write independent source code, validate, and test for model quality improvement. Utilize machine learning, artificial intelligence, classification, regression, NLP, etc. Data analysis using Python, Database Systems (such as SQL), and Azure cloud More ❯
Job Title: Data Integration Engineer Job Description : About Veda Infotech Services, LLC: Veda Infotech Services, LLC is a dynamic software consulting firm with over 10 years of experience in delivering innovative and customized IT solutions. We serve clients across various industries, providing services such as software modernization, business intelligence, cloud computing, cybersecurity, and AI engineering. Our goal is … position or W2 Citizens and Green Card holders are highly encouraged to apply. Location: Washington DCJob Type: Full-time/Contract Hourly Rate: $50 - $75 per hour Overview: The Data Integration Specialist is responsible for managing and optimizing the data integration processes using various tools likeETL tools (Informatica, SQL Server) andRelational Databases (RDBMS). This role involves overseeing … data extraction, transformation, and loading (ETL), working with large datasets, and ensuring the seamless integration of various data sources into a unified data warehouse or system. Key Responsibilities: Design, develop, and implement robust ETL processes for data extraction, transformation, and loading across multiple systems and platforms. Ensure data quality and consistency while transforming raw dataMore ❯
South West London, London, England, United Kingdom Hybrid / WFH Options
Bennett & Game Recruitment
We are seeking an Analytical DataEngineer to join a leading Analytics as a Service (AaaS) provider, supporting clients across energy management, predictive maintenance, HR, and finance. You will transform complex data from multiple sources into actionable insights, creating user-friendly data models and dashboards that empower clients to explore their data independently. This client … facing role blends data analyst and dataengineer skills, including requirement gathering, stakeholder communication, and delivering robust data solutions. Hands-on experience with Power BI, Sisense, Quicksight, and AWS (Sagemaker Unified Studio preferred) is highly desirable. Offering a competitive salary, performance-based bonuses, and fully flexible remote working, this is a fantastic opportunity to shape and … lead analytics projects from onboarding through delivery in a collaborative, fast-growing environment. Analytical DataEngineer Job Overview Cleanse and transform data sets to create one-to-many star schema models from multiple sources. Define fact and dimension tables based on requirements, enabling users to drill down and explore data independently. Proactively search for and review More ❯
Westminster, London, City of Westminster, United Kingdom Hybrid / WFH Options
Bennett and Game Recruitment LTD
We are seeking an Analytical DataEngineer to join a leading Analytics as a Service (AaaS) provider, supporting clients across energy management, predictive maintenance, HR, and finance. You will transform complex data from multiple sources into actionable insights, creating user-friendly data models and dashboards that empower clients to explore their data independently. This client … facing role blends data analyst and dataengineer skills, including requirement gathering, stakeholder communication, and delivering robust data solutions. Hands-on experience with Power BI, Sisense, Quicksight, and AWS (Sagemaker Unified Studio preferred) is highly desirable. Offering a competitive salary, performance-based bonuses, and fully flexible remote working, this is a fantastic opportunity to shape and … lead analytics projects from onboarding through delivery in a collaborative, fast-growing environment. Analytical DataEngineer Job Overview Cleanse and transform data sets to create one-to-many star schema models from multiple sources. Define fact and dimension tables based on requirements, enabling users to drill down and explore data independently. Proactively search for and review More ❯
This is an exciting opportunity for a Senior DataEngineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector, founded … of transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior DataEngineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior DataEngineer will be responsible for, but not limited to: Design and maintain scalable More ❯
Manchester, Lancashire, England, United Kingdom Hybrid / WFH Options
Michael Page Technology
This is an exciting opportunity for a Senior DataEngineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector, founded … of transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior DataEngineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior DataEngineer will be responsible for, but not limited to: Design and maintain scalable More ❯
Manchester, Lancashire, England, United Kingdom Hybrid / WFH Options
Noir
DataEngineer - Leading Pharmaceutical Company - Manchester(Tech Stack: DataEngineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced DataEngineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment.About the Role: Our client is seeking an experienced DataEngineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate about … improving processes, ensuring data quality, and maintaining compliance with regulatory standards. focusing on designing, developing, and maintaining data pipelines, ETL processes, and databases. If you are passionate about driving continuous improvement and ensuring data quality and compliance, we want to hear from you.Key Responsibilities:Design, develop, maintain, and optimise data pipelines, ETL processes, and databases.Drive continuous More ❯