1 to 25 of 43 Big Data Jobs in the North of England

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead … Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are … seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge technologies, architecting big data solutions and developing More ❯

firm and across the globe, Deloitte is an environment where you and your career can flourish. The SAP Analytics+ team consists of 5 core capability groups: Strategy and Architecture Data & Platforms Planning, Budgeting and Forecasting Advanced Analytics Performance, Consolidation & Close Connect to your career at Deloitte Deloitte drives progress. Using our vast range of expertise, we help our clients … how and where it mattersmost . Connect to your opportunity There is an opportunity for you to join and help develop our SAP Analytics+ team, specifically focusing on SAP Data & data Platforms, based on best in class solutions, we expect you to be an expert in using one or more of: SAP ECC/S4/HANA SAP … DataSphere SAP Business Warehouse for HANA (SAP BW/4HANA) SAP Business Transformation Platform (BTP) This represents a unique opportunity to develop your career in consulting within an established Big 4 consulting firm. You will have the chance to develop your technical and functional expertise in the Analytics+ tools, as well as in the delivery and implementation of large More ❯

firm and across the globe, Deloitte is an environment where you and your career can flourish. The SAP Analytics+ team consists of 5 core capability groups: Strategy and Architecture Data & Platforms Planning, Budgeting and Forecasting Advanced Analytics Performance, Consolidation & Close Connect to your career at Deloitte Deloitte drives progress. Using our vast range of expertise, we help our clients … how and where it mattersmost . Connect to your opportunity There is an opportunity for you to join and help develop our SAP Analytics+ team, specifically focusing on SAP Data & data Platforms, based on best in class solutions, we expect you to be an expert in using one or more of: SAP ECC/S4/HANA SAP … DataSphere SAP Business Warehouse for HANA (SAP BW/4HANA) SAP Business Transformation Platform (BTP) This represents a unique opportunity to develop your career in consulting within an established Big 4 consulting firm. You will have the chance to develop your technical and functional expertise in the Analytics+ tools, as well as in the delivery and implementation of large More ❯

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing … overseeing a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. You will collaborate with stakeholders to understand their strategic … objectives and identify opportunities to leverage data and data quality. You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems. You will collaborate with data More ❯

Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the latest big data tools, frameworks and offerings (data mesh, etc.), while also being involved in enabling credible and collaborative problem solving to execute on a strategy. Job responsibilities You will develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions You will develop intricate data processing pipelines … addressing clients' most challenging problems You will collaborate with data scientists to design scalable implementations of their models You will write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines You will use different distributed storage and computing technologies from the plethora of options available You will develop data More ❯

a passion to make an impact. Harnessing our innovative technologies and strong partnerships, we aim to make travel easy and rewarding for everyone. Get to Know Our Team The Data department, based in Bangkok, oversees all of Agoda's data-related requirements. Our ultimate goal is to enable and increase the use of data in the company … through creative approaches and the implementation of powerful resources such as operational and analytical databases, queue systems, BI tools, and data science technology. We hire the brightest minds from around the world to take on this challenge and equip them with the knowledge and tools that contribute to their personal growth and success while supporting our company's culture … of diversity and experimentation. The role the Data team plays at Agoda is critical as business users, product managers, engineers, and many others rely on us to empower their decision making. We are equally dedicated to our customers by improving their search experience with faster results and protecting them from any fraudulent activities. Data is interesting only when More ❯

We are therefore hiring a Data Director to lead and collaborate with our data functions, encompassing data analytics, data science, data governance, and data engineering. You will deliver our vision using data to provide a market-leading platform service, driving value from data. You will drive a data-first culture, empowering self … service approaches across the business, underpinned by technology, governance, and data science capabilities. The data team will provide insights that drive improved strategic outcomes for our business; using data as the foundation for all we do. The ideal candidate will possess a strong technical grounding, a track record of problem solving, commercial acumen, and experience in a … senior role leading data teams. What we're looking for: Demonstrated leadership in data strategy and execution, with a track record of delivering data initiatives aligned to business goals. Proven track record of leading data-driven transformation, using analytics to unlock measurable business impact, enable data-led decisions, inform product development, and enhance customer insight. More ❯

Senior Lead Instructor – Cloud, Data & AI Location: MediaCity, Salford (Hybrid) Salary: Competitive, based on experience Sector: Digital Skills/Technology Education/EdTech A leading, award-winning technology organisation based in Manchester's MediaCity is seeking a Senior Lead Instructor specialising in Cloud, Data, and AI technologies to join its innovative digital skills division. This organisation is on … hands-on role within the organisation's digital skills function. As Senior Lead Instructor , you'll be responsible for delivering and developing high-impact training programmes in cloud-based data, big data, and AI technologies. You'll also work closely with corporate clients to design bespoke upskilling solutions aligned to real-world business needs. You'll need … is your chance to help shape the future tech workforce while working in a vibrant, innovation-led environment. Key Responsibilities Deliver engaging in-person and virtual training on cloud, data and AI technologies to a broad range of learners. Design and update training materials, including labs, presentations, and assessments, aligned with current industry needs. Collaborate with employers to design More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

Head of Engineering. You will oversee all aspects of the engineering lifecycle, from technology design and architecture through to implementation and optimisation. You'll work closely with cloud architects, data scientists, and risk officers to deliver a robust, scalable, and compliant platform that meets the bank's risk and regulatory needs. The role will shape the Lab vision, set … direction, and demonstrate technical leadership across the lifecycle from idea to value realisation. About us Like the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform how we meet the changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too … What you'll do Lead the engineering team responsible for end-to-end infrastructure and technology transformation, including legacy decommissioning and GCP-based data infrastructure. Provide technical direction and mentorship, fostering collaboration, innovation, and continuous improvement. Design scalable, high-performance cloud infrastructure on GCP, ensuring availability, resilience, security, and compliance. Implement Infrastructure-as-Code (IaC) using tools like Terraform More ❯

Head of Engineering. You will oversee all aspects of the engineering lifecycle, from technology design and architecture through to implementation and optimisation. You'll work closely with cloud architects, data scientists, and risk officers to deliver a robust, scalable, and compliant platform that meets the bank's risk and regulatory needs. The role will shape the Lab vision, set … direction, and demonstrate technical leadership across the lifecycle from idea to value realisation. About us Like the modern Britain we serve, we're evolving. Investing billions in our people, data and tech to transform how we meet the changing needs of our 26 million customers. We're growing with purpose. Join us on our journey and you will too … What you'll do Lead the engineering team responsible for end-to-end infrastructure and technology transformation, including legacy decommissioning and GCP-based data infrastructure. Provide technical direction and mentorship, fostering collaboration, innovation, and continuous improvement. Design scalable, high-performance cloud infrastructure on GCP, ensuring availability, resilience, security, and compliance. Implement Infrastructure-as-Code (IaC) using tools like Terraform More ❯

maintenance of ongoing performance metrics, investigations, reports, analyses, dashboards, etc. to drive key business decisions • Participate in the build of scalable solutions/self-serve platforms that will provide data/KPIs to inform business decision making and support the Security & Loss Prevention operations in their day to day tasks and responsibilities • Recognize and adopt best practices in reporting … and analysis: data integrity, test design, analysis, validation, training, and documentation • Apply data mining and quantitative analysis to understand how our customers interact with us and identify the best way to improve the customer experience and meet our loss reduction goals • Acquire various data sources to enable holistic analysis at a global level • Establish performance benchmarks, conduct … maintenance of ongoing performance metrics, investigations, reports, analyses, dashboards, etc. to drive key business decisions • Participate in the build of scalable solutions/self-serve platforms that will provide data/KPIs to inform business decision making and support the Security & Loss Prevention operations in their day to day tasks and responsibilities • Recognize and adopt best practices in reporting More ❯

BRAND NEW DATA ENGINEER OPPORTUNITY IN MANCHESTER - HYBRID WORKING Salary up to £55,000 p/a plus bonus & excellent benefits Work on complex, large-scale data pipelines with cutting-edge tech We're looking for strong Python, SQL, and AWS skills, plus experience in ETL processes Hybrid working - 2-3 days in the office ABOUT THE CLIENT … Our client is a trailblazer in the global data insights space, delivering innovative and actionable solutions to some of the most well-known brands worldwide. They specialise in enabling organisations to make smarter, faster decisions through advanced analytics and high-quality data pipelines.With over a decade of experience, they're now seeking a talented Data Engineer to … help drive the performance, scalability, and reliability of their reporting and analytics capabilities. You'll join a collaborative, forward-thinking team working at the forefront of big data engineering. A GLIMPSE AT THE BENEFITS/CULTURE: 25 days' annual leave + bank holidays (option to buy/sell after 2 years) Bonus scheme rewarding strong performance Life assurance More ❯

with senior clients, engineers and architects on a daily basis? Are you a critical thinker that is keen to continue exploring the untouched capabilities of technologies such as Cloud, Big Data, AI and Robotics, and how they can be architected into client's landscapes to help them achieve their strategic goals? Joining the team means becoming part of … speed and confidence. Your responsibilities as an Enterprise Architect Manager or Senior Manager will include: Assessing the impact of the business strategy on the enterprise architecture, including organisation, applications, data, infrastructure, and operations Staying abreast of industry dynamics and the impact of trends on an organisation, to identify and formulate need for change in enterprise architecture Co-creating a … for investment in proposed transformation roadmaps, aligned with client's strategic planning cycles Leading the creation of Enterprise Architecture blueprints, demonstrating the e2e technology landscape including applications, integrations and data Conducting end-to-end vendor assessments across technology, vendor and or data platforms Working between the business and technology client & 3rd party stakeholders to effectivity formulate communicate and More ❯

months, Full Time Join a dynamic organisation dedicated to making financial lives better through the power of every connection. We are seeking a talented Cloudera Developer to enhance our data solutions and contribute to our mission of delivering exceptional financial services. Responsibilities: utilise various architectural components to design and develop client-focused requirements. Maintain, improve, clean, and manipulate data … quo. Document and communicate essential information for deployment, maintenance, support, and business functionality. Adhere to team delivery/release processes for code deployment and releases. Drive business results with data-based insights, collaborating closely with stakeholders. Passionately discover hidden solutions in large datasets to enhance business outcomes. Design, develop, and maintain data processing pipelines using Cloudera technologies, including … Apache Hadoop, Apache Spark, Apache Hive, and Python. Collaborate with data engineers and scientists to translate data requirements into technical specifications. Develop and maintain frameworks for efficient data extraction, transformation, and loading into the Cloudera platform. optimise and tune data processing jobs for high performance and scalability. Implement data governance and security policies to ensure More ❯

a team that treats each other with respect and challenges you to be better. What you know how to do: Can write Spring 4 beans and Hibernate or JPA data objects. Knows Spring bean scopes and when to use them. Able to identify and fix defective, poor performing or non-scalable code. Knows how to develop and debug AOP … injected code. Understands software security practices including user authentication and authorization, data validation and an understanding of common DOS and SQL injection techniques. Is familiar with profiling, code coverage, logging, common IDE's and other development tools. Demonstrates good judgment, creativity, and ingenuity in proposed technical solutions. Coordinates work across teams to build seamless features. What you also have … Qualifications Does this describe you? Java REST Spring The Ideal Candidate Must have good communication skills. Must have experience working on web applications supporting 1M+ end users or large data sets with 10M+ database records. This is a very Big Data platform. Experience building REST services (orchestration layer) on CRUD data services based on Cloudera Hadoop More ❯

Data Engineer – Leeds – Hybrid - Azure An innovative fintech scale-up revolutionising how financial institutions leverage their data assets. Based in Leeds, they're building next-generation solutions that help banks, investment firms, and financial services companies unlock the true potential of their data to drive smarter investment decisions and enhance customer experiences. The Role They need a … talented Data Engineer to join their rapidly expanding engineering team in Leeds. You'll be architecting robust data systems that power critical financial analytics, working with modern cloud technologies whilst tackling real-world challenges in the fast-paced fintech sector. This is an excellent opportunity for someone ready to make their mark in financial technology within a dynamic … career progression opportunities Brilliant team culture + socials What you'll need: Strong SQL skills - you'll be optimising queries and managing complex financial datasets Python experience, particularly for data processing and ETL workflows Hands-on experience with cloud platforms- Azure Experience designing and maintaining data pipelines using tools like Databricks and PySpark Knowledge of data warehousing More ❯

UK government departments, and some other public organisations. We do this fairly and transparently without taking sides, and our service is completely free. About the role As the Deputy Data Protection Officer you will lead operational data protection within PHSO. You will be a proactive and expert champion for privacy and information rights for people who work for … as you and your team deliver an exemplary service internally and externally. You will be leading one of the UK's busiest information rights teams dealing with special category data at volume and you will use your innovation and eye for efficiencies to continuously improve how we work. Job Description To champion and implement good operational information rights and … data protection practice across PHSO and our data processors (suppliers). To ensure that your team handles information requests in accordance with all statutory obligations, codes of practice and guidance thereby minimising the reputational risk of non-compliance. To manage and maintain guidance and policies to ensure that how we work keeps pace with technological, legislative and best More ❯

troubleshooting and problem resolution Experience in System Integration Knowledge of the following: Hadoop, Flume, Sqoop, Map Reduce, Hive/Impala, Hbase, Kafka, Spark Streaming Experience of ETL tools incorporating Big Data Shell Scripting, Python Beneficial Skills: Understanding of: LAN, WAN, VPN and SD Networks Hardware and Cabling set-up experience Experience of implementing and supporting Big Data More ❯

achieve. BASIC QUALIFICATIONS Basic qualifications Experience with operational parameters and troubleshooting for three (3) of the following: compute/storage/networking/CDN/databases/DevOps/big data and analytics/security/applications development in a distributed systems environment Experience in technical engineering Bachelor's degree PREFERRED QUALIFICATIONS Basic qualifications Experience with operational parameters … and troubleshooting for three (3) of the following: compute/storage/networking/CDN/databases/DevOps/big data and analytics/security/applications development in a distributed systems environment Experience in technical engineering Bachelor's degree Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to … success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice ( ) to know more about how we collect, use and transfer the personal data of our candidates. More ❯

best value and service from AWS? AWS Enterprise Support, Technical Account Managers (TAM) support our customers' creative and transformative spirit of innovation across all technologies - including Compute, Storage, Database, Big Data, Application-level Services, Networking, Serverless, Deployment, Security and more. This is not a sales role, but rather an opportunity to be the principal technical advisor and 'voice … role within cloud computing environments - Experience in operational parameters and troubleshooting for two (2) of the following: Compute/Storage/Networking/CDN/Databases/DevOps/Big Data and Analytics/Security/Applications Development in a distributed systems environment/Telecommunications PREFERRED QUALIFICATIONS - Experience in a 24x7 operational services or support environment - Experience in … success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice ( ) to know more about how we collect, use and transfer the personal data of our candidates. More ❯

A fantastic opportunity has arisen for a person to join a department to assist with the delivery of innovative generative AI data solutions. This role performs the duties of a Data Engineer specialising in generative AI and reports to the senior lead within a developing international and transversal structure. Key Responsibilities: Evaluate, design, deploy, improve and support data sets for internal customers, ensuring resilience, security and responsiveness. Collaborate with internal stakeholders to optimise and secure their data in line with operational needs. Maintain and enhance data pipelines, ensuring compliance with data governance standards. Provide expertise in data management and quality assurance. Stay up to date with evolving technology, contribute to the technology roadmap … in the industrial and/or defence sector. The successful candidate must have: SQL technologies skills (e.g. MS SQL, Oracle). noSQL technologies skills (e.g. MongoDB, InfluxDB, Neo4J). Data exchange and processing skills (e.g. ETL, ESB, API). Development skills (e.g. Python). Big data technologies knowledge (e.g. Hadoop stack). This position offers a lucrative More ❯

A fantastic opportunity has arisen for a person to join a department to assist with the delivery of innovative generative AI data solutions. ** Please note that due to the nature of the client’s business, only candidates who currently hold full sole British Citizenship (without limitations) will be considered. ** This role performs the duties of a Data Engineer … specialising in generative AI and reports to the senior lead within a developing international and transversal structure. Key Responsibilities: Evaluate, design, deploy, improve and support data sets for internal customers, ensuring resilience, security and responsiveness. Collaborate with internal stakeholders to optimise and secure their data in line with operational needs. Maintain and enhance data pipelines, ensuring compliance … with data governance standards. Provide expertise in data management and quality assurance. Stay up to date with evolving technology, contribute to the technology roadmap, and deliver cutting-edge solutions. The successful candidate will ideally have: Knowledge in NLP (Natural Language Processing). Knowledge in OCR (Object Character Recognition). Knowledge in Generative AI. Experience in containerisation technologies (e.g. More ❯

with cross-cultural awareness, as you'll be implementing solutions for diverse markets while maintaining Amazon's global standards of customer obsession. Key responsibilities: Work alongside product managers, ML data scientists, designers, and fellow engineers to create seamless Prime experiences Drive technical decisions that consider EU regulations and regional customer preferences Design and develop scalable systems that support Prime … Own the delivery of end-to-end, full stack solutions. - Make sound engineering decisions and improve our software development practices. - Build analytics platforms to process large volumes of traffic data, trends in marketing signals, and other key metrics. - Build experimentation frameworks to drive continuous testing new marketing experiences. - Contribute to the team's technical vision and roadmap. A day … A SDE2 in this role is in charge of end-to-end project ownership and developing full-stack solutions ranging from building scalable softwares to process large volumes of data, building big-data platforms to process customer level data and to capture marketing signals for analytics and measurement. They work with cross-functional teams containing Data More ❯