1 to 25 of 33 Big Data Jobs in the North of England

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead … Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are … seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge technologies, architecting big data solutions and developing More ❯

firm and across the globe, Deloitte is an environment where you and your career can flourish. The SAP Analytics+ team consists of 5 core capability groups: Strategy and Architecture Data & Platforms Planning, Budgeting and Forecasting Advanced Analytics Performance, Consolidation & Close Connect to your career at Deloitte Deloitte drives progress. Using our vast range of expertise, we help our clients … how and where it mattersmost . Connect to your opportunity There is an opportunity for you to join and help develop our SAP Analytics+ team, specifically focusing on SAP Data & data Platforms, based on best in class solutions, we expect you to be an expert in using one or more of: SAP ECC/S4/HANA SAP … DataSphere SAP Business Warehouse for HANA (SAP BW/4HANA) SAP Business Transformation Platform (BTP) This represents a unique opportunity to develop your career in consulting within an established Big 4 consulting firm. You will have the chance to develop your technical and functional expertise in the Analytics+ tools, as well as in the delivery and implementation of large More ❯

firm and across the globe, Deloitte is an environment where you and your career can flourish. The SAP Analytics+ team consists of 5 core capability groups: Strategy and Architecture Data & Platforms Planning, Budgeting and Forecasting Advanced Analytics Performance, Consolidation & Close Connect to your career at Deloitte Deloitte drives progress. Using our vast range of expertise, we help our clients … how and where it mattersmost . Connect to your opportunity There is an opportunity for you to join and help develop our SAP Analytics+ team, specifically focusing on SAP Data & data Platforms, based on best in class solutions, we expect you to be an expert in using one or more of: SAP ECC/S4/HANA SAP … DataSphere SAP Business Warehouse for HANA (SAP BW/4HANA) SAP Business Transformation Platform (BTP) This represents a unique opportunity to develop your career in consulting within an established Big 4 consulting firm. You will have the chance to develop your technical and functional expertise in the Analytics+ tools, as well as in the delivery and implementation of large More ❯

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing … overseeing a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. You will collaborate with stakeholders to understand their strategic … objectives and identify opportunities to leverage data and data quality. You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems. You will collaborate with data More ❯

Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the latest big data tools, frameworks and offerings (data mesh, etc.), while also being involved in enabling credible and collaborative problem solving to execute on a strategy. Job responsibilities You will develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions You will develop intricate data processing pipelines … addressing clients' most challenging problems You will collaborate with data scientists to design scalable implementations of their models You will write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines You will use different distributed storage and computing technologies from the plethora of options available You will develop data More ❯

a passion to make an impact. Harnessing our innovative technologies and strong partnerships, we aim to make travel easy and rewarding for everyone. Get to Know Our Team The Data department, based in Bangkok, oversees all of Agoda's data-related requirements. Our ultimate goal is to enable and increase the use of data in the company … through creative approaches and the implementation of powerful resources such as operational and analytical databases, queue systems, BI tools, and data science technology. We hire the brightest minds from around the world to take on this challenge and equip them with the knowledge and tools that contribute to their personal growth and success while supporting our company's culture … of diversity and experimentation. The role the Data team plays at Agoda is critical as business users, product managers, engineers, and many others rely on us to empower their decision making. We are equally dedicated to our customers by improving their search experience with faster results and protecting them from any fraudulent activities. Data is interesting only when More ❯

We are therefore hiring a Data Director to lead and collaborate with our data functions, encompassing data analytics, data science, data governance, and data engineering. You will deliver our vision using data to provide a market-leading platform service, driving value from data. You will drive a data-first culture, empowering self … service approaches across the business, underpinned by technology, governance, and data science capabilities. The data team will provide insights that drive improved strategic outcomes for our business; using data as the foundation for all we do. The ideal candidate will possess a strong technical grounding, a track record of problem solving, commercial acumen, and experience in a … senior role leading data teams. What we're looking for: Demonstrated leadership in data strategy and execution, with a track record of delivering data initiatives aligned to business goals. Proven track record of leading data-driven transformation, using analytics to unlock measurable business impact, enable data-led decisions, inform product development, and enhance customer insight. More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

Apply now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not limited … to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will … be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers, data scientists, analysts and even stakeholders to understand their More ❯

maintenance of ongoing performance metrics, investigations, reports, analyses, dashboards, etc. to drive key business decisions • Participate in the build of scalable solutions/self-serve platforms that will provide data/KPIs to inform business decision making and support the Security & Loss Prevention operations in their day to day tasks and responsibilities • Recognize and adopt best practices in reporting … and analysis: data integrity, test design, analysis, validation, training, and documentation • Apply data mining and quantitative analysis to understand how our customers interact with us and identify the best way to improve the customer experience and meet our loss reduction goals • Acquire various data sources to enable holistic analysis at a global level • Establish performance benchmarks, conduct … maintenance of ongoing performance metrics, investigations, reports, analyses, dashboards, etc. to drive key business decisions • Participate in the build of scalable solutions/self-serve platforms that will provide data/KPIs to inform business decision making and support the Security & Loss Prevention operations in their day to day tasks and responsibilities • Recognize and adopt best practices in reporting More ❯

BRAND NEW DATA ENGINEER OPPORTUNITY IN MANCHESTER - HYBRID WORKING Salary up to £55,000 p/a plus bonus & excellent benefits Work on complex, large-scale data pipelines with cutting-edge tech We're looking for strong Python, SQL, and AWS skills, plus experience in ETL processes Hybrid working - 2-3 days in the office ABOUT THE CLIENT … Our client is a trailblazer in the global data insights space, delivering innovative and actionable solutions to some of the most well-known brands worldwide. They specialise in enabling organisations to make smarter, faster decisions through advanced analytics and high-quality data pipelines.With over a decade of experience, they're now seeking a talented Data Engineer to … help drive the performance, scalability, and reliability of their reporting and analytics capabilities. You'll join a collaborative, forward-thinking team working at the forefront of big data engineering. A GLIMPSE AT THE BENEFITS/CULTURE: 25 days' annual leave + bank holidays (option to buy/sell after 2 years) Bonus scheme rewarding strong performance Life assurance More ❯

with senior clients, engineers and architects on a daily basis? Are you a critical thinker that is keen to continue exploring the untouched capabilities of technologies such as Cloud, Big Data, AI and Robotics, and how they can be architected into client's landscapes to help them achieve their strategic goals? Joining the team means becoming part of … speed and confidence. Your responsibilities as an Enterprise Architect Manager or Senior Manager will include: Assessing the impact of the business strategy on the enterprise architecture, including organisation, applications, data, infrastructure, and operations Staying abreast of industry dynamics and the impact of trends on an organisation, to identify and formulate need for change in enterprise architecture Co-creating a … for investment in proposed transformation roadmaps, aligned with client's strategic planning cycles Leading the creation of Enterprise Architecture blueprints, demonstrating the e2e technology landscape including applications, integrations and data Conducting end-to-end vendor assessments across technology, vendor and or data platforms Working between the business and technology client & 3rd party stakeholders to effectivity formulate communicate and More ❯

months, Full Time Join a dynamic organisation dedicated to making financial lives better through the power of every connection. We are seeking a talented Cloudera Developer to enhance our data solutions and contribute to our mission of delivering exceptional financial services. Responsibilities: utilise various architectural components to design and develop client-focused requirements. Maintain, improve, clean, and manipulate data … quo. Document and communicate essential information for deployment, maintenance, support, and business functionality. Adhere to team delivery/release processes for code deployment and releases. Drive business results with data-based insights, collaborating closely with stakeholders. Passionately discover hidden solutions in large datasets to enhance business outcomes. Design, develop, and maintain data processing pipelines using Cloudera technologies, including … Apache Hadoop, Apache Spark, Apache Hive, and Python. Collaborate with data engineers and scientists to translate data requirements into technical specifications. Develop and maintain frameworks for efficient data extraction, transformation, and loading into the Cloudera platform. optimise and tune data processing jobs for high performance and scalability. Implement data governance and security policies to ensure More ❯

a team that treats each other with respect and challenges you to be better. What you know how to do: Can write Spring 4 beans and Hibernate or JPA data objects. Knows Spring bean scopes and when to use them. Able to identify and fix defective, poor performing or non-scalable code. Knows how to develop and debug AOP … injected code. Understands software security practices including user authentication and authorization, data validation and an understanding of common DOS and SQL injection techniques. Is familiar with profiling, code coverage, logging, common IDE's and other development tools. Demonstrates good judgment, creativity, and ingenuity in proposed technical solutions. Coordinates work across teams to build seamless features. What you also have … Qualifications Does this describe you? Java REST Spring The Ideal Candidate Must have good communication skills. Must have experience working on web applications supporting 1M+ end users or large data sets with 10M+ database records. This is a very Big Data platform. Experience building REST services (orchestration layer) on CRUD data services based on Cloudera Hadoop More ❯

Data Engineer – Leeds – Hybrid - Azure An innovative fintech scale-up revolutionising how financial institutions leverage their data assets. Based in Leeds, they're building next-generation solutions that help banks, investment firms, and financial services companies unlock the true potential of their data to drive smarter investment decisions and enhance customer experiences. The Role They need a … talented Data Engineer to join their rapidly expanding engineering team in Leeds. You'll be architecting robust data systems that power critical financial analytics, working with modern cloud technologies whilst tackling real-world challenges in the fast-paced fintech sector. This is an excellent opportunity for someone ready to make their mark in financial technology within a dynamic … career progression opportunities Brilliant team culture + socials What you'll need: Strong SQL skills - you'll be optimising queries and managing complex financial datasets Python experience, particularly for data processing and ETL workflows Hands-on experience with cloud platforms- Azure Experience designing and maintaining data pipelines using tools like Databricks and PySpark Knowledge of data warehousing More ❯

troubleshooting and problem resolution Experience in System Integration Knowledge of the following: Hadoop, Flume, Sqoop, Map Reduce, Hive/Impala, Hbase, Kafka, Spark Streaming Experience of ETL tools incorporating Big Data Shell Scripting, Python Beneficial Skills: Understanding of: LAN, WAN, VPN and SD Networks Hardware and Cabling set-up experience Experience of implementing and supporting Big Data More ❯

A fantastic opportunity has arisen for a person to join a department to assist with the delivery of innovative generative AI data solutions. This role performs the duties of a Data Engineer specialising in generative AI and reports to the senior lead within a developing international and transversal structure. Key Responsibilities: Evaluate, design, deploy, improve and support data sets for internal customers, ensuring resilience, security and responsiveness. Collaborate with internal stakeholders to optimise and secure their data in line with operational needs. Maintain and enhance data pipelines, ensuring compliance with data governance standards. Provide expertise in data management and quality assurance. Stay up to date with evolving technology, contribute to the technology roadmap … in the industrial and/or defence sector. The successful candidate must have: SQL technologies skills (e.g. MS SQL, Oracle). noSQL technologies skills (e.g. MongoDB, InfluxDB, Neo4J). Data exchange and processing skills (e.g. ETL, ESB, API). Development skills (e.g. Python). Big data technologies knowledge (e.g. Hadoop stack). This position offers a lucrative More ❯

A fantastic opportunity has arisen for a person to join a department to assist with the delivery of innovative generative AI data solutions. ** Please note that due to the nature of the client’s business, only candidates who currently hold full sole British Citizenship (without limitations) will be considered. ** This role performs the duties of a Data Engineer … specialising in generative AI and reports to the senior lead within a developing international and transversal structure. Key Responsibilities: Evaluate, design, deploy, improve and support data sets for internal customers, ensuring resilience, security and responsiveness. Collaborate with internal stakeholders to optimise and secure their data in line with operational needs. Maintain and enhance data pipelines, ensuring compliance … with data governance standards. Provide expertise in data management and quality assurance. Stay up to date with evolving technology, contribute to the technology roadmap, and deliver cutting-edge solutions. The successful candidate will ideally have: Knowledge in NLP (Natural Language Processing). Knowledge in OCR (Object Character Recognition). Knowledge in Generative AI. Experience in containerisation technologies (e.g. More ❯

with cross-cultural awareness, as you'll be implementing solutions for diverse markets while maintaining Amazon's global standards of customer obsession. Key responsibilities: Work alongside product managers, ML data scientists, designers, and fellow engineers to create seamless Prime experiences Drive technical decisions that consider EU regulations and regional customer preferences Design and develop scalable systems that support Prime … Own the delivery of end-to-end, full stack solutions. - Make sound engineering decisions and improve our software development practices. - Build analytics platforms to process large volumes of traffic data, trends in marketing signals, and other key metrics. - Build experimentation frameworks to drive continuous testing new marketing experiences. - Contribute to the team's technical vision and roadmap. A day … A SDE2 in this role is in charge of end-to-end project ownership and developing full-stack solutions ranging from building scalable softwares to process large volumes of data, building big-data platforms to process customer level data and to capture marketing signals for analytics and measurement. They work with cross-functional teams containing Data More ❯

Consultant, Solutions Architect, Platform Engineer, Systems Engineer, Cloud Architect etc. - Demonstrated operational experience in Resilience, Observability, Security, and Optimisation of cloud computing environments. - Expertise in areas such as Compute, Data Infrastructure, DevOps, Big Data/Analytics, Security, Cloud Architecture, or Applications Development in a distributed systems environment - External customer-facing experience with the ability to clearly articulate … success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice ( ) to know more about how we collect, use and transfer the personal data of our candidates. More ❯

processes, boost efficiency, and deliver innovative solutions. The team's expertise spans a wide range of technologies, including Java and Python-based MicroServices, AWS/GCP cloud backend systems, Big Data technologies like Hive and Spark, and modern Web applications. With a globally distributed presence across the US, India and Europe, the team thrives on collaboration, bringing together … you'll be doing Design, develop and deploy scalable web applications and services, being part of everything from contributing to web technology and framework stack, to use case and data model design Drive architecture discussions, take ownership and responsibility over new projects, and deliver high quality software with tight timeline Partner with security and compliance teams to ensure the … We're excited if you have 5+ years of experience in delivery multi-tier, highly scalable, distributed web application Deep understanding in software architecture, object-oriented design principles, and data structures Extensive experience in developing microservices using Java, Python Good experience in Test driven development and automating test cases using Java/Python Experience in SQL/NoSQL (Oracle More ❯

processes, boost efficiency, and deliver innovative solutions. The team's expertise spans a wide range of technologies, including Java and Python-based MicroServices, AWS/GCP cloud backend systems, Big Data technologies like Hive and Spark, and modern Web applications. With a globally distributed presence across the US, India and Europe, the team thrives on collaboration, bringing together … you'll be doing Design, develop and deploy scalable web applications and services, being part of everything from contributing to web technology and framework stack, to use case and data model design Drive architecture discussions, take ownership and responsibility over new projects, and deliver high quality software with tight timeline Partner with security and compliance teams to ensure the … We're excited if you have 5+ years of experience in delivery multi-tier, highly scalable, distributed web application Deep understanding in software architecture, object-oriented design principles, and data structures Extensive experience in developing microservices using Java, Python Good experience in Test driven development and automating test cases using Java/Python Experience in SQL/NoSQL (Oracle More ❯

Lead Engineer - Cloud & Application Platforms Location: Manchester (Hybrid Working) Type: Permanent, Full-Time Salary: £90K DOE A global leader in customer data and insights is looking for a Lead Engineer to help shape the future of cloud-native platforms and applications used by some of the world's most recognisable retail and consumer brands. This is a senior, hands … environments and deliver results iteratively Excellent communication skills and a collaborative approach to problem-solving Bonus skills Experience in any of the following is a plus: Python, Scala, or data processing frameworks Event-driven or distributed system architectures Big data tools (e.g., Hadoop, HDFS, Airflow) Linux and containerisation Why join? This is an exciting opportunity to be More ❯

Lead Engineer - Cloud & Application Platforms Location: Manchester (Hybrid Working) Type: Permanent, Full-Time Salary: £90K DOE A global leader in customer data and insights is looking for a Lead Engineer to help shape the future of cloud-native platforms and applications used by some of the world's most recognisable retail and consumer brands. This is a senior, hands … environments and deliver results iteratively Excellent communication skills and a collaborative approach to problem-solving Bonus skills Experience in any of the following is a plus: Python, Scala, or data processing frameworks Event-driven or distributed system architectures Big data tools (e.g., Hadoop, HDFS, Airflow) Linux and containerisation Why join? This is an exciting opportunity to be More ❯

Join Nordcloud and be part of the European cloud revolution. We supercharge our customers to innovate in hyperscaler cloud, enabling seamless migration, advanced security, and data-driven success. Currently, we are looking for a Lead Site Reliability Architect for our team in the UK. Your daily responsibilities: Participating in various customer projects, from new infrastructure builds and migrations to … audits and big data Architect, implement, and improve existing monitoring and alerting systems Design and implement runbooks to allow support teams to attend to incidents Design, develop, implement, and improve new and existing solutions to automate tasks and reduce toil Lead, or form part of development teams responsible for the implementation of applications Advise and mentor development teams More ❯