14 of 14 Permanent Big Data Jobs in the North of England

Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead … Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are … seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge technologies, architecting big data solutions and developing More ❯

a passion to make an impact. Harnessing our innovative technologies and strong partnerships, we aim to make travel easy and rewarding for everyone. Get to Know Our Team The Data department, based in Bangkok, oversees all of Agoda's data-related requirements. Our ultimate goal is to enable and increase the use of data in the company … through creative approaches and the implementation of powerful resources such as operational and analytical databases, queue systems, BI tools, and data science technology. We hire the brightest minds from around the world to take on this challenge and equip them with the knowledge and tools that contribute to their personal growth and success while supporting our company's culture … of diversity and experimentation. The role the Data team plays at Agoda is critical as business users, product managers, engineers, and many others rely on us to empower their decision making. We are equally dedicated to our customers by improving their search experience with faster results and protecting them from any fraudulent activities. Data is interesting only when More ❯

Role Overview- SC Cleared or Eligible only Salary- 70k -80k per annum We are seeking an accomplished Lead Data Engineer (SFIA Level 5) to provide technical leadership, direction, and strategy across complex data engineering initiatives. This role involves leading teams to deliver resilient, scalable, and standards-driven data solutions, while engaging with senior stakeholders to translate … requirements into robust data products and services. The Lead Data Engineer will be responsible for setting engineering standards, embedding best practices, and ensuring delivery aligns with strategic principles. The role also carries line management responsibilities, helping to build capability within the engineering community. Key Responsibilities Provide technical leadership and set the direction for engineering teams and communities, ensuring … delivery adheres to data standards and strategic principles. Engage with senior stakeholders to define requirements for complex and sensitive data products, pipelines, and platforms. Oversee delivery and user testing of requirements across teams. Lead the redevelopment of existing data journeys, enhancing performance, resilience, and scalability, while adapting to evolving systems, tools, and platforms. Translate user requirements and More ❯

Role Overview- SC Cleared or Eligible only Salary- 70k -80k per annum We are seeking an accomplished Lead Data Engineer (SFIA Level 5) to provide technical leadership, direction, and strategy across complex data engineering initiatives. This role involves leading teams to deliver resilient, scalable, and standards-driven data solutions, while engaging with senior stakeholders to translate … requirements into robust data products and services. The Lead Data Engineer will be responsible for setting engineering standards, embedding best practices, and ensuring delivery aligns with strategic principles. The role also carries line management responsibilities, helping to build capability within the engineering community. Key Responsibilities Provide technical leadership and set the direction for engineering teams and communities, ensuring … delivery adheres to data standards and strategic principles. Engage with senior stakeholders to define requirements for complex and sensitive data products, pipelines, and platforms. Oversee delivery and user testing of requirements across teams. Lead the redevelopment of existing data journeys, enhancing performance, resilience, and scalability, while adapting to evolving systems, tools, and platforms. Translate user requirements and More ❯

achieve enduring results. Working with clients in consumer and manufacturing, defence and security, energy and utilities, financial services, government and public services, health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the … following technologies to ensure scalable, high-performance applications: AWS is a significant growth area for the business with a diverse and growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics … Essential requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data using More ❯

achieve enduring results. Working with clients in consumer and manufacturing, defence and security, energy and utilities, financial services, government and public services, health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the … following technologies to ensure scalable, high-performance applications: AWS is a significant growth area for the business with a diverse and growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics … Essential requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data using More ❯

Data Engineer £70,000 - £110,000 GBP Onsite WORKING Location: Manchester, North West - United Kingdom Type: Permanent Role: Lead or Senior Data Engineer Salary: £70,000 - £110,000 per annum (multiple grades - depending on experience) + Benefits Location: Open to UK-wide candidates (Remote/Hybrid options available) Overview We are looking for a Data Engineer with … a strong foundation in software engineering and experience working in consultancy environments. This role involves designing and developing large-scale data processing solutions within Agile teams, contributing to impactful digital transformation projects across sectors. You'll work across the full software lifecycle, from design and development to testing and deployment, while collaborating with colleagues and stakeholders to ensure high … quality, maintainable, and scalable data solutions. Key Responsibilities Design and develop data processing software for deployment in Big Data technologies Build and maintain ETL/ELT pipelines using modern data platforms Collaborate with team members to resolve implementation challenges and ensure code quality Work with operations teams to ensure solutions are production-ready Contribute to More ❯

Bolton As a data engineer specialising in generative AI ; this role will see you working in a developing international and transversal structure. You will have the responsibility to evaluate, build and maintain data sets for internal customers whilst ensuring they can be maintained. Salary : Circa £45,000 - £55,000 depending on experience Dynamic (hybrid) working : 2-3 days … and treatments Facilities : Fantastic site facilities including subsidised meals, free car parking and much more... The opportunity: The MBDA IM GenAI delivery Office department is looking for an experienced data engineer able to evaluate design, deploy, improve and support MBDA data sets. You will ensure MBDA data pipelines are designed to be resilient, secure and responsive. You … will use your data engineering expertise to collaborate with different internal customers regarding their data, ensuring they are optimised and secured for their needs. You will provide your knowledge in data management and data quality to guarantee compliance to MBDA data governance. A key part of this role is keeping up to date with new More ❯

s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. YOUR ROLE Hiring for a Data Engineer for FS domain with Machine learning and MLOps background and proficiency in Python. YOUR PROFILE Primary Skill: AWS Data Engineering, ML Engineering, ML-Ops, ECS, Sagemaker, Gitlab … CD, AI Lifecycle, Experience in front-end development (HTML, Stream-lit, Flask.) Familiarity with model deployment and monitoring in cloud environments (AWS). Understanding of machine learning lifecycle and data pipelines. Proficiency with Python, Pyspark, Big-data ecosystems Hands-on experience with MLOps tools (e.g., MLflow, Airflow, Docker, Kubernetes) Secondary Skill : Experience with RESTful APIs and integrating … business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2024 global revenues of €22.5 billion. Get the future you want | www.capgemini.com More ❯

s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. YOUR ROLE Hiring for a Data Engineer for FS domain with Machine learning and MLOps background and proficiency in Python. YOUR PROFILE Primary Skill: AWS Data Engineering, ML Engineering, ML-Ops, ECS, Sagemaker, Gitlab … CD, AI Lifecycle, Experience in front-end development (HTML, Stream-lit, Flask.) Familiarity with model deployment and monitoring in cloud environments (AWS). Understanding of machine learning lifecycle and data pipelines. Proficiency with Python, Pyspark, Big-data ecosystems Hands-on experience with MLOps tools (e.g., MLflow, Airflow, Docker, Kubernetes) Secondary Skill : Experience with RESTful APIs and integrating … business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2024 global revenues of €22.5 billion. Get the future you want | www.capgemini.com More ❯

s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. YOUR ROLE Hiring for a Data Engineer for FS domain with Machine learning and MLOps background and proficiency in Python. YOUR PROFILE Primary Skill: AWS Data Engineering, ML Engineering, ML-Ops, ECS, Sagemaker, Gitlab … CD, AI Lifecycle, Experience in front-end development (HTML, Stream-lit, Flask.) Familiarity with model deployment and monitoring in cloud environments (AWS). Understanding of machine learning lifecycle and data pipelines. Proficiency with Python, Pyspark, Big-data ecosystems Hands-on experience with MLOps tools (e.g., MLflow, Airflow, Docker, Kubernetes) Secondary Skill : Experience with RESTful APIs and integrating … business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2024 global revenues of €22.5 billion. Get the future you want | www.capgemini.com More ❯

as: High level solution languages such as Java, TypeScript, Python, and Go Web libraries and frameworks such as React and Angular Designing, building, and maintaining CI/CD pipelines Big data technologies, such as NiFi, Hadoop, Spark Cloud and containerization technologies such as AWS, OpenShift, Kubernetes, Docker DevOps methodologies, such as infrastructure as code and GitOps Database technologies More ❯

career. What You’ll Be Doing: ✦ Sourcing & building relationships with the highest calibre salespeople globally ✦ Working on vacancies with early-stage and Series A–C funding across Cyber. DevOps. Big Data. AI. Analytics ✦ Executing candidate processes from start-end. ✦ Embracing a strategic and consultative approach – NOT phone bashing. What’s in it for you: 🔹Average fee size 25k UK More ❯

The Incident Management Team are the front-line operational arm of the HMRC Cyber Security Team, responsible for protecting the confidentiality, integrity and availability of HMRC online services and data assets. The team and the successful individual undertake the following 3 core activities: Detect and Identify Prepare to Respond Response and Remediation The Detect and Identify function of the … of monitoring, analysis and triage activities. The successful candidate will use technical tools to check and maintain the health of the HMRC online services and user devices. Analysis of big data sets is undertaken to identify suspicious or malicious activities which is triaged before lower level investigation and response activities can take place. The Investigation & Response function of … and, if proven, the relevant application(s) will be withdrawn from the process. Recording of interviews is prohibited unless explicit agreement is sought in line with the UK General Data Protection Regulations. Questions relating to an individual application must be emailed as detailed later in this advert. Applicants who are successful at interview will be, as part of pre More ❯