1 to 25 of 68 Big Data Jobs in England

CONTRACT DATA ENGINEER - eDV CLEARED NEW CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY COMPANY FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Principal Data Engineer National Security client Daily rate up to £900 Central London based organisation in an easily accessible location To apply please call or email (see below) WHO WE … ARE? We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED Please either apply by More ❯

CONTRACT DATA ENGINEER - eDV CLEARED NEW CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY COMPANY FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Principal Data Engineer National Security client Daily rate up to £900 Central London based organisation in an easily accessible location To apply please call/or email WHO WE ARE … We are recruiting a contract Data Engineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATA ENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or Elasticsearch Experience With Palantir … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATA ENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply by More ❯

opportunity to join us as we continue to expand throughout the UK. Main duties of the job The role holder will be accountable for designing, building, and maintaining the data infrastructure and pipelines that enable efficient and accurate data collection, storage, processing, and analysis. The role holder will collaborate with cross-functional teams, including analysts, software engineers and … key stake holders to create and maintain data solutions that are crucial in delivering high quality care for our patients. About us We are always looking for great talent to join our team and help achieve our ambitious goals and growth. We care about our people, and we care about the future of community health and how CHEC can … play an innovative part in making this great, with your help. Job description Job responsibilities Design, implement, and optimise data storage systems, including databases, data warehouses, and data lakes, to efficiently handle large volumes of structured and unstructured data. Develop and maintain scalable ETL pipelines to extract, transform, and load data from various sources into the More ❯

Head of Data Engineering - Preston A Head of Data Engineering/Data Engineering Manager to lead the design, development, and enhancement of the data infrastructure and pipelines is required by a leading company based in Preston. The role offers Hybrid working, so 2 - 3 days in the office a week. You must have the following: Proven … experience as a lead data engineer/Data Engineering Manager with some management experience Experience handling large datasets, complex data pipelines, big data processing frameworks and technologies Experience with data modelling, Databricks, data integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing … concepts and dimensional modelling experience Any data engineering skills in Azure Databricks and Microsoft Fabric would be a bonus This new role involves building & managing a team of data engineers, fostering a culture of technical excellence and continuous improvement. Collaboration with cross-functional teams is essential to ensure robust, scalable, and aligned data solutions for delivering high More ❯

Lead Data Engineer - Preston A Lead Data Engineer to lead the design, development, and enhancement of the data infrastructure and pipelines is required by a leading company based in Preston. The role offers Hybrid working, so 2 - 3 days in the office a week. You must have the following: Proven experience as a Senior or Lead data engineer Experience handling large datasets, complex data pipelines, big data processing frameworks and technologies AWS or Azure cloud experience Experience with data modelling, data integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing concepts and dimensional modelling experience Any data engineering skills … in Azure Databricks and Microsoft Fabric would be a bonus This new role involves leading a data team, fostering a culture of technical excellence and continuous improvement. Collaboration with cross-functional teams is essential to ensure robust, scalable, and aligned data solutions for delivering high-quality care. The ideal candidate will lead the design and execution of cloud More ❯

Head of Data - Preston A Head of Data/Head of Business Intelligence to lead the design, development, and enhancement of the data infrastructure and pipelines is required by a leading company based in Preston. The role offers Hybrid working, so 2 - 3 days in the office a week. You must have the following: Proven experience as … Head of Data/Head of Business Intelligence with some management experience Experience handling large datasets, complex data pipelines, big data processing frameworks and technologies Experience with data modelling, Databricks, data integration ETL processes and designing efficient data structures Strong programming skills in Python, Java, or Scala Data warehousing concepts and dimensional … modelling experience Any data engineering skills in Azure Databricks and Microsoft Fabric would be a bonus This new role involves building & managing a team of data engineers, fostering a culture of technical excellence and continuous improvement. Collaboration with cross-functional teams is essential to ensure robust, scalable, and aligned data solutions for delivering high-quality care. The More ❯

Azure Data Engineer VIQU has partnered with a leading Telecommunications organisation seeking an experienced Azure Data Engineer to design, develop, and manage scalable data solutions on the Microsoft Azure platform. You’ll play a key role in architecting and implementing robust data integration solutions, as well as building ETL pipelines to support data ingestion, transformation … and loading. The Role:As an Azure data engineer, you’ll collaborate with cross-functional teams in an agile environment — contributing to sprint planning, daily stand-ups, and other agile ceremonies. Strong communication skills are essential, as you’ll often translate complex data concepts into clear insights for non-technical stakeholders. Key Responsibilities: Architect, design, and implement scalable … Azure-based data solutions. Develop and maintain ETL processes for data ingestion, transformation, and loading. Ensure data governance, integrity, and quality throughout the data lifecycle. Implement robust data security, compliance, and privacy standards. Document data architectures, data flows, and processes for knowledge sharing and audit readiness. Continuously enhance workflows using Agile best practices More ❯

Are you passionate about data and eager to kickstart your career in data engineering? We’re looking for a motivated Junior Data Engineer to join our Service Operations team. This role offers an exciting opportunity to learn, contribute to, and grow within the critical areas of data pipeline development, maintenance, and optimisation for our client-facing … products and services. Working closely with experienced developers, data analysts, data scientists, and other stakeholders, you will be instrumental in ensuring the efficient and reliable flow of data, building foundational skills in a supportive environment. Key Responsibilities Data Pipeline Development • Contribute to the design, building, and maintenance of scalable data pipelines • Implement ETL (Extract, Transform … Load) processes to ingest data from various sources • Ensure data quality, integrity, and reliability through thorough testing and validation Database Management • Help manage and optimise data storage solutions (e.g., SQL and NoSQL databases, data lakes) • Monitor and assist in maintaining database performance and security Data Integration: • Collaborate with data analysts and scientists to integrate More ❯

means more than financial returns its about helping people feel confident in their decisions and supported in their future. We dont just manage money, we guide people through lifes big moments, helping them stay on track and focus on what matters most. Were proud to be one of the UKs leading wealth managers, with over £109bn* in assets under … the UK and Channel Islands. Were a FTSE 250 company with national reach and a local feel and were growing. *As of June 2025 Job description: Role Title: Senior Data Analyst Division: Data and Analytics Location: Liverpool or Glasgow Contract: Permanent Working pattern: Hybrid About the Role In this role you will work closely with Business and Product … teams to develop strategic data platforms. You will possess a strong mix of technical & business skills working towards strategic goals, whilst starting to develop management and leadership experience. You will be responsible for the definition of organisational data assets, and manipulating and linking different data sets across business units. This is a newly created department which focussed More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise around strategic cost … maintain our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect end-to-end ingestion pipelines More ❯

Data Governance Analyst Full time position Location: Reading Hybrid - 2x days in office Salary: 47,000 - 71,000 (depending on experience) As a Data Governance Analyst , you will support the Data Governance Manager in implementing and maintaining the organization's data governance framework. Your role will involve ensuring data quality, consistency, and compliance across various … data domains. You will work closely with data owners, data stewards, and IT teams to enforce data governance policies and procedures, and support Master Data Management (MDM) initiatives. What you'll be doing as a Data Governance Analyst Assist in developing and articulating the organisation's data governance vision, strategy and roadmap. Support … the activation and enforcement of the data governance program vision. Collaborate with various stakeholders, including IT teams, business units, and data owners. Ensure that master data is accurately represented, consistently defined and easily accessible across the organisation. Provide training and guidance to employees on data governance principles, policies and procedures. Assist in establishing mechanisms for governance More ❯

Data Governance Analyst Full time position Location: Reading | Hybrid - 2x days in office Salary: £47,000 - £71,000 (depending on experience) As a Data Governance Analyst , you will support the Data Governance Manager in implementing and maintaining the organization's data governance framework. Your role will involve ensuring data quality, consistency, and compliance across various … data domains. You will work closely with data owners, data stewards, and IT teams to enforce data governance policies and procedures, and support Master Data Management (MDM) initiatives. What you'll be doing as a Data Governance Analyst Assist in developing and articulating the organisation's data governance vision, strategy and roadmap. Support … the activation and enforcement of the data governance program vision. Collaborate with various stakeholders, including IT teams, business units, and data owners. Ensure that master data is accurately represented, consistently defined and easily accessible across the organisation. Provide training and guidance to employees on data governance principles, policies and procedures. Assist in establishing mechanisms for governance More ❯

Expertise in Pentaho Data Integration for ETL processes. Strong understanding of data warehousing concepts, data modelling, and schema design. Experience with other ETL tools (Informatica, Talend, SSIS) is a plus. Advanced SQL for querying and data manipulation. Familiarity with Java, Python, or VBA for scripting and automation. Knowledge of RESTful APIs and various database systems. Skills … in data profiling, data analysis, and ensuring data quality. Experience 612 years in Data Integration and ETL development. Minimum 35 years of hands-on Pentaho experience. Leading complex ETL projects and working with cross-functional teams. Exposure to Banking/Financial Services domain is a plus. Preferred Qualifications Certifications in Pentaho, Big Data, or … Cloud Platforms (AWS/GCP/Azure). Experience with Big Data technologies (Hadoop, Spark) and cloud data services. More ❯

Data Engineer Location: Bolton (Hybrid – 2–3 days on-site per week) Salary: Up to £55,000 (depending on experience) Are you a skilled Data Engineer with a passion for Generative AI and emerging data technologies? This is your opportunity to play a key role in a growing international and cross-functional environment, supporting the design, development … and optimisation of data pipelines that power next-generation AI systems across a world-class defence organisation. The Role As a Data Engineer (Generative AI) , you’ll be responsible for evaluating, building, and maintaining high-quality data sets for internal customers—ensuring performance, reliability, and maintainability at every stage. You’ll work within MBDA’s IM GenAI … Delivery Office , contributing to the design and deployment of resilient, secure, and responsive data pipelines supporting AI and NLP initiatives. You’ll collaborate closely with internal stakeholders, leveraging your expertise in structured and unstructured data to ensure compliance with MBDA’s data governance standards, while actively shaping the organisation’s technology roadmap and advancing its use of More ❯

Design and automate the deployment of Cloudera CDP components (Data Lake, Data Hubs, Data Services) using Terraform . Build and maintain CI/CD pipelines using GitHub Actions for infrastructure and data pipeline automation Collaborate with data engineering teams to integrate CDP with existing Big Data workflows. Write and maintain automation scripts using … nodes in the cluster. Employ security using an authentication and authorization system such as Kerberos. Knowledge of changes required for migrating to Cloudera cloud version CDP Knowledge of Cloudera data services (CDW, CDE, CDF, CAI) Design Native Cloud Application Architectures and optimize applications for AWS Network connectivity, Direct Connect, VPN, VPC, Security group, NACL, Route 53 Must have in … Design, VPC, Subnet, segmentation strategies. Environment and application automation CloudFormation and third-party automation approach/strategy AWS Cost Management and Optimization Job requirements Extensive experience with Cloudera cloud data platform (CDP) and CDP Services and Big data knowledge. Proficiency in Terraform for infrastructure as code (IaC). Strong hands-on experience with Cloudera CDP and Hadoop More ❯

Senior Data Engineer The Senior Data Engineer will play a crucial role in designing, implementing, and maintaining scalable data pipelines and infrastructure. This position is ideal for those with strong technical expertise and a passion for working in the Insurance/Financial services industry. Client Details Senior Data Engineer The employer is a medium-sized organisation … operating in the F sector. They focus on delivering innovative solutions and maintaining a strong reputation for excellence in analytics and data-driven decision-making. Description Senior Data Engineer Develop and maintain robust and scalable data pipelines and ETL processes. Optimise data workflows and ensure efficient data storage solutions. Collaborate with analytics and engineering teams … to meet business objectives. Ensure data integrity and implement best practices for data governance. Design and implement data models to support analytical and reporting needs. Monitor and troubleshoot data systems to ensure reliability and performance. Evaluate and implement new tools and technologies to improve data infrastructure. Provide technical guidance and mentorship to junior team members. More ❯

Senior Data Engineer The Senior Data Engineer will play a crucial role in designing, implementing, and maintaining scalable data pipelines and infrastructure. This position is ideal for those with strong technical expertise and a passion for working in the Insurance/Financial services industry. Client Details Senior Data Engineer The employer is a medium-sized organisation … operating in the F sector. They focus on delivering innovative solutions and maintaining a strong reputation for excellence in analytics and data-driven decision-making. Description Senior Data Engineer Develop and maintain robust and scalable data pipelines and ETL processes. Optimise data workflows and ensure efficient data storage solutions. Collaborate with analytics and engineering teams … to meet business objectives. Ensure data integrity and implement best practices for data governance. Design and implement data models to support analytical and reporting needs. Monitor and troubleshoot data systems to ensure reliability and performance. Evaluate and implement new tools and technologies to improve data infrastructure. Provide technical guidance and mentorship to junior team members. More ❯

Legal Data Analytics Manager Location: London Permanent role. Primary skills Data statistics & Analysis; Client Dashboards;To extract Data, consolidate and analyse it; Create automation solutions including AI solutions; Quantitative analytics (e.g. offer calculations for claims); Analysis for Decision making; Modelling of quantum exposure; Record Data breach analytics The Data Analytics Manager will focus on building … internal client relationships and on the delivery of day-to-day matter work in the data analytics team. Management of people ensuring the appropriate resourcing of matters, training, reporting and you will work closely with the Senior Manager, Data Analytics. The Data Analytics Manager will be responsible for providing expertise, advising on any issues within the team … of the team. The role will ensure the overall provision of high quality services and will play a key part through effective consultancy in building the reputation of the Data Analytics Team, both internally and externally to clients. Responsibilities: With the Head of Data Analytics you’ll be part of the design, development and ongoing evolution of dashboards. More ❯

The Role The Data Practice is the team made up of experts dedicated to Data centric offers (Data platform, Data Analytics, IoT, Big Data, Data compliance) who support our customers in their IT and Data transformations. We help customers choose the right tools and services, build highly scalable secure environments, and help More ❯

The Role The Data Practice is the team made up of experts dedicated to Data centric offers (Data platform, Data Analytics, IoT, Big Data, Data compliance) who support our customers in their IT and Data transformations. We help customers choose the right tools and services, build highly scalable secure environments, and help More ❯

Pay: £50,000.00 - £60,000.00 per year Job description: Data & Technology Lead - London - £50k-£60k DOE + Profit Share THE AGENCY My client is an employee-owned media agency with deep expertise in property and travel sectors, along with a variety of other sectors, renowned for data-driven decision-making that delivers measurable client outcomes. Their collaborative culture … fosters trust and meaningful relationships, offering a modern Farringdon office with hybrid flexibility. THE ROLE: Data & Technology Lead As the Data & Technology Lead, you'll spearhead the design, build, and optimisation of our data infrastructure, automation solutions, and AI-driven tools. Leading all aspects of Data & Technology including architecture, MarTech implementation, and AI automation, you'll … ensure seamless data flow across the business to drive client performance. This pivotal Data & Technology role demands a unique blend of technical expertise, leadership, and client-facing skills. You'll manage and develop team members, oversee data engineering projects, and own the agency's core data pipelines and platforms. Key Responsibilities Data Engineering & Architecture : Lead More ❯

Senior Data Engineer - Azure Databricks/SC Clearance - Contract Active SC Clearance is required for this position Hybrid working - 3 days/week on site required Up to £620/day - Inside IR35 We are currently recruiting for a well experienced Senior Data Engineer, required for a leading global transformation consultancy, based in London. The Senior Data Engineer will be responsible for providing hands-on, technical expertise within an agile team. The ideal candidate will be well experienced in building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure … and experience working with large datasets Key skills and responsibilities: Design, build, and maintain scalable ETL pipelines for ingesting, transforming, and loading data from APIs, databases, and financial data sources into Azure Databricks. Optimize pipelines for performance, reliability, and cost, incorporating data quality checks. Develop complex transformations and processing logic using Spark (PySpark/Scala) for cleaning More ❯

document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “Application Support Request”. Role: AI/ML and Data Science Developer Job Type: Permanent Location: Stevenage (Hybrid) Number of hours: 40 hours per week – full time Are you looking for an exciting opportunity as an AI/ML … Are you passionate about Data Science? We have an exciting role for you - AI/ML and Data Science Developer Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and … Gain access to endless learning opportunities. Work closely with the range of teams within the business to bring products to life. The Role As a AI/ML and Data Science Developer , you are required to Design, develop, and deploy AI/ML models and solutions, including LLMs and GenAI. You will also be responsible for the end-to More ❯

Join a fast-growing technology and engineering organisation that is on a mission to become the best engineering consultancy in the UK. We are looking for a Data Engineer who is passionate about technology, eager to develop their coding skills, and ready to make a significant impact in a collaborative and innovative environment. Due to the security cleared nature … we can not accept applicants who don't possess indefinite leave to remain or are a UK resident. If you require sponsorship, then your application will not be considered. Data Engineer Annual Salary: £40,000 - £55,000 Location: UK (Flexible Hybrid Working) Job Type: Permanent Day-to-day of the role: Work on diverse client projects including building modern … data platforms and services using DevOps practices. Engage in large, distributed workloads, batch and streaming data pipelines, and high-quality monitoring. Collaborate with architects, technology consultants, and client stakeholders to help customers leverage their data effectively. Gain exposure to different industries and networks while working with the latest technologies. Spend time on internal projects, training, and development More ❯

Data Scientist, based Waltham Abbey (Hybrid role). Salary £30-50 k p.a. + many benefits. An exciting time to join an award-winning business in a phase of growth, in a newly created role to analyse data and create models to support Jollyes commercial and marketing teams. We’re developing Data Science solutions to help drive … support office in Waltham Abbey (Essex) and up to 2 x days per week from home (or other Jollyes location as preferred). 37.5 hours per week. The Role – Data Scientist This role sits within our Information Technology team, lead by our Senior Data Scientist. Success measures will include: Project delivery and impact, Data quality and management … commercial and marketing analysis using SQL and Python Automate tasks and reporting to improve efficiency and support decision-making Develop dashboards (Tableau) and email reports for business insights Use data storytelling to influence stakeholders and drive profitability Build predictive models to anticipate customer behaviour Translate data insights into actionable business outcomes Design and run A/B tests More ❯