76 to 100 of 159 Big Data Jobs in the UK excluding London

Data Engineering Manager Who are Diligenta? Diligenta's vision is to be acknowledged as Best-in-class Platform-based Life and Pensions Administration Service provider. Customer service is at the heart of everything we do, and our aim is to transform our clients' operations. A business that has been described as ‘home’ by existing employees, we drive a culture … that is founded on positive change and development. Summary of the role: As a Data Engineering Manager, you will be responsible for the engineering teams in the Data delivery and Data management scopes. These are key positions within the Data office as they provide technical leadership, mentorship and team development, as well as contributing to the … development and implementation of our Data strategy.You will be responsible for organising the team in an efficient and effective manner and prioritising the work to align with organisational priorities. This includes providing technical leadership during development phases, Agile based delivery and engineering best practices. As in any engineering management position, there will be a certain amount of hands-on More ❯

Data Engineering Manager Who are Diligenta? Diligenta's vision is to be acknowledged as Best-in-class Platform-based Life and Pensions Administration Service provider. Customer service is at the heart of everything we do, and our aim is to transform our clients' operations. A business that has been described as ‘home’ by existing employees, we drive a culture … that is founded on positive change and development. Summary of the role: As a Data Engineering Manager, you will be responsible for the engineering teams in the Data delivery and Data management scopes. These are key positions within the Data office as they provide technical leadership, mentorship and team development, as well as contributing to the … development and implementation of our Data strategy.You will be responsible for organising the team in an efficient and effective manner and prioritising the work to align with organisational priorities. This includes providing technical leadership during development phases, Agile based delivery and engineering best practices. As in any engineering management position, there will be a certain amount of hands-on More ❯

Hive & SQL - Must Have Note: At least Candidate should know Scala coding language. Pyspark profile will not help here. Interview includes coding test. Job Description: Scala/Spark • Good Big Data resource with the below Skillset: § Spark § Scala § Hive/HDFS/HQL • Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.) • Experience in Big data technologies, real time data processing platform (Spark Streaming) experience would be an advantage. • Consistently demonstrates clear and concise written and verbal communication • A history of delivering against agreed objectives • Ability to multi-task and work under pressure • Demonstrated problem solving and decision-making skills • Excellent analytical and process-based skills, i.e. process flow diagrams, business modelling More ❯

Hive & SQL - Must Have Note: At least Candidate should know Scala coding language. Pyspark profile will not help here. Interview includes coding test. Job Description: Scala/Spark • Good Big Data resource with the below Skillset: § Spark § Scala § Hive/HDFS/HQL • Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.) • Experience in Big data technologies, real time data processing platform (Spark Streaming) experience would be an advantage. • Consistently demonstrates clear and concise written and verbal communication • A history of delivering against agreed objectives • Ability to multi-task and work under pressure • Demonstrated problem solving and decision-making skills • Excellent analytical and process-based skills, i.e. process flow diagrams, business modelling More ❯

Hive & SQL - Must Have Note: At least Candidate should know Scala coding language. Pyspark profile will not help here. Interview includes coding test. Job Description: Scala/Spark • Good Big Data resource with the below Skillset: § Spark § Scala § Hive/HDFS/HQL • Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.) • Experience in Big data technologies, real time data processing platform (Spark Streaming) experience would be an advantage. • Consistently demonstrates clear and concise written and verbal communication • A history of delivering against agreed objectives • Ability to multi-task and work under pressure • Demonstrated problem solving and decision-making skills • Excellent analytical and process-based skills, i.e. process flow diagrams, business modelling More ❯

and these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience with … Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates with experience … with Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

and these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience with … Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates with experience … with Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

and these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience with … Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates with experience … with Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

Senior Data Scientist – High-Growth Fintech SaaS | Strategic AI & ML Role We’re supporting a fast-scaling fintech SaaS company backed by tier-one investors to find a Senior Data Scientist to take a lead role in shaping their data science capability. This is a high-impact position where you’ll combine deep technical expertise with strategic … product influence, embedding AI and ML at the heart of next-generation financial data products. The Opportunity As Senior Data Scientist, you’ll be both a leading individual contributor and a mentor. You’ll drive excellence across the data science stack, champion technical best practice, and influence product direction with a deep understanding of financial data … and engineering culture , giving you the freedom to deliver solutions that scale globally. What You’ll Be Doing Acting as a technical leader and mentor, raising the bar for data science capability Using domain knowledge of financial data to shape product strategy and solve complex client problems Driving AI/ML innovation — prototyping and embedding intelligent solutions into More ❯

Senior Data Scientist – High-Growth Fintech SaaS | Strategic AI & ML Role We’re supporting a fast-scaling fintech SaaS company backed by tier-one investors to find a Senior Data Scientist to take a lead role in shaping their data science capability. This is a high-impact position where you’ll combine deep technical expertise with strategic … product influence, embedding AI and ML at the heart of next-generation financial data products. The Opportunity As Senior Data Scientist, you’ll be both a leading individual contributor and a mentor. You’ll drive excellence across the data science stack, champion technical best practice, and influence product direction with a deep understanding of financial data … and engineering culture , giving you the freedom to deliver solutions that scale globally. What You’ll Be Doing Acting as a technical leader and mentor, raising the bar for data science capability Using domain knowledge of financial data to shape product strategy and solve complex client problems Driving AI/ML innovation — prototyping and embedding intelligent solutions into More ❯

Senior Data Scientist – High-Growth Fintech SaaS | Strategic AI & ML Role We’re supporting a fast-scaling fintech SaaS company backed by tier-one investors to find a Senior Data Scientist to take a lead role in shaping their data science capability. This is a high-impact position where you’ll combine deep technical expertise with strategic … product influence, embedding AI and ML at the heart of next-generation financial data products. The Opportunity As Senior Data Scientist, you’ll be both a leading individual contributor and a mentor. You’ll drive excellence across the data science stack, champion technical best practice, and influence product direction with a deep understanding of financial data … and engineering culture , giving you the freedom to deliver solutions that scale globally. What You’ll Be Doing Acting as a technical leader and mentor, raising the bar for data science capability Using domain knowledge of financial data to shape product strategy and solve complex client problems Driving AI/ML innovation — prototyping and embedding intelligent solutions into More ❯

Our client, a nationwide Transportation company is looking for a Data Analyst to join their growing team! Do you thrive in a dynamic environment where your analytical skills can make a real difference? If so, we have the perfect opportunity for you! This company is looking for someone passionate about turning data into actionable insights. Role: Performance Data Analyst Contract Type: Interim Day rate: up to £400/day depending on experience Location: London OR Crawley (hybrid - 3 days per week in office) As a Data Analyst, you will provide meaningful insights, analysis, and reporting for stakeholders, driving performance improvement through enhanced reporting and key trend analysis. You'll support data projects and help develop … systems that leave a legacy of better data insights. Key Accountabilities: Conduct deep analysis of existing data sets to uncover areas for improvement. Perform statistical analysis on big data to identify trends. Create tools and platforms for data automation. Conduct diagnostic analysis to pinpoint routine performance losses. Enhance the internal reporting suite to improve data More ❯

Scientist (Computer Science & Artificial Intelligence) Employment Type: Full-time/Part-time Key Responsibilities Conduct cutting-edge research and drive applications in areas such as Artificial Intelligence, Machine Learning, Big Data Analytics, Computer Vision, Natural Language Processing, and Intelligent Systems Architecture; Lead the application and execution of national or provincial research projects, and promote the commercialization of technological … core technology patents, and present work at leading international conferences/journals. Qualifications Education & Background: Ph.D. degree from a renowned overseas university in Computer Science, Artificial Intelligence, Software Engineering, Big Data, or related fields; Overseas postdoctoral experience or R&D work in research institutions/multinational companies is preferred; Strong publication record in top-tier conferences/journals … e.g., NeurIPS, CVPR, ICML, AAAI, TPAMI, Nature, Science). Technical Expertise: Proficiency in at least one major programming language (Python, Java, C++, Go, etc.) with a solid foundation in data structures and algorithms; In-depth understanding of core algorithms and engineering implementation in AI, Machine Learning, or Computer Vision; Familiarity with large-scale computing platforms, distributed systems, cloud architectures More ❯

Scientist (Computer Science & Artificial Intelligence) Employment Type: Full-time/Part-time Key Responsibilities Conduct cutting-edge research and drive applications in areas such as Artificial Intelligence, Machine Learning, Big Data Analytics, Computer Vision, Natural Language Processing, and Intelligent Systems Architecture; Lead the application and execution of national or provincial research projects, and promote the commercialization of technological … core technology patents, and present work at leading international conferences/journals. Qualifications Education & Background: Ph.D. degree from a renowned overseas university in Computer Science, Artificial Intelligence, Software Engineering, Big Data, or related fields; Overseas postdoctoral experience or R&D work in research institutions/multinational companies is preferred; Strong publication record in top-tier conferences/journals … e.g., NeurIPS, CVPR, ICML, AAAI, TPAMI, Nature, Science). Technical Expertise: Proficiency in at least one major programming language (Python, Java, C++, Go, etc.) with a solid foundation in data structures and algorithms; In-depth understanding of core algorithms and engineering implementation in AI, Machine Learning, or Computer Vision; Familiarity with large-scale computing platforms, distributed systems, cloud architectures More ❯

Scientist (Computer Science & Artificial Intelligence) Employment Type: Full-time/Part-time Key Responsibilities Conduct cutting-edge research and drive applications in areas such as Artificial Intelligence, Machine Learning, Big Data Analytics, Computer Vision, Natural Language Processing, and Intelligent Systems Architecture; Lead the application and execution of national or provincial research projects, and promote the commercialization of technological … core technology patents, and present work at leading international conferences/journals. Qualifications Education & Background: Ph.D. degree from a renowned overseas university in Computer Science, Artificial Intelligence, Software Engineering, Big Data, or related fields; Overseas postdoctoral experience or R&D work in research institutions/multinational companies is preferred; Strong publication record in top-tier conferences/journals … e.g., NeurIPS, CVPR, ICML, AAAI, TPAMI, Nature, Science). Technical Expertise: Proficiency in at least one major programming language (Python, Java, C++, Go, etc.) with a solid foundation in data structures and algorithms; In-depth understanding of core algorithms and engineering implementation in AI, Machine Learning, or Computer Vision; Familiarity with large-scale computing platforms, distributed systems, cloud architectures More ❯

We are looking for a Data Scientist to deliver data-driven insights and predictive models to enhance decision-making. Responsibilities Build predictive and prescriptive models Analyze large datasets for insights Implement machine learning algorithms Use Python/R for statistical modeling Work with SQL and NoSQL databases Collaborate with AI and data teams Visualize data with … dashboards and reports Conduct A/B testing and experiments Contribute to data governance policies Support big data solutions on cloud Research new statistical techniques Document models and findings Provide insights to business stakeholders Mentor junior analysts Automate data pipelines More ❯

so will the role. As such you will require a proactive approach and a high level of multi-tasking and resilience. The role would require someone confident working with Big Data and analysing trends and making recommendations. Who has experience in using the forecasting modules within SAP in order to maximise the system. A confident individual with great … communication skills would also be ideally suited to this opportunity. Occasional weekend work will be required for this role. Your New Role Subject matter expertise Data analysis, data maintenance, data representation Ability to create business reports Ability to identify gaps in the new processes and define new ones as required Create PowerPoint presentations to illustrate processes Business … Readiness Data cleansing and readiness of existing systems Process definition and testing Creating training materials Planning and delivery of training to business users Project management Ensures deadlines are complied with in area of responsibility Provides updates to Deployment Lead Reporting of risks, issues and business readiness status Identification of cross domain risks Identifies and communicates project information necessary for More ❯

Data Engineer – Generative AI | Defence Technology A leading international defence organisation is seeking an experienced Data Engineer with a focus on Generative AI to join their IM GenAI Delivery Office in the UK. You will play a pivotal role in designing, managing, and optimising datasets that support advanced defence systems and critical internal projects. What you’ll do … Develop and maintain robust, secure, and high-integrity datasets for internal defence applications. Design and optimise data pipelines to ensure reliable, compliant, and scalable solutions. Apply your expertise in Generative AI, NLP, and OCR to enhance and automate data processes. Build ETL workflows, APIs, and other data integration solutions tailored for mission-critical environments . Provide guidance … on emerging technologies and support the roadmap for next-generation defence data solutions . Skills and experience: Strong knowledge of SQL (MS SQL, Oracle) and noSQL databases (e.g., MongoDB, Neo4J, InfluxDB). Hands-on experience with data processing and integration tools , including ETL, ESB, and APIs. Proficiency in Python or similar programming languages. Exposure to big data More ❯

Data Engineer – Generative AI | Defence Technology A leading international defence organisation is seeking an experienced Data Engineer with a focus on Generative AI to join their IM GenAI Delivery Office in the UK. You will play a pivotal role in designing, managing, and optimising datasets that support advanced defence systems and critical internal projects. What you’ll do … Develop and maintain robust, secure, and high-integrity datasets for internal defence applications. Design and optimise data pipelines to ensure reliable, compliant, and scalable solutions. Apply your expertise in Generative AI, NLP, and OCR to enhance and automate data processes. Build ETL workflows, APIs, and other data integration solutions tailored for mission-critical environments . Provide guidance … on emerging technologies and support the roadmap for next-generation defence data solutions . Skills and experience: Strong knowledge of SQL (MS SQL, Oracle) and noSQL databases (e.g., MongoDB, Neo4J, InfluxDB). Hands-on experience with data processing and integration tools , including ETL, ESB, and APIs. Proficiency in Python or similar programming languages. Exposure to big data More ❯

Data Engineer – Generative AI | Defence Technology A leading international defence organisation is seeking an experienced Data Engineer with a focus on Generative AI to join their IM GenAI Delivery Office in the UK. You will play a pivotal role in designing, managing, and optimising datasets that support advanced defence systems and critical internal projects. What you’ll do … Develop and maintain robust, secure, and high-integrity datasets for internal defence applications. Design and optimise data pipelines to ensure reliable, compliant, and scalable solutions. Apply your expertise in Generative AI, NLP, and OCR to enhance and automate data processes. Build ETL workflows, APIs, and other data integration solutions tailored for mission-critical environments . Provide guidance … on emerging technologies and support the roadmap for next-generation defence data solutions . Skills and experience: Strong knowledge of SQL (MS SQL, Oracle) and noSQL databases (e.g., MongoDB, Neo4J, InfluxDB). Hands-on experience with data processing and integration tools , including ETL, ESB, and APIs. Proficiency in Python or similar programming languages. Exposure to big data More ❯

innovative business partnerships, our mission is to deliver seamless, efficient, and customer-first experiences at scale. Our Planning & Analytics team sits at the heart of this transformation. We harness data to unlock efficiencies, drive cost savings, and enable smarter decision-making across the supply chain. And now, we’re growing — fast. We are looking for problem-solvers, data … and strategic thinkers who want to shape the next era of logistics. What you’ll be doing As a Senior Analyst, you’ll play a pivotal role in using data to power decisions and outcomes across our logistics network: Driving efficiency and optimisation in supply chain and logistics through advanced analytics. Identifying trends, patterns, and opportunities for improvement using … data-driven insights. Working closely with data engineers to build and evolve a common data model for our business domain within the wider analytics landscape. Developing and implementing strategies across inventory, procurement, and distribution. Designing intuitive dashboards and reports to translate data into actionable insight for stakeholders. Partnering with cross-functional teams to turn analysis into More ❯

Data Engineer (Defence) £45,000 - 55,000 GBP Onsite WORKING Location: Stevenage, Cambridge, East of England - United Kingdom Type: Permanent Data Engineer - Generative AI | Defence Technology A leading international defence organisation is seeking an experienced Data Engineer with a focus on Generative AI to join their IM GenAI Delivery Office in the UK. You will play a … that support advanced defence systems and critical internal projects. What you'll do: Develop and maintain robust, secure, and high-integrity datasets for internal defence applications. Design and optimise data pipelines to ensure reliable, compliant, and scalable solutions. Apply your expertise in Generative AI, NLP, and OCR to enhance and automate data processes. Build ETL workflows, APIs, and … other data integration solutions tailored for mission-critical environments . Provide guidance on emerging technologies and support the roadmap for next-generation defence data solutions . Skills and experience: Strong knowledge of SQL (MS SQL, Oracle) and noSQL databases (e.g., MongoDB, Neo4J, InfluxDB). Hands-on experience with data processing and integration tools , including ETL, ESB, and More ❯

Senior Data Engineer (Databricks SQL Azure) Nottingham/WFH to £65k Opportunity to progress your career in a senior, hands-on Data Engineer role at a SaaS tech company. As a Senior Data Engineer you'll join a newly formed team that deals with customer facing reporting on big data sets, they process 120 billion … lines of data per day. You'll be primarily working with advanced SQL with Databricks in Azure including data modelling and low level data design work. As a senior member of the team you'll also contribute to technical discussions, strategic decision making and help to mentor more mid-level data engineers. Location/WFH: There … development environments You're collaborative with great communication skills Ideally you will some experience within an accountancy or finance environment What's in it for you: As a Senior Data Engineer (Databricks SQL) you will earn a competitive salary plus a range of benefits: Salary to £80k 25 days holiday Vitality health insurance 5% non-contributory pension Death in More ❯

Job Title: Data Scientist We're looking for a sharp, strategic Data Scientist to lead the development of scientific standards for evaluating competitor data-especially market share insights. You'll design methods to improve reliability, support senior leaders with actionable intelligence, and mentor colleagues across projects and domains. What you'll do:* Build models to assess and … replace costly market share data sources* Advise teams and elevate data capabilities across the business* Drive competitor insight strategies for high-impact decision-makingKey skills: Python, SQL, Data Modeling, Machine Learning, Market Research, Big Data, Operations Research Hybrid: London 2 days Day Rate: Outside Please send me your CV to More ❯

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. We build and operate ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary technology solutions drive performance and reduce costs while helping our clients to … improve the management and sharing of data across their organisations. In 2024, Aker Systems won the Breakthrough Culture Awards highlighting growth companies putting culture first. In 2020 Aker Systems was recognised as a One to Watch on the Sunday Times Tech Track. The Company was also recognised at the Thames Valley Tech Awards 2020; winning the Thames Valley Tech … identities to apply. We are committed to maintaining an inclusive, and supportive place for you to do your very best work. Aker Systems designs, builds & operates advanced, ultra-secure data infrastructure, delivering data modernisation at enterprise scale to enable AI-driven transformation and seamless sharing of trusted data at scale, predominantly for highly regulated and Central Government More ❯