97 Big Data Jobs in the UK excluding London

Job summary Artificial Intelligence, Machine Learning and other technologies are enhancing big data analytics like never before, generating real insights and opportunities for improvement. In the NHS the data asset available to facilitate this analysis is substantial. Whilst we are just beginning to explore the possibilities of … Specification Qualifications Essential Educated to degree level or equivalent in a numerate subject. Experience Essential Experience working with complex information systems and in a data or information environment. Experience of interpreting and analysing complex information and presenting it in a clear and concise manner. Experience of liaising with staff … equivalent database query language or programming language, along with understanding how they interconnect with other information systems. A detailed knowledge of NHS datasets and data definitions. Desirable An accredited course in informatics or performance management. Knowledge and experience of utilising Business Intelligence visualisations tools such as Power BI or more »

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis more »

digital and platforms. Role purpose/summary Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform. Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and analysis of … large-scale data. Design scalable and resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform. Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and cost-effectiveness. Provide guidance … of the solution design. Key Skills/requirements Proven experience as a Solution Architect, designing and implementing cloud-based solutions. Strong knowledge of popular data platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, Data Lake Analytics), or more »

Job summary The Senior Data Engineer will have direct oversight and responsibility for the development, implementation, review, and establishment of data and techniques used in the Advanced Data Analytics Portfolio (DAP). As a Senior Data Engineer, you will work with project managers, data scientists … senior management across the full extent of the NHSCFA and our wider stakeholders in pursuit of the above. Your primary responsibilities will include developing data pipelines, processing data, and preparing data suitable for analysis. Additionally, you will evaluate, maintain, and manage data pipelines, develop and maintain … data models, and support the design of analytical services, products, and models that meet the needs of NHSCFA. You will also guide, develop, document, and maintain data pipelines and storage solutions used in the analytics environment, ensuring that the infrastructure and methods are secure, optimised, and scalable within more »

Job summary The Senior Data Engineer will have direct oversight and responsibility for the development, implementation, review, and establishment of data and techniques used in the Advanced Data Analytics Portfolio (DAP). As a Senior Data Engineer, you will work with project managers, data scientists … senior management across the full extent of the NHSCFA and our wider stakeholders in pursuit of the above. Your primary responsibilities will include developing data pipelines, processing data, and preparing data suitable for analysis. Additionally, you will evaluate, maintain, and manage data pipelines, develop and maintain … data models, and support the design of analytical services, products, and models that meet the needs of NHSCFA. You will also guide, develop, document, and maintain data pipelines and storage solutions used in the analytics environment, ensuring that the infrastructure and methods are secure, optimised, and scalable within more »

Responsibilities: Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform. Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and analysis of large-scale data. Design scalable and … resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform. Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and cost-effectiveness. Provide guidance and technical leadership to development teams … accurate implementation of the solution design. Required Skills: Proven experience as a Solution Architect, designing and implementing cloud-based solutions. Strong knowledge of popular data platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, Data Lake Analytics), or more »

We work with Seed-Stage Start-ups all the way through to billion dollar Tech Unicorns in AdTech, MarTech, Fintech, Cybersecurity, IT Services, BI & Big Data, SaaS, and PaaS. With the 2 founders having a combined 40 years experience in the tech space there are no better people … to learn from to Excel your careers at a fast rate. Working with some big clients such as Monzo, ASOS, Sky and Crypto blockchain to name a few. Over the next 3 years they are scaling up from 100 to 300+ people presenting more opportunities for progression than ever. more »

Senior Data Scientist - Hybrid/Bristol Job Title : Senior Data Scientist Location : Hybrid/Bristol (Max 2. Days per week) Remuneration : £70,000 - £90,000 per annum Contract Details : Full-time, Permanent Responsibilities : Design, develop, refine, and execute our client's stochastic cyber risk model, ensuring its accuracy … performance, and scalability. Perform complex data analysis to extract insights and identify trends in cyber risk using statistical and machine learning techniques. Translate model insights into actionable strategies and tools for internal and external stakeholders. Collaborate with underwriters, engineers, and cyber risk analysts to integrate the cyber risk model … with other systems and processes. Stay updated with the latest developments in data science, cyber security, and risk modelling, incorporating innovative techniques and technologies into our client's models. Our client, a pioneering company in the risk industry based in Bristol, UK, is seeking a highly skilled and experienced more »

centric applications and embedding models. Familiarity with ML Ops and DevOps practices. An awareness of programming languages such as Python and C#. Experience with Big Data technologies, ETL processes, and distributed computing frameworks like Kubernetes. Responsibilities: Shape the strategic direction of AI implementation across 30+ initiatives. Drive AI … adoption on internal services. Develop technical integration strategy for the product suite. Develop a 'big data' solution across products. Define internal and external technical API strategy. Work with the AI team to enhance existing product set with contemporary technologies. Design, develop, and implement AI solutions. Integrate AI solutions … with client data, APIs, and production systems. Conduct data analysis and design machine learning models. Utilise modern ML and AI libraries and frameworks. Deliver reliable solutions collaboratively. more »

Hive SQL Queries/Spark SQL Statements. * Experience in working with large databases - multi terabytes (3+ Terabytes). * Minimum of 5 years' experience in Big Data Space (Hive, Impala, Spark Sql, HDFS etc). * Any cloud experience (AWS/Azure/Google/Oracle). * Solid experience with more »

languages such as Java, Python, and node.js to streamline deployment processes. Manage and optimize relational databases (e.g., PostgreSQL), NoSQL databases (e.g., MongoDB), and implement data streaming solutions (e.g., Kafka) for efficient data handling. Work with big data technologies such as Hadoop to manage and analyse large … Proficiency in programming languages such as Java, Python, and node.js. Familiarity with SQL and database management systems, including relational and NoSQL databases. Knowledge of data streaming technologies (e.g., Kafka) and big data platforms (e.g., Hadoop). Understanding of cybersecurity principles and best practices. Familiarity with architectural styles more »

Kubernetes, OpenShift, MicroK8s; Infrastructure as Code (IaC), automation & configuration management; Ansible (plus Puppet, Saltstack), Terraform, CloudFormation; NodeJS, REACT/MaterialUI (plus Angular), Python, JavaScript; Big data processing and analysis, e.g. Apache Hadoop (CDH), Apache Spark; RedHat Enterprise Linux, CentOS, Debian or Ubuntu. Java 8, Spring framework (preferably Spring more »

Senior Software Engineer Bristol (2 days per week) £70,000 - £90,000 + Bonus, shares, 30 days holiday + BH. Great parental leave and big tech investment. An awesome opportunity to join a great company! They aren't the new kids on the block but I have a feeling … we their name is going to be pretty big throughout Bristol in 2024! The business have announced a multi-billion (yep with a B) investment over the next 3 years into their data, people and security. Specifically, £50million is going into this area to start a massive transformation … Hibernate ORM Exposure to Quarkus Understanding of networking principles, tools, and equipment Exposure Linux system admin tools Understanding of Maven Exposure with Python and Big Data technologies including ML Salaries £70,000 - £90,000 + bonus, shares, 30 days holiday + BH, great parental leave and menopause health more »

create value Experience working at a start-up or fast-growing software environment Cloud based AI/ML solutions Python Ideally experience working with big data tech The company have a hybrid working policy and you would need to be able to get to the office in central more »

Hive SQL Queries/Spark SQL Statements. * Experience in working with large databases - multi terabytes (3+ Terabytes). * Minimum of 5 years' experience in Big Data Space (Hive, Impala, Spark Sql, HDFS etc). * Any cloud experience (AWS/Azure/Google/Oracle). * Solid experience with more »

and business areas supporting the Customer Relationship Growth strategy to deepen relationships with our customers across both the retail & commercial bank. This includes the data, analytics, and technology to unlock the value of differentiating our branded channel experiences, proposition, price and communication; as well as paper-free sustainable ambitions. … experience: Strong knowledge of cloud architecture, hosting patterns & services (especially GCP), cloud security, resilience, and operational excellence Strong understanding of microservices, containerisation, cloud native, data architectures and event-driven design concepts Strong understanding of API standards, security, networking, ingress/egress patterns & FinOps Strong understanding of data technologies … SQL/NoSQL, Big Data Experience working with enterprise-wide cloud patterns - networks, security, ingress/egress Knowledge of ML/AI and data capabilities in GCP Strong experience & knowledge of some key LBG development technologies (e.g. JavaScript, Java Spring Boot, Python) Knowledge of the SDLC & SRE more »

Senior Data Optimisation Engineer Location: Coventry (3 Days a Week) Salary: up to £80,000 + Benefits Investigo are working with a leading global technology business based in the Midlands in search of a Senior Data Optimisation Engineer to come and join their new team. They offer systems … used by some of the largest house hold brands in the Automotive sector. We are looking to assist them in growing out a new data focused team to ultimate service the pipeline of clients in need of their support and expertise. This responsibilities will include: Manage and execute data … optimisation opportunities. Provide expertise in AWS monitoring and optimisation, optimising databases and ETL pipelines. Utilise programming languages such as Python and PySpark to transform big data into manageable datasets. Contribute to the development of interactive dashboards and provide expert analysis across program lifecycles. Transform technical data into more »

Hugging Face, large language models (LLMs), Retrieval Augmented Generation), learning algorithms, neural networks, ML frameworks (TensorFlow, PyTorch) > Strong IaC experience, using Terraform or CloudFormation > Data Wrangling > Systems: Linux, APIs, infrastructure design load balancing, VMs, PostgreSQL, vector dbs. Senior ML Learning Engineer desirable skills: Version control (Git), computer vision libraries … Big Data (Hadoop, Spark), Cloud AWS, Google Cloud, Azure, and a knowledge of secure coding techniques PCI-DSS, PA-DSS, ISO27001. This is a fantastic opportunity to join a company that fosters growth and in particular a team that offers an exciting and collaborative environment to work in. more »

Senior Data Engineer Snowflake data cloud Birmingham, West Midlands - Hybrid role 70k plus mostly remote working Snowflake, SnowPro, DV2, Data Vault 2.0, Cloud Data Platform The Data Developer will play a key role in the architecture, design, and management of data solutions within the … Snowflake Data Cloud. You will lead a team of Data Developers on the Snowflake Cloud Data platform, providing invaluable technical guidance and mentorship, where you will collaborate seamlessly with cross-functional teams to ensure their data solutions align seamlessly with their business goals. The Data specialist must have a Snowflake certification , either/or; SnowPro Core, SnowPro Advanced Data Engineer or SnowPro Advanced architect etc Experience and Skills: Extensive experience as a Snowflake Engineer, with a focus on data architecture and optimisation. Proven leadership experience, including mentoring and guiding a team of more »

various components of the AI infrastructure. Design and deploy scalable and resilient infrastructure solutions to support AI and machine learning initiatives. Manage and optimise data pipelines, storage systems, messaging frameworks and computing resources for efficient data processing and analysis. Integrate machine learning models into production systems, ensuring seamless … Python programming and strong proficiency in Python development Deep knowledge of distributed and scalable systems, including proficiency with PostgreSQL, RabbitMQ, and Cassandra. Familiarity with big data technologies such as Hadoop, Spark, or Kafka . Strong problem-solving skills and the ability to troubleshoot complex issues in distributed systems. more »

datasets, using your expertise to uncover valuable insights that drive strategic decision-making and fuel business growth? Do you thrive in a high volume data-oriented environment, where every record holds the potential to uncover radical insights and opportunities? Do you have exceptional skills in big data technologies, real-time data processing, and advanced analytics, and would be capable of handling and extracting insights from a highly dynamic dataset growing by 8 billion records each day? If youre a Big Data Analyst used to working with big data and high-volume … records, and have what it takes to transform complex data into actionable recommendations, informed decisions, and impactful outcomes, then this could be the perfect position for you! Salary & Benefits: Competitive salary between £60,000 - £80,000 per annum depending on relevant technical skills and experience Fully remote work arrangement more »

scikit, SpaCy Machine Learning NLP, ML algos, Hugging Face, large language models (LLMs), Retrieval Augmented Generation), learning algorithms, neural networks, ML frameworks (TensorFlow, PyTorch) Data Wrangling Systems: Linux, APIs, infrastructure design load balancing, VMs, PostgreSQL, vector dbs. ML Learning Engineer desirable skills: Version control (Git), computer vision libraries, Big Data (Hadoop, Spark), Cloud AWS, Google Cloud, Azure, and a knowledge of secure coding techniques PCI-DSS, PA-DSS, ISO27001. Note: as there are actually two roles on offer (both new and due to expansion) the client is happy to look at more junior candidates, possibly graduates, for more »