1 to 25 of 102 Big Data Jobs in the UK with Remote Work Options

For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer … definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure and GCP … Cloudera, No-sql databases (Cassandra, Mongo DB), ELK, Kafka, Snowflake, etc. Past experience in Data Engineering and data quality tools (Informatica, Talend, etc.) Previous involvement in working in a Multilanguage and multicultural environment Proactive, tech passionate and highly motivated Desirable requirements: Experience in Data analysis and visualization more »

GCP Data Engineer - Insight & Data Services - Permanent Salary guideline: £85,000 - £95,000 pa (D.O.E) + 5-10% Bonus, Pension up to 6% contributory, Health Insurance, Life Assurance etc. Base Location: Closest office to your home location/Hybrid working/Part Remote/UK wide The Client … Our client is a global leader in Systems Integration and IT Consultancy. They have built out a super advanced and respected industry-wide Insights & Data Practice. The Data Engineering, Architecture and Platform practice is part of global Insights & Data group. The Focus of the Role: Build and … deliver GCP data engineering solutions as part of a larger project: Use Google Data Products tools (e.g. BigQuery, Dataflow, DataProc, AI Building Blocks, Looker, Cloud Data Fusion, Data prep, etc.) to build solutions for our customers Experience in Spark (Scala/Python/Java) and Kafka. more »

GCP Data Engineer - Insight & Data Services - Permanent Salary guideline: £85,000 - £95,000 pa (D.O.E) + 5-10% Bonus, Pension up to 6% contributory, Health Insurance, Life Assurance etc. Base Location: Closest office to your home location/Hybrid working/Part Remote/UK wide The Client … Our client is a global leader in Systems Integration and IT Consultancy. They have built out a super advanced and respected industry-wide Insights & Data Practice. The Data Engineering, Architecture and Platform practice is part of global Insights & Data group. The Focus of the Role: Build and … deliver GCP data engineering solutions as part of a larger project: Use Google Data Products tools (e.g. BigQuery, Dataflow, DataProc, AI Building Blocks, Looker, Cloud Data Fusion, Data prep, etc.) to build solutions for our customers Experience in Spark (Scala/Python/Java) and Kafka. more »

Senior Developer (Data & Analytics) £450-£550 Inside IR35 12 months Hybrid Working - 2 full days a week working in London Talent are seeking a highly skilled Senior Developer with extensive experience in ETL/ELT processes, data warehousing/business intelligence methodologies, and best practices. The ideal candidate … will have a strong background in handling big data, cloud technologies, and unstructured data, along with a deep understanding of star schema structure and hybrid data warehouse design. As a Developer your key responsibilities will be: Design, develop, and maintain robust ETL/ELT processes and … data pipelines. Implement data warehousing solutions using Kimball and Inmon methodologies. Develop and manage cloud-based data solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Create and optimize data processing workflows in Databricks using PySpark more »

Senior Data Architect Opportunity - Scotland - Hybrid/Remote The Bridge IT have partnered with a leading energy supplier who are due to undertake a large data transformation spanning across the organisation. As a Senior Data Architect, you will play a pivotal role in designing, creating, and managing … our clients data architecture. Reporting to the Lead Data Architect, you will be instrumental in establishing a solid foundation for data analytics and data management, ensuring data is organised, accessible, secure, and aligned with business objectives. Key Responsibilities: Design, create, and manage comprehensive data architecture to support data analytics and management. Understand and address business issues, events, and activities, considering their wider implications and long-term impact. Ensure that detailed designs and solutions align with the solution data architecture. Manage and resolve design issues, working closely with the applications/integration more »

a not-for-profit organisation focused on developing the blockchain/DLT ecosystem. Due to ongoing growth they are now looking for an experienced Data Engineer to join their team. This role is pivotal in managing, curating, optimising, and securing datasets specifically related to cryptocurrency discussions across various platforms. … The ideal candidate will be adept in web scraping, data quality assurance using AI, data integration, ensuring data security and compliance, and maintaining detailed documentation. Blockchain experience is not needed but a solid background with Python, AWS and web scraping is a must. Role and Responsibilities Data Collection: Identify relevant chat sources, groups, and forums on platforms discussing particular topics. Maintain and develop web scraping tools or APIs for periodic data extraction. Data Quality Assurance: Develop and implement AI-based procedures for quality control of data and data sources to eliminate inaccuracies more »

of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our team … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion more »

of new services? We are partnering exclusively with a large organisation to bring you an exciting opportunity for a highly skilled and experienced Lead Data Engineer to be responsible for leading data engineering projects, ensuring the efficient processing and management of data across the organisation. … and other benefits. Flexible, hybrid working from Swansea with options for condensed hours. You will get to lead a team working on a modern data platform, collaborating with engineering product teams delivering services and working closely with reporting teams and data scientists to help understand and optimise their … digital services. This role will be instrumental in shaping their data infrastructure, ensuring it supports the strategic objectives. You will leverage cutting-edge technologies, primarily focusing on Microsoft Azure and Databricks, to develop and maintain robust, scalable data solutions. Responsibilities: Leadership and Strategy: Lead the data engineering more »

We are currently seeking a talented Senior Full Stack Developer/Data Engineer to join the Human Genomics Team at the EMBL European Bioinformatics Institute (EMBL-EBI). The team provides genome variation and regulation resources as part of the Ensembl project, human variation interpretation services including the DECIPHER … platform, and data portals for partners around the world. With underlying infrastructure for these services based on EMBLs large and long-standing data resources this is an opportunity to rise to the challenges of big data and make contributions that advance the reach and utility of … e.g. Perturb-seq) data. This project is funded through the Open Targets consortium, an innovative public-private partnership that uses human genetics and genomics data for systematic drug target identification and prioritisation. The new resource will help to address a fundamental need in the scientific and drug discovery community more »

Data Engineer Salary: £59,479 - £66,100 (dependant on skills and experience ) Location: London UK About Us MI5 keeps the country safe from serious threats like terrorism and attempts by states to harm the UK, its people and way of life. We carry out investigations by obtaining, analysing, and … limited and subject to business need. The Role Technology sits at the heart of everything we do at MI5. We're looking for experienced Data Engineers prepared to take on a more senior role within a multi-disciplinary product team. As a Data Engineer and working closely with … technical specialists such as Product Owners, Business Analysts, Delivery Managers, Software Engineers, Data Scientists and Machine Learning Engineers, you’ll build and run secure data applications and data products. You’ll promote Agile technical practises, using Agile methodologies to deliver digital products that are core to MI5 more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

DevOps Engineer -Big Data We are looking for a fully remote DevOps Engineer to join a blockchain intelligence team helping regulators and law-enforcement fight crypto criminals with real-time analysis. This team is a spin off from a Blockchain as a service giant. They aim to aid … in the fight against crypto money laundering at scale, by helping both financial institutions, and government organizations solve investigations in this space through a data-driven approach. A big focus for the tech team (~40 people) this year is to modernize their stack, with the DevOps team focusing … on migrating legacy infrastructure towards AWS, IaC, and containerized architecture. As the team analyses 30TB of Data daily, previous DevOps experience with Big Data is essential. We are seeking a DevOps Engineer with the following: Experience maintaining and scaling AWS services Big data experience with more »

Source Recruit is delighted to offer an exceptional opportunity for a Data & Analytics Senior Developer to join a reputable public-sector organisation on a high-profile project. This role is ideal for senior professionals with extensive experience in Data and Analytics solution design and implementation using Agile, along … with detailed knowledge of data modelling, database design, AI concepts, Cloud technologies, and data migrations. Role Overview: You will be a crucial member of a specialised team tasked with designing and implementing innovative data and analytics solutions to automate business processes and meet user functional and quality … stakeholders is essential to ensure adherence to technical standards and strategic constraints, making exceptional communication skills crucial. This role requires a deep understanding of data modelling, ETL processes, and the latest cloud data technologies, with a focus on delivering high-performance, scalable, and secure solutions, while ensuring that more »

of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis more »

is a well-known provider of iGaming services and products. Their team is expanding, which is why we are looking for an experienced Python Data Developer , based in the UK. They have adopted remote working mode. ................... As a Python Data Engineer at an international team, you will … design, implement, and maintain data pipelines, databases, and proprietary real-time player interaction software. Collaborating with cross-functional teams, you will ensure seamless data integration, support data-driven decision-making, and contribute to the success of our gaming platforms. Key Responsibilities: -Data Pipeline Development: Design, build … and maintain robust and scalable data pipelines for extracting, transforming, and loading (ETL) data from various sources. -Database Management: Manage and optimize databases, ensuring data integrity, security, and performance. Implement best practices for database design, indexing, and maintenance. -Data Integration: Collaborate with game providers, analysts, and more »

We are a team of passionate engineers committed to building the best-in-class petabyte-scale data infrastructure optimization platform that combines hardware acceleration with performance metering to enable real-time actionable insights for reducing data center costs. So far, we have raised a total of $3.5M in … CPU Compiler Engineer, you will collaborate with the founding team to improve and expand the core engine that we are building that massively accelerates Big Data pipelines. Your contributions to our core solution will directly impact data infrastructure processing 10s of petabytes every day where Xonai is … being deployed. Join us in building a cutting edge solution for the cloud to realize cost-effective data infrastructure at scale and with unparalleled flexibility. What you will do: Optimize code generation for executing JIT-compiled code on CPUs (Arm and x86 architectures). Diversify compiler optimizations based on more »

We are a team of passionate engineers committed to building the best-in-class petabyte-scale data infrastructure optimization platform that combines hardware acceleration with performance metering to enable real-time actionable insights for reducing data center costs. So far, we have raised a total of $3.5M in … and maintain the solution up to date and compatible with a variety of supported runtimes. Your contributions to our core solution will directly impact data infrastructure processing 10s of petabytes every day where Xonai is being deployed. What you will do: Optimize code generation for executing JIT-compiled code … execution in CPUs targets. Improve the existing compiler design and toolchain. Collaborate with team members to drive new innovations lying at the intersection of Big Data and compilers. What you will bring: 3+ years of experience working with large applications written in Scala. Strong Scala and Java programming more »

converters. Converted code is causing failures/performance issues. Your responsibilities; As a Spark Scala Engineer you will be working for the GDT (Global Data Technology) Team, you will be responsible for: Designing, building, and maintaining data pipelines using Apache Spark and Scala Working on an Enterprise scale … and Cloud Services in one of the Clouds (GCP). Mandatory Skills; At least 8+ Years of IT Experience with designing, building, and maintaining data pipelines . At least 4+ Years of experience with designing, building, and maintaining data pipelines using Apache Spark and Scala. Programming languages: Proficiency … in Scala and Spark is essential. Familiarity with Python and SQL is often a plus. Big Data technologies: Understanding of HDFS, Kafka, Hive, and cloud platforms is valuable. Data engineering concepts: Knowledge of data warehousing, data pipelines, data modeling, and data cleansing techniques more »

Role: Principle Data Engineer Salary:£120K Working pattern: Fully Remote Are you looking to work for a leading product developer operating in the pharmaceutical industry? They offer the ability to work with Global clients in a rapidly growing industry that has taken centre stage since the covid outbreak. Your … responsibilities include: Lead design and implementation of scalable, secure data products and integration solutions. Collaborate with cross-functional teams to define integration needs and gather requirements. Provide technical leadership, mentor engineers, and drive innovation and best practices. Develop and test APIs, data pipelines, and ETL processes for seamless … data integration. Evaluate and select data integration tools, ensuring scalability and performance. Tech stack: ETL frameworks REST APIs Messaging systems Python Java Databases and SQL Data warehousing Data modeling Data governance Cloud platforms and services (e.g., AWS) Big data technologies (e.g., Spark, Kafka more »

About the Role: I am looking for a talented Data Engineer to join our clients dynamic team on a 6-month contract basis. This is an exciting opportunity for a mid-level professional with 3-5 years of experience to make a significant impact on our data infrastructure … remote/hybrid working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions. Optimize and troubleshoot data workflows to ensure efficiency and reliability. Implement data quality and validation checks to ensure data integrity. Contribute to the development and maintenance of our data lake and data warehouse solutions on AWS. more »

Their mission is to make financial services more accessible, efficient, and personalised. Job Description: We are recruiting for a highly skilled and experienced Senior Data Scientist on behalf of our client. This is a hybrid role based in the UK. The ideal candidate will have a strong background in … data science, machine learning, and statistical modelling, with a proven track record of driving impactful business outcomes in the fintech space. As a Senior Data Scientist, you will lead complex projects, mentor junior data scientists, and collaborate with cross-functional teams to develop and implement advanced analytics … solutions. Key Responsibilities: 1. Lead Data Science Projects: Design, develop, and deploy machine learning models and algorithms to solve complex business problems. Manage end-to-end data science projects, from data collection and pre-processing to model deployment and performance monitoring. Ensure scalability, robustness, and reliability of more »