26 to 50 of 252 Big Data Jobs in the UK

+ Package - Healthcare Sector UK - West Midlands/Bristol - Occasional Travel Interviewing now As the Senior Analytics Engineer you're expected to leverage big data to support with the sizing and development of future hospitals. Alongside this, you'll contribute to the development of a suite of new more »

your day to day duties you will have the opportunity to grow as a technologist working predominantly with Java and Spring in addition to Big Data technologies and frontend frameworks such as React. You will be immersed in a working culture supported by a commitment to continual learning more »

Senior Data Engineer Python, SQL, Big Data Frameworks London, Geneva, Dubai - 4x a week (no flex) £110-120,000 + bonus Seeking a skilled Data Engineer to join a company specialising in quantitative trading and investment management. This role is pivotal in building and maintaining the … infrastructure that supports their cutting-edge trading strategies. Key Responsibilities: Design and manage scalable data pipelines. Integrate data from various sources and develop ETL processes. Optimize database systems for high performance. Work with data scientists and analysts to meet data needs. Automate data processing tasks … to enhance efficiency. Implement data security measures and ensure compliance with industry standards. Requirements: Master's degree in Computer Science, Engineering, Mathematics, or related field from a top uni. Proven experience as a Data Engineer in the financial services or hedge fund industry. Technical Skills: Proficiency in Python more »

Key responsibilities: Develop robust architectures and designs for big data platform and applications within the Apache Hadoop ecosystem. Implement and deploy big data platform and solutions on-premises and in hybrid cloud environments. Read, understand, and modify open-source code to implement bug fixes and perform … and support large scale migration for critical applications. Your Profile Key Skills/Knowledge/Experience: Proven experience in architecting, designing, building, and deploying big data platforms and applications using the Apache Hadoop ecosystem in hybrid cloud and private cloud scenarios. Experience with hybrid cloud big data platform designs and deployments, especially in AWS, Azure, or Google Cloud Platform. Experience in large-scale data platform builds and application migrations. Expert knowledge of Apache Hadoop ecosystem and associated Apache projects (eg, HDFS, Hive, HBase, Spark, Ranger, Kafka, Yarn etc.). Proficiency in Kubernetes for container orchestration. more »

Foundry Specialist/Architect to join our team. The ideal candidate will possess extensive knowledge and hands-on experience with Palantir Foundry, including its data integration, analytics, and operational decision-making capabilities. As a Palantir Foundry Specialist/Architect, you will be responsible for designing, developing, and maintaining data-driven solutions that leverage Palantir Foundry's platform to address complex business challenges. Key Responsibilities: *Solution Architecture:* - Design and architect end-to-end data solutions using Palantir Foundry, ensuring alignment with business goals and technical requirements. - Develop scalable and efficient data models, pipelines, and workflows within the … Foundry environment. - Collaborate with stakeholders to understand business needs and translate them into technical requirements and solutions. *Data Integration:* - Implement data integration solutions to ingest, transform, and manage large datasets from various sources into Palantir Foundry. - Ensure data quality, consistency, and security throughout the data life more »

We are currently seeking a talented Senior Full Stack Developer/Data Engineer to join the Human Genomics Team at the EMBL European Bioinformatics Institute (EMBL-EBI). The team provides genome variation and regulation resources as part of the Ensembl project, human variation interpretation services including the DECIPHER … platform, and data portals for partners around the world. With underlying infrastructure for these services based on EMBLs large and long-standing data resources this is an opportunity to rise to the challenges of big data and make contributions that advance the reach and utility of … e.g. Perturb-seq) data. This project is funded through the Open Targets consortium, an innovative public-private partnership that uses human genetics and genomics data for systematic drug target identification and prioritisation. The new resource will help to address a fundamental need in the scientific and drug discovery community more »

Details Title: Data Architect Employment Type: Full-Time Location: UK - Remote Salary: £75,000 - £85,000 pa Overview We are looking for a Data Architect with expertise working with modern Data Architecture, Data Governance, Big Data and Data Engineering to join us at … Vault Data. The ideal candidate will be someone passionate about creating a robust, scalable and secure data strategy to drive innovation within the business. Job Description As a Data Architect, you will establish and govern the data architecture, data strategy, data management and road-map … with key milestones and deliverables to deliver our product vision. You will lead on Data Governance and Compliance and collaborate with our Developers, ML, AI, QA and Security Engineers to integrate into the broader product life-cycle. As a leading member of the Data Team, you are expected more »

AWS Data Architect (Must have current SC) Amber Labs was born out of the recognition that many organisations require support on their data maturity journey. Our team is passionate and experienced in delivering cutting-edge data capability. Amber Labs was established with a vision to provide specialist … services, automation, accelerators competitively to organisations across EMEA. Job Summary We are seeking a highly skilled AWS Data Architect to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and optimizing our data architecture on the AWS platform. You will work closely with various … teams to ensure data integrity, security, and availability, driving our data strategy forward Key Responsibilities Design and Implement Data Solutions: Develop scalable and efficient data architecture solutions on AWS. Create and maintain data pipelines using AWS services such as Glue, Lambda, Kinesis, and Data more »

Senior Data Engineer Mobysoft is one of the fastest growing SaaS providers in the UK and has been shortlisted in the "Top 50 fastest growing technology companies in the North" for four successive years. Mobysoft provides predictive analytical software that has helped our customers deliver tens of millions of … year at the Real I.T Awards 2024- one of the many awards we are proud of ! Role overview We are an ambitious, customer-centric Data & Insights team, dedicated to developing a new generation of data products that unlock significant value for the social housing sector. We operate with … a focused product lens, driven by curiosity and a commitment to technical excellence. Data Engineering is foundational to this mission, ensuring synchronized, curated, trusted, dynamic data is available at speed and scale for our clients, data analysts,data scientists, and stakeholders. As such we are looking more »

an experienced AWS Cloud Architect to design AWS reference architecture for our services-led client. Responsibilities: Design and implement scalable, secure, and high-performance data architectures on AWS. Develop data models and database designs that align with business requirements and ensure data integrity. Proficiency in CI/… CI, or AWS CodePipeline. Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform, or similar. Create and maintain ETL processes, data pipelines, and data integration workflows using AWS services. Implement data storage solutions, including data lakes, data warehouses, and operational databases. … Provide technical leadership and guidance on AWS data services and architecture to the team. Requirements: Proven experience as an AWS Data Architect or similar role, with a strong focus on data architecture and management. In-depth knowledge of AWS data services, including but not limited to more »

Data Models Lead - Data Engineering - MarTech - Adtech R83188 Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES … Principles – Quality, Responsibility, Mutuality, Efficiency and Freedom – inspire our 130,000 Associates to act daily towards creating the world we want tomorrow. Role Profile Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on … OR equivalent demonstrated through work experience. Nice to have – Masters/Degree with some computing, scientific, statistical or mathematical component. Extensive experience working with data, data models, and data systems in support of marketing technology (MarTech), e.g. CMS, CDPs, identity resolution/SSO Extensive experience using MarTech more »

We are seeking an experienced Python Data Engineer Consultant to join a leading hedge fund. The ideal candidate should have a proven ability to design and implement data solutions, with expertise in extracting, transforming, and loading (ETL) data from various sources, including websites, PDFs, and Real Time … data streams. Role: Python Data Engineer Client: Leading Hedge Fund Type of role: contract (6 months) Location: London office Rate: up to £1500/day Key Responsibilities: Architect, develop, and optimize data pipelines for extracting, transforming, and loading data from diverse alternative data sources, such … as web scrapes, PDF files, and Real Time data infrastructures. Implement and manage database solutions in SQL Server and various cloud-based environments, ensuring data integrity, efficiency, and accessibility. Build and maintain Real Time data processing systems capable of handling large volumes of data with minimal more »

Responsibilities:  Commercial acumen and a recent proven experience in a similar role (such as Commercial Insight Analyst, Data Insight analyst in Product Sales, Product Insight Analyst etc)  Success track in synthesising complex and ambiguous information in order to drive actionable insight brought to life through communication and visualisation  Proficiency … in SQL, Qlik sense and Big Data  Innate curiosity about customers, products and competitors  Cooperative and positive can-do attitude What I’ll be doing – your accountabilities Understanding business context and expectations and translating into practical approaches to data analysis Applying a broad range of techniques (A …/B hypothesis testing, multivarate test,data exploration, data preparation, big data analytics, visualisations, statisticalanalysis, business analysis) for gatheringthe insights and identifying meaningfultrends in the data Generating tactical analysis to distilthe insights, identify opportunities & make recommendations Articulating trends using tactical data visualisation techniques and more »

and Australia. It’s official: Bazaarvoice is a Great Place to Work in the US , Australia, India, Lithuania, France, Germany and the UK! Staff Data Engineer (P7) - Global Data Platform (Enablement) team What is the BV Data team at Bazaarvoice? Authentic data is the lifeblood of … the Bazaarvoice business. It is imperative that our data is consumable, interpretable, and instantly available to fuel insights across our brand, retailer and consumer customers. The BV Data team works closely with Product, Engineering, Business Development, and Account teams to consistently find new ways to use data across the business. Who We Want Are you ready to combine your talent for crafting solid data systems and enthusiasm for cutting-edge technology to harness the power of data at Bazaarvoice? We’re looking for a strong data engineer who thrives on building large-scale more »

Working with a top tier Digital Asset Management firm who are looking for an adept and experienced Data Engineer to play a critical role in shaping and managing their data engineering platform. This role demands strong technical skills and a proven ability to work closely with quantitative researchers … ensuring seamless integration of data engineering processes to support our quantitative investment strategies. Key Responsibilities: Collaborate closely with quantitative researchers to understand their data needs, offer technical solutions, and effectively integrate data engineering with quantitative strategies. Design, develop, and optimize robust data pipelines, facilitating ETL processes … that support quantitative research, analysis, alpha forecasting, and execution. Implement stringent data quality assurance measures to ensure the accuracy, reliability, and consistency of data inputs and outputs. Evaluate, select, and manage appropriate data engineering tools, technologies, and infrastructure, with a focus on scalability and automation. Work with more »

We are a team of passionate engineers committed to building the best-in-class petabyte-scale data infrastructure optimization platform that combines hardware acceleration with performance metering to enable real-time actionable insights for reducing data center costs. So far, we have raised a total of $3.5M in … CPU Compiler Engineer, you will collaborate with the founding team to improve and expand the core engine that we are building that massively accelerates Big Data pipelines. Your contributions to our core solution will directly impact data infrastructure processing 10s of petabytes every day where Xonai is … being deployed. Join us in building a cutting edge solution for the cloud to realize cost-effective data infrastructure at scale and with unparalleled flexibility. What you will do: Optimize code generation for executing JIT-compiled code on CPUs (Arm and x86 architectures). Diversify compiler optimizations based on more »

Foundry Specialist/Architect to join our team. The ideal candidate will possess extensive knowledge and hands-on experience with Palantir Foundry, including its data integration, analytics, and operational decision-making capabilities. As a Palantir Foundry Specialist/Architect, you will be responsible for designing, developing, and maintaining data-driven solutions that leverage Palantir Foundry's platform to address complex business challenges. Key Responsibilities: - Design and architect end-to-end data solutions using Palantir Foundry, ensuring alignment with business goals and technical requirements. - Develop scalable and efficient data models, pipelines, and workflows within the Foundry environment. … Collaborate with stakeholders to understand business needs and translate them into technical requirements and solutions. - **Data Integration:** - Implement data integration solutions to ingest, transform, and manage large datasets from various sources into Palantir Foundry. - Ensure data quality, consistency, and security throughout the data lifecycle. **Data more »

We are a team of passionate engineers committed to building the best-in-class petabyte-scale data infrastructure optimization platform that combines hardware acceleration with performance metering to enable real-time actionable insights for reducing data center costs. So far, we have raised a total of $3.5M in … and maintain the solution up to date and compatible with a variety of supported runtimes. Your contributions to our core solution will directly impact data infrastructure processing 10s of petabytes every day where Xonai is being deployed. What you will do: Optimize code generation for executing JIT-compiled code … execution in CPUs targets. Improve the existing compiler design and toolchain. Collaborate with team members to drive new innovations lying at the intersection of Big Data and compilers. What you will bring: 3+ years of experience working with large applications written in Scala. Strong Scala and Java programming more »

ROLE SUMMARY DATA ENGINEER REMOTE/TRAVEL TO CLIENT SITE IN LONDON Valcon UK are looking to recruit a self-motivated, highly logical and intellectually curious Data Engineer’s to join our expanding Data capability in the UK. As a growing business area, the ideal candidate will … strategy, turn it into an actionable blueprint and help the client get it done. Who have deep expertise in operationalising strategy, process design, digitisation, data and analytics, automation, technology and change. RESPONSIBILITIES: Analyse and organise raw data Build data systems and pipelines Evaluate business needs and objectives … Interpret trends and patterns Conduct complex data analysis and report on results Prepare data for prescriptive and predictive modelling Build algorithms and prototypes Combine raw information from different sources Explore ways to enhance data quality and reliability Identify opportunities for data acquisition Develop analytical tools and more »

Role: Principle Data Engineer Salary:£120K Working pattern: Fully Remote Are you looking to work for a leading product developer operating in the pharmaceutical industry? They offer the ability to work with Global clients in a rapidly growing industry that has taken centre stage since the covid outbreak. Your … responsibilities include: Lead design and implementation of scalable, secure data products and integration solutions. Collaborate with cross-functional teams to define integration needs and gather requirements. Provide technical leadership, mentor engineers, and drive innovation and best practices. Develop and test APIs, data pipelines, and ETL processes for seamless … data integration. Evaluate and select data integration tools, ensuring scalability and performance. Tech stack: ETL frameworks REST APIs Messaging systems Python Java Databases and SQL Data warehousing Data modeling Data governance Cloud platforms and services (e.g., AWS) Big data technologies (e.g., Spark, Kafka more »

Complexio is Foundational AI. This works to automate business activities by ingesting whole company data – both structured and unstructured – and making sense of it. Using proprietary models and algorithms, Complexio forms a deep understanding of how humans are interacting and using it. Automation can then replicate and improve these … Marfin Management, C Transport Maritime, Trans Sea Transport and BW Epic Kosan. Key Responsibilities 👥 Collaborate with cross-functional teams to design and build scalable data solutions that support product innovations and business insights. 🔨 Develop and maintain robust data pipelines that support complex data collection, ingestion, and transformation … processes. 🧑‍💻 Work closely with R&D within data science and AI to provide data. 📈 Design and implement mechanisms for data validation, quality, and reliability to ensure the accuracy and trustworthiness of data sources. 🪲 Diagnose and resolve data-related issues to improve the performance and scalability of more »

of our clients located in London. About the Client: Our client is a sports tech company that leverages AI and expert knowledge to offer data and analysis, addressing performance and commercial challenges in the sports and media industries. About the Role: As a Senior DevOps Engineer/Cloud Engineer … you will be looking to work on cross-functional teams with data engineers and data scientists and help to design the DevOps infrastructure using AWS products and also be responsible for establishing best-in-class CI/CD techniques while helping to scale the analytics capabilities in a … technologies to implement the necessary modifications when required. * Extensive familiarity with CI/CD platforms and best practises, including GitHub Actions. Nice to have: * Data Bricks setup using Terraform experience. * Experience of MLOps and DataOps. * Experience of using container technologies, cloud platforms (ideally AWS), and distributed processing frameworks like more »

Eames Consulting are looking for Data Engineering Manager to join our dynamic team at a prestigious asset management firm. As a Data Engineering Manager, you will play a crucial role in shaping and overseeing the data infrastructure that supports our business operations. Key Responsibilities: Lead and mentor … a team of talented data engineers, fostering a culture of collaboration and continuous improvement. Develop and execute the data engineering strategy aligned with the organization's business objectives. Collaborate with key stakeholders to understand business requirements and translate them into data solutions. Oversee the design, development, and … maintenance of robust data pipelines to ensure the timely and accurate delivery of data to various stakeholders. Manage and optimize data storage, ensuring scalability and security in compliance with industry standards. Communicate complex technical concepts to non-technical stakeholders, fostering a culture of data-driven decision more »

My client, a leading Consultancy, is looking for a Cloud/Data Evangelist. The right candidate will be a Senior Thought Leader with an entrepreneurial mindset with deep domain experience. I need someone who has delivered major projects and multi-million pound Data Analytics Solutions, someone who is … focused with tremendous soft skills and ability to help shape and grow a practice. Responsibilities: • 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies • Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks • Must Have … Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). • In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ more »

the UK! Who We Want We are looking for a Staff Backend Engineer to join our Insights Back-End team to help build out data pipeline, data store and API layer of Bazaarvoice data that will power our various client-facing dashboards, raw data reporting, product … performance reporting. The ideal candidate has built and operated systems that aggregate and share data sets to support new product offerings and is well experienced in evaluating the right technologies to build those data sets. Success in the role is underpinned by a strong understanding of the business … cases of the product portfolio and building relevant data sets, API layer and access methodologies that support the portfolio goals. What You’ll Be Doing Own, design, implement and support of major components of the unified back end data. Define how data should be aggregated and made available more »