76 to 100 of 210 Big Data Jobs in England

As a Java developer, you will be working in a small focused team using some of the latest technologies to create large sets of data, which can be efficiently processed to provide actionable intelligence. • Candidates will be working with Big Data, innovative security and threat detection systems more »

+ Package - Healthcare Sector UK - West Midlands/Bristol - Occasional Travel Interviewing now As the Senior Analytics Engineer you're expected to leverage big data to support with the sizing and development of future hospitals. Alongside this, you'll contribute to the development of a suite of new more »

Key responsibilities: Develop robust architectures and designs for big data platform and applications within the Apache Hadoop ecosystem. Implement and deploy big data platform and solutions on-premises and in hybrid cloud environments. Read, understand, and modify open-source code to implement bug fixes and perform … and support large scale migration for critical applications. Your Profile Key Skills/Knowledge/Experience: Proven experience in architecting, designing, building, and deploying big data platforms and applications using the Apache Hadoop ecosystem in hybrid cloud and private cloud scenarios. Experience with hybrid cloud big data platform designs and deployments, especially in AWS, Azure, or Google Cloud Platform. Experience in large-scale data platform builds and application migrations. Expert knowledge of Apache Hadoop ecosystem and associated Apache projects (eg, HDFS, Hive, HBase, Spark, Ranger, Kafka, Yarn etc.). Proficiency in Kubernetes for container orchestration. more »

Foundry Specialist/Architect to join our team. The ideal candidate will possess extensive knowledge and hands-on experience with Palantir Foundry, including its data integration, analytics, and operational decision-making capabilities. As a Palantir Foundry Specialist/Architect, you will be responsible for designing, developing, and maintaining data-driven solutions that leverage Palantir Foundry's platform to address complex business challenges. Key Responsibilities: *Solution Architecture:* - Design and architect end-to-end data solutions using Palantir Foundry, ensuring alignment with business goals and technical requirements. - Develop scalable and efficient data models, pipelines, and workflows within the … Foundry environment. - Collaborate with stakeholders to understand business needs and translate them into technical requirements and solutions. *Data Integration:* - Implement data integration solutions to ingest, transform, and manage large datasets from various sources into Palantir Foundry. - Ensure data quality, consistency, and security throughout the data life more »

We are currently seeking a talented Senior Full Stack Developer/Data Engineer to join the Human Genomics Team at the EMBL European Bioinformatics Institute (EMBL-EBI). The team provides genome variation and regulation resources as part of the Ensembl project, human variation interpretation services including the DECIPHER … platform, and data portals for partners around the world. With underlying infrastructure for these services based on EMBLs large and long-standing data resources this is an opportunity to rise to the challenges of big data and make contributions that advance the reach and utility of … e.g. Perturb-seq) data. This project is funded through the Open Targets consortium, an innovative public-private partnership that uses human genetics and genomics data for systematic drug target identification and prioritisation. The new resource will help to address a fundamental need in the scientific and drug discovery community more »

AWS Data Architect (Must have current SC) Amber Labs was born out of the recognition that many organisations require support on their data maturity journey. Our team is passionate and experienced in delivering cutting-edge data capability. Amber Labs was established with a vision to provide specialist … services, automation, accelerators competitively to organisations across EMEA. Job Summary We are seeking a highly skilled AWS Data Architect to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and optimizing our data architecture on the AWS platform. You will work closely with various … teams to ensure data integrity, security, and availability, driving our data strategy forward Key Responsibilities Design and Implement Data Solutions: Develop scalable and efficient data architecture solutions on AWS. Create and maintain data pipelines using AWS services such as Glue, Lambda, Kinesis, and Data more »

Senior Data Engineer Mobysoft is one of the fastest growing SaaS providers in the UK and has been shortlisted in the "Top 50 fastest growing technology companies in the North" for four successive years. Mobysoft provides predictive analytical software that has helped our customers deliver tens of millions of … year at the Real I.T Awards 2024- one of the many awards we are proud of ! Role overview We are an ambitious, customer-centric Data & Insights team, dedicated to developing a new generation of data products that unlock significant value for the social housing sector. We operate with … a focused product lens, driven by curiosity and a commitment to technical excellence. Data Engineering is foundational to this mission, ensuring synchronized, curated, trusted, dynamic data is available at speed and scale for our clients, data analysts,data scientists, and stakeholders. As such we are looking more »

an experienced AWS Cloud Architect to design AWS reference architecture for our services-led client. Responsibilities: Design and implement scalable, secure, and high-performance data architectures on AWS. Develop data models and database designs that align with business requirements and ensure data integrity. Proficiency in CI/… CI, or AWS CodePipeline. Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform, or similar. Create and maintain ETL processes, data pipelines, and data integration workflows using AWS services. Implement data storage solutions, including data lakes, data warehouses, and operational databases. … Provide technical leadership and guidance on AWS data services and architecture to the team. Requirements: Proven experience as an AWS Data Architect or similar role, with a strong focus on data architecture and management. In-depth knowledge of AWS data services, including but not limited to more »

Data Models Lead - Data Engineering - MarTech - Adtech R83188 Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES … Principles – Quality, Responsibility, Mutuality, Efficiency and Freedom – inspire our 130,000 Associates to act daily towards creating the world we want tomorrow. Role Profile Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on … OR equivalent demonstrated through work experience. Nice to have – Masters/Degree with some computing, scientific, statistical or mathematical component. Extensive experience working with data, data models, and data systems in support of marketing technology (MarTech), e.g. CMS, CDPs, identity resolution/SSO Extensive experience using MarTech more »

We are seeking an experienced Python Data Engineer Consultant to join a leading hedge fund. The ideal candidate should have a proven ability to design and implement data solutions, with expertise in extracting, transforming, and loading (ETL) data from various sources, including websites, PDFs, and Real Time … data streams. Role: Python Data Engineer Client: Leading Hedge Fund Type of role: contract (6 months) Location: London office Rate: up to £1500/day Key Responsibilities: Architect, develop, and optimize data pipelines for extracting, transforming, and loading data from diverse alternative data sources, such … as web scrapes, PDF files, and Real Time data infrastructures. Implement and manage database solutions in SQL Server and various cloud-based environments, ensuring data integrity, efficiency, and accessibility. Build and maintain Real Time data processing systems capable of handling large volumes of data with minimal more »

Responsibilities:  Commercial acumen and a recent proven experience in a similar role (such as Commercial Insight Analyst, Data Insight analyst in Product Sales, Product Insight Analyst etc)  Success track in synthesising complex and ambiguous information in order to drive actionable insight brought to life through communication and visualisation  Proficiency … in SQL, Qlik sense and Big Data  Innate curiosity about customers, products and competitors  Cooperative and positive can-do attitude What I’ll be doing – your accountabilities Understanding business context and expectations and translating into practical approaches to data analysis Applying a broad range of techniques (A …/B hypothesis testing, multivarate test,data exploration, data preparation, big data analytics, visualisations, statisticalanalysis, business analysis) for gatheringthe insights and identifying meaningfultrends in the data Generating tactical analysis to distilthe insights, identify opportunities & make recommendations Articulating trends using tactical data visualisation techniques and more »

Working with a top tier Digital Asset Management firm who are looking for an adept and experienced Data Engineer to play a critical role in shaping and managing their data engineering platform. This role demands strong technical skills and a proven ability to work closely with quantitative researchers … ensuring seamless integration of data engineering processes to support our quantitative investment strategies. Key Responsibilities: Collaborate closely with quantitative researchers to understand their data needs, offer technical solutions, and effectively integrate data engineering with quantitative strategies. Design, develop, and optimize robust data pipelines, facilitating ETL processes … that support quantitative research, analysis, alpha forecasting, and execution. Implement stringent data quality assurance measures to ensure the accuracy, reliability, and consistency of data inputs and outputs. Evaluate, select, and manage appropriate data engineering tools, technologies, and infrastructure, with a focus on scalability and automation. Work with more »

ROLE SUMMARY DATA ENGINEER REMOTE/TRAVEL TO CLIENT SITE IN LONDON Valcon UK are looking to recruit a self-motivated, highly logical and intellectually curious Data Engineer’s to join our expanding Data capability in the UK. As a growing business area, the ideal candidate will … strategy, turn it into an actionable blueprint and help the client get it done. Who have deep expertise in operationalising strategy, process design, digitisation, data and analytics, automation, technology and change. RESPONSIBILITIES: Analyse and organise raw data Build data systems and pipelines Evaluate business needs and objectives … Interpret trends and patterns Conduct complex data analysis and report on results Prepare data for prescriptive and predictive modelling Build algorithms and prototypes Combine raw information from different sources Explore ways to enhance data quality and reliability Identify opportunities for data acquisition Develop analytical tools and more »

Eames Consulting are looking for Data Engineering Manager to join our dynamic team at a prestigious asset management firm. As a Data Engineering Manager, you will play a crucial role in shaping and overseeing the data infrastructure that supports our business operations. Key Responsibilities: Lead and mentor … a team of talented data engineers, fostering a culture of collaboration and continuous improvement. Develop and execute the data engineering strategy aligned with the organization's business objectives. Collaborate with key stakeholders to understand business requirements and translate them into data solutions. Oversee the design, development, and … maintenance of robust data pipelines to ensure the timely and accurate delivery of data to various stakeholders. Manage and optimize data storage, ensuring scalability and security in compliance with industry standards. Communicate complex technical concepts to non-technical stakeholders, fostering a culture of data-driven decision more »

My client, a leading Consultancy, is looking for a Cloud/Data Evangelist. The right candidate will be a Senior Thought Leader with an entrepreneurial mindset with deep domain experience. I need someone who has delivered major projects and multi-million pound Data Analytics Solutions, someone who is … focused with tremendous soft skills and ability to help shape and grow a practice. Responsibilities: • 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies • Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks • Must Have … Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). • In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ more »

At Innova-TSN, we specialize in crafting and implementing cutting-edge solutions in Business Intelligence, CRM, Business Analytics, Big Data, and Business Discovery. Our focus is on seamlessly integrating these solutions into decision-making processes, aiming to provide innovative and impactful solutions for our clients. We are looking … for a Technical Project Manager with 3 years of experience in project management and at least 2 years of technical expertise in Data Value, Big Data, and/or Business Intelligence environments Technical background is fundamental; we need someone who can assess technical implementations and solutions What more »

platforms (AWS, Azure). o Experience with microservices architecture, APIs, and integration patterns. o Proficiency in security architecture and best practices. o Familiarity with data architecture, including data warehousing, data lakes, and big data technologies. o Full Stack Development: Strong background in both front-end more »

knowledge of cloud platforms (AWS, Azure). Experience with microservices architecture, APIs, and integration patterns. Proficiency in security architecture and best practices. Familiarity with data architecture, including data warehousing, data lakes, and big data technologies. Full Stack Development: Strong background in both front-end and more »

Interim DevOps Engineer/Big Data Specialist – 12 Months+ - Cheltenham - £700 (Inside IR35) – eDV Required Join a mission-focused security team that protects critical infrastructure worldwide! Join an expanding team developing a Cyber Processing and Analytics platform. The project uses Elastic Stack technologies for data storage, enrichment … of operating Rancher, OpenShift or OKD to manage and deploy Kubernetes clusters. · General knowledge of Elastic Stack. · Experience of Linux including: System Administration of Big Data Platforms, System Monitoring, System Patching. · Knowledge of Data streaming and Message Brokers technologies. Please note this role requires current and active more »

My client are looking for a talented and motivated Big Data Architect (Azure, Databricks, Spark) to be based in their London office. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives, as they provide increasing … skills/experience is essential: Strong implementation experience using Spark and Databricks Strong Cloud experience (ideally Azure) Previously heavily involved in an implementation programme Data Warehouse Strong stakeholder management experience Excellent IT background, ideally within Telco/Wireless service providers but not essential Salary: Excellent + bonus + package more »

towards streamlining and digital optimisation of processes, improving patient outcomes, enhance efficiency, and transform patient experience. We are looking for a talented, highly motivated Data Warehouse Manager to manage Digital Patient Pathway Management projects, developers and database administrators within the Data Warehouse team developing systems in on premises … be a particular emphasis in this role on developing information systems within a Microsoft SQL Server development environment and/or an Apache Spark big data processing environment creating algorithms and pipelines to ingest and transform data into information systems and solutions capable of answering clinical and … digital patient pathway management. The role will involve close engagement with clinical/nursing teams and the candidate is expected to have experience extracting data and creating reports from clinical systems. If you're passionate about innovative healthcare solutions, driving digital transformation, and ready to make a tangible difference more »

Role Responsibility/b br ul li Advise health and social care clients in respect of some, or all, of the following: ul li Data protection, confidentiality and Freedom of Information/li li Providing complex advice such as: data protection impact assessments; risk based analysis of data protection compliance of new projects and systems; the use of artificial intelligence; and structuring new initiatives, such as big data projects, marketing strategy and data sharing./li li Assisting with responses to ICO complaints and defending investigations./li li Dealing with complex data subject requests./li li Advising on the use of targeted advertising, cookies and new technologies./li li Drafting and negotiating data protection clauses./li li Advising on issues arising out of cross border transfers of data./li/ul/li li Help build more »

Leading ecommerce client now requires a Data Engineer to join their innovative Machine Learning team. This role will focus on increasing overall data efficiency using Machine Leaning, streamlining data processes to increase overall profitability, and ensuring our clients operations and customer teams can increase overall value. They … with strong exposure to Machine learning principles/practices and technologies such as ML flow/Sage Maker. The role: Develop robust and scalable data pipelines. Collaborate with cross-functional teams to develop and deploy Machine Learning models and algorithms to solve business challenges and create opportunities. Contribute to … the development of our clients in-house Machine Learning operations framework. Support the data science and analytics team in deploying pipelines. Coach and mentor the team to improve development standards. Key requirements: Strong hands-on experience with Databricks, Spark, SQL or Scala. Proven experience designing and building data more »

Hawksworth are now searching for a Senior to Lead Data Scientist to join a large global insurance company that is investing heavily in its Data Science capabilities. As a result they're now looking to hire multiple Data Scientists to join them in their offices in Guildford. … They're looking for people that are comfortable with terms like; Statistical Models, Computer Vision, Predictive Analytics, Data Visualization, Large Language Models (LLM), NLP, AI, Machine Learning, MLOPs, Python, Pyspark, and Azure. Flexible Working : The role is 60% work from home Sponsorship : Sadly sponsorship isn't available for these … roles. About You: Bachelors Degree in Data Science, Mathematics, Economics or similar 4+ years working experience working in the world of Data Science You're more than capable with SQL & Python You have exposure to big data technologies such as Spark Ideally you will have experience more »

A leading Energy & Commodities client is seeking a Senior Data Engineer to join their growing IT team on an initial 6 month contract basis with high chance of extension thereafter to over 12 months. The role requires the individual to work with Solution and Data Architects to design … the next generation Big Data platform to support the digital marketing platform. The role, therefore, doesn't necessarily require Energy or Trading experience. The role is Inside IR35 and will be a couple of days per month onsite in London. Skills Required: Essential experience in Databricks, ADF, SQL … PySpark, CI/CD. Strong design and coding skills (e.g. Python, Scala, JavaScript). Experience with Microsoft or AWS data stack e.g. Microsoft Azure Data Lake, Hadoop (preferably with Spark), Cosmos DB, HDInsight/HBase, MongoDB, Redis, Azure Table/Blob stores etc. Exposure to tools like SAP more »