1 to 25 of 32 Permanent Big Data Jobs in London with Remote Work Options

infrastructure and applications. Responsibilities: Utilize recent AWS experience to design, implement, and manage AWS services such as EC2, ASG, RDS, and OpenSearch for streaming big data. Implement Infrastructure as Code (IAC) principles using tools like AWS CloudFormation or Terraform to automate infrastructure provisioning and management. Develop and maintain deployment more »

For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer … definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure and GCP … Cloudera, No-sql databases (Cassandra, Mongo DB), ELK, Kafka, Snowflake, etc. Past experience in Data Engineering and data quality tools (Informatica, Talend, etc.) Previous involvement in working in a Multilanguage and multicultural environment Proactive, tech passionate and highly motivated Desirable requirements: Experience in Data analysis and visualization more »

a not-for-profit organisation focused on developing the blockchain/DLT ecosystem. Due to ongoing growth they are now looking for an experienced Data Engineer to join their team. This role is pivotal in managing, curating, optimising, and securing datasets specifically related to cryptocurrency discussions across various platforms. … The ideal candidate will be adept in web scraping, data quality assurance using AI, data integration, ensuring data security and compliance, and maintaining detailed documentation. Blockchain experience is not needed but a solid background with Python, AWS and web scraping is a must. Role and Responsibilities Data Collection: Identify relevant chat sources, groups, and forums on platforms discussing particular topics. Maintain and develop web scraping tools or APIs for periodic data extraction. Data Quality Assurance: Develop and implement AI-based procedures for quality control of data and data sources to eliminate inaccuracies more »

more than 4 countries. Blupace provides innovative software solutions for businesses of all sizes, with a focus on Web & Mob Applications, e-commerce websites, data & Analytics , Field services and more. We are passionate about developing innovative technology solutions that make a difference. We have the expertise and experience to … dedicated to providing you with the best possible service, and we are always looking for new ways to improve our products and services. Skills: Data Architect Mode - Hybrid ( 2 days work from home ) Employment -Contract - 1 year ,Location -London Mode of Employment : 1 year Fixed Term Employment Responsibilities & Skills … Role Expectations o Define all architecture patterns Data Mesh Data Fabric EventHub etc o Define each architecture pattern Data Analytics Platform Functional Blueprint Logical Layers and Each layer Capabilities o Identify All Ingestion Patterns Real Time Batch Structured Unstructured Images PDF for each data analytics platform more »

At Ripple, we’re building a world where value moves like information does today. It’s big, it’s bold, and we’re already doing it. Through our crypto solutions for financial institutions, businesses, governments and developers, we are improving the global financial system and creating greater economic fairness … Ripple is growing rapidly and we are looking for a results-oriented and passionate Staff Software Engineer to help create the next generation of data infrastructure built for scale, resilience and reliability. This is a high impact role. You will build real-time data pipelines and a data … lake for valuable internal tools used by leadership, compliance, finance, and product teams to make strategic business decisions. You will be responsible for our Data API that powers public-facing applications used globally to follow the open-source ledger. WHAT YOU WILL DO: Build real time data pipelines more »

Central London Office. Front office trading experience a must. My client is a top tier commodities trading company that is looking for a Market Data Product Owner/Business Analyst to come on board on a 6 month rolling contract. The Data team is looking for a Product … Analyst to understand business problems, challenge existing practices and approaches, define scope and requirements, propose business improvement opportunities, and develop solutions that enable the Data Team to achieve its goals Key Accountabilities and Responsibilities Engage key stakeholders to identify underlying business needs to be addressed Translate business needs into … Skills and Experience Extensive experience as a Product Owner/BA, gathering technical and non-technical requirements. Extensive financial services experience, ideally in Market Data Exposure and understanding of big data technologies and messaging systems Experience in SQL for data extraction, transformation and analysis Experience with more »

Senior Data Engineer (Snowflake) London - x2 days in office a month as a rough expectation. Xcede is delighted to be recruiting a Senior Data Engineer on behalf of a market leader in the retail and e-commerce space. Our continues to invest in innovation, delivering unparalleled shopping experiences … millions of customers in several formats. As they continue to expand their operations and enhance their digital capabilities, they're seeking an experienced Senior Data Engineer who shares their ambition for well-structured, stable, scalable Data management systems. The Senior Data Engineer should come with a proven … track record in managing large-scale data infrastructures and pipelines that support sophisticated analytics. The ideal candidate will be responsible for designing, building, and maintaining robust data solutions that drive strategic decision-making across multiple business units. This role is for someone who principally still loves to code more »

As a Java developer, you will be working in a small focused team using some of the latest technologies to create large sets of data, which can be efficiently processed to provide actionable intelligence. • Candidates will be working with Big Data, innovative security and threat detection systems more »

Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look after our … people. Because for us, they’re not just people. They’re part of the family. A family that dreams big and always works together to make insurance better. For everyone. We offer our employees a unique benefits package that includes personal training sessions, well-being provisions, and an additional … employees to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so that Aventum more »

Find your magic with us Connecting people to their family stories is special. We’re proud to deliver these magic moments. Through technology, data and insights, we bring people closer to their past, to benefit their future. We’re a fast-growing team of smart people, on a mission … Enjoy the agility of a scale-up with the security of real financial backing, in a place where every story matters. Why join our Data Science and Insights team? We’re driven by the desire to create a fantastic customer experience We love nothing more than taking big data and extracting as much insight as possible We’re naturally collaborative and work closely with every other team within the company We’re neatly set up for flexible working and giving people the freedom to thrive. We’re a supportive bunch and actively attend conferences, have discussion more »

Job Description: Lead Data Engineer Location: Central London (Hybrid: 2 days per week onsite.) £600-£700 Outside Company Description: My Client is a leading financial organisation committed to leveraging cutting-edge technology and data-driven insights to empower stakeholders and drive innovation within the industry. As they continue … to expand their data capabilities, they are seeking a skilled Lead Data Engineer to spearhead the development and implementation of their data platform whilst also advising and consulting on legacy data migrations from on-prem to the cloud to increase carbon neutrality. Role Overview: As a … Lead Data Engineer, you will play a pivotal role in designing, building, and maintaining their data infrastructure while collaborating closely with senior stakeholders across the organisation. Your expertise in Azure, Databricks, Spark, Python, and data modelling will be critical in driving the success of their data more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

Who we are: At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in fair and equitable way. With over … about managing AWS accounts and infrastructure to host our systems for LLM-inference, including advanced RAG. To this end you will collaborate tightly with Data Scientists, Machine Learning, Big Data, and Software Engineers in a Scrum environment. You can support streamlining deployment and establish best practices in … of elevating processes and standards, we'd love to hear from you! Your skills and qualifications: 5+ years of experience in DevOps, Cloud Operations, Data Engineering, or a related field, with a strong team player mindset and a sense of ownership High proficiency in AWS administration, IaC (Terraform), CI more »

Azure Synapse Data Engineer - £75K - Remote (London) My client a market leading provider grants clients access to bespoke data insights and analytics specific to their needs, providing research, data and expertise to support clients and all lines of business (Advisory, Digital, Search). They are an innovation … a focus on delivering deep insights to clients, working collaboratively with our colleagues across the business. We are looking for an experienced Azure Synapse Data Engineer with exceptional technical, analytical, communication and project management skills to join our team of data and analytics experts, helping organize and leverage … arguably the richest, broadest data available on work and people, and support the build-out of a scalable, distributed data estate and supporting applications. The role will help us leverage critical data assets, set up data pipelines, transform data, and enable our data scientists more »

My client are looking for a talented and motivated Big Data Architect (Azure, Databricks, Spark) to be based in their London office. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives, as they provide increasing … skills/experience is essential: Strong implementation experience using Spark and Databricks Strong Cloud experience (ideally Azure) Previously heavily involved in an implementation programme Data Warehouse Strong stakeholder management experience Excellent IT background, ideally within Telco/Wireless service providers but not essential Salary: Excellent + bonus + package more »

The driving force behind Big Data at Mimecast: Dive into the forefront of innovation with our Data Platform engineering team, where we process massive volumes of data to delight our customers with insights they love! Our pioneering Data Platform pushes on the boundaries of what … s possible, leveraging the latest technologies and tooling in AWS. Why Join Our Team? “If you’re interested in solving customer data challenges at immense scale, the Data Platform team is for you. Our AWS services process billions of events from millions of users each day. With efficient … storage and querying capabilities, we’re able to serve requests in milliseconds when querying over huge volumes of data!” – Hiring Manager What You’ll Do: As a Senior Software Engineer in the Data Platform team, you will play a pivotal role in designing, developing, and maintaining scalable systems. more »

and extending this to delivery of pilot projects for some of the world’s biggest brands. Sitting in a broader Advanced Analytics team of data scientists, the core focus of the role is on consumer insight and the ability to target audiences effectively with smart algorithms using privacy compliant … capabilities including: Connected Measurement (e.g. MMM, attribution modelling) Planning Foundations (e.g. Channel planning) Additional innovations as they are developed by the Annalect team Whilst data planners and strategy consultants will lead the scope of projects, this role will need to input into the development of analysis plans. There will … a small element of peer review for other members of the Annalect Advanced Analytics team. Lead on the development of new media optimization capabilities. Data evaluations to draft Annalect policy with partners and platforms. Ideal Candidate A rounded data/marketing scientist with the ability to complete projects more »

The ideal candidate's favorite words are learning, data, scale, and agility. You will leverage your strong collaboration skills and ability to extract valuable insights from highly complex data sets to ask the right questions and find the right answers. Contract 1 Year Remote Work Outside IR35 … per day Responsibilities Analyze raw data: assessing quality, cleansing, structuring for downstream processing Design accurate and scalable prediction algorithms Collaborate with engineering team to bring analytical prototypes to production Generate actionable insights for business improvements Qualifications MSc in Data Science At least 1 - 2 years' of experience in … quantitative analytics or data modeling Deep understanding of LLM modeling, machine-learning, clustering and classification techniques, and algorithms Fluency in a programming language (Python, C,C++, Java, SQL) Familiarity with Big Data frameworks and visualization tools (Cassandra, Hadoop, Spark, Tableau more »

Role - Azure Data Engineer Rate - £600 per day inside Hybrid working - 1 day a week onsite (Centre of London) Duration - Initial 6 months My client is a large Financial services organisation based out of London and they are going through a huge data transformation that is expected to … run for at least 18 months. My client is seeking experienced Azure Data Engineers for a stakeholder-facing project. This role will have particular emphasis on Azure, Databricks and DevOps. Our client is in the consultancy sector but does not have a preference for previous experience within a consultancy … a key element of delivery within the project, focusing on delivering technically but also ensuring the quality of delivery within a wider team of Data Engineers. The ideal candidate needs experience and confidence to speak up when several teams can be involved in delivering the project. There is a more »

Lead Big Data Engineer - Hybrid - £120K My client is a leading trading platform that is looking to add a talented Senior Big Data Engineer You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives. … in design, processes, and implementation to improve operational management, scalability, and extensibility. The following skills/experience is essential: -Proven experience as a Lead Big Data Engineer with excellent knowledge of Big Data -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark … etc -Excellent experience of ETL, data warehousing and handling a variety of data types -Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI) -Experience implementing data visualisation and reporting tools -Excellent communication and business-facing skills more »

Big Data Architect - Hybrid - £120K My client is a leading trading platform that is looking to add a talented Big Data Architect. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives. You'll … implementation to improve operational management, scalability, and extensibility. The following skills/experience is essential: -Proven experience as an Architect and excellent knowledge of Big Data -Excellence experience across Azure -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc -Excellent experience of ETL … data warehousing and handling a variety of data types -Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI) -Experience implementing data visualisation and reporting tools -Excellent communication and business-facing skills Big Data Architect more »

Big Data Architect - Hybrid - £110K My client is a global telecommunications company that are looking to add a talented Big Data Architect. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives. You'll … implementation to improve operational management, scalability, and extensibility. The following skills/experience is essential: -Proven experience as an Architect and excellent knowledge of Big Data -Great understanding of Cloud e.g. Azure and or AWS -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark … etc -Excellent experience of ETL, data warehousing and handling a variety of data types -Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI) -Experience implementing data visualisation and reporting tools -Excellent communication and business-facing skills more »

analytics solutions using the full Microsoft BI stack (SQL Server, SSIS, SSRS, SSAS) Ability to translate business requirements into technical requirements & development experience using data discovery tools such as MS Power BI, QlikView, Tableau Ability to model and transform data, build ETL solutions and present data in … a useful business context Experience developing data warehouses & data marts using the Kimball methodology Experience or awareness of Big Data and Data Science related technologies, such as R or Azure Machine Learning, to design and implement predictive analytics models Excellent communication and problem solving skills more »

Solution Data Architect - Hybrid - £120K My client is a global telecommunications company that are looking to add a talented Solution Data Architect. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives. You'll be responsible … implementation to improve operational management, scalability, and extensibility. The following skills/experience is essential: -Proven experience as an Architect and excellent knowledge of Big Data -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc -Excellent experience of ETL, data warehousing and … handling a variety of data types -Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI) -Experience implementing data visualisation and reporting tools -Excellent communication and business-facing skills Solution Data Architect - Hybrid - £120K more »

with an ability to manage, develop and retain customer accounts. ➡ Successful track record in selling technology solutions and digital services, such as AI, IoT, Big Data & Cloud Computing. ➡ Experience in construction and engineering, public transportation, energy providers ➡ Sales experience within UK&I and Europe. 🏢 Location: Hybrid working – Central more »