1 to 25 of 99 Permanent Big Data Jobs in London

not afraid to speak our minds to help steer our customers towards understanding and achieving their key goals. We are looking for a Lead Data Consultant to help us grow and on our journey of taking OC to the next level. Your experience as a data focused technologist … strategise, and deal with the ingestion, processing, integration and ability to get insights out of their data. What you’ll spend your time on: Data Strategy & Architecture: Help customers make sense of, and understand their data in the context of what their business is trying to achieve. Create … data models and articulate the tradeoffs around different data approaches. Design and Architect complex data platforms and solutions across a variety of different scenarios. Leadership & Consulting: Provide technical leadership and guidance for our customers and your fellow team-mates in the area of data and data more »

Job Title: AWS Data Engineer Work Arrangement: Hybrid (London) 2 to 3 days Rate: £400 - £420/day Duration: 6 months Number of Positions: 2 Role Description: We are seeking an experienced AWS Data Engineer with a minimum of 8 years' experience in Big Data platforms. … This role will involve working with cutting-edge technology to build and maintain Big Data pipelines in the cloud. Key Responsibilities: Develop code according to given requirements. Create and execute unit test cases. Assist in backlog grooming. Key Skills/Experience: Extensive experience in developing Big Data pipelines in the cloud using technologies such as Apache Spark. Expertise in performing complex data transformations using Spark SQL queries. Experience orchestrating data pipelines using Apache Airflow. Proficiency in Git-based version control tools. Proficiency with Linux commands and Bash Scripting. Working experience with AWS Big more »

Job Description Big Data Scientist - Docklands London Our Client an international organisation is looking to recruit a Big Data Expert with 2 to 5 years expertise as a Big Data Scientist. You will have Natural Language Processing (NLP) knowledge and experience and understand and … analyse large data sets to discover new insights. Working in a multi-disciplinary team within a highly technical and complex environment. Well versed in scalable data mining and machine learning techniques (using computers to improve as well as develop algorithms)Kernel Methods, Deep Learning, Statistical Relational Learning, Ensemble … Methods Model using advanced statistical/mathematical models, predict and segment data to hypothesize/evolve uses cases to monetize data and generate other business value. Translate business needs to technical requirements and implementation. Experience of Big Data technologies/Big Data Analytics. C++ more »

For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer … definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure and GCP … Cloudera, No-sql databases (Cassandra, Mongo DB), ELK, Kafka, Snowflake, etc. Past experience in Data Engineering and data quality tools (Informatica, Talend, etc.) Previous involvement in working in a Multilanguage and multicultural environment Proactive, tech passionate and highly motivated Desirable requirements: Experience in Data analysis and visualization more »

Azure Synapse Data Engineer - £75K - Remote (London) My client a market leading provider grants clients access to bespoke data insights and analytics specific to their needs, providing research, data and expertise to support clients and all lines of business (Advisory, Digital, Search). They are an innovation … a focus on delivering deep insights to clients, working collaboratively with our colleagues across the business. We are looking for an experienced Azure Synapse Data Engineer with exceptional technical, analytical, communication and project management skills to join our team of data and analytics experts, helping organize and leverage … arguably the richest, broadest data available on work and people, and support the build-out of a scalable, distributed data estate and supporting applications. The role will help us leverage critical data assets, set up data pipelines, transform data, and enable our data scientists more »

Job Purpose As a Data Engineer, you'll be at the forefront of enhancing our client's data capabilities, ensuring every bit is optimised for success. You will be collaborating closely with their visionary Data Scientists, crafting intricate data models and stunning visualisations that will drive … strategic decision-making to new heights. Your expertise in programming languages and data analysis tools will be the key to unlocking their data's full potential. Your contributions will be pivotal in driving strategic decision-making, fueling various impactful use cases. Harness your prowess in programming languages and … data analysis tools, while showcasing your formidable analytical and communication skills. Responsibilities Support the design and maintenance of data integrity checks across our client's various systems. Collaborate with the Data Scientists to understand data needs, representing key data insights in a meaningful way. Building more »

we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. Inviting applications for the role of Senior Principal Consultant, Data Architect/Data Engineer! In this role, you will … play a pivotal role in designing and implementing robust data solutions. Your technical expertise and leadership will drive the success of our big data initiatives. Good level of experience is required. Responsibilities: Build robust, high-performance, and adaptable solutions for modern platforms (GCP Big Query,Relational … OLAP) Finance data modelling extensive experience desired as the data lead. Talend/Informatica transformation logic experience is required Technical thought leadership on architecture, data modeling, and Big Data strategy Expertise in technical principles, vision, and standards for data warehouse. Scalability to handle increasing more »

AWS Data Architect (Must have current SC) Amber Labs was born out of the recognition that many organisations require support on their data maturity journey. Our team is passionate and experienced in delivering cutting-edge data capability. Amber Labs was established with a vision to provide specialist … services, automation, accelerators competitively to organisations across EMEA. Job Summary We are seeking a highly skilled AWS Data Architect to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and optimizing our data architecture on the AWS platform. You will work closely with various … teams to ensure data integrity, security, and availability, driving our data strategy forward Key Responsibilities Design and Implement Data Solutions: Develop scalable and efficient data architecture solutions on AWS. Create and maintain data pipelines using AWS services such as Glue, Lambda, Kinesis, and Data more »

Role: Data Architect Location: London, UK Define all architecture patterns (Data Mesh, Data Fabric, EventHub etc) Define each architecture pattern Data & Analytics Platform Functional Blueprint, Logical Layers and Each layer Capabilities Identify All Ingestion Patterns (Real Time, Batch, Structured, Unstructured (Images/PDF) for each data & analytics platform Analyze existing Data & Analytics Platform Architecture Playbook, Identify Gaps and Enrich Playbook Guided Tooling Framework (Scorecard based approach) Potential Engineering Frameworks (Structured/Semi-Structure) Define Intake Frameworks (Unstructured - OCR/Intake) Data Governance Capabilities/Framework/Integration with rest of Ecosystems Design & Recommend … Data Traceability/Lineage/DQ/Reconciliation and Observability Platform Understanding of Cloud (GCP, AWS) Services Offering Deep Understanding of Banking Regulations and solution required to adopt them in Hybrid Cloud Ecosystem Data & Analytics Platform Governance: FinOps, Regulatory Conduct MVP/POC Qualifying Criteria Must have 12+ more »

a not-for-profit organisation focused on developing the blockchain/DLT ecosystem. Due to ongoing growth they are now looking for an experienced Data Engineer to join their team. This role is pivotal in managing, curating, optimising, and securing datasets specifically related to cryptocurrency discussions across various platforms. … The ideal candidate will be adept in web scraping, data quality assurance using AI, data integration, ensuring data security and compliance, and maintaining detailed documentation. Blockchain experience is not needed but a solid background with Python, AWS and web scraping is a must. Role and Responsibilities Data Collection: Identify relevant chat sources, groups, and forums on platforms discussing particular topics. Maintain and develop web scraping tools or APIs for periodic data extraction. Data Quality Assurance: Develop and implement AI-based procedures for quality control of data and data sources to eliminate inaccuracies more »

of knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. About you: Our team … skills Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion more »

Data Models Lead - Data Engineering - MarTech R83188 Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES®, BEN … Principles – Quality, Responsibility, Mutuality, Efficiency and Freedom – inspire our 130,000 Associates to act daily towards creating the world we want tomorrow. Role Profile Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on … OR equivalent demonstrated through work experience. Nice to have – Masters/Degree with some computing, scientific, statistical or mathematical component. Extensive experience working with data, data models, and data systems in support of marketing technology (MarTech), e.g. CMS, CDPs, identity resolution/SSO Extensive experience using MarTech more »

Data Models Lead - Data Engineering - MarTech - Adtech R83188 Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES … Principles – Quality, Responsibility, Mutuality, Efficiency and Freedom – inspire our 130,000 Associates to act daily towards creating the world we want tomorrow. Role Profile Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on … OR equivalent demonstrated through work experience. Nice to have – Masters/Degree with some computing, scientific, statistical or mathematical component. Extensive experience working with data, data models, and data systems in support of marketing technology (MarTech), e.g. CMS, CDPs, identity resolution/SSO Extensive experience using MarTech more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture: Spearhead the design … and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable and robust … data hub. Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices. Data Integration and Storage Solutions: Implement data storage solutions and manage large-scale processing systems, overseeing the integration more »

We are seeking an experienced Python Data Engineer Consultant to join a leading hedge fund. The ideal candidate should have a proven ability to design and implement data solutions, with expertise in extracting, transforming, and loading (ETL) data from various sources, including websites, PDFs, and Real Time … data streams. Role: Python Data Engineer Client: Leading Hedge Fund Type of role: contract (6 months) Location: London office Rate: up to £1500/day Key Responsibilities: Architect, develop, and optimize data pipelines for extracting, transforming, and loading data from diverse alternative data sources, such … as web scrapes, PDF files, and Real Time data infrastructures. Implement and manage database solutions in SQL Server and various cloud-based environments, ensuring data integrity, efficiency, and accessibility. Build and maintain Real Time data processing systems capable of handling large volumes of data with minimal more »

Responsibilities:  Commercial acumen and a recent proven experience in a similar role (such as Commercial Insight Analyst, Data Insight analyst in Product Sales, Product Insight Analyst etc)  Success track in synthesising complex and ambiguous information in order to drive actionable insight brought to life through communication and visualisation  Proficiency … in SQL and Big Data  Innate curiosity about customers, products and competitors  Cooperative and positive can-do attitude What I’ll be doing – your accountabilities Understanding business context and expectations and translating into practical approaches to data analysis Applying a broad range of techniques (A/B … hypothesis testing, multivarate test,data exploration, data preparation, big data analytics, visualisations, statisticalanalysis, business analysis) for gatheringthe insights and identifying meaningfultrends in the data Generating tactical analysis to distilthe insights, identify opportunities & make recommendations Articulating trends using tactical data visualisation techniques and efficiently communicating more »

Role: Senior Data Engineer Job Type: Permanent Location: London (Hybrid) Ready to utilize your experience in Data Engineering, Solution designing and Cloud Computing? Are you passionate about Azure Cloud and Python? Are you keen to build your career with a dynamic global IT Consultancy implementing cutting-edge data engineering solutions? Make a meaningful impact as a Senior Data Engineer! Careers at TCS: It means more. TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people … customers and identify opportunities to support their strategy and improve their processes across functions. access to endless learning opportunities. The Role As a Senior Data Engineer , you will be at the forefront of leveraging Azure cloud services to design, develop, and implement cutting-edge data engineering solutions. You more »

Data Analytics Engineer - Inside IR35 - £600 - 800 Per day I am actively recruiting for an Immediate start Data analytics opportunity in Central London. This is for an international investment banking firm and will require a strong background in business change and transformation focussed expressly around Data analytics … and Big data platforms. 5+ years of Big Data Experience utilising Pyspark 5+ years of managing data analytical projects within a financial domain (Banking/Investments) Background within investment managment, financial services, etc. Project management experience, consultancy experience to deal and operate with internal and more »

Data Engineer Salary: £59,479 - £66,100 (dependant on skills and experience ) Location: London UK About Us MI5 keeps the country safe from serious threats like terrorism and attempts by states to harm the UK, its people and way of life. We carry out investigations by obtaining, analysing, and … limited and subject to business need. The Role Technology sits at the heart of everything we do at MI5. We're looking for experienced Data Engineers prepared to take on a more senior role within a multi-disciplinary product team. As a Data Engineer and working closely with … technical specialists such as Product Owners, Business Analysts, Delivery Managers, Software Engineers, Data Scientists and Machine Learning Engineers, you’ll build and run secure data applications and data products. You’ll promote Agile technical practises, using Agile methodologies to deliver digital products that are core to MI5 more »

Job Title: Data Architect Location: London (Hybrid) Contract: 6 Months Day Rate: Up to 550 (Outside) Start Date: ASAP Key Responsibilities: • Collaborate with stakeholders across various departments to understand their data needs and objectives. • Translate business requirements into technical specifications and data models using Microsoft solutions. • Document … the current state of the enterprise data architecture, identifying gaps, redundancies, and opportunities for optimization. • Develop and maintain data models, schemas, metadata, and data flow diagrams to support the enterprise architecture. • Establish and enforce data governance policies and standards to ensure data quality, security, and … compliance. • Develop a data strategy roadmap, outlining key initiatives, milestones, and performance metrics to achieve a data-driven enterprise using Microsoft solutions. • Oversee the integration of disparate data sources into a cohesive and unified data ecosystem using Microsoft Fabric and related tools. • Work closely with IT more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability to implement data … ingestion and transformation pipelines for large scale organisations. This career may align to individuals who like to work with a variety of technologies and data services, that will develop and deliver early proofs of concept and production implementation. On a day to day basis you'll: Design and implement more »

This innovative Systematic Trading firm , seeks an experienced and gifted Software Developer/Big Data Engineer with genuine expertise in Python to work within a fast paced Data team . You will work very closely with Quant Research, Trading, Quant Development and traditional ETL/ELT Data … enable the capture, ingestion, transformation, storage, and provision (up and downstream) of large alternate datasets covering structured, semi-structured, and unstructured - API Layer Central Data Platform Telemetry tools Bespoke Data tools for the front office teams Post 18-24 months successful tenure previous individuals have moved internally into … Opportunity for internal mobility to APAC and East Coast U.S promoted. Desired background and skills 3+ years of exp. as a Software Engineer/Big Data Engineer with an understanding of modern Data Architecture Previous Finance experience is NOT essential , you will develop a deep understanding of more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

Job Description Data Analyst with Big Data - Canary Wharf Our Client is seeking a Data Analyst for the Data Products team is driving innovations in the Financial Services Sector using Big Data. The Client has a high-calibre, focused and a mission-driven team. … The models we build and the analysis that we derive from financial data matters to crucial cutting-edge business decisions made across the global financial services firms every day and provides insight into real world problems. In this role, you will gain a deep understanding of income and expense … be leveraged to deliver financial wellness tools in the UK market. This role will allow you to partner analytics teams to review and enhance data categorization for key income and expense transactions, develop a specification for both rules based and machine learning driven enhancements to categorization by defining transaction more »

include capability development, business intelligence solution delivery, performance and quality management, and maintaining technical expertise. The ideal candidate has extensive experience in Business Intelligence, data modeling, Azure platform, SQL databases, and DevOps practices. Desired skills include stakeholder relationship management, familiarity with big data technologies and Azure cloud … measures. * Detailed working knowledge of one or more market leading business intelligence platforms or tools (PowerBI, Tableau). * Expert knowledge of business intelligence concepts, data visualisation and analytic methods. * Data Engineering: A strong background in data engineering, with thorough understanding of concepts like ETL (Extract, Transform, Load … data cleaning, data structures, and data warehousing. * Azure Data Services: Hands-on experience with Azure data services like Azure SQL Database, Azure Data Factory, Azure Data Lake, and Azure Synapse Analytics. * SQL Database Experience: Proficiency in SQL databases with the ability to write more »