16 to 40 of 118 Big Data Jobs in London

We are looking for Senior Data Solution Architect Below are details Data Solution Architect Proven experience as architect and engineering lead in Data & Analytics stream In-depth understanding of data structure principles and data platforms Problem-solving attitude, solution mindset with implementation expertise Working experience … on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Well-versed with the end2end data management philosophies and governance processes Has pre-sales experience and have involved in RFP/RFI/RFQ processes Creative problem-solver with strong communication skills Excellent understanding of traditional … and distributed computing paradigm Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write complex SQL queries Should have strong implementation experience in all more »

Role: Data Architect Duration: FTE Location: London, UK Role Expectations Define all architecture patterns Data Mesh Data Fabric EventHub etc Define each architecture pattern Data Analytics Platform Functional Blueprint Logical Layers and Each layer Capabilities Identify All Ingestion Patterns Real Time Batch Structured Unstructured Images PDF … for each data analytics platform Analyze existing Data Analytics Platform Architecture Playbook Identify Gaps and Enrich Playbook Guided Tooling Framework Scorecard-based approach Potential Engineering Frameworks Structured Semi-Structure Define Intake Frameworks Unstructured – OCR Intake Data Governance Capabilities Framework Integration with rest of Ecosystems Design Recommend Data … Services Offering Deep Understanding of Banking Regulations and solution required to adopt them in Hybrid Cloud Ecosystem Qualifying Criteria Must have Experience in Architecting Data Analytics Platforms like Cloud Big Data EDW’s Must have experience in Data Governance Solutions Metadata Management Data Quality Data more »

Snr. Director | Boutique Technology Consultancy | Data Science & AI Unique opportunity within an impact focused consultancy, helping to shape and lead the Data Science and AI team. I am currently supporting an executive led, boutique consultancy in building out their Data Science and AI team. The company operates … as an extension of C-level and Board, helping to drive critical digital and data change and transformation. Your peers will be former Chief Data Officers and Partners with extensive hands on experience driving large scale analytics transformation. Successful candidates will be hands on, able to apply hands … on skills in coding and modelling and be able to lead small teams of machine learning and AI experts. You will leverage data science to design high performing solutions that solve complex business problems. Extensive experience within Data Science, operating in a senior leadership position or able to more »

service, partner with Deutsche Bank to support contingent recruitment processes. Job description - the role On behalf of Deutsche Bank, we are looking for a Data Governance Analyst for an initial 6 month contract based in the Banks London Office on a hybrid working model of 3 days per week … tasks. 'Together we're sharing new perspectives and transforming what it means to be a bank.' Purpose of the role: Transaction Monitoring & Screening Global Data Steward Office is responsible for Data Governance, Data Quality Management (DQM) & Data Programme delivery covering key functions within Transaction Monitoring and … Screening. Working as part of the DQM team the Senior Data Analyst will be responsible for supporting the Data Quality Management Framework and for contributing towards the central Data Analytics capability. Data Quality Management Framework covers Data Quality Standards, Data lineage & Controls, Exception & DQ more »

Location : London, Must have SC Clearance Certificate Mode: Hybrid Salary: Competitive Overview: We are seeking a talented Data Engineer with expertise in Azure to join our team. The ideal candidate will be responsible for developing data pipelines, building and maintaining data warehouses and data lakes, implementing … data integration and transformation solutions, ensuring data quality and integrity, and optimizing data performance. Responsibilities: Develop data pipelines for ETL/ELT (Extract, Transform, Load) processes using Azure technologies. Build and maintain scalable and efficient data warehouses and data lakes on Azure platforms. Implement … data integration and transformation solutions to enable seamless data flow across systems and applications. Ensure data quality and integrity by implementing data validation and cleansing processes. Perform performance tuning and optimization of data pipelines and storage solutions to enhance efficiency and reduce latency. Requirements: Bachelor more »

a not-for-profit organisation focused on developing the blockchain/DLT ecosystem. Due to ongoing growth they are now looking for an experienced Data Engineer to join their team. This role is pivotal in managing, curating, optimising, and securing datasets specifically related to cryptocurrency discussions across various platforms. … The ideal candidate will be adept in web scraping, data quality assurance using AI, data integration, ensuring data security and compliance, and maintaining detailed documentation. Blockchain experience is not needed but a solid background with Python, AWS and web scraping is a must. Role and Responsibilities Data Collection: Identify relevant chat sources, groups, and forums on platforms discussing particular topics. Maintain and develop web scraping tools or APIs for periodic data extraction. Data Quality Assurance: Develop and implement AI-based procedures for quality control of data and data sources to eliminate inaccuracies more »

and brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Data Engineer role sits within the Engineering team of the Data Services department responsible for all data applications across the company’s divisions globally from Big Data, Data Warehousing, Business Intelligence, Analytics and Data Science. Develop and optimise large-scale data pipelines that ingest data from a variety of sources Work in a dynamic and exciting agile team with a highly skilled team of Data Engineers from other disciplines to design and develop innovative data-driven solutions Comfortable with more »

Data Architect Role Expectations o Define all architecture patterns Data Mesh Data Fabric EventHub etc o Define each architecture pattern Data Analytics Platform Functional Blueprint Logical Layers and Each layer Capabilities o Identify All Ingestion Patterns Real Time Batch Structured Unstructured Images PDF for each data analytics platform o Analyze existing Data Analytics Platform Architecture Playbook Identify Gaps and Enrich Playbook o Guided Tooling Framework Scorecard based approach o Potential Engineering Frameworks Structured Semi Structure o Define Intake Frameworks Unstructured – OCR Intake o Data Governance Capabilities Framework Integration with rest of Ecosystems o … Design Recommend Data Traceability Lineage DQ Reconciliation and Observability Platform o Understanding of Cloud GCP AWS Services Offering o Deep Understanding of Banking Regulations and solution required to adopt them in Hybrid Cloud Ecosystem o Data Analytics Platform Governance FinOps Regulatory o Conduct MVP POC Qualifying Criteria o more »

Data Engineer – London - £85,000 Description Are you passionate about data engineering and looking for an exciting opportunity in the retail industry? I am seeking a skilled Data Engineer to join my clients team and play a pivotal role in their data-driven decision-making process. … As a Data Engineer, you will work closely with data scientists, analysts, and other stakeholders to design, develop, and maintain data infrastructure. Your expertise will contribute to improving data pipelines, optimizing data flows, and ensuring data quality and consistency. Responsibilities Design and implement scalable … data solutions to collect, process, and analyze large volumes of data Collaborate with cross-functional teams to identify and define data requirements Develop and maintain data pipelines and ETL processes Manage data integration from various sources to ensure data consistency and accuracy Design and more »

Power BI developer 6 months contract – Competitive market rates – Inside IR35 - London – 3 days on-site Key Skills: Python, Power BI, SQL, Experience with Big Data pipelines, DAX, Excel, Financial services background The Role: A global trading organisation is looking a Python/Power BI to join their … Data and Business Service team to become accountable for detailed design and delivering solutions. This person will be working with the business helping to build Apps using Python and Power BI for the output dashboards. Key Responsibilities: Develop and construct data pipelines to facilitate efficient extraction, transformation, and … loading of data from diverse sources. Create and implement Business Information Access portals, comprising dashboards and reports, utilizing PowerBI. Collaborate with business stakeholders to comprehend the Data Virtualization layer, ensuring continued deployment and enhancements. Innovate existing solutions and forecast future demands to meet evolving business needs. Develop analytics more »

Big Data Architect - Hybrid - £110K My client is a global telecommunications company that are looking to add a talented Big Data Architect. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives. You'll … implementation to improve operational management, scalability, and extensibility. The following skills/experience is essential: -Proven experience as an Architect and excellent knowledge of Big Data -Great understanding of Cloud e.g. Azure and or AWS -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark … etc -Excellent experience of ETL, data warehousing and handling a variety of data types -Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI) -Experience implementing data visualisation and reporting tools -Excellent communication and business-facing skills more »

Data Models Lead - Data Engineering - MarTech R83188 Mars is a family-owned business with more than $35 billion in global sales. We produce some of the world’s best-loved brands: M&M’s®, SNICKERS®, TWIX®, MILKY WAY®, DOVE®, PEDIGREE®, ROYAL CANIN®, WHISKAS®, EXTRA®, ORBIT®, 5™, SKITTLES®, BEN … Principles – Quality, Responsibility, Mutuality, Efficiency and Freedom – inspire our 130,000 Associates to act daily towards creating the world we want tomorrow. Role Profile Data and Analytics is foundational to our Petcare OGSM and will drive our transformation to a business that is powered by data. To deliver on … OR equivalent demonstrated through work experience. Nice to have – Masters/Degree with some computing, scientific, statistical or mathematical component. Extensive experience working with data, data models, and data systems in support of marketing technology (MarTech), e.g. CMS, CDPs, identity resolution/SSO Extensive experience using MarTech more »

Al prompt generation process Designs, develops, and deploys solutions using ML/Al algorithms • Tests the solutions and applies refinements • Collaborates with members of data teams to support investigation across a variety of topics • Conducts exploratory analysis with GenAl to generate solutions & insights, using domain knowledge • Analyzes data to find deep relations within data to be used in the ML algorithms when relevant Responsibilities • Supports model, application and data maintenance • Understands complex data sets, identifies patterns, builds predictive models, and makes data-driven decisions 5+ years of experience in data science/… prompt engineering or similor roles Expertise in data handling, and data governance setup within the organization Business: financial management, business analysis, metrics reporting, spreadsheet software • Data & analytics: Data Reporting, Visualization & Dashboarding Tools Data Cleansing, Data Curation, Data Harmonizing & Packaging Qualifications Descriptive & Diagnostic Analytics more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture: Spearhead the design … and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable and robust … data hub. Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices. Data Integration and Storage Solutions: Implement data storage solutions and manage large-scale processing systems, overseeing the integration more »

investment management firm that utilizes long-short equities, long-only, fixed income and commodities futures strategies across its funds seek to add a experienced Data Engineer Risk Developer. They have deep expertise in trading, technology and operations and attribute their success to rigorous scientific research. As a technology and … data - driven firm, they design and build their own cutting - edge systems, from high- performance trading platforms to large- scale data analysis and compute farms. The group manages the lifecycle of data used by investment for trading, backtesting and research. Working with quants and tech teams to … integrate, process and serve data from vendors and public sources in the firm's data infrastructure (alpha data and cross-asset referential data). Currently seeking new data developers to join their growing teams. You will be part of a learning culture, where teamwork and more »

A global technology consulting and digital solutions client of ours is looking for a Data Architect to join their growing team in the UK. Below are more details of the position - Ideal Qualifications Must have 12 Experience in Architecting Data Analytics Platforms like Cloud Big Data EDW’s Must have 5 years in Data Governance Solutions Metadata Management Data Quality Data Lineage Data Catalogue Must have 5 solution experience in Reporting Visulization Platform Modernization Canned Self Service and Real Time Reporting Must have 3 Experience in Cloud Migration Solution Proposals includes … Migration Strategy FinOps Cloud Governance Must Have strong understanding of Banking Regulations their applicability for Data Analytics Platforms Must have 8 years’ Experience with Relational Databases like Oracle NoSQL Databases and or Big Data technologies e g Oracle SQL Server Postgres Spark Hadoop other Open Source Must more »

Data Engineer 6 Month Contract Inside IR35 £450/day Hiring Immediately Job Description (Apache Iceberg, Spark, Big Data) Job Details Overview: Overall IT experience of 5+ years of total experience with strong programming skills Excellent skill in Apache Iceberg, Spark, Big Data 3+ years … of Big Data project development experience Hands on experience in working areas like Apache Iceberg & Spark, Hadoop, Hive Must have knowledge in any Database Ex: Postgres, Oracle, MongoDB Excellent in SDLC Processes and DevOps knowledge (Jira, Jenkins pipeline) Working in Agile POD and with team collaboration Ability to more »

Find your magic with us Connecting people to their family stories is special. We’re proud to deliver these magic moments. Through technology, data and insights, we bring people closer to their past, to benefit their future. We’re a fast-growing team of smart people, on a mission … Enjoy the agility of a scale-up with the security of real financial backing, in a place where every story matters. Why join our Data Science and Insights team? We’re driven by the desire to create a fantastic customer experience We love nothing more than taking big data and extracting as much insight as possible We’re naturally collaborative and work closely with every other team within the company We’re neatly set up for flexible working and giving people the freedom to thrive. We’re a supportive bunch and actively attend conferences, have discussion more »

At Ripple, we’re building a world where value moves like information does today. It’s big, it’s bold, and we’re already doing it. Through our crypto solutions for financial institutions, businesses, governments and developers, we are improving the global financial system and creating greater economic fairness … Ripple is growing rapidly and we are looking for a results-oriented and passionate Staff Software Engineer to help create the next generation of data infrastructure built for scale, resilience and reliability. This is a high impact role. You will build real-time data pipelines and a data … lake for valuable internal tools used by leadership, compliance, finance, and product teams to make strategic business decisions. You will be responsible for our Data API that powers public-facing applications used globally to follow the open-source ledger. WHAT YOU WILL DO: Build real time data pipelines more »

of our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of … roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and … debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for data more »

be responsible for designing, developing, and maintaining the company's business intelligence solutions. You will collaborate with cross-functional teams to gather requirements, design data models, and create reports and dashboards that provide valuable insights to support business decision-making. Responsibilities: 1. Collaborate with business users and stakeholders to … understand their reporting and data analysis requirements. 2. Design and develop data models, ETL processes, and data integration workflows to extract, transform, and load data from multiple sources into the data warehouse or BI platform. 3. Create and maintain data structures, such as data cubes or data marts, to support efficient and optimized data retrieval for reporting and analysis purposes. 4. Develop and maintain reports, dashboards, and interactive visualizations using BI tools (e.g., Tableau, Power BI, QlikView) to present data in a meaningful and user-friendly manner. 5. Perform data more »

Job Description Data Analyst with Big Data - Canary Wharf Our Client is seeking a Data Analyst for the Data Products team is driving innovations in the Financial Services Sector using Big Data. The Client has a high-calibre, focused and a mission-driven team. … The models we build and the analysis that we derive from financial data matters to crucial cutting-edge business decisions made across the global financial services firms every day and provides insight into real world problems. In this role, you will gain a deep understanding of income and expense … be leveraged to deliver financial wellness tools in the UK market. This role will allow you to partner analytics teams to review and enhance data categorization for key income and expense transactions, develop a specification for both rules based and machine learning driven enhancements to categorization by defining transaction more »

Data Engineer Embark on a Rewarding Journey with MIKI Travel: Where Your Career Takes Flight. At MIKI Travel, our 55+ years of expertise make us a trailblazing wholesale travel provider, curating unforgettable global adventures. As a premier private travel company with a presence in 36 offices, we invite you … Fuel your career with opportunities for growth, powered by values of quality, innovation, and commitment that shape the Miki way. Job Purpose As a Data Engineer you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to enable efficient data ingestion, processing, storage, and … analysis. The ideal candidate will have a strong background in data engineering, including expertise in building and optimizing ETL processes, data warehousing, and working with big data technologies. Main Responsibilities ● Collaborate with business stakeholders to gather and analyse business requirements, translating them into specific data more »

Job Description: Lead Data Engineer Location: Central London (Hybrid: 2 days per week onsite.) £600-£700 Outside Company Description: My Client is a leading financial organisation committed to leveraging cutting-edge technology and data-driven insights to empower stakeholders and drive innovation within the industry. As they continue … to expand their data capabilities, they are seeking a skilled Lead Data Engineer to spearhead the development and implementation of their data platform whilst also advising and consulting on legacy data migrations from on-prem to the cloud to increase carbon neutrality. Role Overview: As a … Lead Data Engineer, you will play a pivotal role in designing, building, and maintaining their data infrastructure while collaborating closely with senior stakeholders across the organisation. Your expertise in Azure, Databricks, Spark, Python, and data modelling will be critical in driving the success of their data more »

include capability development, business intelligence solution delivery, performance and quality management, and maintaining technical expertise. The ideal candidate has extensive experience in Business Intelligence, data modeling, Azure platform, SQL databases, and DevOps practices. Desired skills include stakeholder relationship management, familiarity with big data technologies and Azure cloud … measures. * Detailed working knowledge of one or more market leading business intelligence platforms or tools (PowerBI, Tableau). * Expert knowledge of business intelligence concepts, data visualisation and analytic methods. * Data Engineering: A strong background in data engineering, with thorough understanding of concepts like ETL (Extract, Transform, Load … data cleaning, data structures, and data warehousing. * Azure Data Services: Hands-on experience with Azure data services like Azure SQL Database, Azure Data Factory, Azure Data Lake, and Azure Synapse Analytics. * SQL Database Experience: Proficiency in SQL databases with the ability to write more »