1 to 25 of 103 Big Data Jobs in London

company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯

offering. Delivering our strategy sustainably is fundamental to achieving our ambition to be a net zero company by 2050 or sooner! About the Role : We are seeking a Senior Data Engineer to join our growing data engineering team. In this role, you will be responsible for designing, building, and optimizing scalable data pipelines and infrastructure that power … analytics, machine learning, and business intelligence across the organization. You will work closely with data scientists, analysts, and platform engineers to ensure robust and efficient data delivery. This is an excellent opportunity for someone who is passionate about data, cloud technologies, and scalable systems, and wants to have a direct impact on data-driven decision-making. … Key Responsibilities: Design, build, and maintain scalable and reliable ETL/ELT data pipelines using Python, PySpark, and SQL. Develop and manage data workflows and orchestration using tools such as Airflow or similar. Optimize data processes for performance, scalability, and cost-efficiency, particularly in cloud environments. Collaborate with data scientists, analysts, and product teams to understand More ❯

Requisition ID 10803 -Posted - Years of Experience (1) - Technology - Where (1) - Job Data Reply is the Reply Group company offering a broad range of analytics and data processing services. We operate across different industries and business functions, working directly with executive level professionals, enabling them to achieve meaningful outcomes through effective use of data. We find that one … of the biggest problems experienced by our clients today is being overwhelmed with the amount of data that they face and not knowing how to leverage it to their advantage. The vast landscape of available technology stacks and models means that choosing the right ones can be a daunting task. Most companies know that their data is valuable … and that they should be making the most out of it to stay competitive, but often don't know where to begin or what to prioritise. At Data Reply, we pride ourselves on helping clients make the right decisions to build their data strategy. With our consultants' expertise, we map the right technologies to meet our clients' business More ❯

relevant skills and experience, we're looking for people who are innovative, commercial and value the work that they do. Our London office is currently looking for a Senior Data Engineer. The Role The Senior Data Engineer will be responsible for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and analysis. They … play a crucial role in building and managing the data pipelines that enable efficient and reliable data integration, transformation, and delivery for all data users across the enterprise. Key Responsibilities Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and load it into the appropriate data storage systems Collaborates with data scientists and analysts to optimize models and algorithms for data quality, security, and governance Integrates data from different sources, including databases, data warehouses, APIs, and external systems Ensures data consistency and integrity during the integration process, performing data validation and cleaning as needed Transforms raw data into More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver data … implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large, distributed mission critical applications as an architect. Proven experience as architect and engineering lead … in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms which involves Cloud & related technologies Keeps track of industry trends and incorporates new concepts Advanced understanding of AI concepts , LLMS, RAG, Agentic apps Advance Understanding in Data visualization and Data More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver data … implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large, distributed mission critical applications as an architect. Proven experience as architect and engineering lead … in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms which involves Cloud & related technologies Keeps track of industry trends and incorporates new concepts Advanced understanding of AI concepts , LLMS, RAG, Agentic apps Advance Understanding in Data visualization and Data More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver data … implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large, distributed mission critical applications as an architect. Proven experience as architect and engineering lead … in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms which involves Cloud & related technologies Keeps track of industry trends and incorporates new concepts Advanced understanding of AI concepts , LLMS, RAG, Agentic apps Advance Understanding in Data visualization and Data More ❯

Senior Data SME - Job Description Experience : 15+ years Experience in all 4 platforms, Business Platform, Technology platform, Enablement platform, Foundation Platform Business Perspective Experience as Principal Arch in leading organizations handling customers effectively. Advanced understanding of Enterprise Architecture principles. Well-versed with the end to end data management philosophies and governance processes fit to business. Deliver data … implement cloud strategies that align with business goals Participating in architectural discussions and decision-making processes to ensure alignment with business goals and best practices Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Technology Perspective Worked in multiple large, distributed mission critical applications as an architect. Proven experience as architect and engineering lead … in Data & Analytics stream. In-depth understanding of data structure principles and data platforms Used Architecture tools for modelling. Working experience on Modern data platforms which involves Cloud & related technologies Keeps track of industry trends and incorporates new concepts Advanced understanding of AI concepts , LLMS, RAG, Agentic apps Advance Understanding in Data visualization and Data More ❯

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing … overseeing a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. You will collaborate with stakeholders to understand their strategic … objectives and identify opportunities to leverage data and data quality. You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems. You will collaborate with data More ❯

Data Scientist page is loaded Data Scientisttime type: Full timeposted on: Posted Todayjob requisition id: R Real-world evidence Data Scientist Data Standardization and Analytics, Real-World Solutions (RWS) IQVIA has adopted OMOP/OHDSI as a systematic and standardized approach to real-workd evidence (RWE). Data are converted into the OMOP Common Data … can be separated, both physically as well as logically, creating the opportunity to develop code for purposes of descriptive statistics or hypothesis testing in the absence of a direct data access to all data assets being targeted. As a consequence, our team can generate insights across multiple datasets in our collaborators network.The Data Standardization & Analytics team's … mission is to deliver world class and globally scalable projects through: Rapid analytics - to assess study feasibility and availability of data Characterization of patient populations: their demographics, the distribution of their comorbidities, the duration between diagnosis and intervention, treatment patterns etc. Protocol-driven analytics - estimating the association between clinical interventions and their outcomes - benefits and adverse events. Predictive models More ❯

Snr Data Engineer - Global Accounts, Professional Services, AWSI-SDT-APJ-Japan Job ID: Amazon Web Services Japan GK AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and meet … best practices and conduct skills transfer workshops. AWS consultants collaborate with customers and partners to address security and compliance, performance and scale, availability and manageability. They advise customers on data platforms using the full range of AWS services. They also assist with the non-technical change management work on policies, processes and people changes. At AWS, we're looking … hands-on keyboard capacity, technical leadership experience, and ability to learn fast in a fast paced environment. They will focus on customer solutions that enables customers to be a data-first organization. Key job responsibilities Expertise - Collaborate with AWS field sales, pre-sales, training and support teams to help partners and customers learn and use AWS services such as More ❯

Arthur Financial are working with a fast growing and innovative Insurance Broker to hire a Head of Data for a newly created role. The Head of Data will lead the design and implementation of the companies data strategy and roadmap. This will include hiring and developing a team, data governance and adoption of big data and AI tooling. The ultimate goal use data to create market leading services and insights for their clients Responsibilities Ownership of the following areas; Data Model, Data Strategy, Data Governance & Quality, Analytics and Insights, Big Data and AI. Hiring and leading a team of data professional as well as managing outsource providers … Requirements Experience of working in a Head of Data or data leadership role within the Specialty Insurance market Proven track record in designing data functions and bringing business users on a journey of adoption Technical understanding of data tooling including; SQL and Microsoft Azure and familiarity of Python and JavaScript would be advantageous More ❯

generation and science capabilities for ROW Ops. We develop scalable analytics applications, AI/ML products and research models to optimize operation processes. You will work with Product Managers, Data Engineers, Data Scientists, Research Scientists, Applied Scientists and Business Intelligence Engineers using rigorous quantitative approaches to ensure high quality data/science products for our customers around … the world. As a Data Engineer, you will play a crucial role in supporting the team by creating and maintaining the data infrastructure necessary for the advanced analytics and machine learning solutions. Our team solves a broad range of problems that can be scaled across ROW (Rest of the World including countries like India, Australia, Singapore, MENA and … Per Route for $MM savings • Deep Learning models to synthesize attributes of addresses • Abuse detection models to reduce network losses Key job responsibilities 1. Design, develop, and maintain scalable data pipelines to support ML model development and production deployment. 2. Implement and maintain CI/CD pipelines for the data and ML solutions. 3. Collaborate with data More ❯

Job ID: Amazon Web Services Australia Pty Ltd Are you a Senior Cloud Architect with GenAI consulting specialist? Do you have real-time Data Analytics, Data Warehousing, Big Data, Modern Data Strategy, Data Lake, Data Engineering and GenAI experience? Do you have senior stakeholder engagement experience to support pre-sales and deliver consulting … engagements? Do you like to solve the most complex and high scale (billions+ records) data challenges in the world today? Do you like leading teams through high impact projects that use the latest data analytics technologies? Would you like a career path that enables you to progress with the rapid adoption of cloud computing? AWS Professional Services Public … Sector ANZ are hiring a highly technical senior Cloud Architect specialised in Data Analytics and GenAI to collaborate with our customers and partners to derive business value from the latest Data Analytics and GenAI services. Our consultants will develop and deliver proof-of-concept projects, technical workshops and support complex projects. These professional services engagements will focus on More ❯

Who We Are BCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech and market data, with expertise around strategic cost … maintain our professional, supportive and entrepreneurial working culture that we all enjoy. What You'll Do We're looking for a highly skilled Principal Engineer with a passion for data, cloud technologies, and building robust, scalable solutions - who also brings strategic product thinking and cross-functional leadership . In this role, you'll not only lead the design and … implementation of the data infrastructure that powers advanced analytics and data science across our platforms, but also contribute to the strategic direction, roadmap, and execution of data products in collaboration with senior stakeholders. Architect & Build Scalable Data Solutions Collaborate closely with senior product stakeholders to understand data needs and architect end-to-end ingestion pipelines More ❯

Data Analytics Engineer Location: Central London - hybrid working Rate: £500.00 per day inside IR35 Duration: 12 months We are working with a leading global player in the travel industry who are seeking a Data Analytics Engineer to join their data team. This role sits at the intersection of data analysis and data engineeringideal for someone … who enjoys building scalable data solutions while staying close to business impact. The Role As a Data Analytics Engineer , youll design, build, and maintain reliable data pipelinesprimarily using PySpark, SQL, and Python to ensure business teams (analysts, product managers, finance, operations) have access to well-modeled, actionable data. Youll work closely with stakeholders to translate business needs … into technical solutions, ensuring data is trusted, scalable, and production-grade. Unlike pure Data Engineers, youll be closer to the business, shaping analytics-ready datasets. Unlike pure Data Analysts, youll spend more time coding, managing data infrastructure, and ensuring pipeline reliability. Who Were Looking For Data Analytics : Analysts who have strong experience building and maintaining More ❯

What we're all about. It isn't often you get to be part of a tech company that, since 2016, has been innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle serious criminal activity. Now, its potential is virtually limitless. Working at Quantexa isn't just intellectually stimulating. … you to join us. Opportunity Applications is an Engineering function within Quantexa's R&D department that is focused on internally building real-world applications of the Quantexa Platform. Data Engineers are focused on building the data infrastructure and processing capabilities that power Quantexa's platform and applications. This role encompasses two closely related teams working on the … foundational data layer of Quantexa's offerings: Data Engineering Accelerators Developing Quantexa's libraries for cleansing, parsing and standardising data used in entity resolution Finding efficiency/performance improvements through big data testing and building performance tooling Owning best practices in entity resolution and network building Data Feeds Building standardised and reusable code for More ❯

Vendor Manager - ESG Data Location London Business Area Data Ref # Description & Requirements Bloomberg runs on data, and data drives the market. Our Data team acquires and supplies this data to our clients. Teams work collaboratively to collect, analyse, process and publish the data which is the backbone of our iconic Bloomberg Terminal … the data ultimately feeding and moving the financial markets. The Team: Sustainable Finance data is increasingly crucial for our clients - providing deeper intelligence than conventional financial analysis alone. Climate change, regulatory pressures, the importance of human capital, and diversity are just a few critical factors global investors consider to best identify emerging risks and opportunities. At Bloomberg, Sustainable … Finance data is displayed alongside fundamental data, backed by news for context, and used to power a growing suite of Sustainable Finance products. As a team, we are responsible for reporting and enhancing Sustainable Finance -related content for the Bloomberg Terminal and Enterprise products, including company-reported and normalized metrics, key analytical ratios, industry-specific metrics, and proprietary More ❯

Job Title: Data Modeler Role Summary: We are seeking a skilled Data Modeler to design, develop, and maintain enterprise data models that support business intelligence, analytics, and application development initiatives. The role involves working closely with business stakeholders, data architects, and engineering teams to translate business requirements into logical, physical, and conceptual data models, ensuring … data integrity, scalability, and alignment with enterprise standards. Key Responsibilities: Design and implement conceptual, logical, and physical data models to support business and technical requirements. Collaborate with data architects, analysts, and engineers to ensure accurate translation of business needs into data solutions. Maintain data dictionaries, metadata, and documentation for consistency and reusability across the organization. … Optimize data models for performance, scalability, and integration with existing systems. Ensure compliance with data governance, security, and quality standards. Support ETL and data integration processes by providing modeling inputs. Work on relational, dimensional, and NoSQL data modeling depending on project needs. Required Skills & Experience: Strong experience in data modeling concepts (conceptual, logical, physical, dimensional More ❯

Job Title: Data Modeler Role Summary: We are seeking a skilled Data Modeler to design, develop, and maintain enterprise data models that support business intelligence, analytics, and application development initiatives. The role involves working closely with business stakeholders, data architects, and engineering teams to translate business requirements into logical, physical, and conceptual data models, ensuring … data integrity, scalability, and alignment with enterprise standards. Key Responsibilities: Design and implement conceptual, logical, and physical data models to support business and technical requirements. Collaborate with data architects, analysts, and engineers to ensure accurate translation of business needs into data solutions. Maintain data dictionaries, metadata, and documentation for consistency and reusability across the organization. … Optimize data models for performance, scalability, and integration with existing systems. Ensure compliance with data governance, security, and quality standards. Support ETL and data integration processes by providing modeling inputs. Work on relational, dimensional, and NoSQL data modeling depending on project needs. Required Skills & Experience: Strong experience in data modeling concepts (conceptual, logical, physical, dimensional More ❯

Lead Data Scientist LondonPrivate Equity£140,000 - £150,000 + benefits Harnham is working with a tech firm in the Private Equity space and hiring a few positions across Data Science, Machine Learning Engineering and Data Engineering. The company have an impressive founding team and hold a strong reputation within the Data & AI and Private Equity … purpose of creating value. Often working in ambiguous and greenfield environments, you will collaborate with a strong team of technical people across multiple industries to solve complex commercial and data problems, delivering key data science initiatives that drive performance and revenue. In this role you will lead the technical teams that deliver value. The Role - Lead Data Scientist You will be: Working on multiple engagements within portfolio companies across various different industry sectors Delivering key Data Science/AI initiatives that drive value for customers. Shaping how projects are delivered, driving performance and working closely with C-level execs. Providing technical leadership across the business, with a focus on end-to-end machine learning solutions. More ❯

Lead Data Scientist London Private Equity £140,000 - £150,000 + benefits Harnham is working with a tech firm in the Private Equity space and hiring a few positions across Data Science, Machine Learning Engineering and Data Engineering. The company have an impressive founding team and hold a strong reputation within the Data & AI and Private … purpose of creating value. Often working in ambiguous and greenfield environments, you will collaborate with a strong team of technical people across multiple industries to solve complex commercial and data problems, delivering key data science initiatives that drive performance and revenue. In this role you will lead the technical teams that deliver value. The Role - Lead Data Scientist You will be: Working on multiple engagements within portfolio companies across various different industry sectors Delivering key Data Science/AI initiatives that drive value for customers. Shaping how projects are delivered, driving performance and working closely with C-level execs. Providing technical leadership across the business, with a focus on end-to-end machine learning solutions. More ❯

efficiency. Working at GSR is an opportunity to be deeply embedded in every major sector of the cryptocurrency ecosystem. About the role: This role sits within GSR's global Data Engineering team, where you'll contribute to the design and development of scalable data systems that support our trading and business operations. You'll work closely with stakeholders … across the firm to build and maintain pipelines, manage data infrastructure, and ensure data is reliable, accessible, and secure. It's a hands-on engineering position with scope to shape the way data is handled across the business, working with modern tools in a fast-moving, high-performance environment. Your responsibilities may include: Build and maintain scalable … efficient ETL/ELT pipelines for both real-time and batch processing. Integrate data from APIs, streaming platforms, and legacy systems, with a focus on data quality and reliability. Design and manage data storage solutions, including databases, warehouses, and lakes. Leverage cloud-native services and distributed processing tools (e.g., Apache Flink, AWS Batch) to support large-scale More ❯

to be successful in this role. The team has a mix of experience levels, and we're building an environment that celebrates knowledge sharing and mentorship. Our senior engineers, data scientists, and managers truly enjoy mentoring junior engineers, data scientists, and engineers from non-traditional backgrounds through one-on-one mentoring and thorough, but kind, code reviews. About … and/or incident response in the context of large organisations In-depth understanding of security threats, hands-on experience detecting and defending from cyber attacks, and experience using big data analytics and orchestration to address security challenges. Ability to develop code with at least one modern language such as Java, Go, TypeScript, Python, Rust and security code … improve their skills and effectiveness PREFERRED QUALIFICATIONS BS or MS in a STEM related field. Understanding of the Mitre ATT&CK framework and knowledge of host and network telemetry data (e.g., process lists, application logs, NetFlow) Have awareness and understanding of current cyber security threats, actors and their techniques. Experience with data science, big data analytics More ❯

Responsibilities and Impact You will enable S&P ratings business to provide best in class end-to-end analytical, commercial and customer experience by building feature rich solutions including big data engineering, analytics, business intelligence and workflow capabilities. The ideal candidate thrives in a highly technical role and will design and develop software using cutting edge technologies consisting … of web applications, data pipelines, big data, machine learning and multi-cloud. Active participation in all scrum ceremonies, follow AGILE best practices effectively. Play a key role in the development team to build high-quality, high-performance, scalable code. Document and demonstrate solutions using technical design docs, diagrams, and stubbed code. Collaborate effectively with technical and non … expected observations and seek out new levels of understanding so that we can help companies, governments and individuals make an impact on tomorrow. At S&P Global we transform data into Essential Intelligence, pinpointing risks and opening possibilities. We Accelerate Progress. Our People: We're more than 35,000 strong worldwide-so we're able to understand nuances while More ❯