1 to 25 of 27 Big Data Jobs in East London

As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation. The Senior Data Engineer will work closely with the data, Architecture, Business Analyst, Data Stewards to integrate and … align requirements, specifications and constraints of each element of the requirement. They will also need to help identify gaps in resources, technology, or capabilities required, and work with the data engineering team to identify and implement solutions where appropriate. Work type: Contract Length: initial 6 months Work structure: hybrid 2 days a week in London. Primary Responsibilities: Integrate data from multiple on prem and cloud sources and systems. Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting. Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare More ❯

and highly skilled Generative AI Architect to lead the design and implementation of advanced AI solutions tailored for professional services. This role requires expertise in AI-driven decision automation , data-driven insights , and scalable architecture to enhance business processes and client outcomes. As a key member of our team, you will architect solutions that learn, reason, and make intelligent … optimize AI algorithms for predictive analytics, recommendation engines, and automation in professional services. Apply machine learning (ML) and deep learning (DL) techniques to enhance decision-making and business intelligence. Data Engineering & Integration Architect robust data pipelines to support AI model training and inference. Implement automated data collection, integration, cleansing, and transformation techniques to ensure high-quality data inputs. Collaborate with data engineering teams to align AI solutions with real-world business applications. AI Model Training, Evaluation & Performance Optimization Train AI models using supervised, unsupervised, and reinforcement learning techniques , refining them based on business insights . Define model performance metrics to ensure AI solutions deliver tangible value. Real-Time AI Applications & System Integration Work alongside software More ❯

Title : Senior Cloud and Data Solution Architect Work Location: London Experience: 15+Years We at Coforge are hiring Senior Cloud and Data Solution Architect professional with the following skillset: Job Summary: We are looking for a skilled Senior Cloud and Data Solution Architect in the UK (based out of London) with a strong delivery and solutions back ground … in Data Analytics and Cloud. The ideal candidate should have expertise in next-gen data technologies such as Microsoft, AWS, GCP, Snowflake, and Databricks. Sales, Delivery, Presales, Solutioning experience is mandatory within Data Analytics alongside with the ability to deliver cloud-based enterprise platforms and data consulting skills is a must. Responsibilities: 16-18+ years … of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache Spark, Beam or equivalent). More ❯

tools for musicians and artists to use to promote their music. At un:hurd music, we've created a music-tech platform that uses proprietary technology to turn music data into stronger promotional campaigns for artists. We've created both mobile and web applications which act as the 'digital marketing companion' for independent artists, facilitating data-led promotional … hire responsible for the software development and technical infrastructure needed to design, train, deploy and scale machine learning models in production environments. You will harness a diverse array of data sources, from streaming services to social media, revolutionizing the way artists promote their music. Our Data Team members are full stack data professionals who independently manage projects … across the complete spectrum, from raw data ingestion to deployment, monitoring, and optimization. While this role emphasizes data engineering and ML deployment, you will have the responsibility of managing projects with autonomy across the full data lifecycle. Responsibilities As an ML Engineer at Un:hurd music, you'll be: MLOps and Model Deployment : Own the deployment, maintenance More ❯

Responsibilities : 16-18+ years of total experience in DWBI, Big Data, Cloud Technologies Implementation experience and hands on experience in either of the 2 Cloud technologies – Azure, AWS, GCP, Snowflake, Databricks Must Have Hands on experience on at least 2 Hyperscalers (GCP/AWS/Azure platforms) and specifically in Big Data processing services (Apache … Spark, Beam or equivalent). In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. Excellent consulting experience and ability to design and build solutions, actively contribute to RfP response. Ability to be a SPOC for all technical discussions … across industry groups. Excellent design experience, with entrepreneurship skills to own and lead solutions for clients. Excellent ETL skills, Data Modeling Skills. Excellent communication skills. Ability to define the monitoring, alerting, deployment strategies for various services. Experience providing solution for resiliency, fail over, monitoring etc. Good to have working knowledge of Jenkins, Terraform, StackDriver or any other DevOps tools. More ❯

We're Hiring: AWS Data Engineer Location: London (2-3 days in office) Experience : 2+ Years Degree: STEM/Business Rate: £225 to 245 a day Umbrella Duration : 6 months contract We're looking for a Data Engineer to help power our innovation engine. You’ll design data models, build scalable ETL pipelines, codify business logic, and … drive data integration across complex systems—structured and unstructured alike. This is your chance to turn raw data into real business value using cutting-edge tech in a collaborative, forward-thinking team. What You’ll Do: Design & implement data models and scalable ETL/ELT pipelines Map data sources, codify business logic, and build data flows Develop data quality solutions & explore new technologies Collaborate with analysts, developers, and business stakeholders What You Bring: 2+ years in data engineering or related roles Bachelor’s in CS, Engineering, Mathematics, Finance, etc. Proficiency in Python, SQL , and one or more: R, Java, Scala Experience with relational/NoSQL databases (e.g., PostgreSQL, MongoDB) Familiarity with big More ❯

Technical Architect - Data Engineering/Azure Contract 6 months Rate £400 per day outside IR35 Location: London Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets. An ecosystem where human imagination is … complex business problems using creative solutions, then we wish to talk with you. As a Lead Architect (Azure), you will work in the Technology team that helps deliver our Data Engineering offerings at large scale to our Fortune clients worldwide. The role is responsible for innovating, building and maintaining technology services. Responsibilities: Be an integral part of large-scale … projects. Qualifications & Experience: A bachelor’s degree in Computer Science or related field with more than 15 years of technology experience Strong experience in System Integration, Application Development or Data-Warehouse projects, across technologies used in the enterprise space. Software development experience using: Object-oriented languages (e.g., Python, PySpark,) and frameworks Stakeholder Management Expertise in relational and dimensional modelling More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Additionally … you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a focus on creating repeatable and reusable components More ❯

The ideal candidate's favourite words are learning, data, scale, and agility. You will leverage your strong collaboration skills and ability to extract valuable insights from highly complex data sets to ask the right questions and find the right answers. Responsibilities Analyze raw data: assessing quality, cleansing, and structuring for downstream processing Design accurate and scalable prediction … business improvements Qualifications Bachelor's degree or equivalent experience in quantitative field (Statistics, Mathematics, Computer Science, Engineering, etc.) At least 1 - 2 years of experience in quantitative analytics or data modelling Deep understanding of predictive modelling, machine-learning, clustering and classification techniques, and algorithms Fluency in a programming language (Python, C,C++, Java, SQL) Familiarity with Big Data More ❯

Our Client We power the future of Marketing and realise business value by applying human creativity to AI, data, and technology. Our expert consultants partner with leading brands to unlock the power of their enterprise data and transform their Marketing capabilities, building sustainable value in a privacy-respectful way. Integrating enterprise technologies, Google’s ecosystem, and our proprietary … solutions to clients' first-party data, we create innovative solutions and unlock the power of AI, delivering tangible ROIs for our clients. Our expert consultants orchestrate Google Marketing and Google Cloud technologies to unlock ultimate AI-powered performance within our client’s organisation. About the Role As one of our Data Engineers, you will be part of a … team responsible for the development and overall delivery of big data platform solutions, automation solutions and data AI Agents. You will be designing and proposing effective combinations of Google Marketing Platform tools (GA4, Campaign Manager 360, Search Ads 360, etc.) and Google Cloud solutions (BigQuery, BQ Sharing (Analytics Hub), Cloud Storage, APIs, Compute Engine, etc.) to address More ❯

For this role, you will be responsible for providing the framework that appropriately replicates the Big Data needs of a company utilizing data. Essential requirements: More than 3 years of presales experience in the design of Big Data and Data analytics solutions according to customer requirements Previous experience with the preparation of high-quality engaging … the offer solution team, solution definition, effort and cost estimation, Past experience in dealing with partners, tools vendors, etc. Business Domain Knowledge More than 5 years of experience in Big Data implementation projects Experience in the definition of Big Data architecture with different tools and environments: Cloud (AWS, Azure and GCP), Cloudera, No-sql databases (Cassandra … Mongo DB), ELK, Kafka, Snowflake, etc. Past experience in Data Engineering and data quality tools (Informatica, Talend, etc.) Previous involvement in working in a Multilanguage and multicultural environment Proactive, tech passionate and highly motivated Desirable requirements: Experience in Data analysis and visualization solutions: Microstrategy, Qlik, PowerBI, Tableau, Looker,... Background in Data Governance and Data More ❯

Data Analyst Hybrid | UK or EU-based | Permanent Curious about how data can transform business strategy? Ready to shape decisions that influence thousands of customers? Want to join a high-performance team where your insights drive impact? If you thrive in a fast-paced, data-rich environment and love turning numbers into stories, this could be the … opportunity you've been waiting for. Discover the Opportunity Our client – a prominent global brand in digital entertainment - is seeking a Data Analyst to join their growing analytics function. This role is ideal for someone who’s passionate about using data to answer big questions, influence marketing strategy, and empower departments across a diverse international business. This … connect insights to actions, and help shape both customer experience and business performance. Why This Role is Great In this role, you’ll have the opportunity to: Translate complex data sets into compelling insights that inform high-level decisions Design and build engaging dashboards and reports using tools like Tableau and Power BI Collaborate closely with marketing, performance, and More ❯

experience within Financial Services (especially in the front and middle office), ideally in consulting or professional services environments, on high-value engagements with tight deadlines for the transformation of big data or real-time platforms. Proven track record delivering complex software transformation projects using agile methods (Scrum, Kanban, Nexus, SAFe, LESS, DSDM) in regulated environments. Technical literacy enabling … you to assess code quality, review pull requests, and gauge team productivity effectively and managing teams of 5-15 developers. Experience with modern technologies and data engineering platforms (Java/.NET, AWS/Azure, microservices, CI/CD pipelines, IaC, kafka, Databricks etc) as well as modern enterprise and integration architectural patterns. Excellent communication, influencing, and negotiation skills, comfortably … stakeholders to ensure successful outcomes. Client-focused, collaborative, and pragmatic approach to solving business problems through technology. Genuine curiosity and continuous learning mindset, staying abreast of emerging software and data technologies. Strong academic background, ideally a 2.1 or above in Computer Science or related fields. Professional technical certifications are advantageous. Benefits: Digiterre is a software and data engineering More ❯

systems (AWS, microservices, IaC) Kubernetes + Terraform expertise in production environments Solid understanding of ML deployment (e.g. PyTorch, TensorFlow, JAX) Frontend skills with React/TypeScript or similar Bonus: big data/real-time analytics/multi-cloud Why Join? Equity with serious upside and rapidly rising valuation — early-stage, high-impact Work at the cutting edge of More ❯

international security across land, sea and air. They are leaders in highly sensitive international protection and continually seek to lead the way for innovation in their domain. About this Big Data Engineer Role As a Big Data Engineer, you will play a crucial role in creating and maintaining systems to support our client’s data science, AI and machine learning workloads. You will be required to work in a collaborative nature with different departments and ensure effective data integration. Why Work as a Big Data Engineer with Our Client? Competitive salary up to £115,000 Flexible working hours Private healthcare Holiday buy and sell Career development Performance bonus What is Expected … of you as a Big Data Engineer with Our Client? You will need to hold current eDV or UKIC security vetting A minimum of 5 years of experience of working with Big Data as a Data Engineer Excellent communication skills and the ability to work in a collaborative nature with the wider team and explain More ❯

Our solutions help our customers solve difficult problems in the areas of Anti-Money Laundering/Counter Terrorist Financing, Identity Authentication & Verification, Fraud and Credit Risk mitigation and Customer Data Management. You can learn more about LexisNexis Risk at the link below, risk.lexisnexis.com About the team: You will be leading and coaching a team of early career data analysts to use global data from the largest, real-time fraud detection platform to craft solutions for our enterprise customers and deliver against strategic projects. About the role : Your experience with data analysis, fraud and technology will lead to immediate real-world impact in the form of lower customer friction, reduced fraud losses and as a result … Alongside management duties you will lead by example and retain a 40% hands-on component in this customer-facing role. You will promote and maximise the value of our data by collaborating with engagement managers and external business leaders. The comprehensive solutions that you and your team build will go head-to-head against some of the most motivated More ❯

We’re hiring: Data Engineer | Cloud-first | SQL + Python | AWS At Reward, data is at the core of everything we do — from powering real-time insights to driving smarter customer loyalty. As we scale globally, we’re on the lookout for a curious, driven Data Engineer to help us shape the future of our data platform. What you’ll be doing: Building and optimising data pipelines in a cloud-first environment (AWS) Collaborating with business stakeholders (tech & non-tech) to deliver smart, scalable reporting and data solutions Migrating and modernising ETL processes and data warehouses for reporting and monetisation Creating well-documented, efficient code in SQL and Python Implementing QA processes … and supporting the business with both regular and ad hoc data deliverables Tech you’ll work with: SQL Server (SSIS, SSRS, SSAS) Python AWS stack – Glue, Lambda, S3, EC2, Jupyter Power BI or Tableau (bonus) Excel (PowerPivot, VBA, lookups, advanced formulas) You’ll also: Collaborate closely with our Data Engineers and Product Owner Own your solutions end-to More ❯

Data Engineer – Crypto Client, London, Hybrid, £Competitive We're hiring on behalf of a leading crypto client for an experienced Data Engineer to join their fast-growing team in London. This is an exciting opportunity to work on cutting-edge blockchain data infrastructure in a highly dynamic environment. What We're Looking For: 5+ years of engineering … experience Strong expertise in data engineering: – Proficient in Python , Spark – Advanced SQL skills Proven experience with data ingestion pipelines Hands-on with cloud platforms – ideally AWS Solid experience working with Big Data and time series databases You’ll be part of a team shaping the future of decentralized finance through robust, scalable data systems. Apply More ❯

Data Security Operations Engineer - Permission Operations Location: London/Hong Kong/Beijing Responsibilities and Goals: Permission Lifecycle Management: Lead the design, implementation, and continuous optimization of enterprise-level permission policies, establish policy iteration mechanisms, and ensure compliance with security standards such as ISO 27001 and business requirements. Security Risk Monitoring and Response: Use tools such as SQL/… Python to analyze user behavior and permission log data, build real-time monitoring systems, develop emergency response procedures for security incidents related to permissions, and drive automation in incident resolution. Cross-Departmental Governance: Collaborate with product, R&D, and business departments, lead the technical upgrades of permission management modules (such as RBAC, TBAC, ABAC model optimization), and promote the … validating policy effectiveness through A/B testing). Cutting-Edge Technology Research: Track emerging technologies such as Zero Trust and AI-driven permissions, explore their application in DevSecOps, big data platforms, and other scenarios. Requirements: Bachelor’s degree or above in Network Security, Computer Science, or related fields. Possess offensive and defensive thinking with an understanding of More ❯

with occasional in-person attendance at the office as needed Employment Type : Part-time About Tredence: Tredence is a global analytics services and solutions company. Our capabilities range from Data Visualization, Data Management to Advanced analytics, Big Data and Machine Learning. Our uniqueness is in bringing the right mix of technology and business analytics to create … solutions that are transitioned to our clients at the end of the engagement. We do this cost effectively using a global execution model leveraging our clients' existing technology and data assets. We also come in with strong IP and pre-built analytics solutions in data mining, business intelligence and Big Data. Job Responsibility: · Responsible for HR operations … reason Tredence is one of the fastest-growing private companies globally. Join us, and you'll collaborate with some of the brightest, most collaborative, and driven professionals in the data analytics space. You’ll work with cutting-edge technologies and engage directly with senior stakeholders at some of the world’s most innovative and influential companies. We offer a More ❯

across global liquid markets (including Equities, FX, Fixed Income, Commodities, and vanilla Derivatives (Futures and Options)). They now seek an experienced Technical Business, with a background as a Data Engineer, Software Developer/Engineer, skilled in both Python and SQL. Indicative Package Basic Salary ~£120k-£160k Based on density of skills and knowledge across Project/Product Management … Quant Research, Trading, and Risk teams. Full life cycle Business Analysis for Front and Middle office technology projects, for both the Discretionary and Systematic businesses, including the likes of Big Data and ML/DL tech, Low Latency Market Connectivity, Market Data, OMS, Analytics, and Risk solutions. Structure and scope requirements into technical projects. Define the project …/Product Manager role delivering Front &/Middle Office technology projects at a Fund, Prop. Investment Manager, Investment Bank, or FinTech firm. Min. 2 yrs’ prior exp. as a Data/Software Engineer, Technical Architect, Quant Developer Experience and current understanding of Agile and Waterfall style approaches Calm, considered, detailed-orientated and collaborative approach Current understanding of at least More ❯

About the Role We are seeking a highly skilled and commercially minded Data Scientist to spearhead the development of analytical solutions for data driven marketing, leveraging supervised and unsupervised learning techniques to optimise the marketing chain (targeting, bid optimisation, messaging, media preference, text-to-speech). Key Requirements Previous experience as a data scientist in an advertising …/marketing agency Experience with big data platforms (AWS, Aurora, ElasticSearch) Experience with Natural Language Processing & Large Language Models Experience building Data Science tools or Agentic Frameworks Experience in AdTech or data-driven marketing Experience with scikit-learn or keras, pandas, and numpy Expert understanding of SQL & Python programming More ❯

customers flexibility and choice in price discovery, execution, and processing of their transactions, through voice, hybrid, or fully electronic brokerage options. In addition, our BGC Trader and BGC Market Data platforms offer financial technology solutions, market data and analytics related to financial instruments and markets. Company Values: Act with Integrity - Work with Commitment - Create Opportunity Team Role and … management and business planners. We also supply key presentations of this information along with easy-to-follow flow charts mapping the business practices as a group. Key Skills Required Big Data Analytics PowerBI/PowerQuery Risk Reporting (KRI/MI) Leadership Critical Thinking Logical Approach Creative Solutions Change Management Collaboration Job Responsibilities: As a key member of the … Reporting: Strong awareness of key risks impacting the firm and ability to assess operational control effectiveness. Planning and organizing weekly risk reports for Operations Senior Management. Preparing metrics and data for operations risk and regulatory requirements, including CMAR, ORCC, and daily management reporting tasks. Communicating any client money breaches or items of risk to Operations Senior Management (OpRed). More ❯

Strategy, Drive Change London | Hybrid | Leadership without line management Are you an engineering leader who still enjoys being close to the tech? We're looking for someone who combines big-picture thinking with hands-on expertise as well as being comfortable shaping architecture across a complex estate while collaborating closely with delivery teams. You’ll work at the heart … What you'll be doing: Leading strategic architecture decisions for a large, distributed environment Influencing across engineering, architecture, and delivery functions Working on cloud-first platforms, distributed systems, and big data challenges Partnering with senior leaders to shape and evolve tech roadmaps Helping drive change without the need for direct people management—though mentoring a small senior team More ❯

Contract, 6 months, Immediate start. £100 per hour. Inside IR35. Project Manager Programmer Manager, Service Delivery Manager, Big Data. Location: London We are recruiting for a PM to join on a contract basis. What You’ll Be Doing: Own and manage operational relationships with key clients Lead service delivery across complex, technical projects Drive service reviews, reporting, and continuous … relationship roadmaps Be the voice of the customer internally and externally ✅ What We’re Looking For: 5+ years in a Service Delivery or similar client-facing role Experience in Data Warehousing, BI, or Cloud technologies Strong communication and stakeholder management skills Highly organized, self-driven, and able to juggle multiple priorities Bonus: Background in technical advisory roles (e.g., TAM … clients—owning relationships, leading service reviews, and ensuring seamless delivery across the implementation lifecycle. You’ll collaborate with senior stakeholders and cross-functional teams to help customers scale their data solutions and unlock the full potential of the software. More ❯