1 to 25 of 122 Big Data Jobs in London

Lead Big Data Engineer Salary: £94,000 DOE Location : London (4 days a week on site) ** MUST HOLD AN ACTIVE DV CLEARANCE ** Benefits: Health care, dental, flexible working, critical illness cover, health assessments and annual incentive programme. As the Lead Big Data Engineer, you will play … a pivotal role in designing, implementing, and maintaining our big data architecture. You will work with the wider teams to ensure seamless data integration Responsibilities: Develop and maintain scripts for automation processes and work flows Conduct thorough testing to ensure seamless integration Data pipeline support by … managing and optimising Utilise detailed knowledge of Linux internals Troubleshooting by diagnosing and resolving technical issues Following network protocols Design scalable big data systems Data pipeline support Hybrid cloud management Implement and support business intelligence and visualisation tools Utilise big data NoSQL engines and platforms more »

Position Summary We are seeking a highly skilled and experienced Senior Data Engineer with a consulting background to join our team. In this role, you will design, build, and optimise scalable data solutions that drive business insights for our clients. You will work with modern cloud technologies, specifically … Azure products, and apply your expertise in SQL, Python, Spark, and Terraform. The ideal candidate has a deep understanding of lakehouse and medallion architecture, data modelling, creating and configuring ETL/ELT pipelines, and securing networks for private connectivity. This role requires a hands-on engineer who can lead … data projects, consult with stakeholders, and deliver high-performance data platforms that meet security, compliance, and business requirements. The Senior Data Engineer has responsibility for the following: Consulting & Stakeholder Collaboration: Work closely with clients and internal teams to gather requirements in technical and pre-sales engagements, define more »

Data Scientist - statistics, physics, mathematics, Computer Science, Engineering, Data Mining, Big Data (Hadoop, Hive, Map Reduce) This is an exceptional job opportunity to work as a Data Scientist on this global analytics team using a number of big data technologies to produce complex … behavioural models, customer uptake product analysis, and new product innovation. Responsibilities: Generate/Review large sets of data through the advanced use of quantitative and statistical analytical techniques. Design, build, and utilise consumer behavioural forecasting models with different sectors of the business to maximise business opportunities. Lead initiatives to … improve the accuracy, availability, granularity, and coverage of company data. Develop an analytic strategy that improves customer and product strategy. Improve and design better data analysis processes for the future. Proactively develop new actionable analyses and insights from large data sets through advanced quantitative statistical techniques. Analyse patterns more »

Permanent Job Alert: Title: Chief Data Architect Location: London Salary: £150,000 Industry: FinTech Contact: Brief Overview: Work for is a leading global investment bank and financial services company, specializing in wealth management, investment banking, asset management, and private equity. With a commitment to innovation and excellence, we provide … tailored financial solutions that meet the diverse needs of our clients. We are looking for a visionary Chief Data Architect to shape our data strategy and drive the evolution of our data infrastructure. JOB Requirements: Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, or a related field. Minimum of 10 years of experience in data architecture, data management, or a related field, with at least 5 years in a leadership role. Proven experience in financial services or investment banking sectors, with deep understanding of financial products, regulatory requirements, and more »

Position: Azure Data Architect Location: Remote Type: 6 Month Contract (Outside IR35) Rate: £550 to £600 Per Day Role: This is a fantastic opportunity to work for a leading Consultancy, my client is currently looking for an experienced Senior Data Architect to act as client architecture lead for … various programmes of work. Data Architect is a multi-disciplinary role, requiring collaboration with a wide range of stakeholders, from developers to C-level executives. You will be responsible for working with customers to influence and shape the end-to-end data management and analytics workstreams, within fast … paced and complex programmes, engaging in a wide variety of data management and analytics activities. Key Responsibilities: Support and influence Data Strategy, and Data Governance Policies and Principles Promote Data Management standards and best practices Support business and data requirements gathering Input and guidance to more »

Job Title: Java Big Data Engineer Location: London Salary: up to £100K depending on experience. Austin Fraser is supporting an innovative and international software company in London who are looking to on board an experienced Java Big Data Engineer on a permanent basis. You will be … joining an established development team and working on their flagship product which is a data platform involving ML techniques. In this role, you will be responsible for designing, developing, and optimizing data pipelines, processing large-scale datasets, and ensuring efficient integration of data with various big data platforms. Your expertise in Java and big data technologies will help with the use of data for critical business insights. Requirements Minimum 5+ years of experience in software engineering with strong expertise in Java and related frameworks. Proven experience with big data more »

Job Description Big Data Scientist - Docklands London Our Client an international organisation is looking to recruit a Big Data Expert with 2 to 5 years expertise as a Big Data Scientist. You will have Natural Language Processing (NLP) knowledge and experience and understand and … analyse large data sets to discover new insights. Working in a multi-disciplinary team within a highly technical and complex environment. Well versed in scalable data mining and machine learning techniques (using computers to improve as well as develop algorithms)Kernel Methods, Deep Learning, Statistical Relational Learning, Ensemble … Methods Model using advanced statistical/mathematical models, predict and segment data to hypothesize/evolve uses cases to monetize data and generate other business value. Translate business needs to technical requirements and implementation. Experience of Big Data technologies/Big Data Analytics. C++ more »

ending September 2022 totaled $12.1 billion. To learn how we can supercharge progress for you, visit https://www.hcltech.com We are hiring for Data Engineer for London ,( Not offering sponsorship) 8+ yrs of experience in IT industry (prefer experience in Banking & Financial Services sector Key skills: Databases (RDBMS … No SQL, open source, proprietary), SQL expertise, StreamSets, Kafka, Big Data Hadoop, Spark, Python, Data on Cloud, Test Management tools (Octane), JIRA Experience in building Data solutions, experience in utilizing and feeding data from data lake. Engineering experience in building data patterns around … data sourcing , data controls, data on cloud, Data privacy, data accessibility, data lineage, meta data management Engineering expertise in implementing Cloud based solutions (public, private) that will require defining new or utilizing existing design patterns. Experience in integrating applications data with enterprise more »

The Head of FP&A will lead financial strategy, planning, and analysis, leveraging Big Data and AI to drive insights and profitability in the leisure and hospitality industry. They will support key property acquisitions and capital investments, ensuring alignment with strategic goals, while developing a strong, data … this role. Job Responsibilities : Strategic Financial Planning & Forecasting : Lead the annual budgeting process, long-term financial planning, and rolling forecasts. Develop financial models utilising big data platforms to support business scenarios and new initiatives. Property Acquisition Underwriting : Lead financial due diligence efforts for potential property acquisitions, and strategic … assessment of value, risk, and return on investment. Partner with property, financial, legal and operational teams to evaluate the financial viability of investments, utilising Big Data and AI-driven predictive models to forecast future cash flows, market trends, and key KPI's. Big Data & AI Integration more »

Are you an experienced Informatica Cloud specialist with Data Engineering skills ? Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ? Its a hybrid working role and you will be based from either their London, Leeds, Manchester or Edinburgh office, typically … platforms, including AWS, Azure, or Google Cloud. ETL Processes: Proven ability in developing optimal and reliable ETL processes ingested from a wide variety of data sources, both structured and unstructured. Data Transformation: Strong skills in data transformation, data cleansing, and data mapping using Informatica Cloud … tools. SQL: Advanced working knowledge in SQL and relational databases (e.g., Microsoft SQL Server, Oracle). Big Data Technologies: Familiarity with big data technologies such as Hadoop, Spark, or Kafka is a plus. Data Warehousing: Experience in data warehousing, including data modeling and more »

Data Engineer eDV Clearance { Defence, MOD } Gloucester Up to £120,000 + Training + Progression + Company Benefits Are you a Data Engineer with enhance developed vetting looking to join on of the worlds most renowned multinational technology businesses where you will be working on some of the … in control of how quickly you progress with access to constant personal and professional development opportunities? On offer is the exciting opportunity form a Data Engineer who currently has enhanced developed vetting to join one of the world's most well known multi national technology business who have consistently … role within this global tech giant as well as a vital role within the UK and Global Defence industry. In this role, the successful Data Engineer will be responsible for data collection and overall data cleansing from a wide range of diverse sources, data exploration and more »

Senior Data Engineer - Python, ETL, AWS - health tech - tech for good, make a positive impact on the world. Highly successful and fast growing organisation. This is a new role and part of the Technology team. The Senior Data Engineer will design, build, maintain, and troubleshoot the systems and … infrastructure that enables the organisation to collect, store, process, and analyse large amounts of data. The Senior Data Engineer is responsible for developing and maintaining the data pipelines that move data from various sources into a centralised data warehouse or data lake, where it can … be used by data analysts, data scientists, and other stakeholders within the organisation. Responsibilities Guiding their internal customers towards a successful technical solution to their data challenges. Communicating with technical and non-technical stakeholders. Developing, testing, and monitoring distributed data processing pipelines. Producing high quality, reproducible more »

Artificial Intelligence Engineer/Data Scientist £50k - £90k dependant on experience, bonus, good benefits. Flexible Working Location opportunity. This role may suit individuals who have previously held the following role titles: Data Engineer, Data Architect, Big Data Consultant, Data Scientist, Data Modeller, Big Data Analyst, AI Engineer. We have been asked to assist in the recruitment of AI Engineer/Data Scientists to join an innovative and growing team within the data practice of this prestigious global technology consulting firm. Our client offers excellence in career growth, professional development … UK security clearance and be fully flexible on working location. The successful engineer will be a key member within a team designing modern analytical data solutions, engaging in the full life cycle of projects. This will be a diverse role, with an exciting variety of work. Key Skills We more »

an exciting time to be joining Onclusive as we continue to be at the forefront of leveraging Large Language Models (LLM), Machine learning, and Big Data Analytics on our billions of online content data points to solve challenging marketing problems. Our Product Manager, Analytics, is an essential … catalyst of Onclusive’s success as a strategic partner to our tens of thousands of companies worldwide. Onclusive’s AI & Data Analytics products improve the velocity and expanding needs of data driven monitoring, decision making and innovation of our SaaS platform users, including PR and communications professionals, investor … relations, social media managers, data analysts, and marketers. About the Role We are looking for a UK (London)-based Product Manager to help drive the next evolution of our SaaS analytics experiences for Onclusive customers. Your mission is to simplify, unify, accelerate, and innovate the end-to-end data more »

Data Modeler- Insurance We are currently hiring for a Data Modeler with Azure Synapse Analytics experience to join one of our Insurance clients on a 6 month contracts. Inside IR35 Remote Responsibilities: Develop, maintain, and optimize semantic data models using Azure Synapse Analytics. Design data models … that integrate data from Azure Data Lake Storage Gen2, Azure SQL databases, and other sources for consumption in Power BI and Synapse SQL pools. Build and maintain dimensional and relational models based on the business requirements. Ensure data model accuracy, scalability, and performance. Use PySpark within Azure … Synapse notebooks to extract, transform, and load (ETL/ELT) data from raw formats (e.g., Delta, Parquet, CSV) stored in ADLS Gen2. Integrate data from Azure SQL databases and other sources into unified data models for analytical use. Implement data transformation pipelines and workflows in PySpark. more »

Data Architect Position Data Architect is required for a European leader in cloud implementation, application development and managed services working within the Banking and Finance industry. We are looking for an experienced Data Architect, with hands-on delivery background and strong stakeholder management. You will work in … Systems (DBMS): Proficiency in various database systems like DB2, Oracle, MySQL, Microsoft SQL Server, PostgreSQL, and NoSQL databases such as MongoDB, Cassandra, or Redis. Data Modelling: Expertise in designing conceptual, logical, and physical data models. Understanding of normalization and denormalization techniques. ETL (Extract, Transform, Load): Knowledge of ETL … processes and tools to integrate data from various sources into a data warehouse or other storage systems. Data Warehousing: Familiarity with data warehousing concepts and technologies, including star and snowflake schema designs. Big Data Technologies: Understanding of big data platforms such as more »

Pensions Data Scientist Home Based Fixed term contract to December 2025 We are seeking a highly skilled and innovative Pension Data Scientist to join our digital team. This role is pivotal in building a comprehensive digital analytical strategy for our core digital pension products. The successful candidate will … utilise their expertise in data science, AI, Gene AI, machine learning, and big data to drive data-informed decisions, optimise product performance, and enhance user experiences. The candidate is expected to build and lead a high-performing Data Science, Generative AI, AI/machine learning … for our digital pension products. Identify key performance indicators (KPIs) and metrics to measure the effectiveness and success of digital initiatives. Design and oversee data collection processes to ensure data accuracy and integrity. Manage large datasets and ensure they are properly stored, cleaned, and accessible for analysis. Conduct more »

themselves. Role Summary We are seeking a talented Power BI developer to join our Business Intelligence team. The ideal candidate will possess both strong data visualisation skills to delight our customers combined with technical expertise in SQL, Power BI, Power Automate and Microsoft Azure with a strong background in … report development, data modelling, data warehousing, strong stakeholder management relationship, good communication and collaboration skills. Role Accountabilities Strategy Design, develop, test and deliver Power BI reports and dashboards that provide insightful and actionable business intelligence in line with agreed architecture and design standards. Collaborate with cross functional stakeholders … to understand business needs and translate business requirements into technical specifications offering data driven solutions. Connect to various data sources, import, and transform data for business intelligence. Develop calculated measures and columns with DAX in Power BI Optimise BI dashboards with a focus on usability, performance, flexibility more »

problems for our clients. Join our engineering teams that build massively scalable software and systems, leverage machine learning alongside financial engineering to continuously turn data into action. Create new businesses, transform finance, and explore a world of opportunity at the speed of markets. As an investment bank, asset manager … our clients achieve their sustainability objectives - from companies, institutional investors, and governments to individuals - each with their own distinct set of sustainability priorities. About Data Engineering Data plays a critical role in every facet of the Goldman Sachs business. The Data Engineering group is at the core … of that offering, focusing on providing the platform, processes, and governance, for enabling the availability of clean, organized, and impactful data to scale, streamline, and empower our core businesses. Our sustainability data team partners across the firm to source, curate and apply innovative data. We strive to provide more »

Overall 8+ years of IT experience with 3+ years in Data related technologies, and expertise of 1+ years in data-related GCP Cloud services and delivered at least 1 project as an architect. Mandatory to have knowledge of Big Data Architecture Patterns and experience in the … delivery of end-to-end Big Data solutions on GCP Cloud. Expert in programming languages like Java/Scala and good to have Python Expert in at least one distributed data processing framework: Spark (Core, Streaming, SQL), Storm or Flink, etc. Expert in Hadoop eco-system with … GCP cloud distribution and worked at least on one or more big data ingestion tools (Sqoop, Flume, NiFI, etc), distributed messaging and ingestion frameworks (Kafka, Pulsar, Pub/Sub, etc) and good to know traditional tools like Informatica, Talend, etc Should have worked on any NoSQL solutions like more »

Principal Consultant - Big Data & Analytics London £35,000.00 Principal Consultant - Big Data & Analytics London based or UK Based Flexible hybrid working model £30k to 40k Basic depending on experience Uncapped bonus scheme OTE = up to 50% of personal billings The role Working with an experienced team … a sense of humour and hunger to do well. You will already have a strong network of digital contacts in relevant markets such as big data, analytics or similar. 360 recruiter and someone who is happy with developing new business opportunities. It would be a bonus if you more »

optimal database performance by analyzing database issues and monitoring database performance. Responsibilities What you will be doing: Governance Manage appropriate levels of access to data and auditing of DBA/Developer activities Assist with development of IGA/PAM solutions for automation of the data access lifecycle (joiners … movers, leavers, access recertification, drift detection) Collaborating on data governance policies, data quality standards and data security measures. Operational Working with developers and SRE’s to diagnose and fix problems in production environments Processing customer GDPR requests for access or deletion of personal data Participating in … Designing and building appropriate monitoring and alerting Developing Terraform and Python code to automate management of backend databases Work closely with development teams and data engineering/warehousing teams to help them design appropriate data models and data flows, and produce database migrations Evaluate and recommend new more »

Data Architect - Microsoft Fabric, Azure, BPSS Up to £540 per day (Inside IR35) Location: London/Remote (once or twice a week on site) Duration: Up to 3 months (with view to extend) My client is looking for a Microsoft Fabric Data Architect to work on a business … critical programme ASAP. Key Requirements: Proven experience as a MS Fabric Data Architect Comfortable developing and implementing a delivery plan with key milestones based on requirements Strong working knowledge of Microsoft Fabric core features, including setup, configuration, and use of: Azure Data Lake (OneLake) for Big Data storage Azure Synapse Data Warehouse for database management Azure Synapse Data Engineering and Data Factory for data integration Microsoft Purview (preview for Fabric) for data governance Azure Data Science for analytics and AI workloads Event stream and Data Activator for real-time more »

DATA ENGINEER LONDON BASED £55,000-65,000 PER ANNUM This UK-based Music company are searching for a new Data Engineer, you will be joining their product engineering organisation, and will be responsible for building a new data lake in AWS. You will also be responsible … for building new data pipelines in python. THE COMPANY The company is one of the largest in the UK and helps artists with music licensing. They are currently undergoing a large Data Migration and becoming more data-focused as a company, therefore are looking to expand their … data team. THE ROLE You will be joining a team of 4 data engineers and will report up to the Lead Data Engineer, the team is very hardworking and fast-paced. You will be responsible for implementing best coding practices within the team and will be using more »

heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. You will be … an essential part of this mission, using your technical expertise to demonstrate how our Databricks Data Intelligence Platform can help customers solve their complex data challenges. Reporting to Senior Manager, Field Engineering. The impact you will have: Form successful relationships with clients throughout your assigned territory, providing technical … and business value to Databricks customers in collaboration with Account Executives. Operate as an expert in big data analytics to excite customers about Databricks. Scale best practices in your field and support customers by authoring reference architectures, how-tos, and demo applications. Grow your knowledge and expertise to more »