26 to 50 of 113 Permanent Big Data Jobs in London

Position: Head of Data Engineering Overview: As the Head of Data Engineering for a scale up Digital Lender, you will play a critical role in designing, developing, and managing the data infrastructure that powers the digital platform. This position requires strong technical expertise in data engineering … AWS services, and financial data processing. You will lead a team of data engineers to ensure the efficient extraction, transformation, and loading of financial data into their analytics and decision-making systems. Responsibilities: Architectural Design: Design and architect scalable, efficient, and reliable ETL pipelines on AWS, ensuring … high performance and low latency data processing. AWS Service Utilisation: Utilise various AWS services such as S3, Glue, EMR, Athena, Redshift, and Lambda to build end-to-end data pipelines that meet business requirements and compliance standards. Team Leadership: Lead and mentor a team of data engineers more »

Find your magic with us Connecting people to their family stories is special. We’re proud to deliver these magic moments. Through technology, data and insights, we bring people closer to their past, to benefit their future. We’re a fast-growing team of smart people, on a mission … Enjoy the agility of a scale-up with the security of real financial backing, in a place where every story matters. Why join our Data Science and Insights team? We’re driven by the desire to create a fantastic customer experience We love nothing more than taking big data and extracting as much insight as possible We’re naturally collaborative and work closely with every other team within the company We’re neatly set up for flexible working and giving people the freedom to thrive. We’re a supportive bunch and actively attend conferences, have discussion more »

Job Description Data Analyst with Big Data - Canary Wharf Our Client is seeking a Data Analyst for the Data Products team is driving innovations in the Financial Services Sector using Big Data. The Client has a high-calibre, focused and a mission-driven team. … The models we build and the analysis that we derive from financial data matters to crucial cutting-edge business decisions made across the global financial services firms every day and provides insight into real world problems. In this role, you will gain a deep understanding of income and expense … be leveraged to deliver financial wellness tools in the UK market. This role will allow you to partner analytics teams to review and enhance data categorization for key income and expense transactions, develop a specification for both rules based and machine learning driven enhancements to categorization by defining transaction more »

Data Engineer Embark on a Rewarding Journey with MIKI Travel: Where Your Career Takes Flight. At MIKI Travel, our 55+ years of expertise make us a trailblazing wholesale travel provider, curating unforgettable global adventures. As a premier private travel company with a presence in 36 offices, we invite you … Fuel your career with opportunities for growth, powered by values of quality, innovation, and commitment that shape the Miki way. Job Purpose As a Data Engineer you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to enable efficient data ingestion, processing, storage, and … analysis. The ideal candidate will have a strong background in data engineering, including expertise in building and optimizing ETL processes, data warehousing, and working with big data technologies. Main Responsibilities ● Collaborate with business stakeholders to gather and analyse business requirements, translating them into specific data more »

Nutshell: We are looking for an Engineering Lead to join our 15-month-old, rapidly growing, psychological AI startup to build B2B analytics and data products that tackle complex questions about human behaviour, and in doing so, tackle some of the most challenging issues of our time. You will … be working closely and collaboratively with our Lead Data Scientist, Lead Front-End Developer, and Lead Behavioural Scientist. Why This Role Is Important to our Work: Our focus is to use cutting-edge data science and behavioural science techniques to answer complex questions about human behaviour. We work … profits, municipalities, strategy consultancies, and businesses to solve business and societal challenges. At our core, we’re a company founded on the premise that data can be used for social good, and we take on as many projects as possible aligned with that mission. Once You Are Here, You more »

Job Description: Lead Data Engineer Location: Central London (Hybrid: 2 days per week onsite.) £600-£700 Outside Company Description: My Client is a leading financial organisation committed to leveraging cutting-edge technology and data-driven insights to empower stakeholders and drive innovation within the industry. As they continue … to expand their data capabilities, they are seeking a skilled Lead Data Engineer to spearhead the development and implementation of their data platform whilst also advising and consulting on legacy data migrations from on-prem to the cloud to increase carbon neutrality. Role Overview: As a … Lead Data Engineer, you will play a pivotal role in designing, building, and maintaining their data infrastructure while collaborating closely with senior stakeholders across the organisation. Your expertise in Azure, Databricks, Spark, Python, and data modelling will be critical in driving the success of their data more »

monitoring solutions and baseline statistics reporting to support the implementation Requirements Individual needs strong Java, SPARK and KAFKA experience. Experience with medium-to-large data pipelines: implementing, testing and deploying Experience with stream processing using Kafka Experience with automated unit and integration testing Experience with Kafka Connect. Champion good … engineering practices and help teams to define and setup frameworks for “Big Data As A Service”. technology strategy and engineering roadmaps around Big Data and execute strategic engineering proof of concepts. Develop monitoring strategies for infrastructure, platforms and applications aligning with enterprise strategy and overall … industry trends. Big Data Technologies such as Hadoop, Spark, Kafka, etc. Hadoop: 5+ years Kafka: 3+ years Spark: 4+ years PySpark: 3+ years more »

Vertex Search is representing a fast-growing financial services firm that is now looking to make a Senior Data Engineering hire, the first role of its kind into the business with huge scope for impact and influence. The nascent data engineering team will collaborate with internal teams around … the business with a focus on data engineering, pipelines, tooling and services. Key Responsibilities: Data Engineering: Design and develop data services across various business functions, including Feed Processing Systems, Trade Processing Systems, Workflow Management, and Customer Operations. Data Pipelines: Design and develop data pipelines for … extracting, transforming, and loading data into appropriate storage systems. Data Tools and Services: Develop data tools and services that empower users to discover, understand, and utilize data effectively. Best Practice: Advise on and contribute to the development & adoption of data governance and management practices. Collaborate more »

GTM functions across EMEA. The company aims to help businesses reduce their carbon footprint by providing an alternative to old-fashioned consultancy. With a data driven alternative they want to help companies to achieve their net zero pledges. Close to announcing Series A funding, the company has immense growth … mindset to thrive in a fast-paced, agile environment where you will be a huge part of the growth! * Experience selling software within the Data Ecosystem - Data Analytics, Data Intelligence, Big Data, Data-warehousing would be an ideal What's next? 👀 If this sounds more »

Insights & Analytics Management Level Associate Job Description & Summary Forensic Technology - Forensic Investigative Analytics Our Forensic Technology team helps clients manage vast amounts of electronic data and navigate the legal and business processes that are mandated by critical events Prevention is even better; knowing where vulnerabilities are and managing the … the following team: Forensic Investigative Analytics In an increasingly digitised world, instances of fraud and electronic crime are becoming more and more common. Forensic Data Analytics involves the analysis of data in order to discover meaningful patterns, measure historic events or predict the likelihood of future ones. Much … of our work requires us to analyse vast quantities of electronic data, using cutting edge technology and advanced statistical techniques to extract meaningful insights for our worldwide clients. As we operate in an environment where speed of response is often critical to our clients, we are constantly innovating and more »

Principal Data Engineer – National Salary Circa £80,000. London Salary Circa £100,000. Do you like working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity for an Engineer Manager with significant experience of managing data pipelines. As well as … being an expert in cloud platform, you’ll have a strong background in Data Ingestion and Integration, designing and implementing ETL pipelines on various technologies, Data Quality monitoring and a rounded understanding of data operations. Aviva believes strongly in experimentation leading to industrialisation and we are searching … individuals who are focussed on using their skills to drive out real business value for our customers. A bit about the job: At Aviva, data serves as the lifeblood that propels our organizations forward, and we are no exception. As a Principal Data Engineer within our esteemed Data more »

Data Engineer with Azure & Power BI Permanent £65-70k + Great Bens Hybrid Flexible Working - London area Talented and experienced Data Engineer/Power BI Developer, strong in both interpersonal communication skills, as well as key technical experience including; strong SQL, Azure Synapse Analytics and Power BI … DAX & PowerQuery). This is a key technical role to join a small dynamic and friendly team, responsible for the data that enables our client to deliver premium entertainment to a Global network of over a billion airline passengers. You will play a crucial part in the continued development … and maintenance of the existing data warehouse solution, including data analysis, integration pipeline creation, SQL JSON querying and reporting using Power BI. The cloud based systems leverage data to support operational activities and inform business decisions. The combination of creativity and technology is at the heart of more »

working alongside our team on a wide variety of projects with a special focus on innovation. You could be working with all types of data (both structured and unstructured) using a variety of software - so we're open to seeing engineers with different technology backgrounds! THE MACHINE LEARNING ENGINEER … SHOULD HAVE…. SC or DV Security Clearance to work on secure projects Demonstratable technical background in Machine Learning/Data Science Experience with programming languages such as Python and R Demonstratable experience developing & delivering Machine Learning strategies Experience with big data ecosystems, cloud infrastructure and analytic … frameworks Techniques and toolkits for data cleansing, data processing and data preparation Any experience with techniques and toolkits for combining data or analysing data streams would be desirable TO BE CONSIDERED…. Please either apply by clicking online or emailing me directly to For further more »

Eames Consulting are looking for Data Engineering Manager to join our dynamic team at a prestigious asset management firm. As a Data Engineering Manager, you will play a crucial role in shaping and overseeing the data infrastructure that supports our business operations. Key Responsibilities: Lead and mentor … a team of talented data engineers, fostering a culture of collaboration and continuous improvement. Develop and execute the data engineering strategy aligned with the organization's business objectives. Collaborate with key stakeholders to understand business requirements and translate them into data solutions. Oversee the design, development, and … maintenance of robust data pipelines to ensure the timely and accurate delivery of data to various stakeholders. Manage and optimize data storage, ensuring scalability and security in compliance with industry standards. Communicate complex technical concepts to non-technical stakeholders, fostering a culture of data-driven decision more »

Job Description Collibra Ranger Data Project Manager - Docklands London We are keen to recruit a Collibra Ranger Certified data Project Manager with at least 1 to 2 years experience of Collibra Ranger. Overall you must have a background in data and data management especially in line … would be a major plus. This is a permanent position based In the Docklands London. This is an exciting and challenging new position working data, Big Data and Collibra. Salary will be in the range £60K - £70K. Please send your CV to us in Word format along more »

Love data as much as we do? Want to influence strategy with data analytics at Amazon? We have the career for you. AMXL Strategy team is looking for a Business Intelligence Manager to help build our BI team to own our reporting, metrics creation, KPI definition and cross … implementing reporting solutions using Amazon cloud technologies. A successful candidate knows and loves working with business intelligence tools, is comfortable accessing and working with big data from multiple sources, and passionately partners with the business to identify strategic opportunities and deliver results. You should have an internal drive … skills, as well as superior written and verbal communication skills. S/he would be a self-starter, comfortable with ambiguity, able to think big (while paying careful attention to detail), and enjoy working in a fast-paced dynamic environment. Key job responsibilities Hire, manage, and coach a team more »

and analytics to the global capital and commodity markets. As a Python Developer you will play a pivotal role in developing and maintaining advanced data processing and analysis solutions. You will collaborate closely with cross-functional teams to design, implement, and optimize Python-based applications, with a particular emphasis … on utilizing Airflow and also pandas for efficient data manipulation and analytics. This role offers an exciting opportunity to contribute to the transformation of their business through the application of innovative technologies. Responsibilities: Develop robust, scalable, and maintainable Python applications tailored to the needs of our insurance operations. Collaborate … with data engineers, data scientists, and business analysts to understand requirements and translate them into technical solutions. Working with Product team to integrate financial products of external clients, manage data flows, source market data and analyse financial algorithms. Utilize Pandas for data processing, transformation, and more »

analytics solutions using the full Microsoft BI stack (SQL Server, SSIS, SSRS, SSAS) Ability to translate business requirements into technical requirements & development experience using data discovery tools such as MS Power BI, QlikView, Tableau Ability to model and transform data, build ETL solutions and present data in … a useful business context Experience developing data warehouses & data marts using the Kimball methodology Experience or awareness of Big Data and Data Science related technologies, such as R or Azure Machine Learning, to design and implement predictive analytics models Excellent communication and problem solving skills more »

purpose of making the world a better and safer place. Element, a well-established organization that touches billions of lives, is searching for a Data Scientist in London (hybrid) to help build a startup within their organization. You will design and train performant models from scratch and create a … drive our product's analytics engine. Operating in an Agile setting, you will be part of a cross functional team, collaborating closely with other Data Scientists, Data Engineers, Software Engineers, Product Owners and UX/UI Designers, to innovate and drive our product to new heights. Core Responsibilities … learning models & design robust analytics engines for high-end digital products Create repeatable, interpretable, dynamic and scalable models that are seamlessly incorporated into analytic data products Document code, results, and details of the approaches in a systematic way to promote knowledge sharing and code re-use Collaborate with other more »

My client is an expanding international company with expertise in high-performance computing and data infrastructure. They are powering and enabling rapid growth across Generative AI, cloud capability and cryptocurrency mining. The current priority is to hire a Program Manager as Head of Change. This pivotal role reports to … Infrastructure as a Service, whilst also having an extensive track record in cryptocurrency mining, they are committed to furthering the green credentials within cloud data centre infrastructure space. The company has a significant presence in North America and Europe, extensive real work physical technology assets and a brand which … Design and execute change management strategies to seamlessly integrate activities across business lines. Foster communication and collaboration for a unified approach to transformational initiatives. Data-Driven Decision Making: Utilize data analytics for informed decision-making, optimizing program performance and resource allocation. Regularly assess program effectiveness and adapt strategies more »

collaborative culture where your voice is valued. Ready to explore a career path? Start your journey. Job Description As a member of Egencia’s Data Engineering group, you will tackle Egencia’s most sophisticated and impactful challenges using cutting-edge data technologies. Working in an agile development mindset … you will contribute to our cloud-based data platform and make sure it scales dynamically and operates reliably. Internal and external clients will use the products you develop to gain in-depth insights into travel programs, financials, and operations. Every day, data scientists will leverage the platform you … code – lots of it. We use Python, Java, Scala, Spark, and SQL. We welcome programmers of all backgrounds as long as you focus on data engineering solutions and attention to quality. Foster and strengthen a deep understanding of vast data sources in the cloud and know precisely how more »

Senior Data Engineer (Snowflake) London - x2 days in office a month as a rough expectation. Xcede is delighted to be recruiting a Senior Data Engineer on behalf of a market leader in the retail and e-commerce space. Our continues to invest in innovation, delivering unparalleled shopping experiences … millions of customers in several formats. As they continue to expand their operations and enhance their digital capabilities, they're seeking an experienced Senior Data Engineer who shares their ambition for well-structured, stable, scalable Data management systems. The Senior Data Engineer should come with a proven … track record in managing large-scale data infrastructures and pipelines that support sophisticated analytics. The ideal candidate will be responsible for designing, building, and maintaining robust data solutions that drive strategic decision-making across multiple business units. This role is for someone who principally still loves to code more »

Title: Senior Data Engineer (Consumer/Digital) Location: Central London (Flexible) Salary: £70-£95k + Bonus HL10778 Permanent Finatal is currently partnered with a high-growth Private Equity fund that has recently closed its third Fund and operates across the globe. With over £500 Million in Assets Under Management … and a strong focus on the consumer sector, they are now looking for their first Data Engineer and Consumer Strategist. This role is crucial for unlocking the full potential of their portfolio by providing a comprehensive understanding of every aspect of customer interaction and driving data-led decision … architectural decisions across the portfolio and internally at the Fund as they embark on their journey to foster growth and success through digital and data strategies. Role: As the first Data Engineer hire you will work closely with the Head of Digital and Head of AI to drive more »

An excellent Data Product company have need of Data Engineers for very Databricks heavy roles to join their team. They specifically like people with Databricks Certifications, but other Cloud Data stack certs (AWS, Azure, GCP etc) are also of interest to them. These roles would support talented … and driven Juniors through Mid-Level Data Engineers who want to continue learning and developing. Salaries between circa £50,000 - £60,000 + excellent benefits including a good bonus and the roles can be fully remote (so long as you are based in the UK). Role Overview: In … continuous delivery and improvement. Your contributions will be crucial in automating tests, enhancing our continuous integration and delivery practices, and maintaining high standards in data processing and analytics. Responsibilities Include: Developing and maintaining robust Databricks notebooks and workflows. Working with Databricks Unity Catalog for Governance related tasks Driving the more »

Cloud Architect/Data Architect Google Cloud/GCP, Machine Learning/Generative AI London Based - New Offices, Refurbed in the Heart of a buzzing area £90k-£120k basic salary + bonus Benefits: 25 days holiday + bank holidays Private Healthcare Discounted Gym Membership (Nuffield + Hussle) Life Insurance … Income Protection, Employee Assistance Program Pension Scheme (max 10%) We are working with an AI/Data Consultancy with core clients within the Retail, Financial Services, Gaming, SaaS sectors. The successful Cloud Architect will work with an array of technologies with clients from several industries & sectors meaning you will … clients, devising innovative solutions to address their needs, defining project parameters, and supervising the execution of these projects. Role of the Cloud Architect/Data Architect: Utilising advanced data processing and cloud technologies effectively to stimulate innovation. Engaging with clients to create top-notch solutions tailored to their more »