1 to 19 of 19 Data Ingestion Jobs in London

Job Title: Data Platform Architect Location: London Contract Details: Fixed Term Contract for 6 months Responsibilities: Design and support the implementation and configuration of our client's new Data Fabric and iPaaS technologies, ensuring scalability, reliability, security, and cost-effectiveness. Collaborate closely with the Data Product Managers … Data Platform Manager, Data Governance and Information Architecture team, Group IT, Security, and other Architects to understand platform requirements and translate them into technical designs and solutions. Integrate Data Fabric (e.g., Apache Trino) and/or iPaaS solutions (e.g., Snaplogic, Boomi, Workato, IBM) with various data … Apply networking and security concepts and best practises, including virtual networks, subnets, firewalls, network security groups, VPN, encryption, authentication, and authorisation. Utilise knowledge of data architecture principles and patterns such as data lake, data warehouse, data mart, data mesh, data pipeline, data catalogue more »

Job description Job Title: Data Engineer Grade: Band 2 Contract type: Permanent Location: London Salary: £61,000 per annum plus civil service pension scheme. Higher ranges may be available for exceptional candidates. Hours: Flexible working and part time hours will be considered. Closing date for applications is 23:59pm … we are not able to sponsor work visas or accept temporary visas as we are looking to hire on a permanent basis. Introduction: The Data Engineer is a role within the NAO's Digital Services (DS) function. With responsibility for the design, delivery and maintenance of robust data analytics solutions, the role looks to ensure optimal performance, scalability and reliability. They will work closely with business stakeholder, data scientists and other digital functions to understand requirements and deliver effective data solutions. The post holder will develop and construct data products and services and integrate more »

this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. A fantastic new opportunity has become available Data Engineer or Data Strategy Consultant with one of our Financial One of the world's leading financial institutions, serving individuals, small- and middle … corporations, and governments with a full range of banking, investment management and other financial and risk management products and services based in Chester. Role : Data Engineer or Data Strategy Consultant Location : Bromley (3 days a week onsite) Duration : 12 Months Rate: Circa £600/Day Experience and Skills … required : Strong proficiency in SQL and Python. Experience with data warehousing and data lakehouse architectures. Expertise in data modelling methodologies (3NF, dimensional, data vault) for enterprise-level data stores. Hands-on experience with SQL and/or PL/SQL. Strong understanding of data more »

Marketing Data Analyst/Data Scientist Digital Advertising 12 month Contract initially Hybrid London 3 days WFH 2. Inside IR35 rate to Umbrella 435pd inclusive of Holiday etc Our Globally recognised brand is looking for a Marketing Data Analyst/Data Scientist with Digital Advertising/… digital marketing insights experience (such as web analytics/mobile App data/advertising platform data, Adobe Analytics, Google analytics etc). You will have a data/data scientist background & will likely have a Postgraduate degree (MS or PhD) in a quantitative field of study. … We are looking for approx 5-7 years professional experience, developing advanced Tableau data visualizations, dashboards and reporting. You will also need strong Python and SQL to develop and maintain custom ETL Processes and be comfortable with Database Modelling and Data warehousing technologies ideally snowflake. This role will more »

Job Title: Deputy Head of Data Systems Department Location: United Kingdom About the Role: We are seeking a talented Deputy Head of the Data Systems Department for a leading organization specializing in data engineering. This role will support the leadership of a department responsible for all aspects … of data management, including ingestion, storage, calculations, and making data accessible to various business units. Key Responsibilities: Assist in leading a team of 40-50 engineers, contributing to the strategic direction of the Data Systems Department. Collaborate with cross-functional teams to ensure data engineering … projects align with business objectives. Drive improvements in data ingestion, storage solutions, and processing methodologies. Facilitate seamless access to data for internal stakeholders, enhancing overall data utilization. Mentor and develop team members, fostering a culture of innovation and excellence. Qualifications: Proven experience in a leadership role more »

New Contract opportunity for a Snowflake Data Engineer to join global asset management company in the UK. Please note: This position is fully remote and requires candidates that are based in the United Kingdom. Snowflake Data Engineer Responsibilities: Data Integration : Configure Fivetran connectors for automated data ingestion into Snowflake. Develop and manage ETL processes for data extraction, transformation, and loading. Data Modelling : Design and maintain Snowflake schema for performance and business needs. Create dbt models to transform raw data into structured formats. Performance Optimization : Monitor and optimize SQL queries for efficient … data retrieval. Manage Snowflake warehouse resources to optimize compute usage and cost. Snowflake Data Engineer Experience: Project Experience: Completed at least two full project lifecycles from start to finish, where Snowflake-oriented solutions were a core component. These projects could include data warehousing, data lakes, or more »

New contract opportunity for a AWS (Redshift) Data Engineer to join global asset management company in the UK. Please note: This position is fully remote and requires candidates that are based in the United Kingdom. AWS (Redshift) Data Engineer Responsibilities: Data Integration: Configure AWS Glue to automate … data ingestion into Amazon Redshift. Develop and manage ETL processes using AWS Glue for data extraction, transformation, and loading. Data Modelling: Design and maintain Amazon Redshift schema for performance and business needs. Use AWS Glue jobs to transform raw data into structured formats. Performance Optimization … Monitor and optimize SQL queries in Amazon Redshift for efficient data retrieval. Manage Amazon Redshift cluster resources to optimize compute usage and cost. AWS (Redshift) Data Engineer Experience: Project Experience: Completed at least two full project lifecycles from start to finish, where Amazon Redshift-oriented solutions were a more »

Lead Data Engineer Compensation: £80,000 - £100,000 Location: West London Overview We're seeking an experienced Data Engineer to lead our Engineering team within our Technology division. This role combines technical leadership with hands-on development work in a fast-paced environment. Key Responsibilities Lead and mentor … a team of data engineers in designing and implementing scalable data pipelines Collaborate with cross-functional teams to gather requirements and design data solutions Develop automated processes for data ingestion, cleansing, and transformation Drive architectural decisions and maintain data engineering best practices Support various … stakeholders including developers, analysts, and data scientists Ensure data delivery architecture remains consistent across projects Technical Requirements Proven experience in data engineering leadership Expert knowledge of ETL/ELT processes Strong background in cloud-based data platform modeling Advanced SQL and relational database expertise Proficiency in more »

Data Engineer | £60-80k + Bonus | Sports tech | Hybrid in London I'm working on with one of our key partners, a global SportTech business on 2 exciting vacancies in the Data Science space! As a business they provide data and analytical and AI services within … a giant in this sector 📈 Recognised as a leader in the space 🏆 Award winning wellbeing model and mental health workplace support Joining as a Data Engineer you'll... - Support in architectecting and optimizing end-to-end data pipelines for ingesting, transforming, and analyzing data using Python and … AWS, ensuring high availability and scalability - Implement robust data processing workflows, leveraging AWS services such as Lambda, Glue, and Step Functions to streamline data ingestion and transformation for downstream analytics - Develop and maintain SQL interfaces for querying and reporting on betting odds, empowering data-driven decision more »

Candidate should have 8 years of relevant experience in ELK S/He should be able to develop/build the required pipeline for data ingestion using Logstash component S/He should have implantation experience in ELK If candidate has just done monitoring of existing ELK setup … exposure to cloud and Kafka Also should have exposure to security domain Strong understanding of elastic - elastic search, Kibana, logstash, Fleet and other integrations Data Engineering skill set to design and develop pipelines to ingest data into Elastic Cloud & Domain aware Candidate will be responsible Building all the … required pipeline for data ingestion Setting up ELK stack Analyzing and sharing insight to stakeholders Marinating the ELK stack more »

Data Product Owner - Central London - £65-£70k Data Product Owner required to join a dynamic team dedicated to leveraging data for impactful decision-making and business success. On behalf of our high-profile client, we're seeking a skilled Data Product Owner to lead the life … cycle of their data products, ensuring optimal performance and alignment with strategic objectives. Key responsibilities: As Data Product Owner you will be responsible for managing the entire life-cycle of data products, ensuring they perform optimally and align with business objectives. This role involves collaborating with cross … functional teams to define the product vision, strategy, and requirements, while overseeing operational processes and maintaining data integrity. Key responsibilities include developing and communicating a clear product strategy, gathering and prioritising requirements, creating and maintaining road-maps, and managing day-to-day operations like data ingestion, processing more »

coupled with at least 2 years experience of Nice Actimize. - Analyzing current installation of Actimize WLF solution at a client side - Recommend improvements on data ingestion and batch process performance - Recommend optimal Threshold setting and Scoring configuration which adhere to the client requirements - Improve detection and alert generation … especially face-to-face with clients. - Must be willing to travel to client site. Nice to have - Experience in DowJones Sanctioned List and Profile data ingestion to WLF The position will be based in Canary Wharf London. Rate will be in the range £275 to £375 per day more »

One of the largest insurance companies in the UK is looking for a Senior Data Scientist with Geospatial experience. They will be looking to grow out this function with you at the forefront, so it's an exciting opportunity with a great progression path. As a Senior Geospatial Data Scientist, you will spearhead the creation of geospatial solutions to address complex challenges across various business functions. Leveraging your expertise in geospatial data analysis, machine learning, and statistical modelling, you will also play a key role in shaping the development of innovative insurance products and services. The Role … derive insights from large-scale geospatial datasets. Collaborate with cross-functional teams to understand business needs and translate them into technical solutions. Perform exploratory data analysis and feature engineering to extract key information from geospatial data. Build, evaluate, and refine predictive machine learning models to improve accuracy and performance. more »

Leading Financial Trading client are looking for a talented and motivated Senior Software Developer to lead on the design and development of a strategic data warehouse for storing Fundamental data. You'll design, implement, and maintain robust, scalable, and efficient ETL pipelines for data ingestion and transformation. … work on a high profile long-term Greenfield programme, on a contract basis. The following skills/experience is essential: Strong Python or Java Data Warehousing Strong ETL SQL Knowledge of DevOps practices Excellent communication skills Up to £750/day Duration: 12 months + Location: London (good work … from home options available) If you are interested in this Senior Software Developer (Java/Python/Data Warehousing) and meet the above requirements please apply immediately. more »

at all levels . The Role - As a Full Stack Engineer, you will design, develop, and maintain a scalable platform that leverages AI and data ingestion to deliver disruptive solutions to the insurance industry. Working closely with the founding team, you will be responsible for both frontend and … and optimize RESTful APIs, backend services, and middleware. Contribute to DevOps processes, implementing CI/CD pipelines for seamless integration and delivery. Work on data-driven features , leveraging AI and automation to continuously improve the system.Participate in code reviews, providing feedback to ensure high standards and best practices. What … start-up or agile environment. Solid React, and backend technologies such as Python and/or Node.js, along with CI/CD toolsKnowledge of data platforms and AI-driven solutions is highly desirable.Experience with cloud platforms (AWS, GCP, Azure) is desirable.Ability to work independently and deliver high-quality solutions more »

Equities, FX, Commodities, and Fixed Income. Developing and refining trading signals, tools, and dashboards using coding and SQL queries. Leading independent research projects, including data ingestion, model development, and presenting results. Skills and experience required: MSc or above in a maths, stats or stem related field. Minimum more »

Equities, FX, Commodities, and Fixed Income. Developing and refining trading signals, tools, and dashboards using coding and SQL queries. Leading independent research projects, including data ingestion, model development, and presenting results. Skills and experience required: MSc or above in a maths, stats or stem related field. Minimum more »

focus on performance improvements and scalability, ensuring they meet the evolving needs of the business. Hands-on Development: Engage in full-stack development, from data ingestion and processing to building high-performance, distributed computing systems. Your work will directly impact the accuracy and efficiency of the firm’s more »

will include, but not be limited to: In the early stages of projects production: Establish quick, efficient and clear pipelines (particularly with regards to data ingestion into Unreal from 3D CAD packages) Prepare coherent documentation for pipelines, tools and procedures; Do benchmarking for the project features through research more »