51 to 75 of 290 Permanent Data Engineering Jobs in London

Data Engineer - AI & Cloud Data Engineering Industry : Defence & Security Location: London, Bristol or Manchester Clearance: All applicants must hold UK security clearance to Developed Vetting level (DV) Salary: £55,000 - £75,000 (DOE) (+£15k Benefits Package) As a practitioner in AI & Cloud Data Engineering, you are responsible for bridging the gap between our customers' needs and technical solutions. Your primary responsibilities are building large-scale data pipelines and infrastructure to ingest, transform, and organise raw data into accessible, trusted information assets. In your role, you will be responsible for deliverables and … a consultant will differ based on the focus of the client engagement and your skillset, but could include and may require you to: • Utilize data integration tools and frameworks independently, adhering to standard pipeline authoring procedures. • Implement optimised solutions for complex data integration problems. • Design high-quality software more »

Job Title: Junior Data Engineer Location : London (Anywhere in UK) Pay Rate : £150/Day We are looking to hire a Junior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures on AWS. You will work closely with senior data engineers, data scientists, and other stakeholders to ensure data is accessible, reliable, and ready for analysis. Key Responsibilities: Data Pipeline Development : Design, build, and maintain data pipelines to ingest, transform, and load data from various sources into AWS data storage solutions. Data Integration : Implement ETL (Extract, Transform, Load) processes using AWS services such as AWS Glue, AWS Lambda, and AWS Data Pipeline. Data Storage Management : Manage and optimize data storage solutions, including Amazon S3, Amazon Redshift, and AWS RDS. Data Quality and Validation : Ensure data quality more »

located in London, is in search of a highly skilled Principal Consultant. This role is ideal for a seasoned professional with extensive experience in data engineering and a passion for leading transformational projects. The firm prides itself on delivering innovative solutions that drive business success across a wide … array of industries. As a Principal Consultant, you will lead and oversee complex data engineering projects, ensuring the delivery of high-quality solutions that meet and exceed client expectations. You will utilize your expertise in ETL pipelines, AWS, and Python to guide projects from inception to completion. Additionally … a pivotal role in business development, client management, and mentoring junior consultants. Key Responsibilities: Lead the design and implementation of robust ETL pipelines and data architectures. Oversee the deployment and optimization of AWS-based data solutions. Develop advanced Python scripts for data processing and analysis. Manage client more »

Senior Data Engineer £65,000 - £75,000 + 10% Bonus London based - Hybrid working A consultancy at the heart of ground-breaking innovation and transformative solutions where expertise meets ambition. With a focus on collaborative brilliance shaping industries and propelling client towards their full potential whilst driving meaningful change … is seeking to add a Senior Data Engineer to the team based in London. Requirements of a Senior Data Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Proficiency in the design and deployment of production data pipelines, involving languages like Java, Python, Scala, Spark, and SQL. You should also have some more »

Principal Data Engineer £80,000 - £103,000 + 15% Bonus London based - Hybrid working A consultancy at the heart of ground-breaking innovation and transformative solutions where expertise meets ambition. With a focus on collaborative brilliance shaping industries and propelling client towards their full potential whilst driving meaningful change … is seeking to add a Principal Data Engineer to the team based in London. Requirements of a Principal Data Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Proficiency in the design and deployment of production data pipelines, involving languages like Java, Python, Scala, Spark, and SQL. You should also have some more »

Digital Intelligence is home to 4,500 digital, cyber and intelligence experts. We work collaboratively across 10 countries to collect, connect and understand complex data, so that governments, nation states, armed forces and commercial businesses can unlock digital advantage in the most demanding environments. We are looking for experienced … Data Engineers to join our team following continuous growth and success. As a Data Engineer you will be involved in: Design, develop, test and support data collection, data integration and ETL applications to make information and data available to key client stakeholders and technical interfaces … Model data requirements, data sources and data flows to bring order and structure to programmes of work Defining how and where data is created, mastered and destroyed to ensure proper control over the lifecycle of corporate data assets Using categories of products that can be more »

and a more sophisticated experience from their energy suppliers. Against this backdrop, Wipro is enabling electric, gas and water utilities to leverage digital and data capabilities to reinvent themselves, streamline and accelerate business performance, deliver a superior customer experience, and help them transition to a low carbon, decentralized, federated … Utilities domain & consulting team in UK collaborating with internal and customer teams consisting of domain experts, customer side Product Owner, Scrum Master, Solution Architect, Data & Integration Architect and Scrum Team members. Duties Develop data architecture and lead the delivery of end-to-end data, integration, reporting solution … for Utilities Systems cloud and hybrid hosting. Analyse business requirements, conduct data & integration impact analysis. Develop enterprise data landscape, conceptual data model and logical data model. Develop physical data modelling and database designs. Design databases to meet and exceed different nonfictional requirements – High availability, zero more »

Head of Data Engineering & Business Intelligence - Private Markets - up to £130k plus package OFS are working with a leading alternative asset management firm based in Central London who are looking to hire a Head of Data Engineering & Business Intelligence. Working within the IT department, this individual … innovative solutions to enhance core business systems and create significant intellectual property. The position holder will also be instrumental in helping establish a leading data and analytics strategy and associated governance processes, and steer functional teams in the direction of reporting self-service and data stewardship for reporting … Qliksense, PowerBI, Tableau). The ability to design and implement effective database models that are optimised for reporting and analysis. A strong background in data engineering, with thorough understanding of concepts like ETL (Extract, Transform, Load), data cleaning, data structures, and data warehousing. Comprehensive understanding more »

Lead Data Engineer/Data Lead/Senior Data Engineer/Lead Data Engineer Lead Data engineer We are searching for a Lead Data Engineer with significant experience in Python, Snowflake, Segment, ELT, SQL (PostgreSQL, MySQL). The client is a world renowned leading … Non-profit organization. Lead Data Engineer/Data Lead/Senior Data Engineer/Lead Data Engineer Responsibilities: Spearhead the advancement of their innovative data strategy. Plan, create, validate, document, and oversee a variety of data migration procedures for transferring data from current … systems to a new data infrastructure. Oversee the entire data lifecycle to ensure usability, facilitating analysis and insights crucial for informing business decisions. Support, mentor and manage a small to midsize team of Data Engineers. Requirements: Solid and comprehensive experience in data engineering positions Expert more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients and … deploy Artificial Intelligence and Machine Learning. Our cloud-based platforms - Axtria DataMax™, Axtria InsightsMax™, Axtria SalesIQ™, and Axtria MarketingIQ™ - enable customers to efficiently manage data, leverage data science to deliver insights for sales and marketing planning and manage end-to-end commercial operations. With customers in over … legacy to be the leaders we produce for the industry. Will you be next? Job Description: We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have 5-7 years of recent experience in data engineering and hold a more »

Job Overview Position: Senior Data Engineer In this role, you will be responsible for storing, processing, modeling, and applying data science to ensure that data and insights are available for data analytics and business intelligence (BI) systems. You must be proficient in data assessment and … profiling, source system analysis, and providing a clear vision for processing and interpreting data to support its end-use. Ideal Candidate Profile The ideal candidate will have a background in Data Engineering or Data Warehousing (Data Engineer/DW Developer) with robust DW development and … ETL/ELT data pipeline experience, along with expert knowledge of SQL. Key Skills - Mandatory Strong data modeling and SQL/database design skills Proficiency in ETL/ELT processes Extensive experience with Python Excellent numerical, analytical, and statistical skills Ability to visualize and present data and more »

Results | Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Finance Analytics technology team, tasked with developing, managing, and optimizing data pipelines within our data ecosystem. The Data Engineer will leverage cutting-edge technology in Snowflake, Python, Informatica, and Azure to improve our data capabilities and support our Finance business partners in their decision-making processes. Key responsibilities include: Design, build, and maintain efficient, reliable data pipelines using ETL and ELT … processes. Ensure the seamless flow and availability of high-quality data across the organisation Use Snowflake for data storage, processing, and analytics. Optimise data structures and queries to support analytics and BI initiatives Develop scripts in Python and SQL to automate data processes, integrate data more »

in 2023. Our mission is to revolutionize how the world learns about people, so people can revolutionize the world. The Role The VP of Data Science and Analytics will be responsible for driving the data strategy and leveraging data to create value across the organization. This role … will identify key areas of opportunity for data and data science within Prolific, focusing on initiatives that bring the most value to the business. The VP will collaborate with stakeholders to create innovative data products using Prolific s unique access to a global pool of verified participants. … What you'll be doing Set and execute the data strategy, both for internal analysis and external products. Identify and prioritize high-impact data science projects, such as ML models to improve data quality/fraud detection, optimizing marketplace efficiency, etc. Foster effective collaboration between the data more »

I am looking for a talented and experienced Full-stack Tech Lead to join an exciting data-driven technical consultancy, who are harnessing the power of data to help businesses make better decisions. This is a fantastic opportunity to be involved in some inspiring Tech for good projects … your code to have a real impact on positive causes then this is the role for you. You will be leading a team of data-orientated technical consultants to develop complex technical solutions. A strong engineering background, experience in a fast-paced environment, great people skills and the … grow into the role you will be expected to take on more leadership responsibilities. Experience needed: Good understanding of system design/architecting Including data engineering and data management. Promoting engineering standards, best practices and testing Experience in building out APIs, Cloud-based ETL pipelines, customer more »

is a not-for-profit organisation focused on developing the blockchain/DLT ecosystem. Due to ongoing growth they are now looking for a Data Engineer to join their team. This role is pivotal in managing, curating, optimising, and securing datasets specifically related to cryptocurrency discussions across various platforms. … The ideal candidate will be adept in web scraping, data quality assurance using AI, data integration, ensuring data security and compliance, and maintaining detailed documentation. Blockchain experience is not needed but a solid background with Python and AWS is a must. Role and Responsibilities Data Collection … Identify relevant chat sources, groups, and forums on platforms discussing particular topics. Maintain and develop web scraping tools or APIs for periodic data extraction. Data Quality Assurance: Develop and implement AI-based procedures for quality control of data and data sources to eliminate inaccuracies and anomalies. more »

roadmap and work with key stakeholders across the firm to prioritise and resource delivery activities in line with business priorities. * Define and implement a Data Governance Framework and associated quality metrics and ensure ownership is unambiguous for all core data sets and systems. * Identify data gaps or … data acquisition needs and ensure they are clearly aligned to business imperatives and priorities. * Work with internal and third-party technology teams to ensure development activity is conducted to the expected level of quality and timeliness, providing constructive feedback and coaching where appropriate. Technical skills required * Detailed working knowledge … of one or more market leading business intelligence platforms or tools (Qliksense, PowerBI, Tableau). * Expert knowledge of business intelligence concepts, data visualisation and analytic methods. * Data Modelling: The ability to design and implement effective database models that are optimised for reporting and analysis. * Extensive track record of more »

Working with a high performing multi strategy hedge fund that are looking to hire into their London team which is made up of data sourcing experts, data scientists, engineers and specialists. Adding an engineer to the team. Mission of this engineer being to deliver financial and alternative datasets … and insights across asset classes to various investment teams across the business. Collaborating with the data sourcing team members, end users, and at times the vendors. Building data pipelines and delivery structures. Responsibilities: Enhancing the existing data platform to capture real time data Collaborate with the … data strategy and sourcing team to define data requirements and design data pipelines and delivery frameworks Act as a subject matter expert on data asset offerings, engaging with both technical and non-technical clients Set up distribution channels such as APIs and FTP Investigate and resolve more »

Senior Data Engineer (AWS) up to 90k London - 2/3 days a week My Client is an exciting scale up focused on the Art world, looking for a Senior Data Engineer to join a team of software engineers, data engineers, data scientists, and analysts. You … will be responsible for designing and constructing reliable data pipelines. You will leverage the most advanced data engineering and Python tools to ensure the most efficiency and effectiveness in your work. Responsibilities: Collaborate with the team to design, test, and implement scalable and secure data pipelines … that meet business needs. Maintain the integrity of data by ensuring good quality. Monitoring pipelines for optimal performance and minimal downtime. Adapt data models to accommodate changing business requirements in collaboration with other teams. Collaborate with other teams Share expertise by mentoring and showing best practices in data more »

We are seeking an experienced Python Data Engineer Consultant to join a leading hedge fund. The ideal candidate should have a proven ability to design and implement data solutions, with expertise in extracting, transforming, and loading (ETL) data from various sources, including websites, PDFs, and Real Time … data streams. Role: Python Data Engineer Client: Leading Hedge Fund Type of role: contract (6 months) Location: London office Rate: up to £1500/day Key Responsibilities: Architect, develop, and optimize data pipelines for extracting, transforming, and loading data from diverse alternative data sources, such … as web scrapes, PDF files, and Real Time data infrastructures. Implement and manage database solutions in SQL Server and various cloud-based environments, ensuring data integrity, efficiency, and accessibility. Build and maintain Real Time data processing systems capable of handling large volumes of data with minimal more »

enable our customers to create value from sustainability-related activities. Job summary: At South Pole, we are on a mission to drive sustainability through data-driven insights. We are navigating a number of system migrations and through this process we want to upgrade our company s data maturity. … The ideal candidate will have some hands-on work experience of data driven design in Datawarehousing and Product development and SaaS configuration and integration. They really excel in broader systems thinking, data management, data driven design and communication. The Data Architect will be responsible for designing … conceptual and logical data models and relationship to operational models. A key requirement is the appreciation of master data, meta data, definitions and data quality and be able to both influence and govern the work of others and also produce designs related to data management. more »

Job summary Join a passionate NHS team helping to shape the future of healthcare. The Health Economics Unit is looking for a Senior Data Engineer to provide vital data and insights, as we support health and care providers in making impactful decisions to improve population health. As a … passionate member of our outstanding team, you will have a range of responsibilities, including: Data extraction and integration Data workflow management Data processing and transformation Data storage and management Quality assurance and governance Data analysis Collaboration and development The Senior Data Engineer will sit … within the Data and Analytics team, led by the Chief Analyst and reporting to the Lead Data Engineer, and working closely across HEU team, with data scientists, analysts, project managers, and health economists. You will also engage with our clients, partners and stakeholders throughout projects, understanding their more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture: Spearhead the design … and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable and robust … data hub. Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices. Data Integration and Storage Solutions: Implement data storage solutions and manage large-scale processing systems, overseeing the integration more »

Results | Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Investments Data, Technology team, tasked with developing, managing, and optimizing data pipelines within our data ecosystem. Reporting to the Investments Data Lead, this role is instrumental in implementing the data strategy that supports front office stakeholders, systems, and clients. The Data Engineer will leverage cutting-edge technology in Snowflake, Python, SQL, and Azure to enhance our data capabilities and support … the investment decision-making process. Key responsibilities include: Design, build, and maintain efficient, reliable data pipelines using ETL and ELT processes. Ensure the seamless flow and availability of high-quality data across the organization. Utilize Snowflake for data storage, processing, and analytics. Optimize data structures and more »

Head of Data Platforms | Power BI | Microsoft | Strategy | London | £65,000 - £75,000 Are you a Senior Data Engineer who is looking for a step up into a Head of Data position, or a Head of Data who is looking for a new greenfield project? If … on… You’ll be joining an education organisation who due to a large amount of growth and acquisitions are looking to build an established Data Engineering function. This is a greenfield project where you will be solely responsible for managing their data capability. This includes BI reporting … and data warehousing. To be successful in this role you will: from a Data Engineering background and be able to build a data warehouse from scratch experience building reports in Power BI/Tableaux good experience with SQL previously helped shape a data function, including more »

We believe in better. And we make it happen. Better content. Better products. And better careers. Working in Tech, Product or Data at Sky is about building the next and the new. From broadband to broadcast, streaming to mobile, SkyQ to Sky Glass, we never stand still. We optimise … ithin the Network Automations and Intelligence team in particular, we have identified a range of pre- and post-graduate level projects covering the broader data analytics space, specifically in the telecommunications context. These projects span data engineering, data science, machine learning, and systems development ; all of … which are areas that interns are expected to actively contribute What you'll do Work closely with network engineers, data scientists, and developers across Sky who will support you in enhancing your knowledge and skill sets. Generate ideas with the team and participate in improvement of existing projects Work more »