1 to 25 of 25 Permanent Data Pipeline Jobs in the City of London

Job Overview Position: Senior Data Engineer In this role, you will be responsible for storing, processing, modeling, and applying data science to ensure that data and insights are available for data analytics and business intelligence (BI) systems. You must be proficient in … data assessment and profiling, source system analysis, and providing a clear vision for processing and interpreting data to support its end-use. Ideal Candidate Profile The ideal candidate will have a background in Data … Engineering or Data Warehousing (Data Engineer/DW Developer) with robust DW development and ETL/ELT data pipeline experience, along with expert knowledge of SQL. Key Skills - Mandatory Strong data modeling and SQL/database design skills Proficiency in ETL more »

Data Engineer - Python - SQL - London - Up to £65k I'm currently working with an organisation who are globally recognised due to the nature of their work, despite only having a presence within the UK. My client are directly involved and help to organise annual events which attract every … provide career progression plans as well as extensive opportunities to gain industry recognised certifications. Experience required Python & SQL experience is essential Extensive experience in pipeline building, ideally using Azure Data Factory Background in Data Engineering Additional experience of Snowflake is advantageous This is a great … removed). Keywords: Azure, Azure Data Factory, MS Business Intelligence, MS Power BI, MS SQL Server, Snowflake, Python, SQL, Data Pipeline, Data Modelling, MDM, T-SQL, Data Lake, Logic Apps, Function App, London more »

Data Engineer required for a 6 month initial contract with a leading commodities trading firm. Outside of IR35 Hybrid working - 2/3 days in London office Experience Required: - Commodities industry … experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

About the role: My client is seeking an experienced Senior Data Engineer with a specialisation in Snowflake and DBT to own and evolve the company's data stack. The ideal candidate for this role will be a self-starter with a knack for problem-solving and … a strong ability to learn new skills quickly. Key responsibilities include designing and developing scalable data models and warehouses, creating and maintaining database objects, and ETL processes for loading data into Snowflake. Proven proficiency in SQL, database optimisation, and effective database security implementation is a must … working closely with Data Science team). The candidate should also have good communication skills, an approachable personality, and prior knowledge/experience of the media industry will be beneficial. The role provides personal and professional development opportunities for an individual who can take on ownership and responsibility more »

Our client, a prestigious global law firm, is seeking a highly skilled Data Engineer to join their dynamic team. This firm is renowned for its commitment to delivering exceptional legal services across various sectors. With a strong emphasis on innovation and technology, they provide a stimulating and collaborative … environment for professionals to thrive. Role Overview: As a Data Engineer, you will play a crucial role in designing, developing, and maintaining the firm's data architecture. You will work closely with various departments to ensure seamless data integration and support data … will have substantial experience in a professional services environment, preferably within the legal, accounting, or audit sectors. Key Responsibilities: Develop and maintain scalable data pipelines and systems. Design and implement robust data architectures and models. Collaborate with data scientists, analysts, and other stakeholders to more »

financial backbone of the nation. Inspire People is working with the Bank of England to seek an experienced Solution Architect with expertise in data analytics and cloud-based solutions (Azure) to play a key role in the development and enhancement of the architecture strategy and roadmaps for data … financial system, to collaborate with industry experts and thought leaders and contribute to the shaping of national financial policies and practices through effective data analytics. Key Responsibilities: * Lead pivotal programmes and projects, crafting data solutions that align with business and technology strategies. * Translate business goals into … enterprise-wide technology and data strategies. * Design and produce architectural artefacts for data platforms, migration strategies, and analytics solutions. * Drive the development and enhancement of data and analytics architecture strategy. * Guide the implementation of data governance standards and best practices. * Represent and more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data more »

Stride Recruitment are looking for skilled and motivated SAS Data Engineers to join a consulting firm offering end-to-end data solutions, delivering best-in-class experiences for their external clients. Technical Background: SAS SAS Base … Azure or AWS or GCP Python/PySpark Proficiency in SQL and/or similar data technologies Familiarity with data pipeline tools and ETL processes Knowledge of cloud platforms and data architecture Additional Skills: Excellent communication and stakeholder management skills Ability to translate … complex data into actionable insights. Strong analytical and problem-solving abilities This is a great opportunity to work with an award-winning Data Management and Analytics consultancy, working closely with leading software vendors and top industry experts across a range of sectors, unlocking value and insight more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI more »

Business Development Manager - Data Solutions Stride Recruitment is working with a leading data consultancy focused on delivering Data & Analytics Solutions for clients in markets such as; Financial Services, Retail, CPG, and Telco. They specialise in the delivery of Modern Data Solutions for … firms in their chosen target markets. Using innovative technologies, they deliver data pipelines, cloud data architectures, advanced analytical and AI/ML solutions. We are looking for ambitious and self-motivated sales professional with a passion for helping customers achieve more with Data, Analytics … Demonstrated ability in negotiating high-value contracts with a track record of successful deal closures. Analytical Mindset: Strong analytical skills to understand complex data environments and articulate the value proposition of our solutions effectively. Technological Proficiency: Familiarity with the latest trends in data analytics, machine learning more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI more »

intuitive and responsive user interfaces. Maintain code quality and consistency across the front-end codebase. Machine Learning and AI Integration: Work closely with data scientists to integrate machine learning models into the production environment. Develop and maintain data pipelines and infrastructure to support AI initiatives. Ensure … tools. Experience with cloud platforms (AWS, Google Cloud, Azure) and containerization (Docker, Kubernetes). Proficiency in database management (SQL, NoSQL) and data pipeline tools. Soft Skills: Excellent problem-solving skills and attention to detail. Strong communication and collaboration abilities. Ability to work independently and in a team more »

Data Engineer - London - Hybrid £60,000 - £70,000 + Package You will be responsible for the engineering of the data platform which is essential to the running and evolution of their mass participation event portfolio. This involves working with databases, coding in Python, integrating data from API's, building automated ingest and curation data pipelines, and using Azure cloud services to hydrate their core data system and downstream systems used for key business functions and analytics. You will be reporting into the Head of Data, working closely … support the thousands of Charities that they work with. Tech Stack: Python and SQL Demonstrable knowledge and skills in Azure Cloud Stack - Azure Data Lake, Azure Data Factory, Azure Logic Apps, Azure Function App and Azure SQL Managed Instance or Microsoft SQL Server. Skilled in T more »

SQL DBA - Fully Remote - £55K - £60K Overview: An excellent opportunity has arisen with a market leading, data driven Saas company for an experienced, motivated, and autonomous SQL DBA with skills in T-SQL and AWS. Role & Responsibilities: Manage AWS RDS SQL Server databases Monitor system's health and … T-SQL programming 1+ years of performance tuning Index analysis Profiler Performance monitor AWS console: RDS Databases Performance insight Knowledge of Data Pipeline and Glue (Desirable) Data warehousing Package: £50K - £60K basic salary Fully remote 25 days annual leave more »

I'm looking for a Power BI and data analytics enthusiast to join a business services organisation in Central London - this is a hybrid role, requiring 2-3 days per week in the office on average. This is a pivotal role for this business, where you'll be … aligned to one of their major financial services clients as the dedicated "data" person, and will proactively harness untapped data in the client's network to inform decision-making, ensure the delivery of exceptional services to the client, and drive operational efficiency. This will involve identifying … data sources, implementing data capture and storage methodologies, and automating data pipelines from these various sources. You will be responsible for developing regular automated and ad-hoc Power BI reports to provide invaluable insight to management, on how they may reduce costs and improve more »

I'm looking for a Power BI and data enthusiast to join a business services organisation in Central London - this is a hybrid role, requiring 2-3 days per week in the office on average. This is a pivotal role for this business, where you'll be aligned … to one of their major financial services clients as the dedicated "data" person, and will proactively harness untapped data in the client's network to inform decision-making, ensure the delivery of exceptional services to the client, and drive operational efficiency. This will involve identifying data sources, implementing data capture and storage methodologies, and automating data pipelines from these various sources. You will be responsible for developing regular automated and ad-hoc Power BI reports to provide invaluable insight to management, on how they may reduce costs and improve operational more »

I'm looking for a Power BI and data analytics enthusiast to join a business services organisation in Central London - this is a hybrid role, requiring 2-3 days per week in the office on average. This is a pivotal role for this business, where you'll be … aligned to one of their major financial services clients as the dedicated "data" person, and will proactively harness untapped data in the client's network to inform decision-making, ensure the delivery of exceptional services to the client, and drive operational efficiency. This will involve identifying … data sources, implementing data capture and storage methodologies, and automating data pipelines from these various sources. You will be responsible for developing regular automated and ad-hoc Power BI reports to provide invaluable insight to management, on how they may reduce costs and improve more »

I'm looking for a Data Engineer with experience working across SQL Server, Python, and ideally some Azure services to join a London-based events organisation. This is a hybrid role, requiring 2 days in the office and 3 days at home per week. You will be joining … their growing Data and Analytics team, who have been re-building and enhancing their Customer Data Platform in partnership with a well-renowned tech consultancy, to deliver better value and insights to various internal teams such as Commercial, Marketing, Digital etc. To do this, you will … leverage SQL, Python, Azure Cloud Services (e.g. Azure Data Factory) and Snowflake (though please note that prior experience with Snowflake is not a requirement). Their front-end reporting is in Power BI, which you may also have the opportunity to get involved in, though this is not more »

I'm looking for a Data Engineer with experience working across SQL Server, Python, and ideally some Azure services to join a London-based events organisation. This is a hybrid role, requiring 2 days in the office and 3 days at home per week. You will be joining … their growing Data and Analytics team, who have been re-building and enhancing their Customer Data Platform in partnership with a well-renowned tech consultancy, to deliver better value and insights to various internal teams such as Commercial, Marketing, Digital etc. To do this, you will … leverage SQL, Python, Azure Cloud Services (e.g. Azure Data Factory) and Snowflake (though please note that prior experience with Snowflake is not a requirement). Their front-end reporting is in Power BI, which you may also have the opportunity to get involved in, though this is not more »

designing and building In the Macro Quant Engineering group , you will work directly with Portfolio Management, Traders, Quant Researchers, High Performance Software and Data Engineering teams. Your work will be varied and include - Develop Software solutions for Quant Research and Trading communities Automated Research workflows to support idea … generation and strategy development Design and build Backtesting solutions Build Data Pipelines for collection of new Alternate datasets Design and Build Market Data APIs Design and build bespoke Analytics and Risk tools Implementation of new Trading Strategies into Production Skills and Academics required Minimum 3 years … Mathematics/Probability, et al., and Software Development/Computer Science. Expert Python (inc. Pandas, NumPy, SciPy, et al) Excellent understanding of Advanced Data Structures and Algorithms Experience of AWS, GCP or Azure Experience of high performance languages such as C++, C#, (JVM based) is beneficial more »

services from local and federal governments, as well as other companies, thanks to the software they supply. Though they have more experience with data science, you will be joining a team that is less skilled with Microsoft Azure technologies. Along with being a member of a team that … Azure technologies, along with a solid understanding of cloud architecture and networking for customised solutions. Infrastructure experience such as code deployments Knowledge of data pipelines for operations involving machine learning. Familiarity with implementing huge language models and machine learning models. Familiarity in setting up CI/CD processes. more »

Senior Software Engineer - £110k - Hybrid Working Opportunity for a tech-savvy innovator with a passion for data-driven solutions to join a global data-centric company as a Senior Software Engineer, helping to shape the future of clients' data strategies and engineering practices. They … specialise in providing cutting-edge data solutions to various clients across the globe. Their tech stack includes Kotlin, React, Kafka, Kubernetes, and AWS, and they are on a mission to make data work smarter for businesses across various industries. £110,000 depending on experience. Requirements: Experience … with a JVM language, Kotlin, Java, Scala, Clojure Knowledge of Typescript and React is beneficial Exposure to data pipelines using technologies such as Spark and Kafka Experience with cloud services (ideally AWS) Hybrid working 1-2 days per week in Central London. £110,000 depending on experience. Please more »

deploying a Flink application to meet our clients specific business needs within the banking sector. Responsibilities: Collaborate with the development team to understand data pipelines and processing requirements Design and develop a real-time stream processing application using Apache Flink Integrate the Flink application with existing systems and … deploying a Flink application to meet our clients specific business needs within the banking sector. Responsibilities: Collaborate with the development team to understand data pipelines and processing requirements Design and develop a real-time stream processing application using Apache Flink Integrate the Flink application with existing systems and more »