1 to 25 of 25 Data Pipeline Jobs in Central London

Senior Developer (Data & Analytics) £450-£550 Inside IR35 12 months Hybrid Working - 2 full days a week working in London Talent are seeking a highly skilled Senior Developer with extensive experience in ETL/ELT processes, data warehousing/business intelligence methodologies, and best practices. The … ideal candidate will have a strong background in handling big data, cloud technologies, and unstructured data, along with a deep understanding of star schema structure and hybrid data warehouse design. As a Developer your key responsibilities will be: Design, develop, and maintain robust ETL …/ELT processes and data pipelines. Implement data warehousing solutions using Kimball and Inmon methodologies. Develop and manage cloud-based data solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Create and more »

Job Overview Position: Senior Data Engineer In this role, you will be responsible for storing, processing, modeling, and applying data science to ensure that data and insights are available for data analytics and business intelligence (BI) systems. You must be proficient in … data assessment and profiling, source system analysis, and providing a clear vision for processing and interpreting data to support its end-use. Ideal Candidate Profile The ideal candidate will have a background in Data … Engineering or Data Warehousing (Data Engineer/DW Developer) with robust DW development and ETL/ELT data pipeline experience, along with expert knowledge of SQL. Key Skills - Mandatory Strong data modeling and SQL/database design skills Proficiency in ETL more »

Data Engineer London - Hybrid working £55,000 - £60,000 A global leading HR staffing organisation based in London is currently looking to recruit a Data Engineer who will play a crucial role in designing, developing, and maintaining the data infrastructure that powers innovative solutions … within the client. We require an engineer who has a passion for data and has a good background in Azure, synapse, Databricks, SQL, Python and DataOps. This is a fantastic opportunity for a Data Engineer to gain exposure to different business areas from Visualisation, Machine Learning … Alongside this my client is going to be going through a cloud migration to Azure. Responsibilities : Collaborate with cross-functional teams to understand data requirements and design efficient data pipelines. Develop and maintain scalable data models and databases. Design and implement data more »

Data Engineer required for a 6 month initial contract with a leading commodities trading firm. Outside of IR35 Hybrid working - 2/3 days in London office Experience Required: - Commodities industry … experience Weather forecasting Airflow (or equivalent data orchestration platforms) Data Modeling (Star Schema) Data Warehousing Data Pipeline Orchestration (Kafka) On-Prem SQL more »

our award-winning team at Sparta Global. About the Job You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … utilising Databricks to support the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data more »

Stride Recruitment are looking for skilled and motivated SAS Data Engineers to join a consulting firm offering end-to-end data solutions, delivering best-in-class experiences for their external clients. Technical Background: SAS SAS Base … Azure or AWS or GCP Python/PySpark Proficiency in SQL and/or similar data technologies Familiarity with data pipeline tools and ETL processes Knowledge of cloud platforms and data architecture Additional Skills: Excellent communication and stakeholder management skills Ability to translate … complex data into actionable insights. Strong analytical and problem-solving abilities This is a great opportunity to work with an award-winning Data Management and Analytics consultancy, working closely with leading software vendors and top industry experts across a range of sectors, unlocking value and insight more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI more »

Business Development Manager - Data Solutions Stride Recruitment is working with a leading data consultancy focused on delivering Data & Analytics Solutions for clients in markets such as; Financial Services, Retail, CPG, and Telco. They specialise in the delivery of Modern Data Solutions for … firms in their chosen target markets. Using innovative technologies, they deliver data pipelines, cloud data architectures, advanced analytical and AI/ML solutions. We are looking for ambitious and self-motivated sales professional with a passion for helping customers achieve more with Data, Analytics … Demonstrated ability in negotiating high-value contracts with a track record of successful deal closures. Analytical Mindset: Strong analytical skills to understand complex data environments and articulate the value proposition of our solutions effectively. Technological Proficiency: Familiarity with the latest trends in data analytics, machine learning more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI more »

Senior Data Engineer Bracknell - Flexible Up to £90,000 Austin Fraser has an exciting opportunity for a Senior Data Engineer to join one of the leading retail chains, running two of the busiests sites in the UK. This is a great time to join the business … as they are reshaping the in-house data engineering capability by moving to a cloud native platform, to become more product delivery focused . They are now looking to onboard a Senior Data Engineer with 5+ years of experience working with SQL, GCP, DBT, Big Query … Python and Airflow. In return you will benefit from an excellent remuneration package. The role: Creating, deploying, and maintaining secure data platforms on the cloud. You'll contribute to crafting and delivering data solutions tailored to meet the diverse requirements of stakeholders across the Partnership. You more »

Lead Data Engineer (Azure/SQL) - London - £70k 2-3 days per week in office My client is looking for a Data Lead to take responsibility for the technical design and implementation of data integration projects using Azure and Integration Services. Core duties will … the team whilst ensuring the overall performance of the solutions utilising the latest technologies, processes and best practice. You will design and build data pipelines, ETL processes and data workflows that enable data to be transferred seamlessly across a variety of platforms Required Skills … Demonstrable experience in designing and deploying Azure Integration Services solutions - Proven experience of building data solutions and products in Azure - Data pipelines - SQL knowledge - Agile/Scrum Lead Data Engineer (Azure/SQL) - London - £70k 2-3 days per week in office In accordance more »

I'm looking for a Power BI and data analytics enthusiast to join a business services organisation in Central London - this is a hybrid role, requiring 2-3 days per week in the office on average. This is a pivotal role for this business, where you'll be … aligned to one of their major financial services clients as the dedicated "data" person, and will proactively harness untapped data in the client's network to inform decision-making, ensure the delivery of exceptional services to the client, and drive operational efficiency. This will involve identifying … data sources, implementing data capture and storage methodologies, and automating data pipelines from these various sources. You will be responsible for developing regular automated and ad-hoc Power BI reports to provide invaluable insight to management, on how they may reduce costs and improve more »

I'm looking for a Power BI and data enthusiast to join a business services organisation in Central London - this is a hybrid role, requiring 2-3 days per week in the office on average. This is a pivotal role for this business, where you'll be aligned … to one of their major financial services clients as the dedicated "data" person, and will proactively harness untapped data in the client's network to inform decision-making, ensure the delivery of exceptional services to the client, and drive operational efficiency. This will involve identifying data sources, implementing data capture and storage methodologies, and automating data pipelines from these various sources. You will be responsible for developing regular automated and ad-hoc Power BI reports to provide invaluable insight to management, on how they may reduce costs and improve operational more »

I'm looking for a Power BI and data analytics enthusiast to join a business services organisation in Central London - this is a hybrid role, requiring 2-3 days per week in the office on average. This is a pivotal role for this business, where you'll be … aligned to one of their major financial services clients as the dedicated "data" person, and will proactively harness untapped data in the client's network to inform decision-making, ensure the delivery of exceptional services to the client, and drive operational efficiency. This will involve identifying … data sources, implementing data capture and storage methodologies, and automating data pipelines from these various sources. You will be responsible for developing regular automated and ad-hoc Power BI reports to provide invaluable insight to management, on how they may reduce costs and improve more »

I'm looking for a Data Engineer with experience working across SQL Server, Python, and ideally some Azure services to join a London-based events organisation. This is a hybrid role, requiring 2 days in the office and 3 days at home per week. You will be joining … their growing Data and Analytics team, who have been re-building and enhancing their Customer Data Platform in partnership with a well-renowned tech consultancy, to deliver better value and insights to various internal teams such as Commercial, Marketing, Digital etc. To do this, you will … leverage SQL, Python, Azure Cloud Services (e.g. Azure Data Factory) and Snowflake (though please note that prior experience with Snowflake is not a requirement). Their front-end reporting is in Power BI, which you may also have the opportunity to get involved in, though this is not more »

I'm looking for a Data Engineer with experience working across SQL Server, Python, and ideally some Azure services to join a London-based events organisation. This is a hybrid role, requiring 2 days in the office and 3 days at home per week. You will be joining … their growing Data and Analytics team, who have been re-building and enhancing their Customer Data Platform in partnership with a well-renowned tech consultancy, to deliver better value and insights to various internal teams such as Commercial, Marketing, Digital etc. To do this, you will … leverage SQL, Python, Azure Cloud Services (e.g. Azure Data Factory) and Snowflake (though please note that prior experience with Snowflake is not a requirement). Their front-end reporting is in Power BI, which you may also have the opportunity to get involved in, though this is not more »

days on-site. Key Responsibilities: Design and implement integration solutions using Azure, M365, Active Directory and Intune. Develop and maintain APIs, services, and data pipelines. Collaborate with stakeholders to ensure integration solutions meet business needs. Troubleshoot and resolve integration issues. Perform system monitoring, performance tuning, and optimisation. Document more »

and reliability of their products through innovative testing practices. Key Responsibilities: Create and maintain test automation frameworks. Develop and manage test pipelines for data pipelines. Contribute to manual testing efforts and overall test management activities. Assist in requirements and scenario definition and elicitation. Participate in test planning and … and manage Continuous Integration/Continuous Deployment (CI/CD) pipelines. Skills and Qualifications: Proficiency in test automation and related tools. Experience with data and database testing. Strong skills in test management and planning. Ability to create use cases, requirements, and scenarios. Knowledge of test architecture … and best practices. About You: You are a detail-oriented and innovative professional with a strong background in test automation and data pipeline testing. Your ability to create robust test frameworks and manage test activities will contribute significantly to our product's success. Your experience with CI more »

Engineering in sculpting and realising the strategic vision, enhancing the analytical prowess of the Actuarial team. Embrace the challenge of refining operations through data automation and harnessing cutting-edge technologies. Key Essentials: Proficiency in Python, SQL, and PowerBI is paramount. Experience with Azure or APIs is highly advantageous. … standards. Showcase technical prowess in Python, SQL, and JSON. Implement and oversee a robust CI/CD process. Enhance Azure modules, advancing automated data pipelines. Question conventional analysis and design, advocating for innovative alternatives. Articulate technical design principles to non-technical stakeholders. Propose enhancements to data efficiency and reliability. Represent the actuarial engineering perspective in key forums and authorities. Explore and introduce new tools for data management and analysis. To apply, please submit your CV and a cover letter detailing your relevant experience and how you can contribute to the success of more »

a Senior Go Lang Developer. Job Responsibilities/Objectives - Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. … Extensive ETL and Data warehousing experience - Strong experience in GoLang programming - Google Cloud Services and BigQuery Required Skills/Experience - Assess, analyze, data ingestion, transformation & storage layers (RAW, Exploratory, Curated .application) - Understand and provide inputs for STT documents. - Design and develop the data pipelines more »

Brio Digital are happy to be supporting a data consultancy who are currently looking for an analytics engineer. The role will be hybrid with 2x days per week on-site in London. Salary; Up-to £80,000. Analytics Engineer Experience & Tech; SQL Python Experience with cloud platforms such … as GCP or Azure. Experience with Big Query & Synapse. Experience with Data visualisation tools such as D3. Experience in a client facing position A consultancy background would be highly beneficial. Analytics Engineer role overview; You have previously had experience working across multiple client projects at one time. You … be very client facing & also present to clients so if you have done this previously, that will be highly beneficial. You will build data pipelines to support analytics across very large data sets. You will mentor and support more junior members of the team. Apply now more »

office on a hybrid basis. As a Contract Senior Golang Developer, you will play a crucial role in assessing, analysing, and enhancing our data ingestion, transformation, and storage layers. Your primary focus will be on Go Programming and DBT, with secondary skills in Google Cloud Services. The successful … candidate will bring 5 to 10 years of experience in developing robust data pipelines, conducting unit testing, and providing support for production deployments. Key Responsibilities: Assess and analyse data ingestion, transformation, and storage layers, including RAW, Exploratory, Curated, and application layers. Understand existing codebase and make … alterations or fixes as per design requirements. Develop and optimize data ingestion pipelines using Go Programming and DBT. Conduct unit testing and validation of the developed code to ensure reliability and performance. Collaborate with cross-functional teams to support production deployments and resolve any issues that may arise. more »

Senior Software Engineer - £110k - Hybrid Working Opportunity for a tech-savvy innovator with a passion for data-driven solutions to join a global data-centric company as a Senior Software Engineer, helping to shape the future of clients' data strategies and engineering practices. They … specialise in providing cutting-edge data solutions to various clients across the globe. Their tech stack includes Kotlin, React, Kafka, Kubernetes, and AWS, and they are on a mission to make data work smarter for businesses across various industries. £110,000 depending on experience. Requirements: Experience … with a JVM language, Kotlin, Java, Scala, Clojure Knowledge of Typescript and React is beneficial Exposure to data pipelines using technologies such as Spark and Kafka Experience with cloud services (ideally AWS) Hybrid working 1-2 days per week in Central London. £110,000 depending on experience. Please more »