1 to 25 of 184 Data Pipeline Jobs in London

x1 day a week in the office (Thursday)Salary 90,000 - 95,000 per annumAbout the roleWhich? is currently seeking an exceptional Lead Data Engineer to take the helm in driving our innovative data strategy forward. In this role, you'll be at the forefront of … crafting and executing our data vision, operating within a dynamic Greenfield environment. The successful candidate will have the unique opportunity to form a diverse, talented team, while also spearheading the development of our data function from inception to fruition across various projects.Our forthcoming data … experience designing and implementing scalable data models for both relational and NoSQL databases.Strong Python skills with a focus on data pipeline development and automation of data-related tasks.Extensive experience designing, building, optimising, and monitoring complex ELT pipelines, ensuring data quality and more »

Principal Data Engineer - Hybrid (Bristol or London) - 80 - 110kSpinks are working with an established, rapidly growing digital consultancy who are looking to bolster their awesome Data Team with another experienced Principal Data Engineer. As a Principal Data Engineering Consultant, you will be … they occur.Be a strong communicator and presenter, presenting prototypes, solutions, and progress to internal/external stakeholders in a clear concise manner.Building reliable Data Pipelines.Promoting Test-Driven Development and/or Behaviour Driven Development.Continuously review and prioritise the delivery team's workload and anticipate the need for realignment more »

days on-site. Key Responsibilities: Design and implement integration solutions using Azure, M365, Active Directory and Intune. Develop and maintain APIs, services, and data pipelines. Collaborate with stakeholders to ensure integration solutions meet business needs. Troubleshoot and resolve integration issues. Perform system monitoring, performance tuning, and optimisation. Document more »

Senior Data Engineer Contractor £700 inside IR35 9-12 months duration. Hybrid with a London based office. This Senior Data Engineer will be spearheading the technical evolution of a cutting-edge retail platform. A highly reputable client of ours is searching for an experienced Data Engineer to deliver a transition into a Snowflake Data Warehouse and will be responsible for the creation of robust data pipelines. This role is a contract position inside IR35, designed for a leader who thrives in a product-centric environment and is passionate about … utilisation of advanced features, validated by Snowflake certification (e.g., SnowPro Core). - DBT expertise coupled with advanced Python skills, specifically in data pipeline development and data task automation. - Mastery of SQL (PostgreSQL, MySQL) for intricate queries and performance tuning. Demonstrated ability in designi... more »

Software Engineer– LondonSports Analytics & Statistics CompanyFulltime onsite*Please note this role cannot sponsor. Please do not apply if you are seeking sponsorship*A Data Engineer is required for an exciting and innovative Software sports betting company based in London. The successful candidates will be working closely with the … researchers and alongside other extremely talented and driven engineers to build and support systematic trading models. You will be working on real-time data pipelines for live sports events where your expertise will help the company advance their in-play sports analytics and pricing function. Your day-to … day will involve developing robust and scalable data pipelines, implementing new feeds into the business, and integrating them with their quantitative decision models.Essential SkillsProven experience as a data engineer or similar, with a track record of handling mid to large scale data projects.Strong proficiency more »

report to the VP of Software who reports to the CEO. There are four R&D groups in the Software department:Cloud Infrastructure (data and ML training infra)Onboard Software (the car computer system software)Embodied AI Products (the AI+Robotics autonomy software and data)Evaluation and … the self-driving problem in order to enable the creation of new training and validation datasets), Experiments (essentially the Embodied AI development toolkit), Data Science (measurement reliability and accuracy in noisy self-driving environments). You will need to develop additional capabilities to evaluate model performance and validate … experience in Robotics, particularly related to simulating robotsIndustry experience with Computer Vision with real-world product impactExperience with cloud platforms, databases, large scale data pipelinesWhat we offer youThe chance to be part of a truly mission driven organisation and an opportunity to shape the future of autonomous driving. more »

INFOSENIOR DATA ENGINEER FULLY REMOTE (UK BASED)UP TO 80,000PERMANENTDo you have experience using cloud technologies? Are you passionate about Data Engineering and have a strong background working cross-functionally? This role is an amazing chance to work with some experienced and talented individuals in … a fast-paced environment.THE COMPANYThe company is a lead art tech company. They are looking for an engineer that can help manage their data pipelines and optimise them. They are also looking to build more exciting data products and apps that they want you to be … a part of.THE ROLEYou will be:Managing and developing data pipelines and making sure the scraping data is good.Working closely with data team to develop products.Spearheading data changes and driving business impact.Using Terraform and the AWS stack.YOUR SKILLS AND EXPERIENCEMinimum 4-years more »

mission by providing a hugely diverse set of technical solutions and platforms. From supporting critical systems which underpin the UK economy, to evolving data analytics, reinventing our online presence, and introducing a fully digital workplace. Be part of a team that’s constantly evolving, just like our industry.We … deliver services to both the Bank and external users. These include critical systems and services that underpin the UK economy, financial supervision, evolving data analytics, collaboration and research.This role sits within the Technology Strategy and Architecture (TSA) division in the Technology Directorate who are accountable for technical strategy … level.As a senior member of the Team, you will be:Taking a leading role on programmes and projects, understanding business imperatives and developing data solutions that deliver against the requirements aligned to business and technology strategiesResponsible for translating business strategic goals and objectives into supporting enterprise-wide technology more »

a dynamic and experienced Business Intelligence Developer to join their innovative team. This role presents an exciting opportunity for individuals passionate about leveraging data to drive business insights and decisions. With a salary range of up to £70,000 per annum, this position offers competitive compensation and ample … room for professional growth. Key Responsibilities: Engineering: Design, develop, and maintain data pipelines using Azure Data Factory (ADF) and Databricks, ensuring the seamless flow of data across various systems and platforms. BI Reporting: Utilize Power BI to create visually appealing and insightful reports and … dashboards that provide actionable insights to stakeholders across the organization. Collaborate closely with cross-functional teams, including data scientists, business analysts, and IT professionals, to understand business requirements and translate them into technical solutions. Optimization: Implement performance tuning techniques to enhance the efficiency and scalability of data more »

The ideal candidate will have a strong background in MLOps, with experience in deploying models on multiple GPUs, scaling, load balancing, and managing data pipelines. This role is critical in ensuring the high performance and reliability of our AI-driven solutions. Responsibilities: Deploy LLMs using platforms like Huggingface … or similar. Manage deployment on multiple GPUs, ensuring optimal performance. Implement scaling and load balancing to handle varying loads efficiently. Design and maintain data pipelines for model training, preferably using Kubeflow. Establish continuous integration and delivery pipelines using Docker, Kubernetes, or AWS counterparts (e.g., ECR). Visualise fine … grained MLOps data using industry standard tools and platforms Ensure system security through triaging, log analysis, and infrastructure debugging. Implement Infrastructure as Code using tools like Terraform or CloudFormation. Requirements: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field or equivalent experience. Solid more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … implementing cloud solutions for different applications, automating cloud operations and cloud deployments Assume responsibility for the architecture of solutions that leverage advanced analytics, data pipelines, web portals, statistical models, Machine Learning and AI, through our technology platform Draw on the strength and experience of a wider team of more »

LEAD DATA ENGINEER London x2 days a month in office OVERVIEW Xcede are delighted to be partnered with one of the UK's most impactful HealthTech brands. The organisation have won numerous awards for their data-led approach to designing an impactful B2C product that has … entirely disrupted their domain and outperformed their competitors. With a well-established analytics, data science, and data engineering function already in place, the team is looking for a Lead Data Engineer to come in act primarily as a Principal IC while also helping with … management of junior engineers (we'd like to see some experience of this). RESPONSIBILITIES Manage and assist a team of data engineers. Design and continue to build essential data infrastructure for the organisation alongside data pipelines & ETLs. Collaborate with data scientists more »

Lead Data Engineer. What’s it all about? Information, Systems and Change and Data and Digital Solutions. You will be responsible for leading the technical design and implementation of data integration projects using Microsoft Azure and Integration Services alongside other cloud components. As the … Lead Data Engineer you will also oversee the quality, performance, and security of the data integration solutions. How you’ll make a difference? By delivering data integration solutions on their data platform, you will contribute to the continuous improvement of data … that improve the services the client provides for their customers. How you’ll do it? Lead the Engineering Team in the development of data and integration solutions leveraging the latest technologies, tools, processes, and best practice. Create and provide data products following the data more »

Are you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future! With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that transcend … surpassing expectations drives them to explore every avenue for growth, harnessing opportunities that benefit their teams, projects, communities, and industry. As an Azure Data Engineer, you will play a pivotal role in the data engineering and business intelligence journey of global and regional operations. Collaborating with … cross-functional teams, you'll lead the charge in designing and implementing scalable azure data engineering and Power BI data visualisation solutions that meet diverse business needs. Your experience as an Azure Data Engineer and BI Developer will be key to optimizing data more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

Client: A global financial services company About the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability … and efficiency. Key Responsibilities: Design, develop, and maintain scalable data pipelines using BigQuery, Python, and CloudRun. Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions. Implement best practices for data modeling, ETL processes, and data governance. Optimize and fine-tune data processes to improve performance and reliability. Stay up-to-date with the latest technologies and trends in data engineering and recommend innovative solutions to enhance our data infrastructure. Required Skills: Strong proficiency in BigQuery, Python, and more »

with one of the best leading insurance companies, in collaboration with a prestigious bank in London. We're actively seeking a talented Senior Data Engineer to enrich our dynamic team. Responsibilities: Experience designing data models and developing industrialized data pipelines. Strong knowledge of database … and data lake systems, with proficiency in Python and SQL (any flavor). Comfortable with shell scripting (e.g., Bash) and provisioning new infrastructure in leading cloud providers, preferably GCP or AWS. Experience creating DataOps pipelines. Adept at working in an Agile environment, actively participating in approaches such as more »

Graduate Data Engineer - Fast Growing FinTech A very fast scaling FinTech in London are looking for a talented Data Engineer to join their team. In this role as a Data Engineer you’ll work with extremely high calibre engineers and hit the ground running … with where you have the most experience and then gaining exposure to the rest of their services to build out your expertise. Graduate Data Engineer - About You On track for a First from a Top Russel Group University Self-starter who thrives in challenging environments A background in … a relevant field (Computer Science, Physics, Mathematics) with Software internships or projects Demonstrable experience in Python and SQL Data Engineer Desirable Qualities: Ability to communicate effectively to technical and non technical people Nice to haves includes: Kubernetes, Docker, BigQuery, Cloud, Databases Interest in FinTech Data Engineer more »

Job Summary: We are looking for a skilled and experienced Data Architect Technical to work as part of our IT team. As a Data Architect Technical, you will be responsible for designing, developing, and maintaining the data architecture for our organization. You will have … a strong understanding of data integration best practices and will play a key role in driving successful data integration and transformation initiatives. Responsibilities: Overall Solution: Over 15 years of IT experience and over 7 years of experience in architecting, designing, developing and maintaining an End to … visualization skills for data models and logical workflows. Continuous Improvement: Analyze performance metrics and propose improvements. Provide resolution to data pipeline challenges. Cloud Data Technologies: Work with Cloud Infrastructure Architects to create data security, backup, disaster recovery, and archiving strategies. Advocate more »

Data Engineer London £85,000 Harrington Starr is currently working with a leading AI-based SAAS business that is looking to hire multiple Data Engineers to help them further grow their already exciting business. Within this role, you will be responsible for Maintaining, supporting and expanding … existing data pipelines using DBT, Snowflake and S3. You will also be tasked with implementing standardised data ingress/egress pipelines coupled with onboarding new, disparate data sets, sourced from many and varied data vendors, covering all asset types and frequencies from … must be able to work and build relationships with internal teams as you will be working with the quant teams to streamline the data to make it easier to use on the platform. You will also be working with external client to help them onboard their data more »

Data Visualisation Engineer Location: UK Salary: £41,000 per annum We are Forward, the social enterprise that empowers people to break the cycle of crime or addiction to move forward with their lives. For more than 25 years we have been working with people to build positive and … make positive changes and build productive lives with a job, family, friends and a sense of community. What you will be doing The Data Visualisation Engineer (DVE) is responsible for designing, developing, and maintaining data visualisation systems and dashboards. Using a variety of tools and technologies … to create interactive and visually appealing representations of data that enable users to quickly and easily understand complex data sets. Services are designed to deliver a range of interventions, programmes, workshops, advice and guidance for our clients. As a member of the Data & Performance more »

days on-site. Key Responsibilities: Design and implement integration solutions using Azure, M365, Active Directory and Intune. Develop and maintain APIs, services, and data pipelines. Collaborate with stakeholders to ensure integration solutions meet business needs. Troubleshoot and resolve integration issues. Perform system monitoring, performance tuning, and optimisation. Document more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting … time to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI more »