26 to 50 of 283 Data Pipeline Jobs in London

This role falls outside IR35*** James Adams is currently looking for an experienced Lead Data Engineer. This is a 6-month initial contract working hybrid remotely in London. Seeking a Talented Lead Data Engineer My client is looking for an experienced and skilled Lead Data Engineer to join their growing team. You'll play a vital role in designing, building, and maintaining their data infrastructure, supporting their mission of making industry data more transparent and accessible. Responsibilities: Lead the design, development, maintenance, testing, and optimization of a scalable and … documentation for the data platform, including data processes, schemas, and dictionaries. Identify and implement improvements to enhance data pipeline efficiency and reliability. Manage cloud-based data services, balancing performance and cost across storage and compute capabilities. Mentor and guide junior data more »

Job Summary: We are looking for a skilled and experienced Data Architect Technical to work as part of our IT team. As a Data Architect Technical, you will be responsible for designing, developing, and maintaining the data architecture for our organization. You will have … a strong understanding of data integration best practices and will play a key role in driving successful data integration and transformation initiatives. Responsibilities: Overall Solution: Over 15 years of IT experience and over 7 years of experience in architecting, designing, developing and maintaining an End to … visualization skills for data models and logical workflows. Continuous Improvement: Analyze performance metrics and propose improvements. Provide resolution to data pipeline challenges. Cloud Data Technologies: Work with Cloud Infrastructure Architects to create data security, backup, disaster recovery, and archiving strategies. Advocate more »

Find your magic with us Connecting people to their family stories is special. We’re proud to deliver these magic moments. Through technology, data and insights, we bring people closer to their past, to benefit their future. We’re a fast-growing team of smart people, on a … the agility of a scale-up with the security of real financial backing, in a place where every story matters. Why join our Data Science and Insights team? We’re driven by the desire to create a fantastic customer experience We love nothing more than taking big data … up to date data We have a modern data stack already in place comprising of a Snowplow data pipeline, a Snowflake data warehouse, dbt as the data transformation tool and our BI tool, Looker. We don’t expect you more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description As a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers. You will have a proven track record as a Data Engineer and be adept in your ability … Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Integrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

As the Data Architect, you'll lead data architecture initiatives, establishing standards and practices essential for effective data management. Your focus will be on designing and implementing robust data and information systems, ensuring they meet stringent criteria for modelling, flow, lineage, quality … and security. Working closely with stakeholders and data governance teams, you'll drive adherence to established standards, facilitating data-driven decision-making processes across the organisation. This role encompasses: Developing and maintaining a comprehensive Data Architecture Framework and maturity roadmap. Enforcing best data practices, setting standards, and ensuring compliance. Creating data models and overseeing the implementation of changes to address evolving business needs. Providing leadership in evaluating and implementing master data management and metadata management solutions. Collaborating with IT operations and delivery teams, producing essential data more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer. The ideal candidate will have a proven … of large data sets Data quality system and process design and implementation. Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

Job DescriptionAre you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you!Position: Lead Data EngineerResponsibilities:Lead Data Management and Architecture … Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency.Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to … build a highly scalable and robust data hub.Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices.Data Integration and Storage Solutions: Implement data storage solutions and manage more »

Data Visualisation Engineer Location: UK Salary: £41,000 per annum We are Forward, the social enterprise that empowers people to break the cycle of crime or addiction to move forward with their lives. For more than 25 years we have been working with people to build positive and … make positive changes and build productive lives with a job, family, friends and a sense of community. What you will be doing The Data Visualisation Engineer (DVE) is responsible for designing, developing, and maintaining data visualisation systems and dashboards. Using a variety of tools and technologies … to create interactive and visually appealing representations of data that enable users to quickly and easily understand complex data sets. Services are designed to deliver a range of interventions, programmes, workshops, advice and guidance for our clients. As a member of the Data & Performance more »

Senior Data Analyst/Data Modelling/SQL/Tableau/Python/Databicks Role: Senior Data Analyst Company: Renewable Energy Package: Up to £80,000 Location: London (Hybrid, 1 day a week in office) A world leader in renewable and sustainability energy are … currently in search of a seasoned Senior Data Analyst to join their growing Data team. As the Senior Data Analyst, you will be instrumental in providing comprehensive data analysis, utilizing your expertise in Tableau to unearth actionable insights that inform strategic business … Python. Experience with advanced analytics techniques, including modeling and segmentation. Strong visualization skills, including proficiency with Tableau. Familiarity with cloud-based data pipeline architectures (e.g., Databricks) and platforms (e.g., AWS). Knowledge of Git-based source control methodologies, including branching and pull requests. Proven track record of more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture … Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors … to build a highly scalable and robust data hub. Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices. Data Integration and Storage Solutions: Implement data more »

Job DescriptionDuration - 12 months We are seeking a Data Engineer who will be responsible for processing and managing our high-quality multimedia datasets for use by our researchers and engineers. The ideal candidate will have a strong background … in data engineering, experience in data processing and management, and proficiency in working with developers to optimise data pipeline tooling.Responsibilities:Data processing: Using online workflows and command line tools/scripts to clean and transform our multimedia datasets to make them … access information, and sharing other relevant information. This requires collaboration with multiple internal teams and working with spreadsheets, documents, internal wikis, and similar tools.Data pipeline: Support improvements to our data pipeline tooling by working closely with developers to provide feedback and make modifications to optimise data more »

Job Role: Azure Data Engineer Location: Central London - Hybrid/3 Days in Office Salary: £60,000 - £70,000 + 12.5% Bonus Key areas: SQL Data Engineer, Azure Data Engineer, Azure Data Factory, Azure Databricks, Azure Data Services, Snowflake, SQL … Server, Data, BI, BI Development, MS BI Chapman Tate is collaborating with a leading Housing Association that is revolutionizing the industry through innovative data-driven solutions. As they continue to expand their operations, they are seeking a talented Azure Data Engineer with strong SQL … expertise to join their dynamic team. Are you passionate about leveraging data to drive business insights and enhance operational efficiency? Do you have experience working with Azure data technologies and a knack for SQL development? If so, this is an exciting opportunity to contribute to the more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally.Job DescriptionThis is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer.The ideal candidate will have a proven track record as … for ingestion and transformation of large data setsData quality system and process design and implementation.Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

Role: Senior Data Engineer Job Type: Permanent Location: London (Hybrid) Ready to utilize your experience in Data Engineering, Solution designing and Cloud Computing? Are you passionate about Azure Cloud and Python? Are you keen to build your career with a dynamic global IT Consultancy implementing cutting … edge data engineering solutions? Make a meaningful impact as a Senior Data Engineer! Careers at TCS: It means more. TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful … and identify opportunities to support their strategy and improve their processes across functions. access to endless learning opportunities. The Role As a Senior Data Engineer , you will be at the forefront of leveraging Azure cloud services to design, develop, and implement cutting-edge data engineering solutions. more »

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work … a detail-oriented innovator and team player, we’re excited to hear from you. Responsibilities Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. Integrate data management technologies and software … databases, as well as NoSQL databases Familiarity with cloud services (preferably GCP ) and understanding of its ETL frameworks. Desired : experience with data pipeline and workflow management (Airflow, Composer). Desired : Familiarity with machine learning algorithms and data science principles is a plus. Qualifications Degree in more »

Job DescriptionJob title: Lead Data EngineerClient: Data Driven Quant FundSalary: Up to £160,000Location: London/HybridMy client are seeking a Lead Data Engineer to own delivery of scalable data pipelines that are critical to the entire firms infrastructure.Being a Lead Data … cutting edge technologies and boast a world class technical team where you will work with and learn from the best.Responsibilities:As a Lead Data Engineer, you will engage with data scientists, software engineer's and product managers to deliver high … quality product based on very specifically tailored data requirements.Architect and implement data ingestion, transformation, and storage processes.Optimise data pipeline performance.Keep up with market developments in the data engineering and AI space and implement these best practices.Requirements and Skills:Bachelor's Degree more »

Job DescriptionStott and May has partnered with a global healthcare organisation within the private sector, to source a senior data engineer to join their growing tech team. Hybrid (3/4 days per month in London or Manchester) Salary: Circa £80k p/annum Key Responsibilities:Lead the … consolidation and migration of legacy data to our new cloud-based data platform.Design and implement master and transactional data models to ensure data integrity and consistency.Develop ETL pipelines and cloud data storage solutions that meet business requirements and non-functional … needs.Collaborate closely with data analysts, visualization engineers, and project managers to deliver data solutions.Surface data for analytical consumption and prepare data for ML/predictive and prescriptive models.What we are looking for: Proficiency with Databricks and building data pipelines on more »

Job DescriptionData Engineer Opportunity – Global Social Media Brand - Contract PAYE - Up to £350 PD - 12 Months - Fully RemoteOverview: We are seeking a Data Engineer who will be responsible for processing and managing our high-quality multimedia datasets for use by our researchers and engineers. The ideal candidate will … in data engineering, experience in data processing and management, and proficiency in working with developers to optimise data pipeline tooling.Role and Responsibilities:Data processing: Using online workflows and command line tools/scripts to clean and transform our multimedia datasets to … access information, and sharing other relevant information. This requires collaboration with multiple internal teams and working with spreadsheets, documents, internal wikis, and similar tools.Data pipeline: Support improvements to our data pipeline tooling by working closely with developers to provide feedback and make modifications to optimise data more »

Data Engineer Location: London, 3 days per week in the office Salary range: £50,000-£70,000 + benefits Purpose: Design, build, and maintain scalable data architectures, including pipelines and cloud-based data warehouses. Tech: Python (NumPy, Pandas), SQL, ETL, Cloud (AWS, Azure or … consultancy who solely specialise in the Maritime trading industry. You will work onsite with 1 specific client to design, build and maintain scalable data architectures working with key stakeholders in their business to shape their data-driven strategies. The Company: They have a long history providing … ETL Processes: Deep expertise in developing and optimising ETL pipelines. Version Control: Experience with Git for code collaboration and change tracking. Data Pipeline Tools: Proficiency with tools such as Apache Airflow. Cloud Platforms: Familiarity with AWS, Azure, Snowflake, and GCP. Visualisation: Tableau or PowerBI Delivery Tools: Familiarity more »

We Want We are looking for a Staff Backend Engineer to join our Insights Back-End team to help build out data pipeline, data store and API layer of Bazaarvoice data that will power our various client-facing dashboards, raw data reporting, product performance reporting. The ideal candidate has built and operated systems that aggregate and share data sets to support new product offerings and is well experienced in evaluating the right technologies to build those data sets. Success in the role is underpinned by … a strong understanding of the business cases of the product portfolio and building relevant data sets, API layer and access methodologies that support the portfolio goals. What You’ll Be Doing Own, design, implement and support of major components of the unified back end data. Define how data more »

you’re a detail-oriented innovator and team player, we’re excited to hear from you.ResponsibilitiesDesign, construct, install, test, and maintain highly scalable data management systems.Ensure systems meet requirements and industry practices for data quality and integrity.Integrate data management technologies and software tools into … existing structures.Create data tools to support sport data modelling, prediction and analytics.Work with data and analytics experts to strive for greater functionality in our data systems.Essential SkillsProven experience as a Data Engineer, with expertise developing scalable data pipelines.Strong … with relational databases, as well as NoSQL databasesFamiliarity with cloud services (preferably GCP) and understanding of its ETL frameworks.Desired: experience with data pipeline and workflow management (Airflow, Composer).Desired: Familiarity with machine learning algorithms and data science principles is a plus.QualificationsDegree in Computer Science, Engineering more »

SENIOR DATA SCIENTIST (NLP & LLM) Up to £85,000 LONDON Ready to elevate your career to new heights? Join a team of experienced Data Scientists and Data Engineers to create impactful LLM's models and work with cutting-edge NLP technologies. The Role: Work … performance, and make informed solution selections. Conduct comprehensive work spanning the entire data lifecycle, including data exploration, data pipeline development, insights and feature extraction, machine learning model creation, and deployment. Collaborate on consulting-style pilot projects aimed at helping clients gain a deep … understanding of their data and identifying problems that can be addressed through the platform. Collaborate closely with data scientists and data engineers to construct and implement machine learning models. Take an active role in leading team meetings and client workshops. Assist in establishing software more »

developer 6 months contract – Competitive market rates – Inside IR35 - London – 3 days on-site Key Skills: Python, Power BI, SQL, Experience with Big Data pipelines, DAX, Excel, Financial services background The Role: A global trading organisation is looking a Python/Power BI to join their Data … be working with the business helping to build Apps using Python and Power BI for the output dashboards. Key Responsibilities: Develop and construct data pipelines to facilitate efficient extraction, transformation, and loading of data from diverse sources. Create and implement Business Information Access portals, comprising dashboards … continued deployment and enhancements. Innovate existing solutions and forecast future demands to meet evolving business needs. Develop analytics tools leveraging the data pipeline to offer actionable insights across various business functions, thereby enhancing key performance metrics. Emphasize automation and adopt an early feedback approach to streamline processes. more »

Stott and May has partnered with a global healthcare organisation within the private sector, to source a senior data engineer to join their growing tech team. Hybrid (3/4 days per month in London or Manchester) Salary: Circa £80k p/annum Key Responsibilities: Lead the consolidation … and migration of legacy data to our new cloud-based data platform. Design and implement master and transactional data models to ensure data integrity and consistency. Develop ETL pipelines and cloud data storage solutions that meet business requirements and non … functional needs. Collaborate closely with data analysts, visualization engineers, and project managers to deliver data solutions. Surface data for analytical consumption and prepare data for ML/predictive and prescriptive models. What we are looking for: Proficiency with Databricks and building data more »

AWS Data Architect - Insight & Data Services - Permanent Salary guideline: £90,000 - £100,000 pa (DOE) + 10% Bonus, Pension up to 6% contributory, Health Insurance, Life Assurance etc. Base Location: UK Wide - Hybrid model - Onsite/Remote The Role: The Cloud Data Platforms team … is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety of projects and sectors. Cloud Data Platforms is the home of the Data Engineers, Platform Engineers, Solutions Architects and Business Analysts who are focused … on driving our customers digital and data transformation journey using the modern cloud platforms. We specialise on using the latest frameworks, reference architectures and technologies using AWS, Azure and GCP. Essential Skills and Experience: * AWS (e.g., Athena, Redshift, Glue, EMR) * Strong AWS Data Solution Architect Experience more »