1 to 25 of 258 Permanent Data Pipeline Jobs in Berkshire

engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources … effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote … SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality More ❯

get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “Application Support Request”. Role : Data Architect Job Type: Permanent (Hybrid) Location: London, United Kingdom Ready to utilize your skills in designing, creating, and managing data architecture? Join … us as a Data Architect. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients … an exciting team where you will be challenged every day. • Build strong relationships with a diverse range of stakeholders. The Role As a Data Architect, you will be responsible for designing, creating, and managing data architecture. You will also ensure that data is efficiently More ❯

ideas and commitment to excellence, we want you to join us. To learn more visit alti-global.com. Job Description & Overview The Head of Data Engineering & Analytics will lead the development and execution of AlTi’s enterprise data engineering strategy, enabling the capture, transformation, storage and delivery … of high-quality data across the firm’s global wealth, investment, corporate and asset management functions. This leader will architect and scale data engineering capabilities to support real-time and batch integration, reporting, and advanced analytics. This role reports to the CTO and will be a … version control and system observability for data pipelines. Establish metrics and KPIs and identify and deploy tools to measure data pipeline health, data quality, timeliness and accuracy, team performance, cost-effectiveness, and business impact. Actively mentor and grow talent within the team while More ❯

Job Title: Lead Data Engineer (AWS) Business Unit/Segment: Data Management/Analytics Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent - Salary -£80k to £100k Summary of the Role: A leading global data and AI company is looking for a Lead … with emerging data technologies and recommend improvements to data engineering practices. Develop and enforce best practices for data pipeline orchestration, testing, and deployment. Provide mentorship, feedback, and leadership across project and operational initiatives. Collaborate with cross-functional teams to design a consistent and … CD practices and code versioning systems. Key Skills and Attributes: Cloud & Data Engineering: Deep expertise in AWS services and data pipeline development. Data Modelling & Architecture: Strong background in data warehousing and modern modelling frameworks. Leadership: Ability to lead teams, provide feedback More ❯

and become part of our journey to shape a positive and impactful future. Job Description Becoming part of the UK team in our Data & AI Service Line will present new opportunities for you to make a positive impact as we embark on securing major projects with our top … Advisory : Combining architectural assessments with platform selection guidance, providing vendor-independent recommendations for optimal data ecosystem design. Data Migration, Integration & Pipeline Support : Providing strategic guidance on data migration and integration approaches, logical pipeline design, and data flow orchestration, based on … understanding of methodologies and principles of data science and MLOps, including model development, validation, and lifecycle management. Experience in data pipeline design, ETL/ELT processes, and data integration approaches and appreciation of trade-offs associated with specific use-cases and architectural choices. More ❯

Junior Data Engineer – Manufacturing - £30-35k – Hybrid or Remote Overview: An exciting opportunity has arisen for a Junior Data Engineer to join one of the world’s leading transportation manufacturers who specialise in providing safety and securement solutions for mobility devices. They are known best … the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

Role Title: Data Modeler Duration: contract to run until 31/12/2025 Location: London, Hybrid 2-3 days per week onsite Rate: up to £644 p/d Umbrella inside IR35 Role purpose/summary We are seeking an experienced Data Modeller with proven … expertise in the London Market insurance sector. The successful candidate will play a key role in designing and validating data models that support enterprise data initiatives. This includes working closely with data engineers, architects, and business stakeholders to ensure data structures are … Skills: Experience with insurance platforms such as Guidewire, Duck Creek, or legacy PAS systems. Knowledge of Delta Lake, Apache Spark, and data pipeline orchestration tools. Exposure to Agile delivery methodologies and tools like JIRA, Confluence, or Azure DevOps. Understanding of regulatory data requirements such as More ❯

We are looking for Data Engineer for our client's project based at London, UK - Hybrid Role Description: We are seeking an experienced Data Modeller with proven expertise in the London Market insurance sector. The successful candidate will play a key role in designing and validating … data models that support enterprise data initiatives. This includes working closely with data engineers, architects, and business stakeholders to ensure data structures are scalable, accurate, and aligned with business needs. Key Responsibilities: Design and maintain conceptual, logical, and physical data … Skills Experience with insurance platforms such as Guidewire, Duck Creek, or legacy PAS systems. Knowledge of Delta Lake, Apache Spark, and data pipeline orchestration tools. Exposure to Agile delivery methodologies and tools like JIRA, Confluence, or Azure DevOps. Understanding of regulatory data requirements such as More ❯

Key aspects of the role include: Data Pipeline Development: Architect, develop, and optimise data extraction, transformation, and loading (ETL) processes for high-volume healthcare data. Integration of NHS Systems Data: Work directly with NHS data sources and ensure seamless integration of … systems like UDAL, NCDR, SUS+, HES, and ODS into our analytics platform. System Performance: Monitor and enhance the performance of our data systems to ensure reliability and responsiveness. Collaboration: Partner with data scientists, analysts, and stakeholders to ensure that data solutions align with business … needs and analytic strategies. Scalability & Security: Implement and enforce best practices for data security, quality, and scalability across our data infrastructure. Essential Skills: Healthcare Data Expertise: Proven experience in designing and managing data solutions within healthcare environments. Demonstrated ability to work with More ❯

Key aspects of the role include: Data Pipeline Development: Architect, develop, and optimise data extraction, transformation, and loading (ETL) processes for high-volume healthcare data. Integration of NHS Systems Data: Work directly with NHS data sources and ensure seamless integration of … systems like UDAL, NCDR, SUS+, HES, and ODS into our analytics platform. System Performance: Monitor and enhance the performance of our data systems to ensure reliability and responsiveness. Collaboration: Partner with data scientists, analysts, and stakeholders to ensure that data solutions align with business … needs and analytic strategies. Scalability & Security: Implement and enforce best practices for data security, quality, and scalability across our data infrastructure. Essential Skills: Healthcare Data Expertise: Proven experience in designing and managing data solutions within healthcare environments. Demonstrated ability to work with More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

platform enables partners—from local pubs to multinational chains—to optimise staffing in real-time, enhancing efficiency and profitability. The Role As a Data Engineer, you'll play a pivotal role in shaping the data infrastructure. Your responsibilities will include: Building and Maintaining Data … engineers, and internal stakeholders to understand data needs and deliver solutions that drive data-driven decisions. Monitoring and Troubleshooting: Oversee pipeline performance, address issues promptly, and maintain comprehensive data documentation. What You’ll Bring Technical Expertise: Proficiency in Python and SQL; experience with … and scalable data solutions. Backend Development: Willingness to develop proficiency in backend technologies (e.g., Python with Django) to support data pipeline integrations. Cloud Platforms: Familiarity with AWS or Azure, including services like Apache Airflow, Terraform, or SageMaker. Data Quality Management: Experience with data More ❯

Role: Data & Migration Workstream Lead Location: London (Oxford Circus) Hybrid: 1-2 days per week in the office About Monument Technology Limited In building its core UK banking business, Monument has developed an open, scalable, cloud native and world-leading banking technology platform, the third pillar of the … innovate at a fraction of the cost. From front end mobile apps, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“bank in a box”) or in part as required. Our technology stack has gained positive attention … co ordinate technical delivery teams and cross-functional contributors including the ability to effectively engage with non-technical audiences. Skilled in data pipeline development and reporting implementation. Experience of data governance and data quality frameworks. Basic familiarity with cloud hosted online data More ❯

Who are Valcon: Valcon is a north-western European consulting, technology and data company based in the UK, the Netherlands, Denmark, Sweden, and even Croatia. Valcon is private equity backed and in recent years has bought together some of the most exiting companies from these companies to form … across Europe and have no plans to stop. What do we do: Our mission is to combine premium consulting with deep technology and data knowledge to add value to our clients. Overview of Data Practice: Every company has data challenges, easy or complex, big … or small. This asks for flexibility and in-depth knowledge of data solutions and techniques. We help to define the data strategy and implement best-fit data solutions. Being a leader on data services, running projects for and with our clients, we More ❯

agentic AI system that seamlessly integrates into clients' systems, automating compliance and portfolio risk analysis processes. Job Summary: We are seeking a Senior Data Engineer with 3-5 years of experience in building and maintaining robust data pipelines for our SaaS platform, ensuring high-quality data is available for analysis and decision-making. You will work closely with cross-functional teams to support data-driven initiatives and contribute to the development of innovative solutions. Responsibilities: Web Crawling and Data Extraction: Develop, deploy, and maintain web crawlers using Python to extract … analysis to provide insights and support decision-making processes. Work with financial datasets to identify trends, patterns, and anomalies. Data Pipeline Development: Design and maintain ETL (Extract, Transform, Load) pipelines to streamline data workflows. Integrate data from multiple sources and ensure More ❯

time with the negative aspects of money and more on the positive - enjoying what the world has to offer. Responsibilities As Head of Data you will be responsible for overseeing the development and implementation of Onmo’s data strategy. You will ensure internal and external stakeholders … have access to reliable and timely data. And you will collaborate closely with the Data Product Owner to ensure alignment with business goals and requirements. Own and communicate the vision for Onmo’s data strategy, ensuring alignment with business priorities across risk, finance, product, and customer … service. Drive data literacy across the organization by enabling self-serve capabilities for non-technical teams. Lead the design, development, and implementation of a scalable and robust data warehouse for high quality analysis and reporting across the business. Collaborate with the Data Product Owner More ❯

Senior Data Engineer – West London (office based 4 days a week) We are currently looking for a Senior Data Engineer to join an advanced analytics business who provide insights for ecommerce customers. As an organisation they have experienced amazing success over the last few years and … space. Requirements Strong expertise in PostgreSQL and SQL. Proficient in Python for data engineering tasks. Solid understanding of ELT pipelines, data architecture, and data modeling. Experience with modern data transformation tools such as dbt . Familiarity with AWS-based data pipeline services and cloud architecture. Comfortable working in agile teams and cross-functional environments. Knowledge of statistical concepts and their application in data-driven systems. If you have the desired skills and experience and would like to find out more please respond to this advert More ❯

AWS Data Engineer Salary: Negotiable to £80,000 Dependent on Experience London: Hybrid working 3 days per week in the office 2 days home-based Job Ref: J12931 A leader in consumer behaviour analytics, seeks a driven Data Engineer with proven AWS experience to guide data infrastructure architecture, working alongside a small talented team of engineers, analysts, and data scientists. In this role, you’ll enhance the data platform, develop advanced data pipelines, and integrate cutting-edge technologies like DataOps and Generative AI, including Large Language Models (LLMs … S3. Strong SQL skills for data transformation, cleaning, and loading. Strong coding experience with Python and Pandas. Experience of data pipeline and workflow management tools: Dagster, Celery, Airflow, etc. Build processes supporting data transformation, data structures, metadata, dependency and workload management. More ❯

join us at FPSM and be part of something bigger... What we are looking for: We are seeking a highly motivated and experienced Data Product Manager to own the strategy, roadmap, and execution of our Customer Data Platform (CDP) and Single Customer View (SCV). This … is a critical role within our rapidly growing data organization, and you will be instrumental in enabling data-driven decision-making across the business. You'll work closely with engineering, marketing, product, and other internal teams to ensure our CDP is a powerful tool for understanding … with overall business objectives and stakeholder needs. Requirements Gathering: Proactively gather, analyze, and prioritize requirements from internal stakeholders (marketing, product, analytics, etc.) for data integration, access, and utilization. Data Source Integration: Oversee the integration of various data sources into the CDP, ensuring data More ❯

Senior Data Engineer Job Type : Permanent Location: London – Hybrid/flexible Salary: £55,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge … client base. They are providing the utmost level of quality and security in everything they do. The Role We are seeking a Senior Data Engineer to join our Azure-native data team in a leading UK financial services firm. This role is key to maintaining and … evolving our data platform, supporting both ongoing enhancements and greenfield development. You will work on data integration, ETL pipelines, analytics, and AI-driven insights, ensuring robust data solutions that support business growth. You will be responsible for designing, building, and optimising Azure Data More ❯

make better use of it. We provide advice, support and delivery services across various industry sectors covering a multitude of areas, ranging from Data Strategy, Governance and Security to Data Platform Modernisation, Cloud and Customer Intelligence. We do everything with a view to creating tangible business … measure how we are performing and ensures we deliver the value that our customers deserve. Summary We are seeking a skilled and proactive Data Engineer with experience in Microsoft Fabric to join our growing data team. You will be responsible for developing, maintaining, and optimising data … lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity with DevOps practices, particularly around data pipeline deployment. Good problem-solving skills and the ability to work under minimal supervision. Effective communicator with stakeholders of varying technical expertise. Benefits Annual Leave More ❯

make better use of it. We provide advice, support and delivery services across various industry sectors covering a multitude of areas, ranging from Data Strategy, Governance and Security to Data Platform Modernisation, Cloud and Customer Intelligence. We do everything with a view to creating tangible business … measure how we are performing and ensures we deliver the value that our customers deserve. Summary We are seeking a skilled and proactive Data Engineer with experience in Microsoft Fabric to join our growing data team. You will be responsible for developing, maintaining, and optimising data … lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity with DevOps practices, particularly around data pipeline deployment. Good problem-solving skills and the ability to work under minimal supervision. Effective communicator with stakeholders of varying technical expertise. Benefits Annual Leave More ❯

Contract Data Engineer – £550/day (Outside IR35) – Hybrid (London) – 6-Month Initial Term Our client is seeking an experienced Data Engineer to join our team on a contract basis to support the development and optimisation of our data infrastructure within the energy trading … sector. This role is ideally suited to someone with a strong background in cloud-based data engineering, particularly with Databricks and AWS , who is looking to contribute to a high-impact project from day one. Key Details: Day Rate : £550/day IR35 Status : Outside IR35 Contract Length … Proven commercial experience with Databricks (including AKS) Strong hands-on experience with AWS Proficient in Python and/or Scala for data pipeline development Solid understanding of data warehousing concepts and ETL best practices Desirable Experience: Exposure to Power BI for data visualisation More ❯

About Quantum: Quantum is building next-generation AI and trading technologies that harness cutting-edge research and data science. As part of our rapid growth, we are seeking a highly skilled Senior Data Engineer to support our Data & AI team by designing and maintaining … robust, scalable, and production-grade data systems. This is greenfield project, allowing for full product ownership and key decision making. Role Overview: As a Senior Data Engineer at Quantum, you will be instrumental in building the infrastructure that powers our Data Science, AI and … Trading tools. You will work closely with the Data and Technology teams to ensure data accessibility, quality, and scalability - particularly focusing on trading (time-series databases), analytical, and AI pipelines. This is a highly collaborative role, ideal for someone who thrives on taking full ownership from More ❯

Data Engineer (Python Spark ETL) London/WFH to £90k Are you a tech savvy Data Engineer keen to make an impact, delivering Greenfield systems? You could be progressing your career at a successful and growing Cyber Security Risk Management tech company that specialises in solutions … s, working on complex and interesting systems at the cutting edge of technology. The company is scaling and enjoying great success. As a Data Engineer you'll be instrumental in building and scaling the data infrastructure to support advanced data aggregation, storage and analytics … Engineer with a strong knowledge of Data Lakes, Data Warehousing, ETL/ELT processes and data pipeline orchestration You have strong Python and SQL coding skills You have experience with big data frameworks and tools including Spark You have More ❯