1 to 25 of 63 Data Pipeline Jobs in Slough

engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities: Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources … effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote ...

developers (quants and strategists) in a unique hands-on opportunity within a focused, high-impact team. You'll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with … leading global Investment Banks' front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge faced by all banks, working closely with various businesses and gaining an overview of many different sectors. What We're Looking For 5 + ...

unique opportunity to remain hands-on in engineering while also leading a focused, high-impact team. You'll be at the forefront of data and cloud-native engineering, working with modern technologies across AWS, On-premise kubernetes, Python, and data pipelines, while engaging directly with … leading global Investment Banks' front-office. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge faced by all banks, working closely with various businesses and gaining an overview of many different sectors. What We're Looking For 10 + ...

Data Engineer £Up to £65,000 GBP Hybrid WORKING Location: London; Norwich; Watford; Colchester; Chelmsford; Woking; Chatham; Slough, Central London, Greater London - United Kingdom Type: Permanent Must Have: Active SC Clearance Join a world-class organisation delivering mission-critical data solutions for Defence, National Security … architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data ...

Data Engineer (Inside IR35) £425 Per day SC Cleared - A must to be considered for this opportunity London To support the formation of a new Data Team, there is a critical need to establish robust, scalable, and secure data infrastructure. Currently, data … performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). Support the integration of data into visualisation platforms and analytical environments (e.g., Power BI, ServiceNow). Ensure adherence ...

governance, and security across all platforms. Troubleshoot and enhance existing pipelines to improve scalability and resilience. Sample Projects You Work On Financial Asset Management Pipeline: Build and manage data ingestion from third-party APIs, model data using dbt, and support machine learning workflows for asset … production environments, emphasizing performance optimization and code quality. Python expertise: Advanced proficiency in Python for data engineering, data wrangling and pipeline development. Cloud Platforms: Hands-on experience working with Azure. AWS experience is considered, however Azure exposure is essential. Data Warehousing: Proven expertise ...

Data Engineer – Modern Data & AI Platforms London (Hybrid 2 days) | Contract/Permanent | Global Consulting Environment Build the data foundations behind AI, automation, and real-world impact. We're hiring a Data Engineer to join a fast-growing digital and data … operating across energy, manufacturing, chemicals, infrastructure, automotive, and commodities. This is a hands-on engineering role where you'll design and run the data systems that power analytics, automation, and AI-driven solutions — working alongside consultants, analysts, and data scientists in a true delivery-focused environment. ...

Lead Data Engineer (AWS Snowflake Python) London/WFH to £110k Are you a technologist Data Engineer with strong technical leadership skills? You could be progressing your career in an impactful, hands-on Lead Data Engineer role at a growing technology company as they … expand their UK presence. As a Lead Data Engineer you'll take responsibility for the team's engineering practices such as code reviews and CI/CD and for overall code quality and test coverage. You'll plan and manage the team's Sprints, collaborating closely with product ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

Senior Data Engineer Job Title: Senior Data Engineer Salary Range: £80,000–£100,000 Location/Working model: London | Hybrid This is a critical technical position within a high-growth, forward-thinking organization that specializes in digital innovation. We require an experienced Senior Data … systems for high-volume data ingestion and processing, implementing effective monitoring, logging, and alerting mechanisms. Performance Optimization: Continuously monitor, tune, and optimize pipeline scalability and performance to meet stringent throughput and latency standards. Cross-Functional Alignment: Partner directly with technical and business teams to ensure the data ...

Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks … Data Engineer to design, develop, and manage data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business ...

Data Engineer – SC Cleared (or Clearable) Location: Remote/London occasional visits to London Salary: Up to £70,000 Start Date: ASAP About the Role Join a dynamic Digital Transformation Consultancy as a Data Engineer and play a pivotal role in delivering innovative, data … What We're Looking For: Proven hands-on experience in data engineering projects Good hands-on experience of designing, implementing, debugging ETL pipeline Expertise in Python, PySpark and SQL languages Expertise with Spark and Airflow Experience of designing data pipelines using cloud native services ...

well-established professional services business is hiring a Data Engineer to play a key role in building and optimising its modern cloud data environment. This is a technical, hands-on role with team management responsibilities – ideal for someone who wants to stay close to the tech … while guiding and developing a growing team. Role: Data Engineer Salary: £70,000 - £85,000 Location: Guildford – 5 days per week onsite What you'll be doing: Design, build, and optimise scalable data pipelines and architecture Work hands-on with SQL, PySpark, Databricks, Azure, and Data ...

looking for a Data Engineer who will design and implement customer data solutions that enable personalised experiences while ensuring privacy, quality, and accessibility of customer information across all touchpoints. Length: 12 months Location: London, UK Environment: Hybrid - 2-3 days in the office Key responsibilities: Leading … engineering decisions for customer data, including infrastructure, APIs and data pipelines Defining & delivering company's identity customer 360 solutions, ensuring seamless integration across different customer-facing platforms Architecting and implementing real-time data integration Designing and enforcing consent and preference management systems in compliance ...

Founding Solutions Data Architect London/WFH to £115k Are you a data technologist with start-up experience looking for your next opportunity? You could be progressing your career, in a founding position at a tech start-up that is producing an AI native data pipelining platform. As the Founding Solutions Data Architect you'll play a vital role in helping client data teams to adopt and scale the company's platform. You'll be responsible for a broad range of activities including Solution Design and Architecture, Technical Onboarding ...

well as modernising legacy pipelines. If you like building data infrastructure where you can see the direct impact on conversion rates, pipeline quality, and reporting speed, this role will suit you. About You You're a data engineer with 3+ years' experience who thrives … understandable, not just making things work once. Most importantly, you care about outcomes. You measure the impact of your work on conversion rates, pipeline velocity, and data quality. You're excited to join a mission-driven organisation where better data infrastructure means better outcomes ...

models for education - solving the ultimate learning task of predicting student knowledge and optimal 'next task' Work with a vast amount of unique data - we have data from over 1M language tests, including text and voice data Create brand new dictionaries, applicable … English language, but in the future it could be other languages or even subjects such as Mathematics Analyse large amounts of diverse data - including data from every movie, book, and song Work in a cross-functional team and communicate with backend engineers and product managers Create ...

Senior Data Scientist Up to £100K Xcede is currently partnering with the world's largest multinational services company as they continue to expand their central data solutions capability. In this role, your work will be rolled out across a truly global legal organisation, shaping how advice … delivered to clients in 80+ countries worldwide. You'll use data and machine learning to enhance legal processes, support strategic decision-making, and deliver forward-looking insights to an international client base. This includes designing innovative, data-driven solutions, building proof-of-concepts, and converting them ...

leading Financial Services client in the City of London is now seeking an experienced Data Engineering Manager to join on a permanent basis. This role is offering a base of £90,000 + a strong benefits package and flexible working. The ideal Data Engineering Manager will … come from a data engineering background and have strong knowledge in SQL, Snowflake, Microsoft Azure, Azure Data Factory and Azure DevOps. The Engineering Manager will design, improve and maintain robust data pipelines within data architecture. To be considered for this role ...

client, an award-winning fintech specialising in investment and insurance data solutions, is urgently seeking a Senior Data Engineer. You will work with actuarial and asset management datasets, building end-to-end data pipelines in Python (Pandas, NumPy), SQL, GCP (BigQuery), DBT, and Databricks. … This role focuses on large-scale financial data, automating processes, integrating multiple data sources, and delivering actionable insights to senior stakeholders. Only candidates with direct experience in investment, asset management, or reinsurance/insurance operations handling financial securities or actuarial outputs will be considered. Key Skills ...

deploy LLM-based applications using frameworks such as LangChain, semantic search, RAG, and fine-tuning (SFT/RL). Develop backend logic and data pipelines to power intelligent automation and real-time processing. Manage infrastructure: relational and graph databases, containerization, CI/CD pipelines, and cloud platforms ...

numi is proud to partner with a growing global technology consultancy seeking a 5x Senior Data Engineers to join their team in London on a hybrid basis. This consultancy empowers some of the world's biggest businesses by delivering advanced data, AI, cloud, and digital solutions. … make a real impact, this is an excellent opportunity to expand your personal and professional skills across various industries and technologies. As the Data Engineer, you will be the core builder responsible for designing, constructing, and maintaining robust and reliable data infrastructure. Your key focus will ...

roadmap, combining leadership of architecture and engineering practice with hands-on development of prototypes and production features. You'll partner with Product, Data, and Platform Engineering to design and integrate AI-driven capabilities such as voice/chatbots, natural-language analytics, and predictive models. This role balances strategic … feasibility studies for emerging AI technologies. Collaborate with Product Management to scope AI features and align them with business goals. Partner with Data Engineering to operationalize models, manage training data, and implement monitoring and retraining pipelines. Work closely with Development, DevOps, and QA teams to ensure ...

deployed, adopted, and driving measurable results. What You'll Do Design and deliver AI systems: Build and deploy machine learning models and data-driven products that directly impact investment decisions and portfolio company performance. Drive measurable impact: Partner with internal desks and portfolio teams to integrate ML products … Deal Sourcing Workflows: Prototype experimental systems to automate early-stage deal sourcing. You'll build integrations to extract signals from public and proprietary data sources, integrate with third-party APIs to enrich lead information, and integrate with in-house GenAI platform to create a structured data ...

Data Engineer- (AI and Cloud-focused Business) You'll be part of a forward-thinking team building scalable data platforms, automation, and analytics solutions across Google Cloud and Google Marketing Platforms. Working between AI, data, and marketing technology, you'll help transform enterprise data … business value for leading brands. Shape the future of cloud-powered, AI-driven analytics with a team operating at the cutting edge of data and marketing tech. You'll work with: BigQuery Cloud Functions Dataflow Analytics Hub Looker Studio APIs & Python What we're looking for: Strong ...