501 to 525 of 1,416 Data Pipeline Jobs in London

client is looking for a talented Graduate Data & Platform Engineer to join their IT Data & Platform team, where you'll play a key role in designing, developing and maintaining cutting-edge data solutions within Microsoft Fabric. You'll build and optimise data pipelines, lakehouses and data warehouses, using PySpark, Python, T-SQL and DAX to deliver scalable, high-performing solutions that drive business intelligence and analytics. Working closely with stakeholders across the business, you'll develop robust, secure and well-documented data platforms while embracing ...

client is looking for a talented Graduate Data & Platform Engineer to join their IT Data & Platform team, where you'll play a key role in designing, developing and maintaining cutting-edge data solutions within Microsoft Fabric. You'll build and optimise data pipelines, lakehouses and data warehouses, using PySpark, Python, T-SQL and DAX to deliver scalable, high-performing solutions that drive business intelligence and analytics. Working closely with stakeholders across the business, you'll develop robust, secure and well-documented data platforms while embracing ...

Woven by Toyota is seeking an experienced Autonomy Data Manager to lead a team of data scientists, data engineers and ML engineers. You will shape data strategy, drive data models and ensure production-quality data pipelines ...

Design, build and enhance modern data engineering and AI solutions for clients, focusing on hands-on delivery across Azure, Microsoft Fabric and related Microsoft data platform services Develop data pipelines, transformations, semantic models and reporting solutions using SQL, Python, Power BI and Fabric Ensure … handover Follow agreed standards for quality, security and maintainability Work with clients and internal colleagues to understand requirements and translate business needs into data and AI solutions Communicate technical decisions and trade-offs clearly Prepare and maintain technical documentation, design artefacts and delivery updates Support implementation, governance ...

Location: Hybrid – London As a Senior Forward Deployed Engineering - Architect you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will own the architecture, lead design decisions, and implement end-to-end systems spanning data engineering … will have: Production Solution Delivery: Lead impactful customer technical projects by delivering production-grade systems, designing and building reference architectures, custom applications and data ingestion and ML/AI model integration Transformational Impact: Guide strategic customers as they implement transformational big data projects including ...

make an impactBuild systems for training, deploying and monitoring machine learning models used in our Disputes platform, at scaleBuild and optimize data pipelines and backend services to process dispute and payment data in real timeBuild and scale our feature store for use-cases both online … complete ownership of delivering comprehensive, end-to-end features within a startup-like setting, driving the entire lifecycle from requirement refinement, data pipeline construction and model training to troubleshooting and production deploymentTurn raw data into production-ready features that feed our dispute systemsCollaborate with platform ...

Great Yellow we’re looking for a Senior Data Platform Engineer to join our team. About Great Yellow Great Yellow is building the operating system for a regenerative economy. Our mission is to make regenerative land-use investable and scalable, helping businesses, investors, and land managers move from … data means before you model it. Build for reliability. Put the hooks, monitoring, and KPIs in place to know how a pipeline is performing, where its limits are, and when it’s degrading, before someone else notices. Contribute to the platform. Pair with our Senior Software Developer ...

performance, keeping teams in sync and workflows on track to maximise throughput. Simultaneously our computer vision and AI capabilities capture real-time data and detect surgical events – improving quality of data outputs. The result: ORs are optimised like never before – with predictive analytics and automated notifications … Engineering Own the architecture, quality, and scalability of Proximie’s data platform. Lead the team building and maintaining ETL/ELT pipelines, data warehousing, and analytics infrastructure. Set engineering standards, tooling decisions, and technical direction across the data stack (Python ...

looking for an RL Environment Data Engineer/Researcher to design, build, and refine reinforcement learning training environments across different domains. This role will focus on data collection, task definition, reward design, evaluation criteria, anti-reward-hacking mechanisms, and post-training validation of environment data effectiveness. Responsibilities - Design and improve RL training environments across various task domains. - Collect, clean, structure, and evaluate data used for RL environment construction and model post-training. - Define task objectives, reward functions, and evaluation standards to ensure reliable and reproducible training signals. - Develop technical approaches ...

Help build the platform at the heart of Retail Insight's data strategy We're looking for a Senior Platform Engineer to join our Data & Engineering team and play a key role in the development and evolution of our Databricks platform. This is a senior, hands … engineering role where you'll design, build and optimise the data platform that powers our products and services. Working alongside Platform, Data and Product teams, you'll help deliver scalable, secure and high-performance data solutions that enable analytics, machine learning and AI across ...

Software Engineer - Finance and Regulatory Reporting Location: London Experience: Junior/Mid Role We're looking for a software engineer to build the data pipelines behind our finance and regulatory reporting. You'll own the flow of trade and position data from our platform through … Linux. Careful, methodical approach to data accuracy. Excellent written and verbal communications skills. Nice to have Experience with data pipeline or workflow orchestration tools. Exposure to financial or regulatory reporting. Familiarity with cloud providers (e.g. AWS, GCP, Azure). Firm Mirae Asset Securities Co., Ltd. ...

made intelligent through a single platform. 1,000s of developers and AI labs build on Terra today. we process 15+ billion health data events per year. and we are just getting started. the health OS health data is fragmented. every device, every app, every sensor speaks … different language. we built the health OS to solve that — a full-stack platform that turns raw, messy, siloed health data into something developers and AIs can reason over, build on, and ship with. Terra was founded in 2021 and operates from London, San Francisco, and South Korea. ...

looking for an experienced Data Platform Architect to own the architecture, design, and evolution of enterprise data platforms. This role combines hands-on technical leadership with system design, architectural governance, and vendor oversight. The ideal candidate would have extensive hands-on experience with modern cloud-native … architecture (AWS preferred); and event-driven paradigms (Kafka). You will define scalable, secure, and resilient data platform architectures, guide implementation by internal teams and external partners, and ensure solutions meet the needs of the business while complying with regulatory and security requirements. Experience operating in regulated industries ...

days a week in the office Duration: 6 months initially You must have strong expertise in designing, architecting, and delivering enterprise-scale data platforms on Google Cloud Platform (GCP). The ideal candidate will have extensive experience with BigQuery, cloud data migration, data warehousing … while working closely with client stakeholders to define architecture and drive successful delivery. Key Responsibilities Design and implement scalable, secure, and high-performance data architectures on GCP, with BigQuery as the core data warehouse. Define end-to-end data architecture, including ingestion, transformation, storage ...

IDAs a Forward Deployed Engineer (FDE) you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will own the architecture, lead design decisions, and implement end-to-end systems spanning data engineering, AI, and application development. … will have: Production Solution Delivery: Lead impactful customer technical projects by delivering production-grade systems, designing and building reference architectures, custom applications and data ingestion and ML/AI model integrationTransformational Impact: Guide strategic customers as they implement transformational big data projects including ...

households, putting us in a unique position to drive the transformation of the household services sector. We harness cutting‐edge tech and data to help consumers manage their homes more effectively, and we provide some of the UK’s biggest companies with unparalleled insight into what customers need … Experience/Familiarity with AWS Multi Accounts system designs, tools like Crossplane and Control Tower. Familiarity with Argo Workflows or similar data pipeline as a service tools. Familiarity working with a variety of Cloud Native projects. Familiarity with Github Action. Familiarity with OpenTelemetry. More about ...

Senior Data Engineer (Quantexa) Location: London (Hybrid, 2 days in Office per week) Duration: 6 months + Rate : Up to £650 per day (Inside IR35) Opus have partnered with a Globally Renowned Data & AI consultancy who're searching for a Quantexa contractor to help with … delivery of market-leading big data driven transformation programmes. You'll be joining a high-performing team led by experienced data and AI practitioners who work across solution architecture, advanced analytics, cloud transformation, and multi-million-pound client engagements. Key Responsibilities: Design and build scalable ...

Senior Data Engineer (Quantexa) Location: London (Hybrid, 2 days in Office per week) Duration: 6 months + Rate : Up to £650 per day (Inside IR35) Opus have partnered with a Globally Renowned Data & AI consultancy who're searching for a Quantexa contractor to help with … delivery of market-leading big data driven transformation programmes. You'll be joining a high-performing team led by experienced data and AI practitioners who work across solution architecture, advanced analytics, cloud transformation, and multi-million-pound client engagements. Key Responsibilities: Design and build scalable ...

fastest-growing crypto applications and one of the biggest drivers of the explosive growth in memecoins on the planet. MISSIONS As a Data Analyst, your role is to support data initiatives across the company's product, helping teams make informed decisions through clear analysis, reporting … insight generation. You’ll work closely with more senior data staff while gradually taking on more ownership as you develop. Assist in designing, running, and analyzing A/B tests to help improve our consumer product experience Investigate product metrics to uncover trends, issues, and opportunities Build, update ...

owned by the Reporting Lead; your focus is turning agreed requirements into robust, well‐modelled Power BI solutions on top of our Snowflake data platform. You will work across a live portfolio of dashboards spanning leads, order take, handovers, retailer performance, inventory and customer experience. Our stack … Microsoft Power BI (including composite models over Azure Analysis Services and shared enterprise datasets), Snowflake as the data warehouse, and Power Automate for reporting workflow automation. This is an excellent opportunity to join a leading company. Our commitment to extending data and reporting products and services ...

operates in a uniquely complex and regulated environment and is maturing risk and compliance management towards intelligent, automated, and agentic systems underpinned by data to drive accountability and speed in decision making. The Director, Risk Engineering & Assurance is a pivotal leadership role in this journey. About the Role … direction for how the function adopts and scales AI, automation, and agentic workflows to enable our by-design and assurance ambitions. Deliver the data products. Build, publish, and continuously improve governed risk, compliance, privacy and resilience data products, curated collections of signals from across key areas ...

client, a leading US-based discretionary hedge fund, is seeking a strong Data Engineer to join their London team. This role sits within a front-office technology environment, focused on building and maintaining high-quality data infrastructure that supports trading, research, and portfolio analytics across … multi-asset platform. You will play a key role in developing scalable data pipelines and ensuring reliable access to clean, well-structured data used by portfolio managers, analysts, and technologists. The position offers strong ownership across the full data lifecycle, from ingestion through ...

commercial real estate information, analytics and news. Commercial Real Estate industry professionals around the globe use CoStar to access the most comprehensive data to make decisions with confidence. CoStar delivers immediate, verified commercial real estate information on over 5.9 million properties across every market. Learn more about CoStar. … experience with SQL Server, writing SQL queries, data matching/cleansing/enriching as well as ETL/data pipeline engineering. A demonstrable track record of building and launching successful products that leverage terabytes of data. Ability to analyse technical requirements and design new architectures ...

design, build, test, and deploy scalable AI services integrated with strategic systems and operational processes. You will collaborate with software engineers, AI and data science specialists, operations stakeholders, and business partners to improve operational workflows, controls, and the software development lifecycle. You will focus on hands-on engineering … equivalent practical experienceDemonstrate strong Python programming skillsDesign, develop, and integrate RESTful APIs, such as with FastAPIBuild and support ETL and data pipeline engineering workflowsApply Infrastructure as Code practices, such as Terraform, and work within CI/CD pipelinesDesign and integrate databases and data modelsApply monitoring ...

Data Engineer - GCP | £525-£550 per day | Inside IR35 6-Month Contract | Hybrid - 2 Days Onsite in Isleworth 83zero are working with a leading media and broadcasting organisation who are looking for an experienced Data Engineer to join their engineering team on an initial 6-month … contract . This is a hands-on engineering role focused on building and supporting cloud-native data applications, services and scalable data pipelines within Google Cloud Platform . We are looking for someone with a strong software engineering mindset who is comfortable developing production-grade applications ...