26 to 50 of 104 Data Pipeline Jobs in the City of London

Data Engineer - London Salary: £60,000-£75,000 Dependent on Experience London: Hybrid working - 3 days per week in the office, 2 days home-based Job Ref: J13171 An exciting opportunity for a Data Engineer to join a growing technology business specialising in consumer data and analytics. Working within a small, talented team of engineers, analysts and data scientists, you will play a hand-on role in developing and improving the data platform, building scalable data pipelines and working with large volumes of consumer data. Strong coding ...

Senior Data Engineer – Databricks & DLT (Delta Live Tables) Certain Advantage are recruiting on behalf of our trading client for a Senior Data Engineerwith strong analytical capabilities and hands‐on experience in building scalable data solutions using a programming language like Python or Scala … well as experience in Databricks and Delta Live Tables - This experience is essential. Suitable candidates will have expertise inDatabricks,streaming architectures, data ingestion frameworks, anddashboarding, along with experience working withSAP data sources. You will be responsible for designing and implementing scalable data pipelines ...

support flexible working - click here for more information on flexible working options Flexible Working Options Hybrid Working JOB TITLE Senior Data Engineer SALARY £76,760 - £95,950 LOCATION London HOURS Full-Time WORKING PATTERN Our work style is hybrid, which involves spending at least two days per week … adjustments including hybrid working expectations in line with our Flexibility Works policy. What you’ll be doing... We’re looking for a Senior Data Engineer to join our Data Platform team and help build the foundations that power Curve’s data-driven culture. Working ...

Join to apply for the Senior Data Engineer role at Avencia Consulting Join to apply for the Senior Data Engineer role at Avencia Consulting Direct message the job poster from Avencia Consulting Talent Acquisition | Talent Sourcing Partner - Corporate Functions London | Permanent | Full-Time | Hybrid Working … excellent opportunity has arisen for a Senior Data Engineer to join a respected, international insurance and analytics organisation. In this role, you will design, develop, and maintain data solutions that enhance underwriting and claims decision-making, support operational improvements, and drive data-driven strategies ...

Role: We are looking for an experienced, highly motivated Python developer with expertise in building robust data pipelines, creating and manipulating DataFrames, and turning defined specifications into reliable, production grade scripts. The role centres on developing and orchestrating the data infrastructure behind a systematic research platform … with Python, especially Pandas and NumPy Mastery of SQL and PostgreSQL: schema design, complex queries, indexing and performance optimisation, beyond basic querying Experience with pipeline orchestration and scheduling Proven ability to deliver reliable, tested scripts against a written specification, and to migrate them cleanly from a test environment ...

Azure Data Support Engineer Location: Newcastle or London preferred. Job Type: Full-time | Permanent (On-Call Requirement) Security Clearance Requirement: This role is suitable for candidates who already hold UK Government Security Clearance (SC), or who are eligible and willing to undergo the SC vetting process (eligibility criteria … apply). Key Responsibilities Azure Platform Support & Monitoring Support and maintain Azure-based data solutions, including Azure Data Factory pipelines, datasets, linked services, triggers; Azure Databricks (Spark jobs, notebooks, clusters); Azure Machine Learning models and endpoints; Power BI dashboards and dataset refreshes. Monitor and troubleshoot failures ...

looking for a strong self-starter with a genuine passion for data and a drive to produce results. The right candidate will thrive in a fast-paced environment, where priorities can shift quickly, and will demonstrate the self-motivation and intellectual curiosity needed to continuously learn and develop … core principles: Client first Results and impact driven Self-motivated Continuous improvement Role Purpose The LPS Analyst will report to the LPS Data Lead, providing hands-on analytical and data support across LPS's monoline facilities and wider Lockton portfolio solutions initiatives. The primary focus ...

Title: Data Engineer - Snowflake&DBT Location: London (3 days in office) Salary/Rate: £600-700 per day inside IR35 Start Date: End of September Job Type: Initial 3-4 month contract (possibility of extension) Company Introduction We have an exciting opportunity now available with … sector-leading consultancy clients! They are currently looking for a skilled Data Engineer with Snowflake & DBT Specialist to join the data engineering team of a global asset manager, supporting Aladdin use-case development and the modernisation of legacy data processes. Job Responsibilities/Objectives ...

LEAD DATA ENGINEER (Azure) Uo to £75,000 + Benefits London (Hybrid) This is a fantastic opportunity to join one of the UK's most recognisable cultural organisations as they embark on a major data transformation programme. You'll take ownership of building a modern data platform from the ground up, driving best practice across data engineering while helping the organisation unlock the full value of its data and AI ambitions. THE COMPANY Part of a renowned charitable organisation that entertains millions across the UK, this is the largest publicly ...

savings, budgeting, financial coaching & rewards. Stream - Employee financial wellbeing support: early access to your earned pay, savings, budgeting, financial coaching & rewards. Responsibilities: Data ingestion: Work to build, test and implement solutions for new data acquisition, building end to end process to support the entire department. Using … python, connect to various third party APIs, returning complex data from multiple endpoints. Implement processes to retain and refresh this data within business systems. Data Modeling: Using the businesses preferred ETL tools, generate curated datasets from raw input tables. Ensure all datasets have clear ...

experienced Data Engineer looking for more than simply delivering another backlog of tickets, this could be an opportunity to have genuine influence over the technology, the solution and the direction of major National Security programmes. We’re working with a highly regarded specialist technology consultancy operating across Data … reputation for technical excellence and is winning significant programmes against much larger organisations. As part of continued growth, they are looking for experienced Data Engineer (with current UK security clearance) to play a key role in designing and delivering complex data solutions. Our client is open ...

Data Engineer - AWS, Spark & AI Salary: £60,000-£75,000 Dependent on Experience London: Hybrid working - 3 days per week in the office, 2 days home-based Job Ref: J13171 Join a fast-growing technology start-up where you'll have the freedom to experiment with cutting-edge … data and AI technologies, solve interesting problems and make a visible impact from day one. Working alongside a talented team of engineers, analysts and data scientists, you won't be confined to one small part of the platform. You'll build scalable pipelines, work with large ...

technology consultancy in London is seeking a Lead Data Engineer to help public sector organizations become data-led. This role involves defining data strategies … advising teams on data value, and contributing to recruitment and management efforts. Ideal candidates will possess strong skills in data pipeline creation, architecture design, and have a thorough understanding of agile practices. The role also offers flexible remote working arrangements. #J-18808-Ljbffr ...

analytics engineering team operating within a highly regulated environment. Key Responsibilities Technical Leadership & Platform Ownership Provide technical leadership for the organisation's strategic data and analytics products. Define and drive the technical roadmap for the GCP Analytics platform from concept through to implementation. Take ownership of engineering standards … with organisational governance standards, security policies and regulatory obligations. Balance innovation and rapid delivery with appropriate risk management and control frameworks. Design secure data integration patterns incorporating authentication, authorisation and access management technologies. Support delivery of solutions that are suitable for audit scrutiny and regulatory reporting requirements. Operate ...

/pain points. Next 6 months - some examples of what to expect: Help architect and deploy a scalable & cost effective ETL data pipeline with version control, outputting clean data ready for tokenisation. Help deploy our active deep learning training & validation architecture to prod, so that … healthcare and save lives. Work with the ML/data team to creatively ideate and ship features to improve ETL pipeline throughput and quality through a data-driven approach powered by analytics. #J-18808-Ljbffr ...

Databricks | Competitive Salary | UK (Remote) Are you an experienced Data Engineer who enjoys turning complex data into reliable, scalable solutions? Do you have strong hands‐on experience with Databricks, PySpark, Python and SQL? The role 7Dxperts is looking for a Senior Data Engineer … using Python and SQL. Create and maintain Databricks notebooks, jobs, workflows and clusters. Work with Delta Lake and lakehouse architectures. Monitor, troubleshoot and optimise pipeline performance. Maintain high standards of data quality and reliability. Automate processes and create reusable engineering solutions. Support and mentor junior Data ...

part of the global enterprise sales team and reporting to the Director, Enterprise Sales, this role contributes directly to ARR growth targets through disciplined pipeline management and the execution of complex, high-value expansion deals. This role requires a commercially sharp enterprise sales professional with a proven track record … workflow transformation within client organizations, positioning Chaos as integral to their design and visualization processes. Develops and manages a robust, long-term sales pipeline for the assigned portfolio, providing accurate and reliable forecasting for expansion revenue. Maintains expertise on global AEC industry trends, digital transformation initiatives, competitive landscapes ...

analytics suite to elevate the Actuarial and Underwriting teams and help answer Fidelis’ most difficult business challenges. You will work closely with the Data team as the company implements a new data architecture. Core Duties and Responsibilities: Be a strategic partner to the Underwriting team: Helping … unearth the metrics that will inform key business decisions. Understand and take ownership of our business processes, and recommend improvements in data management, error identification, quality control, or process automation. Ensure best practice and process documents are created to support training across the team Collaborate with Actuaries, Underwriters ...

Senior Data Engineer (Quantexa) Location: London (Hybrid, 2 days in Office per week) Duration: 6 months + Rate : Up to £650 per day (Inside IR35) Opus have partnered with a Globally Renowned Data & AI consultancy who're searching for a Quantexa contractor to help with … delivery of market-leading big data driven transformation programmes. You'll be joining a high-performing team led by experienced data and AI practitioners who work across solution architecture, advanced analytics, cloud transformation, and multi-million-pound client engagements. Key Responsibilities: Design and build scalable ...

DEVELOPER LONDON3 DAYS ONSITE OUTSIDE IR35 £450 TO £500 PER DAY This is an opportunity to join a business undergoing a major data transformation programme, helping to build a trusted reporting environment across multiple business functions. You will play a key role in shaping data architecture … strategic decision-making. The Company They are a well-established, commercially focused organisation with a strong international presence. As part of an ongoing data integration initiative, they are bringing together information from multiple systems across finance, HR, operations, and client-facing functions. They are investing in creating ...

Harnham. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range DATA ENGINEER - INVESTMENT FIRM 6-MONTH CONTRACT £600 PER DAY INSIDE IR35 HYBRID ABOUT THE COMPANY A rapidly growing investment firm headquartered in London, which … continues to attract strong investor backing. With 230+ employees and ongoing expansion, the company is now focused on becoming more AI- and data-enabled, modernising its infrastructure to support more advanced analytics and automation. THE TEAM You'll join a skilled and collaborative analytics team of eight, working ...

about building and delivering transformative digital solutions for a diverse range of Public and Private sector clients. We are recruiting for a Senior Data Engineer to join our Hippo Herd. We work at the intersection of strategy, design, and technology to solve complex problems and create lasting value. … collaborative and agile culture empowers our teams to make a genuine impact. As a Senior Data Engineer , you will play an important role in making Hippo the best Consultancy out there. You will work as part of a multi-disciplinary team combining data, design, product, delivery ...

INTEC SELECT LIMITED is seeking a Data Engineer in London to own the data platform end to end, shaping data movement from ingestion to warehousing and ML support. This hands-on role sits in a small, collaborative team with scope to influence architecture … standards from day one. You will build and own data pipelines, design data models, and help productionize ML models while ensuring data quality, governance and GDPR compliance across the business. #J-18808-Ljbffr ...

client, a leading global SaaS organisation is looking for a Senior Data Analyst to work on exciting AI/ML user experience projects for a 12 month contract. Hybrid with 3 days on site. Responsibilities; Providing data sources that help build the AI/ML user … experience Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow. Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality and robustness. Scope and plan ...

prepare businesses for agentic transformation. You'll work across multiple projects, helping establish the foundations for AI driven development, from integrations and data pipelines through to agent development, DevOps and CI/CD. The role could suit two closely related profiles: an Agentic Systems Engineer experienced in building ...