Data Pipeline Jobs in London

151 to 175 of 186 Data Pipeline Jobs in London

Data Scientist

London Area, United Kingdom
Referment
Referment are working closely with the Investment Team for a global Multi-Strategy Hedge Fund to help hire a Weather Data Scientist for their London team. Their commodities division has been going from strength to strength and with their innovative weather research and forecasting platform, they’re looking … for a skilled Weather Data Scientist to work on PM engagement in advising how these analytics can be applied to trading within the Commodities Markets. This is an individual contributor role and will require someone who can work closely with portfolio managers covering weather analytics focusing on temperature … precipitation, and wind patterns impact on the commodity markets. You will work closely with data engineers focusing on the analytics and modelling side of the platform being built. Statistical analysis, weather mapping and visualisation reports will be required to show the impact of the prices on the commodities more »
Posted:

Python Developer

London Area, United Kingdom
Cititec Talent
in the firm's technological evolution. The company are looking for a python developer who can design and develop their innovative AWS-native data analytics platform. Using Python, to build high-performance, high-throughput data pipelines for trading exchange, FX and fundamental data. This platform incorporates … real-time extraction, transformation and analysis of data from hundreds of diverse sources, some generating up to 100,000 transactions per minute The ideal candidate should have the majority of the following … Experience Developing and maintaining data pipelines for a company's analytics platform. Knowledge of how to collaborate with various teams to meet pipeline requirements. Be able to Troubleshoot and resolve pipeline issues. Strong experience in cloud-based development (AWS). Experience Optimizing pipelines for performance and more »
Posted:

Software (Data) Engineer - Core Ledger & Data Populator | Prime Brokerage

London Area, United Kingdom
Selby Jennings
Partnered with a global fintech firm, in the prime brokerage space, that are looking for a skilled SWE (data focused) to join their London office as part of their core ledger & populator team, ensuring connectivity is in place to move/ingest large amounts of (market) data and systems in place to move money. Responsibilities: Build connectivity to facilitate the ingestion of market data and trading activities from both traditional and digital exchanges. Develop data pipelines for transferring large volumes of data, enabling real-time analysis. Build systems to … nice to have) Prior experience working with a mid-early stage fintech start up (nice to have) Experience with standard tooling for big data (nice to have) Experience in cryptocurrency (nice to have) This is a great opportunity to join a fast pace growing company with good funding more »
Posted:

SAS Developer

London Area, United Kingdom
Hybrid / WFH Options
Job N Job
London & Edinburgh Work Mode: Mostly WFH, candidates should be open to travel as required. Job Description: We are seeking a highly skilled Senior Data Engineer with expertise in SAS to join our team and contribute to the transformation of our data pipelines. The successful candidate will … play a crucial role in rewriting existing pipelines from SAS, Info, pearl, and shell scripts to Python and DBT-based solutions, ultimately loading data into Snowflake and Salesforce on Azure. Key Responsibilities: Lead the conversion of existing SAS-based modules to Python-based solutions. Design, develop, and implement … Python and DBT-based pipelines for efficient data transformation and loading. Collaborate with cross-functional teams to understand requirements and ensure successful pipeline migration. Utilize expertise in SAS, pearl, and shell scripts to seamlessly transition to Python and DBT technologies. Implement best practices for data more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Oakland Search
We are looking for a Data Engineer to join our Y Combinator backed start-up. They are using AI and ML technology to build a SaaS product. You will be working closely with the Data Scientists and wider engineering teams. Responsibilities Maintaining Python/SQL ETL … capabilities Collaborate with several teams to provide technical solutions Requirements Early-stage start-up passion Strong Python knowledge Experience building and optimizing "big data" pipelines more »
Posted:

Senior GoLang Developer - London Based

London, United Kingdom
Square One Resources
a Senior Go Lang Developer. Job Responsibilities/Objectives - Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. … Extensive ETL and Data warehousing experience - Strong experience in GoLang programming - Google Cloud Services and BigQuery Required Skills/Experience - Assess, analyse, data ingestion, transformation & storage layers (RAW, Exploratory, Curated .application ) - Understand and provide inputs for STT documents. - Design and develop the data pipelines more »
Employment Type: Contract
Rate: GBP Daily
Posted:

Senior GoLang Developer - London Based

City, London, United Kingdom
Square One Resources
a Senior Go Lang Developer. Job Responsibilities/Objectives - Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. … Extensive ETL and Data warehousing experience - Strong experience in GoLang programming - Google Cloud Services and BigQuery Required Skills/Experience - Assess, analyze, data ingestion, transformation & storage layers (RAW, Exploratory, Curated .application) - Understand and provide inputs for STT documents. - Design and develop the data pipelines more »
Employment Type: Contract
Rate: GBP 500 Daily
Posted:

Python Developer

London Area, United Kingdom
Hybrid / WFH Options
Cititec Talent
energy and commodities markets. They provide a wide range of services to a substantial and diversified customer base. They are seeking a skilled, data focused Python Developer who can design and develop their innovative AWS-native data analytics platform. As a Python Developer, you will be … building high-performance, high-throughput data pipelines for trading exchange, FX and fundamental data. The ideal candidate should have the majority of the following: Bachelor's degree in Computer Science, Engineering, or a related field. Strong Python development. Experience with Pandas is desirable. 3+ years of experience in … data engineering. Experienced in building ETL data pipelines. Relational database experience w/PostgreSQL. Understanding of tech within our stack: AWS/Apache beam/Kafka. Experience with Object Orientated Programming A desire to work in the commodities/trading sector. Permanent/Full-Time Employment. more »
Posted:

Head of Engineering

London Area, United Kingdom
Hybrid / WFH Options
Explore Group
I have partnered with a cutting-edge software business who are looking to hire a Head of Data Engineering, As the Head of Data Engineering, you will be responsible for designing, developing, and maintaining our data infrastructure on GCP. You will work closely with … cross-functional teams to ensure that our data pipelines are robust, scalable and efficient. The best-matched Head of Data Engineering will have the following experience and abilities: Led a team of data engineers in designing, building, and maintaining data pipelines on … the Google Cloud Platform. Evaluate and recommend new technologies and tools to improve our data infrastructure and processes. Monitor and optimize the performance of data pipelines to ensure reliability, scalability, and cost-effectiveness. Hybrid working in London, 2 days a week in the office If this more »
Posted:

AWS Data Engineer (Databricks)

London Area, United Kingdom
Hybrid / WFH Options
Revolution Technology
Our client are a renowned name in the Property Sector, they are on the lookout for 2 AWS Data Engineers to come in on a contract basis. Key Skills/Requirements: Must have Python & Spark experience Must have strong AWS experience Must have Terraform experience SQL & NoSQL experience … Have built out Data Warehouses & built Data Pipelines Strong Databricks & Snowflake experience Docker, ECS, Kubernetes & Orchestration tools like Airflow or Step Functions are nice to have Contracts are running for 6 months initially, paying up to £450p/day (Outside IR35) and will be mostly remote more »
Posted:

Data Analytics Engineer

London Area, United Kingdom
Brio Digital
Brio Digital are happy to be supporting a data consultancy who are currently looking for an analytics engineer. The role will be hybrid with 3x days per week on-site in London. Salary; Up-to £80,000. Analytics Engineer Experience & Tech; SQL Python Experience with cloud platforms such … as GCP or Azure. Experience with Big Query & Synapse. Experience with Data visualisation tools such as D3. Experience in a client facing position A consultancy background would be highly beneficial. Analytics Engineer role overview; You have previously had experience working across multiple client projects at one time. You … be very client facing & also present to clients so if you have done this previously, that will be highly beneficial. You will build data pipelines to support analytics across very large data sets. You will mentor and support more junior members of the team. Apply now more »
Posted:

Data Engineer

London Area, United Kingdom
Understanding Recruitment
Fantastic new opportunity for a Data Engineer to join a high performing team at a leading hedge fund! You'll be vital in building and maintaining infrastructure for the efficient execution of their quantitative and discretionary trading strategies. What we'd love to see: MSc in Comp Sci … Engineering etc. from a Top University Demonstrable Data Engineering experience within a financial services company or hedge fund/commodity trading Strong Python and SQL Building and maintaining data pipelines AWS preferred but not essential What's in it for you? £80k - £100k starting salary dependent … on experience Opportunity to work with a world class team of Data professionals and portfolio managers 4 days on site more »
Posted:

Software Engineer (Rust/HPC/Real Time Data) - Up to £200k 1st Year Compensation

London Area, United Kingdom
Hunter Bond
Job Title: Software Engineer (Rust/HPC/Real Time Data) Client: Elite Tech Firm Salary: Up to £200k 1st Year Compensation Location: London Sells: Cutting-edge tech, ownership of multiple greenfield projects, no red tape, a friendly/collaborative environment, beautiful offices, personal projects on Fridays! An … as part of a team of engineers looking after and building a zero-down time low latency solutions for multi petabyte/exabyte data sets Working heavily in Rust Building/Optimising some of the world's most advanced data pipelines Collaborating with ML Engineers, Data … with other incredibly passionate technologists Skills: 5+ years experience working as a Software Engineer ideally using Rust Outstanding CompSci Fundamentals needed! Knowledge of data engineering principles/data lake architectures - Arrow/Parquet etc. Excellent knowledge of low-level concepts (e.g. compilers, x86, LLVM etc. more »
Posted:

Azure Machine Learning Engineer (SC Cleared)

London, United Kingdom
LSA Recruit
/Contract- Inside IR35 Experience Req - 8-10YRS Job Overview: Looking for an Azure Machine Learning engineer to join our team of Data Scientists.The candidate will be joining a team who are experienced data scientists, but with less experience in Microsoft Azure tools (eg Microsoft … learning and AI, including good knowledge of cloud architecture and networking for Azure-specific solutions. Experience in Infrastructure as Code deployments Experience in data pipelines for machine learning workflows. Experience in deploying machine learning models and large language models. Experience in establishing CI/CD pipelines. Proficiency in … programming with Python plus any additional programming languages. Strong foundations in data science methods and best practices. Experience with open-source machine learning libraries and deep learning frameworks. Experience with at least one big data framework. Record of having been part of a team that has more »
Employment Type: Any
Salary: GBP Annual
Posted:

Quantitative System Developer

Greater London, England, United Kingdom
Petroineos Trading Limited
QD will focus on quantitative trading infrastructure development and maintenance. This will include back-testing, signal and risk monitoring, building and maintaining robust data pipelines and databases that connect with other quantitative trading infrastructures, Optimising system performance and scalability, Identifying and resolving technical problems that might arise within … What we’re looking for/Skills that will help you in the role programming skills using Python and experience of utilising large data sets (if you have proven additional skills using C++/C# will be seen as advantageous). knowledge of data structures, database … and data pipelines for efficient data management. experience of successful working in a trading environment; utilities, producers or trading houses is preferred but open to other relevant industry backgrounds. work experience in small, high-performance team a distinct advantage. strong numerical and analytical skills. thinking, practical more »
Posted:

Lead Machine Learning Engineer

London Area, United Kingdom
Harnham
projects, alongside deep learning and neural networks to support core internal projects Part of a team of 7 reporting to the Head of Data Science Chance to upskill and mentor juniors whilst remaining fully hands on Focusing on end-to-end data pipelines, for training, evaluating … and deploying ML models Working closely with Data Scientists on client partners, advising on best practice ML and MLOps infrastructure Driving best practices in a fast paced environment, within a well established company Your Skills and Experience: MSc or PhD level education in STEM subjects. Strong experience in more »
Posted:

Lead Machine Learning Engineer

London Area, United Kingdom
Harnham
based projects, alongside deep learning and neural networks to support core clients Part of a team of 12 reporting to the Head of Data Science Chance to have 1 direct report within an MLE team of 3 Focusing on end-to-end data pipelines, for training … evaluating and deploying ML models Working closely with Data Scientists on client partners, advising on best practice ML and MLOps infrastructure Driving best practices in a fast paced environment, within a well established company Your Skills and Experience: MSc or PhD level education in STEM subjects. Strong experience more »
Posted:

Azure ML Engineer

London, United Kingdom
Cactus IT Solution
Active SC Clearance Required Job Overview: The candidate will be joining a team who are experienced data scientists, but with less experience in Microsoft Azure tools (e.g. Microsoft Machine Learning and Azure AI). They should help with the upskilling of the team in these tools as well … learning and AI, including good knowledge of cloud architecture and networking for Azure-specific solutions. · Experience in Infrastructure as Code deployments · Experience in data pipelines for machine learning workflows. · Experience in deploying machine learning models and large language models. · Experience in establishing CI/CD pipelines. · Proficiency in … programming with Python plus any additional programming languages. · Strong foundations in data science methods and best practices. · Experience with open-source machine learning libraries and deep learning frameworks. · Experience with at least one big data framework. · Record of having been part of a team that has more »
Employment Type: Permanent
Posted:

Prime Financing Quant

London Area, United Kingdom
Anson McCade
teams, to promote the implementation of sophisticated tools/analytics and advance their risk/pricing workflow. Devote special attention towards building robust data pipelines. Develop new innovative models, as well as enhancing existing ones. Implement and enhance existing data pipelines required by our various models … in Math, Sciences, Engineering or Computer Science; Software design and development skills, particularly in Python or C++; Experience with complex/real-time data pipes; Significant work experience in a related field; Analytical, quantitative and problem-solving skills; Excellent communication and presentation skills, in particular to senior stakeholders more »
Posted:

Golang Developer - urgent

London, United Kingdom
Initialize IT
Developer - £500 per day - London/remote - 12 months Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. … Duties Assess, analyze, data ingestion, transformation & storage layers (RAW, Exploratory, Curated .application) Understand and provide inputs for STT documents. Design and develop the data pipelines using GoLang programming. Able to build APIs to integrate different sources Perform UT and validate the transformations. Deploy code using CICD … pipelines built. Essential Skills: Extensive ETL and Data warehousing experience Strong experience in GoLang programming Google Cloud Services and BigQuery more »
Employment Type: Contract
Rate: GBP Daily
Posted:

GoLang Developer

London, United Kingdom
fortice
days pweek) iR35 determination - Inisde iR35 Duration - 6 months Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud … Key Responsibilities Assess, analyze, data ingestion, transformation & storage layers (RAW, Exploratory, Curated .application ) Understand and provide inputs for STT documents. Design and develop the data pipelines using GoLang programming. Able to build APIs to integrate different sources Perform UT and validate the transformations. Deploy code using … CICD pipelines built. Essential Skills Extensive ETL and Data warehousing experience Strong experience in GoLang programming Google Cloud Services and BigQuery more »
Employment Type: Contract
Rate: GBP 495 Daily
Posted:

Go Lang Developer Hybrid Remote London £500 per day inside

London, United Kingdom
Hybrid / WFH Options
TELSTRA Associates
will need as much of the following as possible. Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. … Assess, analyse, data ingestion, transformation & storage layers (RAW, Exploratory, Curated application) Understand and provide inputs for STT documents. Design and develop the data pipelines using GoLang programming. Able to build APIs to integrate different sources Perform UT and validate the transformations. Deploy code using CICD pipelines more »
Employment Type: Contract
Rate: GBP 500 Daily
Posted:

Senior Data Engineer (SAS)

London, United Kingdom
Uniting People
Job Title: Senior Data Engineer (SAS) Responsibilities: Rewrite existing data pipelines (SAS, Info, pearl, shell scripts) to Python and DBT transformation-based solutions. Convert SAS-based modules to Python-based pipelines. Load transformed data to Snowflake on Azure. Requirements: Strong experience with SAS programming … primary skill). Proficiency in pearl and shell scripting (secondary skills). Expertise in Python and DBT for data transformation. Experience in converting SAS-based modules to Python-based solutions. Familiarity with Snowflake for data management. Experience with Airflow or similar technologies is a plus. Desired more »
Employment Type: Permanent, Contract
Salary: £65000 - £70000/annum
Posted:

Data Engineer - DBT, Python, SQL – Leading Hedge Fund – up to £250,000 total compensation

Greater London, England, United Kingdom
Saragossa
Push the boundaries of BI, building complex data pipelines and beautiful visualisations for all kinds of business users at this $50bn Hedge Fund. Every business user here understands the power and importance of data for them to do their jobs and for the business to excel. … t need to understand what a Hedge Fund does, but you’ll need to be adaptable and eager to learn. You’ll take data requirements direct from the business users and you’ll be given freedom and support to come up with your own ideas to give the … with modern tech such as Snowflake, Airflow, DBT, Kubernetes/Docker and cubeJS whilst also using Tableau CRM and Jupyter notebooks for gaining data insights. If you think there’s a better or newer tool, you’re free to use that too. The key think is that you more »
Posted:

Analytics Engineer

City of London, London, United Kingdom
Brio Digital
Brio Digital are happy to be supporting a data consultancy who are currently looking for an analytics engineer. The role will be hybrid with 2x days per week on-site in London. Salary; Up-to £80,000. Analytics Engineer Experience & Tech; SQL Python Experience with cloud platforms such … as GCP or Azure. Experience with Big Query & Synapse. Experience with Data visualisation tools such as D3. Experience in a client facing position A consultancy background would be highly beneficial. Analytics Engineer role overview; You have previously had experience working across multiple client projects at one time. You … be very client facing & also present to clients so if you have done this previously, that will be highly beneficial. You will build data pipelines to support analytics across very large data sets. You will mentor and support more junior members of the team. Apply now more »
Employment Type: Permanent
Salary: £60000 - £80000/annum
Posted:
Data Pipeline
London
10th Percentile
£52,500
25th Percentile
£62,500
Median
£75,000
75th Percentile
£100,000
90th Percentile
£120,000