Data Pipeline Jobs in London

51 to 75 of 180 Data Pipeline Jobs in London

Data Support Engineer

London, England, United Kingdom
iO Associates - UK/EU
Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security … policies. Essential Technical Skills 2-3 years Azure data systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. … Building Azure data pipelines. Agile methodology experience. Problem-solving skills. Awareness of industry trends. Stakeholder engagement. Desired Experience Business Objects Reporting. Power BI familiarity. more »
Posted:

Senior Consultant - Data Engineer

London Area, United Kingdom
Anson McCade
Our client, a leading innovation and transformation consulting firm based in London, is seeking a talented Senior Consultant - Data Engineer. This role is perfect for an experienced professional who thrives in dynamic environments and is eager to drive impactful data engineering projects. The firm specializes in … leveraging advanced technology to transform businesses, providing cutting-edge solutions to a diverse range of clients. As a Senior Consultant - Data Engineer, you will play a key role in designing, developing, and optimizing data pipelines and architectures. Your expertise will help clients harness the power of … their data, ensuring robust and scalable solutions that meet business needs. You will work with a talented team, utilizing your skills in ETL processes, AWS, and Python to deliver high-quality data engineering projects. Key Responsibilities: Design and develop ETL pipelines to support data more »
Posted:

Lead Data Engineer

London, England, United Kingdom
Harnham
LEAD DATA ENGINEER LONDON BASED £80,000-90,000 PER ANNUM This Real estate company is searching for a new Lead Data Engineer, to Revolutionise their expanding Data and Analytics team, and help build out brand new Data pipelines using Python and … SQL. You will also be responsible for building a new Data platform in GCP. THE COMPANY This growing company are searching for a new Lead Data Engineer, to own the technical direction of their expanding Data and Technology team. They have been investing heavily … in their data team over recent years, and are a very data-focused business. THE ROLE Joining this team as a Lead data engineer, you will be responsible for building the company's next-generation data platform using GCP. This role has more »
Posted:

Full Stack Developer/ Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Set2Recruit
Full Stack Developer/Data Engineer opportunity. Full time permanent position. Fully remote or hybrid - office just outside of London. My client is a dynamic and rapidly growing electrification company dedicated to the decarbonisation of heat transport and induction. They have years of experience from across the energy … sector in integrating and connecting renewable generation, EV charging and the digitalisation of energy. They are seeking a Full Stack Developer/Data Engineer with Data bricks expertise to help tackle exciting challenges in the energy sector. In this role, you will: Develop and scale energy … solutions: Bring ideas to life, building robust and scalable applications from proof-of-concept to deployment, working alongside the Energy Solutions team. Design data pipelines for smarter energy: Craft and manage data pipelines using Databricks, integrating best-in-class demand forecasts to optimize energy use. Enhance more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Xcede
SENIOR DATA ENGINEER (Hertfordshire HQ – circa x1 day a week in office. Commutable from London.) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of … Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly … organisation. Requirements An academic background in Statistics, Mathematics, or Computer Science (or similar) A number of years of commercial work as a Senior Data Engineer (responsible for taking decisions, rather than just writing code) An ability to write production quality Python code. Strong SQL Skills Experienced creating data more »
Posted:

Machine Learning Engineer (Sports Analytics)

London Area, United Kingdom
Singular Recruitment
the selected Machine Learning Engineer, your background will include: A minimum of fours years industry experience in machine learning. Familiarity with cloud computing, data pipelines, and distributed ML technologies. Strong programming skills in Python, and experience with ML frameworks. Knowledge in Agile methodologies, CI/CD tools (e.g. more »
Posted:

Senior Analytics Engineer

City Of London, England, United Kingdom
Pavilion Recruitment Solutions
Engineering in sculpting and realising the strategic vision, enhancing the analytical prowess of the Actuarial team. Embrace the challenge of refining operations through data automation and harnessing cutting-edge technologies. Key Essentials: Proficiency in Python, SQL, and PowerBI is paramount. Experience with Azure or APIs is highly advantageous. … standards. Showcase technical prowess in Python, SQL, and JSON. Implement and oversee a robust CI/CD process. Enhance Azure modules, advancing automated data pipelines. Question conventional analysis and design, advocating for innovative alternatives. Articulate technical design principles to non-technical stakeholders. Propose enhancements to data efficiency and reliability. Represent the actuarial engineering perspective in key forums and authorities. Explore and introduce new tools for data management and analysis. To apply, please submit your CV and a cover letter detailing your relevant experience and how you can contribute to the success of more »
Posted:

Machine Learning Engineer

London Area, United Kingdom
Harnham
based projects, alongside deep learning and neural networks to support core clients Part of a team of 9 reporting to the Head of Data Science - working closely with a wider Data Engineering function Focusing on end-to-end data pipelines, for training, evaluating and … deploying ML models Working closely with Data Scientists on client partners, advising on best practice ML and MLOps infrastructure Looking for a 'Full Stack Data Scientist' profile Your Skills and Experience: MSc or PhD level education in STEM subjects. Strong knowledge of data science … fundamentals of building and evaluating models Strong experience in data pipelines and deploying ML models Preference for experience in retail/marketing but not required Tech across: Python, AWS, Databricks, PySpark, AB Testing, MLFlow, APIs Apply below more »
Posted:

Python Developer

London Area, United Kingdom
Cititec Talent
in the firm's technological evolution. The company are looking for a python developer who can design and develop their innovative AWS-native data analytics platform. Using Python, to build high-performance, high-throughput data pipelines for trading exchange, FX and fundamental data. This platform incorporates … real-time extraction, transformation and analysis of data from hundreds of diverse sources, some generating up to 100,000 transactions per minute The ideal candidate should have the majority of the following … Experience Developing and maintaining data pipelines for a company's analytics platform. Knowledge of how to collaborate with various teams to meet pipeline requirements. Be able to Troubleshoot and resolve pipeline issues. Strong experience in cloud-based development (AWS). Experience Optimizing pipelines for performance and more »
Posted:

Python Developer

London Area, United Kingdom
Hybrid / WFH Options
Cititec Talent
energy and commodities markets. They provide a wide range of services to a substantial and diversified customer base. They are seeking a skilled, data focused Python Developer who can design and develop their innovative AWS-native data analytics platform. As a Python Developer, you will be … building high-performance, high-throughput data pipelines for trading exchange, FX and fundamental data. The ideal candidate should have the majority of the following: Bachelor's degree in Computer Science, Engineering, or a related field. Strong Python development. Experience with Pandas is desirable. 3+ years of experience in … data engineering. Experienced in building ETL data pipelines. Relational database experience w/PostgreSQL. Understanding of tech within our stack: AWS/Apache beam/Kafka. Experience with Object Orientated Programming A desire to work in the commodities/trading sector. Permanent/Full-Time Employment. more »
Posted:

Head of Engineering

London Area, United Kingdom
Hybrid / WFH Options
Explore Group
I have partnered with a cutting-edge software business who are looking to hire a Head of Data Engineering, As the Head of Data Engineering, you will be responsible for designing, developing, and maintaining our data infrastructure on GCP. You will work closely with … cross-functional teams to ensure that our data pipelines are robust, scalable and efficient. The best-matched Head of Data Engineering will have the following experience and abilities: Led a team of data engineers in designing, building, and maintaining data pipelines on … the Google Cloud Platform. Evaluate and recommend new technologies and tools to improve our data infrastructure and processes. Monitor and optimize the performance of data pipelines to ensure reliability, scalability, and cost-effectiveness. Hybrid working in London, 2 days a week in the office If this more »
Posted:

Software Engineer (Rust/HPC/Real Time Data) - Up to £200k 1st Year Compensation

London Area, United Kingdom
Hunter Bond
Job Title: Software Engineer (Rust/HPC/Real Time Data) Client: Elite Tech Firm Salary: Up to £200k 1st Year Compensation Location: London Sells: Cutting-edge tech, ownership of multiple greenfield projects, no red tape, a friendly/collaborative environment, beautiful offices, personal projects on Fridays! An … as part of a team of engineers looking after and building a zero-down time low latency solutions for multi petabyte/exabyte data sets Working heavily in Rust Building/Optimising some of the world's most advanced data pipelines Collaborating with ML Engineers, Data … with other incredibly passionate technologists Skills: 5+ years experience working as a Software Engineer ideally using Rust Outstanding CompSci Fundamentals needed! Knowledge of data engineering principles/data lake architectures - Arrow/Parquet etc. Excellent knowledge of low-level concepts (e.g. compilers, x86, LLVM etc. more »
Posted:

Lead Machine Learning Engineer

London Area, United Kingdom
Harnham
projects, alongside deep learning and neural networks to support core internal projects Part of a team of 7 reporting to the Head of Data Science Chance to upskill and mentor juniors whilst remaining fully hands on Focusing on end-to-end data pipelines, for training, evaluating … and deploying ML models Working closely with Data Scientists on client partners, advising on best practice ML and MLOps infrastructure Driving best practices in a fast paced environment, within a well established company Your Skills and Experience: MSc or PhD level education in STEM subjects. Strong experience in more »
Posted:

Power BI Analyst

City of London, London, United Kingdom
Nigel Frank International
I'm looking for a Power BI and data enthusiast to join a business services organisation in Central London - this is a hybrid role, requiring 2-3 days per week in the office on average. This is a pivotal role for this business, where you'll be aligned … to one of their major financial services clients as the dedicated "data" person, and will proactively harness untapped data in the client's network to inform decision-making, ensure the delivery of exceptional services to the client, and drive operational efficiency. This will involve identifying data sources, implementing data capture and storage methodologies, and automating data pipelines from these various sources. You will be responsible for developing regular automated and ad-hoc Power BI reports to provide invaluable insight to management, on how they may reduce costs and improve operational more »
Employment Type: Permanent
Salary: £50000 - £65000/annum
Posted:

Data Platform Manager

London, England, United Kingdom
dmg media
Data Platform Manager Location: dmg::media Headquarters – London Position: Permanent Package Description Our benefits package increases the longer you’ve been with us. Here’s what to expect: 25 days’ holiday (increasing by 1 per year up to a total of 30) Upon joining you will be automatically … many other benefits…. Job Introduction DMG:Media own some of the world’s biggest news brands, and as such processes billions of data points every month in order to provide insights and targeting criteria for teams and stakeholders as part of our ambition to be the world … s leading Publisher when it comes to the sophisticated application of data – to power relentless growth. DMG:Media is seeking an experienced and talented Data Platform Manager to evolve its Big Data Platform and advance its overall data proposition. The successful candidate more »
Posted:

Data Engineering Lead

London Area, United Kingdom
Xcede
Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great scope for career progression & you’ll be leading and managing a small team of Data … from the Data Engineering work to contribute towards the Data Science/Analytics. Work across the whole Data pipeline (Data Engineering, Data Warehousing, Analytics) Help shape the strategy and roadmap for whole Data function and contribute towards … Engineering pipeline. Preferably someone who is capable of ‘wearing many hats’ and getting hands on in other areas across the Data Engineering pipeline if necessary! Experience leading team of Data Engineers/Scientists. Min. Bachelors’ degree in STEM subject (ideally from UK university). THE more »
Posted:

Senior Data Engineer

London Area, United Kingdom
La Fosse
Senior Data Engineer 6 month fixed term contract – 2 x a week in London £80,000 - £90,000 per annum + excellent benefits I am very excited to be partnering with a well-known fintech company! We're seeking a talented Senior Data Engineer to join … the data engineering team on a 6-month fixed-term contract, with the potential to extend but within a different department in the company. Role Overview: As a Senior Data Engineer, you'll play a pivotal role in maturing the data warehouse. You'll … collaborate closely with various stakeholders to gather business requirements and translate them into scalable data pipelines. Your expertise in Azure will be crucial in building robust infrastructure to support our data-driven initiatives. Key Responsibilities: with stakeholders to understand business requirements and translate them into technical more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Burns Sheehan
Senior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great … opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely … Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as needed. Modern tech stack - Python, AWS more »
Posted:

Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Travelex
Job Title: Data Engineer Job Type: Full Time, Permanent Working location: London, Hybrid Role Purpose At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. Our data architecture is becoming more service-oriented and … for you to solve. Our work is fast-paced although our team remains collaborative and flexible even when delivering fast. Your role as data engineer has a wide remit: working with product owners, subject matter experts and managers across the company, to design and deliver new components of … to the traditional data engineering type! Significant hands-on experience with AWS, especially AWS services focused on data flow, pipelines, data transformation, storage and streaming. Excellent data engineering skills, for example with SQL, Python, DBT and Airflow. Good understanding of service-oriented more »
Posted:

Data Engineer

Greater London, England, United Kingdom
Hybrid / WFH Options
Anson McCade
Data Engineer Location: London – Hybrid Employment: Full Time All applicants must hold a DV (Developed Vetting) clearance to apply. The Opportunity: For the Ministry of Defence (MOD), maintaining National Security is a 24-hour-a-day, 365-day-a-year mission. For this reason, it partners with this … Big 4 Firm to support its multidisciplinary AI & Cloud Data Engineering Capabilities. The Role: As an AI & Cloud Data Engineering practitioner, you’ll build large-scale data pipelines and infrastructure, utilising data integration tools to optimise complex data solutions. Collaborating … with high-performing Data Science and ML Engineering teams to drive innovation and insight through AI and Data across the Defence & Security sector. Required Skills/Experience: British Passport Holder with active DV (Developed Vetting Clearance) End-to-end development with data pipelines, ETL more »
Posted:

Lead Data Engineer

Greater London, England, United Kingdom
DATAHEAD
Lead Data Engineer Opportunity | 🌩️ Azure Cloud | 🛡️ Lloyds Insurer ✨🌟 A leading insurance business collaborates with DATAHEAD to find a talented Senior Data Engineer to join their Data Team 🚀. This is an incredible chance to work with technology and data-driven Lloyd's … offers agility and allows you to help shape its future 🌐! 🔧 You'll be joining the technology Engineering Team, focusing on designing and developing data solutions within an Azure cloud native environment 🌩️. The landscape is a greenfield setting, where a new Azure and Databricks-based platform will be … from scratch. Strong skills in Azure tooling (ADF), SQL, and Python are essential 🛠️. 🎯 Key Responsibilities: 🔹 Expertise in Azure platform architecture and developing data engineering pipelines 🌩️ 🔹 Proficiency in SQL and Python (Spark) 🐍 🔹 Provide technical assistance in data engineering, analysis, orchestrations, and enrichment 📊 🔹 Build relationships within the more »
Posted:

Developer (Python & Azure)

London Area, United Kingdom
Mastek
be essential for achieving project success. Key Responsibilities: Software Development: Write high-quality, maintainable code using languages such as Python , SQL . Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2 Utilize PowerBI, Tableau, or similar tools to design and create interactive … PoCs to validate new technologies, frameworks, or solutions. Drive the development of MVPs, ensuring timely delivery and alignment with business goals. Azure and Data Engineering: Leverage your Azure expertise to design and implement cloud-based solutions. Collaborate with data engineers to build robust data pipelines and ensure data quality. SQL and Data Interface: Develop and optimize SQL queries for data retrieval and manipulation. Work on data interfaces to connect various systems within the bank. Qualifications: Bachelor’s degree in Computer Science, Information Technology, or more »
Posted:

Senior Cloud Data Engineer – Snowflake / Azure

London Area, United Kingdom
OFS
A highly prestigious Investment Management firm are looking to hire a Senior Cloud Data Engineer with strong Python and Snowflake experience to join their new Data & AI team in a permanent position. The Cloud Data Engineer will join alongside Data Scientists and … Data Modellers to manage and improve the cloud-based Data Warehouse (Azure, Snowflake), and guide the organisation through an unprecedented period of data change. Your Key responsibilities will be: Engineering scalable and secure cloud data solutions for high-performance Data Science workloads and Generative AI applications Enhancing and managing the cloud-based Data Warehouse (Azure, Snowflake) Designing, building and deploying data pipelines to support advanced analytics and the development of Machine Learning algorithms and Generative AI (GenAi) applications Providing technology thought leadership and supporting more »
Posted:

AWS Data Engineer

London Area, United Kingdom
Hexaware Technologies
Amazon well architected frameworks, serverless solutions and improving existing platforms using AWS technologies with Agile delivery methods Demonstrable experience of Python 3, Python data management/… manipulation libraries and usage of Python with AWS components Demonstrable experience working in the Data domain, covering the full data pipeline from ingestion, mastering, management and consumption/distribution of large datasets Financial Services expertise preferred working with Equity and Fixed Income asset classes and … a working knowledge of Indices Experience with No-SQL and Relational databases and data analysis using SQL. Enter key behaviours and skills required to be successful in the role: Education & Work experience: 7+ years of AWS and Python development engineer experience within the Financial Services and Data more »
Posted:

MLOps Engineer

London Area, United Kingdom
DeepRec.ai
digital avatars and human clones. Role: MLOps Engineer Location: London Salary: Up to £100,000 Responsibilities: Develop ML Pipelines: Build and maintain scalable data processing systems. Ensure data quality and integrity. Automate ML Processes: Integrate machine learning solutions into existing systems and automate workflows. Deploy and … implementation practices. Ensure Security: Adhere to security and compliance standards in ML deployments. Requirements: Education: Bachelor’s or Master’s in Computer Science, Data Science, or related field. Experience: 2-3 years in ML, data engineering, or MLOps. Abilities: Strong analytical, problem-solving … and communication skills. Skills: Proficient in Python, ML frameworks like TensorFlow or PyTorch. Experienced with CI/CD, Docker, Kubernetes, and data pipeline tools like Airflow. more »
Posted:
Data Pipeline
London
10th Percentile
£52,500
25th Percentile
£62,500
Median
£75,000
75th Percentile
£100,000
90th Percentile
£120,000