151 to 175 of 239 Data Engineer Jobs in London

A highly prestigious Investment Management firm are looking to hire a Senior Cloud Data Engineer with strong Python and Snowflake experience to join their new Data & AI team in a permanent position. The Cloud Data Engineer will join alongside Data Scientists and Data Modellers to manage and improve the cloud-based Data Warehouse (Azure, Snowflake), and guide the organisation through an unprecedented period of data change. Your Key responsibilities will be: Engineering scalable and secure cloud data solutions for high-performance Data Science workloads and Generative AI applications … Enhancing and managing the cloud-based Data Warehouse (Azure, Snowflake) Designing, building and deploying data pipelines to support advanced analytics and the development of Machine Learning algorithms and Generative AI (GenAi) applications Providing technology thought leadership and supporting the business in adoption of Machine Learning and GenAI capabilities more »

Senior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great … opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely with … a fantastic Head of Software Engineering. What you'll be up to?: Data Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL more »

Senior Data Platform Engineer Up to £80,000 1 day a week in office (flexible) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly Azure ML. Data Engineering … Guarantee data access, Data quality, ETL, Data pipelines Platform administration: Help set up accesses, infrastructure, create new storage, enforce best practices Production: Help the preparation of the data science pipelines, interact with data scientists, re-shape code, support towards some ML Ops principles, make the more »

We are seeking a qualified Data Engineer to join our team, where your responsibilities will include: Designing, optimizing, and maintaining scalable data pipelines and ETL processes using Spark, ensuring streamlined data processing and integration. Collaborating cross-functionally to translate complex data requirements into actionable technical … solutions that drive business objectives. Leveraging Microsoft Azure and Databricks to architect robust data solutions, prioritizing performance optimization for enhanced operational efficiency. Conducting data modeling, profiling, and quality assessments to uphold the integrity and reliability of our data assets. Executing data governance, transformation, and integration initiatives … to support advanced analytics and reporting requirements. Integrating machine learning models seamlessly into data pipelines to facilitate predictive and prescriptive analytics. Ensuring adherence to data security protocols and regulatory compliance standards, maintaining the highest levels of database integrity and operational excellence. This position is available at either our more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description This is an exciting opportunity for an experienced Data Engineer. You will join a team delivering a design & development of modern data management tools to curate important data sets, models and processes, while identifying areas for process automation and further … a related quantitative discipline) Strong object-oriented design and programming skills and experience in OO languages (Python and/or Java) Previous experience in Data manipulation, Data Analysis or Data Modelling Deep understanding of multidimensionality of data, data curation and data quality, such as more »

Role: Senior Data Engineer Salary: £65,000 - £75,000 Location: London Pattern: Hybrid – 1x per week on-site Vitals: Python, Synapse, PowerBI, Data Factory, Kubernetes Visa Sponsorship: Not Available Responsibilities: Develop leading data warehousing solution. Support data and BI analysts by providing top quality data. … Act as key contact on data strategy across company. Design and develop data models, delivering ingestion of data sources into warehouse. The Perfect Candidate: Experience with delivery leading in data teams. Experience at different business levels and varied solutions. Capability and familiarity with BI, Synapse, Python … Data Factory & Kubernetes. Excellent communication and unrelenting curiosity. Submit your CV and if suitable, a consultant will get in touch ASAP more »

a business, put this down to not just their skilled work force but also their head office support team. This role is for a Data Engineer/BI developer who wants to continue to excel using the latest Data technologies. The role is primarily focused around building … but then also created some awesome dashboards and reports using Power BI. The successful applicants will be helping to really utilise the power of data to help them across a range of projects. This ranges from internal projects to improve the business but also, external projects that lead to … interest then get in touch ASAP. Send across your CV to t.shahid@nigelfrank.com or alternatively, give me a call on 0191 3387551. Keywords: Azure Data Factory, Azure Databricks, Databricks Lakehouse, MS Power BI, Power BI, Spark, Delta Lake, T-SQL, DevOps, ETL, Data Modelling, DAX, Data Warehousing more »

Senior Azure Data Engineer £85K - £90K (D.O.E) Hybrid: 2 - 3 days a week on-site in London Must be already eligible to work in the UK and not Sponsoship dependant Previous exclusive(ly) contracting experience will not be considered (unfortunately) As the Senior Azure Engineer, you will … oversee Azure governance, manage Azure subscriptions, and provide architectural design oversight for Azure infrastructure. Additionally, you will lead the Service Team within the Data Center Department. Responsibilities: Establish and enforce Azure usage standards. Manage budgets and provide cost reporting for Azure resources. Collaborate with various teams to design, deploy … of cloud resources. Support Microsoft Power Platform components including CRM, Power Apps, Power Automate, and Power BI. Share knowledge and support tools like Synapse, Data Factory, DataBricks, MS on-prem data gateway, Entra ID, and databases. Own the Kanban process, conduct bi-weekly standups, and coordinate team tasks. more »

Data Engineer Intern A unique opportunity to join a data driven STEM recruitment/executive search business that supplies the world’s leading Hedge Funds & Quant Trading firms with best in class technology talent. Your profile: Computer Science/STEM Graduate with a passion for building software … Directors Commercial experience in a fast paced industry Exposure to multiple business areas Opportunity to learn about the FinTech space Work on a strategic data project at the forefront of our growth *Potential for full time offer on successful completion of the internship* Apply now or get in touch more »

to be working with a London-based B2B SaaS startup who are looking to expand the engineering team by bringing in a business-savvy data engineer to be the third member of the data team. The role: This role primarily covers building out the core product by … to create a scalable SaaS product. Once this has achieved a certain level of product maturity, this role will also involve building their own data platform. We they offer: • Senior mentorship • Competitive compensation package, incl. stock options • Flexible hours and hybrid working, typically 3 days a week in the … be a net-zero CO2 company and donate 1% of their revenues to social impact causes. Requirements: • A proven level of commercial experience in data engineering • Experience at seed to series A/B stage companies or an excitement to experience first-hand the joys and pains the come more »

Our client, a leading energy-focused trading house are seeking a commodity pricing focused developer/data engineer for their European Cross Commodities portfolio in London. The role will be focused on using pricing data for the commercial trading teams, and playing a key role between internal … clients and technical staff. A major part of the role will consist of facilitating the creation of large and automated data pipelines for commercial trading stakeholders. The individual hired will be hands-on in helping to collect, cleanse and analyse data from multiple sources, identifying trends, patterns and … hiring an individual who can harness cross-functional collaboration, across all technology, infrastructure, devops, and commercial trading stakeholders, ensuring alignment and successful implementation of data projects and initiatives. Requirements: Degree program in Computer Science or related field 2+ years of Python programming experience in financial services or within energy more »

Role Profile Enter role description, key responsibilities, and job description: Hands on Senior Engineer with experience of working within high performance development teams Significant AWS Engineering experience implementing Amazon well architected frameworks, serverless solutions and improving existing platforms using AWS technologies with Agile delivery methods Demonstrable experience of Python … Python data management/manipulation libraries and usage of Python with AWS components Demonstrable experience working in the Data domain, covering the full data pipeline from ingestion, mastering, management and consumption/distribution of large datasets Financial Services expertise preferred working with Equity and Fixed Income asset … classes and a working knowledge of Indices Experience with No-SQL and Relational databases and data analysis using SQL. Enter key behaviours and skills required to be successful in the role: Education & Work experience: 7+ years of AWS and Python development engineer experience within the Financial Services and more »

fairly new, with a lot of what needs to be done not even built yet. You’ll be coming in to work closely with data scientists and the wider business to build all ETL solutions behind round the clock trading decisions. This is a great chance to get into … of autonomy. You will decide on the best solution and work with the business to deliver it to their requirements. Initial projects will include data infrastructure migration, building research data services and lots of ad-hoc data science projects. With the business still being small and growing … quickly, there a lots of times when you’ll need to be nimble and reactive. The majority of data projects are completed using a mix of technologies. It’s essential that you have a solid background in data engineering, ideally with a computer science degree. Strong Python, SQL more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices near … Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and utilising Databricks to support … the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data models to be used for analytics more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices near … Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and utilising Databricks to support … the ongoing development of the cutting-edge Data Platform. You'll seek opportunities for improvement where possible, and will collaborate with both business and technology stakeholders to ensure that the solution is fit for purpose. You will also design and develop data models to be used for analytics more »

A global construction company are looking for an experienced BI Developer/Data Engineer to join their growing Data Team in their London office - this is a hybrid role, requiring 3 days per week in the office to collaborate with colleagues. It's a really exciting time … to join the team, as they look to leverage the latest Microsoft Azure data technologies, having launched a brand-new Data Platform and introduced Databricks. The role is predominantly back-end Data Engineering focused, where you'll develop various solutions for data collection and integration, transformation … and modelling. This will include developing data pipelines in Azure Data Factory, to automate data collection and integration across various sources. You will also do a little bit of front-end work, developing engaging visuals in Power BI, though this will not be your primary focus. In more »

Engineering Manager/Principle Data Engineer - Inside IR35 - London - 6 Months SR2 is pleased to partner with an incredible charity who are looking to accelerate its Data Platform. This role in question will sit between an Architect and a Principle Engineer. For this role, you need to more »

Senior Data Engineer – West London - £100,000 Description I am seeking a highly skilled Senior Data Engineer to join an innovative team for one of my clients who specialise in computer software. As a Senior Data Engineer, you will be responsible for the development … implementation, and maintenance of our data infrastructure, ensuring the efficient and secure management of our company's data assets. You will collaborate closely with cross-functional teams to analyze data needs, design and build scalable data solutions, and provide data-driven insights to support strategic … decision-making. Responsibilities Designing, developing, and maintaining the company's data infrastructure, pipelines, and ETL processes Collaborating with data scientists, analysts, and product managers to understand data requirements and translate them into effective data solutions Implementing data quality controls and ensuring data integrity and more »

Role: Mid-Level Data Engineer Business Area: Engineering/Technology Reporting to: Head of Data Location: Hybrid/Remote About Validis Validis is a dynamic fintech company with a leading software platform, built for the extraction and standardisation of accounting data. Validis is both a B2B and … SasS with operations across the UK, US & Australia. We specialize in providing quality data for both audits and financial services, with the guarantee that our product will streamline processes for the financial industry. Our current client base holds a number of blue- chip companies, mainly comprising audit firms and … to excel in. We believe in the power of being... YOU! About the role We are looking for a skilled and motivated Mid-Level Data Engineer to join our growing team. This role will be fully remote, offering flexibility and the chance to contribute to our data more »

Data Engineer Salary: £59,479 - £66,100 (dependant on skills and experience ) Location: London UK About Us MI5 keeps the country safe from serious threats like terrorism and attempts by states to harm the UK, its people and way of life. We carry out investigations by obtaining, analysing … limited and subject to business need. The Role Technology sits at the heart of everything we do at MI5. We're looking for experienced Data Engineers prepared to take on a more senior role within a multi-disciplinary product team. As a Data Engineer and working closely … with technical specialists such as Product Owners, Business Analysts, Delivery Managers, Software Engineers, Data Scientists and Machine Learning Engineers, you’ll build and run secure data applications and data products. You’ll promote Agile technical practises, using Agile methodologies to deliver digital products that are core to more »

Lead Data Engineer I'm currently working on a dynamic opportunity which is looking for a Lead Data Engineer to join and lead thier team! You'll play a pivotal role in bridging engineering best practices with thier data domain. Thier team is committed to … transforming data into actionable insights, aiding decision-making processes and enhancing our products. Your expertise will drive advancements in our data engineering practices, leading the development of new data products with a focus on data backends, infrastructure, and DataOps. If you thrive on enhancing infrastructure scalability … and designing sophisticated data architectures, then this role is perfect for you! Responsibilities Design Data Architecture: Spearhead the development of an event-driven operational data architecture. Optimize Infrastructure: Ensure the scalability and reliability of our data pipelines and infrastructure. Advance Data Privacy: Strengthen our data more »

Job Title: Data Engineer Job Type: Permanent Location: London or Fully remote Salary: £50,000-£70,000 (Dependant on experience) + Bonus + Benefits Skills: Python, SQL, Posgress SQL, Snowflake, Powershell Roc Search`s client provides real-time decisions and active risk monitoring to enable their customers to … maximize profitability while managing risk. their solutions are continually adapting to changing market conditions. They 20+ years of retail data science expertise and experience. They work with a global base of leading commerce partners, representing a big proportion of all US omnichannel retail sales activity across hundreds of thousands … intelligence to operations, finance, marketing, and loss prevention. Their performance-improvement solutions yield measurable results with significant return on investment. About the role The Data Engineer will be part of a team that follows DataOps best practices and owns the standardized data assets and the processes around more »

not afraid to speak our minds to help steer our customers towards understanding and achieving their key goals. We are looking for a Lead Data Consultant to help us grow and on our journey of taking OC to the next level. Your experience as a data focused technologist … strategise, and deal with the ingestion, processing, integration and ability to get insights out of their data. What you’ll spend your time on: Data Strategy & Architecture: Help customers make sense of, and understand their data in the context of what their business is trying to achieve. Create … data models and articulate the tradeoffs around different data approaches. Design and Architect complex data platforms and solutions across a variety of different scenarios. Leadership & Consulting: Provide technical leadership and guidance for our customers and your fellow team-mates in the area of data and data more »

we thrive on pioneering new businesses and seizing energy investment opportunities. Job Summary The job holder will be responsible for expanding and optimising our data and data pipeline architecture, as well as optimising data flow and collection for cross functional teams. The Data Engineer will … support our software developers, database architects, and Trading teams with data initiatives that will ensure optimal data delivery architecture is consistent throughout ongoing projects. This role requires the jobholder to be self-directed and comfortable supporting the data needs of multiple teams, systems and products. They will … design, build and optimise the data architecture to support our next generation of products and data initiatives. Key Responsibilities: Create and maintain optimal data pipeline architecture Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key more »

Senior Data Engineer About us HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning. … Our team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and a dedication … and commercial decisions are driven by this innovative collection of art market data. Role overview We are seeking a highly skilled and experienced Senior Data Engineer. You would be joining a strong team of roughly 20 people (software and data engineers, data scientists, analysts), in a fast more »