1 to 25 of 224 Data Engineer Jobs in London

Principal Data Engineer London (hybrid) Up to £100,000 base + package Here at Anson McCade we are partnering with a leading Digital Transformation Consultancy who are in need of an experienced Data Engineer to join a multi-disciplinary team building, supporting and maintaining User-Centred … databases is also desirable. Solid experience of at least one Cloud provider such as AWS, Azure or GCP. Strong experience of working with different data formats, e.g., CSV, JSON and XML Building reliable Data Pipelines Broader knowledge of IT — e.g., Security and Networking Working in an Agile Environment … office Salary up to £100,000 per annum Professional growth and career development Collaborative and inclusive work environment Health and well-being initiatives Principal Data Engineer London (hybrid) Up to £100,000 base + package If this position is of interest please don't hesitate and apply down more »

Data Engineers needed for 6-12 month project based in London paying £450 a day inside IR35. This is an Urgent role an ideally we need the data engineers to be able to start asap or within 3 weeks as a maximum. All data engineers have to … with Teams across multiple locations and time zones interpersonal and communication skills with an ability to lead a team and keep them motivated. Role – Data Engineer Location – London Rate - £450 a day all inclusive Location - London more »

Senior Azure Data Engineer - 6 Month Contract - Inside IR35 This is an Azure Data Engineer 6 month contract position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having … strong Azure Data Factory and Databricks experience. Work Involved: Implementing and delivering data pipelines Providing mentorship to junior members of the team Working with the Platform team defining capabilities for the lake framework Developing business conceptual data models Producing new frameworks using design patterns and data ingestion Requirements: Strong Data Pipeline experience Databricks Azure Data Factory Spark Azure cloud Financial Services If you're interested get in touch ASAP more »

Our leading Energy Trading client are looking for an experienced Data Engineer to join their team. They are leading wholesalers in power, natural gas, oil, LNG and coal. The role will be to utilise the companies data in a more sustainable form and into a more efficient … model. Key Responsibilities: Create data pipelines that combine internal and external data across several APIs Creating clear, compelling and accurate visualisations and dashboards Engaging directly with stakeholders and senior management to assess their requirements and translate business objectives into effective data visualisation solutions. Key Skills: Strong Python … and SQL coding experience essential Experience with scripting language Proficiency in data orchestration tools (Dagster/Airflow) Proficiency in visualisation tools such as Tableau and Power BI. Proficiency with Git and CI/CD (ideally using Azure DevOps Salary: £70,000 - 80,000 Hours: 40 hours a week more »

Leading eCommerce client are now searching for a Lead Data Engineer to play a pivotal role in delivering their innovative data strategy. This role will shape our client’s data function, delivering end to end data requirements and designing data pipelines/warehouses to … ensure data is streamlined and enhances overall business success. The role: Design, develop and test an array of data migration processes to streamline the conversation from existing system to a new Snowflake infrastructure. Manage the end-to-end data lifecycle, enabling the use of data to … influence overall business decisions. Streamline our client’s data processes to ensure that customer journeys are personalised. Ensure the accuracy and reliability of data. Collaborate on business projects, advising on data and data structures. Assess the commercial potential of our client’s data and use this more »

Intelligence technologies and leading and educating a technical team across two global territories. The client is in the initial stages of deploying the Collibra Data Catalog tool to assist in accurate reporting of IT Asset Management. Collaborate with key stakeholders to understand business requirements and translate them into Collibra … solutions. Lead the implementation of Collibra Data Catalog, including configuration, customisation, and integration with other systems. Design and implement data governance workflows, data dictionaries, and data lineage within Collibra. Develop and maintain Collibra data governance policies, standards, and rules. Provide technical guidance and support to … users on Collibra platform usage and best practices. Develop custom reports and dashboards to monitor data governance metrics and KPIs. Conduct training sessions and workshops for end-users to promote adoption and usage of Collibra. Work closely with the Collibra vendor and internal IT teams to resolve technical issues more »

shop and this role will face off with a range of business leads in order to build the pipelines that will ultimately ingest the data for their new strats! Responsibilities: Design and implement scalable ETL solutions (structured and unstructured; batch and streaming) Building data pipelines, standardizing, and cleansing … data for the investment team Define and set best practice standards surrounding data (i.e., data modelling, database design, ETL design, job scheduling and monitoring, etc) Manage the entire data flow, from acquisition to transformation into actionable insights using SQL and Python/Java Design and maintain … APIs Requirements: Degree in Computer Science. 4+ years of professional software development experience. A passion for data and experience in applying that passion to high quality data products. Strong knowledge of software engineering best practices, object-oriented concepts, and the ins and outs of data-focused development. more »

Senior Data Engineer 💰 £85,000-£100,000 🖥️ Snowflake, AWS, dbt, Terraform 🌍 London, 2-3 days a week in London office We are partnered with one the UK's most exciting e-commerce platforms, operating within the luxury beauty and wellness industry, and supporting them on their search for … a Senior Data Engineer. The role... As a Senior Data Engineer you'll be at the forefront of transforming and interpreting complex data into valuable insights that drive the business. Your expertise will be crucial in leveraging key technologies like Snowflake, AWS, DBT, and Terraform to … enhance understanding of customer behaviors, market trends, and operational efficiencies. What you'll be doing... You will gather, analyse, and transform data from diverse sources, ensuring cleanliness and quality. You will be architecting and building the next generation Data Platform. You will construct data models, pipelines, and more »

IT) Group Functions Job Reference # 294845BR City London Job Type Full Time Your role Do you have proven track record of building big data solutions? Are you confident at iteratively refining user requirements and removing any ambiguity? Do you want to design and build best-in-class, cloud … native big data solutions? We’re looking for a Big Data Lead Engineer to: • engineer reliable data pipelines for sourcing, processing, distributing, and storing data in different ways, using cloud (Azure) data platform infrastructure effectively. • transform data into valuable insights that inform … business decisions, making use of our internal data platforms and applying appropriate analytical techniques. • develop, train, and apply data engineering techniques to automate manual processes, and solve challenging business problems. • ensure the quality, security, reliability, and compliance of our solutions by applying our digital principles and implementing both more »

Data Engineer - Azure Databricks CONTRACT - London (Hybrid) Data warehousing - Trading - Credit/Market Risk Harrington Starr is working with a leading Energy trading firm in London on an initial 6-month contract for a market-leading project. The project is signed off and they are looking to … start interviewing ASAP. Responsibilities: Azure Cloud Data Engineering using Azure Databricks Data Warehousing Data Engineering Very strong with the Microsoft Stack ESSENTIAL knowledge of PySpark clusters Python & C# Scripting experience Experience of message queues (Kafka) Experience of containerization (Docker) FINANCIAL SERVICES EXPERIENCE (Energy/commodities trading) If more »

We have a very important mandate from a leading hedge fund that who are looking for a Senior Data Engineer to join a group formed only 3 months ago. They would be one of the first Data Engineers on the ground with full autonomy. This organization specifically … within the firm. The project itself cannot be disclosed yet as it is in such early stages but in regard to the amount of data you would be dealing with - THE SKY IS THE LIMIT!! Additionally, the firm has a real focus on introducing new technology if it can more »

TL;DR 🧢 Role | Senior Data Engineer 💫 Company | InsurTech, Scale-up, Data 📏 Size | c.100 🎯 Areas | Data Pipelines, ETL, Cloud Infra, DataOps, Data Models, Machine Learning ✨ Tech | Python, ETL, SQL (all flavours), GCP 📍 Based | London (Zone 1) 💻 Hybrid | 2 days a week in-office 💰 Offer | Up to … over half a billion $ in funding. 2024 is the year they 10x their client base. That's where you come in... 💥 As a Senior Data Engineer you will: be designing and developing complex data processing modules ranging from ETL to ML, working closely with the firm's … core algo team, who are developing the machine learning models that underpin the value my client provides to its customers collaborate with data scientists and engineers to design, build, optimise and maintain production grade data pipelines to feed the company's core algos create frameworks, infrastructure and systems more »

Eames Consulting are delighted to be supporting an established Investment management company that are looking for a Data engineer. Responsibilities: Develop and maintain complex SQL queries, customize reports, and optimize data usage. Create tools to address business challenges and empower users with third-party tools. Design and implement … cloud-based data platforms, ETL pipelines, and data integration. Collaborate with colleagues to ensure data integrity, quality, and security standards are met. Experience required: 3 years experience working as a Data engineer or similar Strong proficiency in SQL or Data Bricks and database development … including complex query optimization and performance tuning. Comfortable using programming languages such as Python Strong Data Warehousing experience - building data pipelines from scratch Good understanding of open source, big data, and cloud data platforms (e.g. AWS, Azure); given a business problem, you can analyse and evaluate more »

We are working on behalf of an International (Re)Insurance client based in London to recruit a Lead/Senior Data Engineer, joining an established team of Analytics Engineers helping optimise the Actuarial teams' efficiency through data automation and the use of emerging technologies. The successful candidate … will work on the following: - Actuarial Data Infrastructure - Data Engineering - Data Analysis & Visualisation We are looking for someone with Python and ideally SQL in conjunction, working knowledge of Power BI, and ideally Microsoft Azure (or similar such as AWS). Knowledge of API's is also helpful. … It will appeal to someone eager to join a collaborative team who are playing an important role in driving the use of data forward. This candidate is expected to have prior relevant experience as a Lead or Co-Lead on development projects, not necessarily within an insurance environment. Ability more »

Data Engineer Azure/Snowflake/Python London (Contract) Role: Our client is looking to expand their data engineering team and add in the utilisation of Snowflake which is currently being used by a select few members of the team, and upskilling taking place alongside. They want … to add in an additional team member who has multiple years of experience using Snowflake as a data tool and can hit the ground running Experience Snowflake Financial services Cloud (Ideally azure) Airflow would be an advantage more »

Data Science & ML Consultant Location : London – Hybrid Employment : Full Time All applicants must hold a DV (Developed Vetting) clearance to apply. The Opportunity : For the Ministry of Defence (MOD), maintaining national security is a 24-hour-a-day, 365-day-a-year mission. For this reason, it partners with … this Big 4 Firm to support its multidisciplinary Data Science and Machine Learning team within DSSV (Data Science, Simulation and Visualisation). The Teams work together to drive innovation and insight from data, using cutting-edge Data Science and Machine Learning techniques alongside Digital Transformation to … solve complex problems through AI and Data. The Role : Working closely with senior data scientists, the Consultant's responsibilities span the entire data science lifecycle, from Proof of Concept to fully tested production solutions. Additional duties include preparing technical documentation, participating in client proposal responses, and pitching data more »

Lead Data Engineer I'm currently working on a dynamic opportunity which is looking for a Lead Data Engineer to join and lead thier team! You'll play a pivotal role in bridging engineering best practices with thier data domain. Thier team is committed to … transforming data into actionable insights, aiding decision-making processes and enhancing our products. Your expertise will drive advancements in our data engineering practices, leading the development of new data products with a focus on data backends, infrastructure, and DataOps. If you thrive on enhancing infrastructure scalability … and designing sophisticated data architectures, then this role is perfect for you! Responsibilities Design Data Architecture: Spearhead the development of an event-driven operational data architecture. Optimize Infrastructure: Ensure the scalability and reliability of our data pipelines and infrastructure. Advance Data Privacy: Strengthen our data more »

employees worldwide. We aim to create diversity in the tech market and support the growth of the renewable energy sector. As a Management Information & Engineer, you will play a pivotal role in supporting and enhancing our business applications landscape, with an initial focus on Mercury XRM, our PowerApps-based … Customer Relationship Management (CRM) solution built on MS Dynamics 365. This role demands a deep understanding of data modelling, application integration, and support mechanisms to ensure optimal performance and user satisfaction. You will leverage Power Automate to streamline CRM workflows and require strong PowerBI skills for data analysis … and reporting. Additionally, expertise in JSON and Java is essential for potential integrations and customization tasks along with skills in Python for handling large data sets. This hands-on position requires not only technical acumen but also a strategic vision for data management information reporting within our organisation. more »

Data Engineer – London - £100,000 Description My client, a prominent figure in the insurance industry are on the hunt for a Data Engineer to join there ever growing Data team. The right individual will have a passion for Data as well as being able … to communicate to non-technical stakeholders. The right Data Engineer will ideally have experience working with Azure however my client are open to seeing people equally AWS/GCP. Responsibilities Designing and implementing scalable and efficient data storage solutions on Azure. Building and maintaining data pipelines … to ingest, process, and transform large volumes of data. Collaborating with data scientists and analysts to understand their requirements and develop optimized data models. Monitoring and troubleshooting data pipeline performance issues. Implementing security measures to protect our data assets. Conducting regular data quality checks and more »

Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good/Charity Essential skills required: Azure – solid experience required of the Azure Data ecosystem Python - ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure Data Engineers This is the chance to work for a unique organisation! Our client is a not-for-profit charity that reviews/certifies companies … circa in the UK). You will be reporting to the CTO who manages the tech team of circa 30 people comprising developers, data engineers, QA and DevOps. Essential skills required: Azure – solid experience required of the Azure Data ecosystem Python - ESSENTIAL as PySpark is used heavily. You more »

Data Engineer Do you want to join a leading investment firm specializing in quantitative trading, driven by innovation and excellence? Keep reading! 📍 Location : London, UK As a Data Engineer , you'll build and maintain infrastructure for trading strategies, collaborating with data scientists and analysts. Responsibilities … Data Pipelines 🔗 Data Integration 🗄️ Databases 🤝 Collaboration 🔄 Automation 🔐 Security What we would love to see from you! 🎓 Education : Master’s in CS, Engineering, Mathematics, or related field 📊 Experience : Proven Data Engineer experience, preferably in finance 💻 Skills : Python, SQL, NoSQL, big data tools Cloud platforms (AWS, Azure more »

BettingJobs are working with an established sports betting odds provider who are based in London who are looking to add a Data Acquisition Engineer to their team. Responsibilities: Develop, test, run and monitor software that consumes data efficiently from approved sources. Ensure proper documentation is written and … date. Adopt and follow a good pace of software refactoring ensuring fast delivery of accurate data. Use internal tools to evaluate and validate all data acquired. Ensure all data shipped to the customers meets the quality standards. Quickly address customer issues following escalation from the Client Services Team … Keep learning and improving, sharing the acquired knowledge with the wider group. Maintain good relationships with wider Data Acquisition Team. Maintain clear and open path of communication with Client Services Team. Requirements: Coding proficiency preferably in Scala; alternatively Java, Python or any other high level language. A Bachelors degree more »

We are looking for a Data Engineer to join our Y Combinator backed start-up. They are using AI and ML technology to build a SaaS product. You will be working closely with the Data Scientists and wider engineering teams. Responsibilities Maintaining Python/SQL ETL pipelines … AI capabilities Collaborate with several teams to provide technical solutions Requirements Early-stage start-up passion Strong Python knowledge Experience building and optimizing "big data" pipelines more »

Data Engineer Salary: £59,479 - £66,100 (dependant on skills and experience ) Location: London UK About Us MI5 keeps the country safe from serious threats like terrorism and attempts by states to harm the UK, its people and way of life. We carry out investigations by obtaining, analysing … limited and subject to business need. The Role Technology sits at the heart of everything we do at MI5. We're looking for experienced Data Engineers prepared to take on a more senior role within a multi-disciplinary product team. As a Data Engineer and working closely … with technical specialists such as Product Owners, Business Analysts, Delivery Managers, Software Engineers, Data Scientists and Machine Learning Engineers, you’ll build and run secure data applications and data products. You’ll promote Agile technical practises, using Agile methodologies to deliver digital products that are core to more »

an unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not just accessible but … optimised for safe, secure utilisation across multiple fronts — be it reporting, analytics, or powering applications — ultimately driving substantial productivity gains for all data consumers. As a collaborative force, you will seamlessly integrate across central, regional, and local teams, refining our client's data visualisation strategy and elevating our more »