151 to 175 of 212 Permanent Data Engineer Jobs in London

support RtB. * Solid MS SQL Server DBA experience (SQL 2012-2019) * Strong Database Design skills * Expertise in SQL Statement Tuning * Experience with native transactional Data Replication * Experience in configuring Always-On Availability Groups (incl. Windows Clustering) * Experience with deploying and managing Cloud Database Services (AWS/Azure preferred) like more »

Data Engineer Tech for good - up to £52,000 1 day a week - London My Client is in the tech for good space working to protect children globally. They are looking for a Data Engineer who will report directly to the Head of Data and … is responsible for building and maintaining of the Enterprise Data Platform, including data ingestion pipelines and data models. Responsibilities/skills required: Experience working the entire data lifecycle, building relevant data models and pipelines that meet business requirements Minimum of 3 years experience in a … Data Engineering role Must have strong experience with Snowflake and SQL Implement data solutions making sure the data is accessible, accurate and up-to-date Strong experience with data management, data migration, data ingestion, data transformation, data storage, data quality, data more »

Results | Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Investments Data, Technology team, tasked with developing, managing, and optimizing data pipelines within our … data ecosystem. Reporting to the Investments Data Lead, this role is instrumental in implementing the data strategy that supports front office stakeholders, systems, and clients. The Data Engineer will leverage cutting-edge technology in Snowflake, Python, SQL, and Azure to enhance our data capabilities … and support the investment decision-making process. Key responsibilities include: Design, build, and maintain efficient, reliable data pipelines using ETL and ELT processes. Ensure the seamless flow and availability of high-quality data across the organization. Utilize Snowflake for data storage, processing, and analytics. Optimize data more »

Data Engineer Consultant - Data & AI (DV Cleared/Eligible)65,000 – 75,000 + packageLocation: United Kingdom (London – London) Type: PermanentData Engineer Consultant - Data & AI (DV Cleared/Eligible)Location: LondonSalary: 65k - 75kAbout the Role:Our client, a leading consultancy in the Defence & Security sector … is seeking a skilled Data Engineer to join their AI & Data Engineering team. This pivotal role offers the opportunity to be at the forefront of advanced technology projects aimed at enhancing national security. The position is perfect for individuals who are passionate about leveraging their technical expertise … to contribute significantly to high-profile initiatives.Key Responsibilities:Develop and maintain scalable data pipelines and architectures that meet client needs across diverse data environments.Implement integration frameworks and query engines to produce high-quality standardized data, enabling insightful AI applications and reporting.Collaborate with multidisciplinary teams to deliver custom more »

Job Description: Data Engineer (Specialist/Professional) Work Location: London/Birmingham, UK Platform: GCP Position Overview: We are seeking a skilled and experienced GCP Data Engineer to join our team. As a GCP Data Engineer, you will be responsible for designing, implementing, and … maintaining our data infrastructure and pipelines on the Google Cloud Platform (GCP). Key Responsibilities: Design & Development: Design and implement data ingestion pipelines, data processing workflows, and data storage solutions using GCP services such as Cloud Storage, Big Query, Dataflow, Composer etc. Work with other DEs … to integrate data solutions into existing or new applications. Develop and manage data integration processes to extract data from various sources, transform and cleanse it, and load it into appropriate data storage systems. Implement robust ETL processes to ensure data quality and consistency. Data more »

Results | Truth Builds Trust If our mission, values, and purpose align with your own, we would love to hear from you! Your opportunity The Data Engineer is a crucial member of the Finance Analytics technology team, tasked with developing, managing, and optimizing data pipelines within our data ecosystem. The Data Engineer will leverage cutting-edge technology in Snowflake, Python, Informatica, and Azure to improve our data capabilities and support our Finance business partners in their decision-making processes. Key responsibilities include: Design, build, and maintain efficient, reliable data pipelines using ETL and … ELT processes. Ensure the seamless flow and availability of high-quality data across the organisation Use Snowflake for data storage, processing, and analytics. Optimise data structures and queries to support analytics and BI initiatives Develop scripts in Python and SQL to automate data processes, integrate data more »

Senior Data Engineer Python, SQL, Big Data FrameworksLondon, Geneva, Dubai - 4x a week (no flex)110-120,000 + bonusSeeking a skilled Data Engineer to join a company specialising in quantitative trading and investment management. This role is pivotal in building and maintaining the infrastructure … that supports their cutting-edge trading strategies.Key Responsibilities:Design and manage scalable data pipelines.Integrate data from various sources and develop ETL processes.Optimize database systems for high performance.Work with data scientists and analysts to meet data needs.Automate data processing tasks to enhance efficiency.Implement data security … and ensure compliance with industry standards.Requirements:Master's degree in Computer Science, Engineering, Mathematics, or related field from a top uni.Proven experience as a Data Engineer in the financial services or hedge fund industry.Technical Skills:Proficiency in Python and SQL.Experience with relational and NoSQL databases.Knowledge of big data more »

Data Engineer – SAS/SQL/Power BI * Sponsorship is not available with this position * Role – Data Engineer Salary – Up to £75k DOE Location – Manchester or London (Hybrid) A well established and award-winning Data consultancy are looking to add a Senior Data Consultant … to join their talented data team. You’ll be at the centre of everything they do as a business, supporting a range of top tier clients. The position is offering a basic salary up to £75,000 depending on experience as well as a discretionary bonus, 25-day annual … more; Flexible working environment Inclusive and friendly culture Private Medical Insurance Buy and Sell additional annual leave Funded Learning and development programmes The Successful Data Engineer will have: Experience in developing and designing data pipelines and ETL processes Previous experience of data warehousing Utilise SAS for more »

LEAD DATA ENGINEER LONDON BASED £80,000-90,000 PER ANNUM This Real estate company is searching for a new Lead Data Engineer, to Revolutionise their expanding Data and Analytics team, and help build out brand new Data pipelines using Python and SQL. You … will also be responsible for building a new Data platform in GCP. THE COMPANY This growing company are searching for a new Lead Data Engineer, to own the technical direction of their expanding Data and Technology team. They have been investing heavily in their data team over recent years, and are a very data-focused business. THE ROLE Joining this team as a Lead data engineer, you will be responsible for building the company's next-generation data platform using GCP. This role has many hands-on aspects, along with more »

Senior Data Engineer Location: London Salary: £75k - £90k (DOE) About the Company: Our client, a leading technology-driven organization, is seeking a talented and experienced Senior Data Engineer to join their dynamic team. The company prides itself on fostering innovation and utilizing cutting-edge technology to … drive business success. This is a fantastic opportunity to work with a team of experts who are passionate about harnessing data to create impactful solutions. Key Responsibilities: Design, develop, and maintain robust ETL (Extract, Transform, Load) processes to ensure efficient data flow and integration across various systems. Utilize … Python for data manipulation, transformation, and automation tasks. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions. Implement data pipelines and workflows to support real-time and batch data processing. Optimize database performance, including tuning queries and more »

Principal Data Engineer Location: London (2 days a week in the office) Salary: £90k - £105k (DOE) About the Company: Our client, a leading technology-driven organization, is seeking a talented and experienced Lead Data Engineer to join their dynamic team. The company prides itself on fostering … cutting-edge technology to drive business success. This is a fantastic opportunity to work with a team of experts who are passionate about harnessing data to create impactful solutions. Key Responsibilities: • Design, develop, and maintain robust ETL (Extract, Transform, Load) processes to ensure efficient data flow and integration … across various systems. • Utilize Python for data manipulation, transformation, and automation tasks. • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions. • Implement data pipelines and workflows to support real-time and batch data processing. • Optimize database performance more »

We are seeking an experienced Python Data Engineer Consultant to join a leading hedge fund. The ideal candidate should have a proven ability to design and implement data solutions, with expertise in extracting, transforming, and loading (ETL) data from various sources, including websites, PDFs, and Real … Time data streams. Role: Python Data Engineer Client: Leading Hedge Fund Type of role: contract (6 months) Location: London office Rate: up to £1500/day Key Responsibilities: Architect, develop, and optimize data pipelines for extracting, transforming, and loading data from diverse alternative data sources, such as web scrapes, PDF files, and Real Time data infrastructures. Implement and manage database solutions in SQL Server and various cloud-based environments, ensuring data integrity, efficiency, and accessibility. Build and maintain Real Time data processing systems capable of handling large volumes of data more »

A global leading commodities trading firm have partnered with Referment to find a skilled Data Engineer to join their London team on a contract basis. This organisation has some exciting Greenfield projects focussed on modernisation of data warehouse, data lakes and data streaming services. This … is critical role, which will require designing, implementing, and enhancing data solutions to support the businesses trading operations. This role will involve building out data pipelines, ETL processes and data warehouses and will require a well-rounded data engineer with deep experience in Python and … other OO languages like Java. Delivery is vital within this role so experience in scaling up data systems using the best data engineering processes is required. Due to the nature of commodities trading, there is exciting problems to solve from data storage, reporting analytics and processing data more »

Roles and Responsibilities: • Analyse and organize raw data • Build data systems, pipelines, and data products. • Evaluate business needs and objectives • Interpret trends and patterns • Conduct complex data analysis and report on results • Prepare data for prescriptive and predictive modelling • Build algorithms and prototypes • Combine raw … information from different sources • Explore ways to enhance data quality and reliability • Identify opportunities for data acquisition • Develop analytical tools and programs • Collaborate with data scientists and architects on several projects • Automate Tasks • Create Models and Identify Patterns Key Skills: • Previous experience as a data engineer or in a similar role • Technical expertise with data models, data mining, data migration, Data warehousing and segmentation techniques (GCP). • Big query, big tables and Compute engine in GCP. • Knowledge of programming languages Python, R, and java. • Machine learning will be added advantage. • Hands more »

Senior Azure Data Engineer (Consultancy) £70,000-£80,000 salary Hybrid (London) Immediate start One of my long-standing consultancy clients, one of the UK's leading Microsoft Solutions Partners for over 20 years and experts in digital transformation with Azure, have just reached out with an urgent … hire for a Senior Azure Data Engineer to join the team. **This is a permanent position ( no contractors will be considered ), and you must have full right to work in the UK to apply** They have a new project starting in mid-February, so are looking ideally for … for interviews next week, and they are looking to have this position filled by next Friday . Essentials: Experience in a consultancy . Azure Data Engineer certification . Experience working with Dynamics 365 Experience with Azure Synapse , Data Factory , Data Lakes 4+ years as a Data more »

Job Overview Position: Senior Data Engineer In this role, you will be responsible for storing, processing, modeling, and applying data science to ensure that data and insights are available for data analytics and business intelligence (BI) systems. You must be proficient in data assessment … and profiling, source system analysis, and providing a clear vision for processing and interpreting data to support its end-use. Ideal Candidate Profile The ideal candidate will have a background in Data Engineering or Data Warehousing (Data Engineer/DW Developer) with robust DW development … and ETL/ELT data pipeline experience, along with expert knowledge of SQL. Key Skills - Mandatory Strong data modeling and SQL/database design skills Proficiency in ETL/ELT processes Extensive experience with Python Excellent numerical, analytical, and statistical skills Ability to visualize and present data more »

Senior Data Engineer Salary Negotiable to £70,000 DoE Hybrid working with 2 days in London Job Reference J12785 Work with an award-winning independent protection adviser. Develop the data engineering capabilities. Data is a key enabler for the business and developing enterprise grade data engineering services is a central pillar in the digital transformation program. The data pipelines and models that you will develop will underpin all Business Intelligence, Machine Learning and CRM capabilities. The role holder must ensure that the data is well-managed and ready for consumption by the … business, which will require the integration of multiple data sources (both cloud and on-prem) and developing data transformations pipelines in an Azure Synapse environment. The role will be aligned to a specific area of the business e.g. the digital teams or central data services and projects more »

INFOLEAD DATA ENGINEERLONDON, CURRENTLY FLEXIBLE/REMOTE/HOMEWORKINGUP TO 100,000 + BENEFITSAs a Lead Data Engineer, you will be inheriting a Snowflake data platform for a successful Ecommerce company that has disrupted the market with their product line. You will be leading a junior … to further develop the platform and team members.THE COMPANY:It has only been in the last year that this company has invested in their data function which has massively impacted the growth of the business. They have grown their data department from 0-to 30 with Data Engineering sitting at the forefront of this. With headcount for further growth, it will be your responsibility to take the data platform to the next level, driving modern ways of working including software principles, testing, CI/CD etc.THE ROLE:As a Lead Data Engineer, you more »

Senior Data Engineer (AWS) up to 90k London - 2/3 days a week My Client is an exciting scale up focused on the Art world, looking for a Senior Data Engineer to join a team of software engineers, data engineers, data scientists, and … analysts. You will be responsible for designing and constructing reliable data pipelines. You will leverage the most advanced data engineering and Python tools to ensure the most efficiency and effectiveness in your work. Responsibilities: Collaborate with the team to design, test, and implement scalable and secure data pipelines that meet business needs. Maintain the integrity of data by ensuring good quality. Monitoring pipelines for optimal performance and minimal downtime. Adapt data models to accommodate changing business requirements in collaboration with other teams. Collaborate with other teams Share expertise by mentoring and showing best practices more »

Lead Data Engineer (Director) - Individual contributor - Azure, Data Factory, Databricks, Apache Spark - London Based I am hiring for a Lead Data Engineer for a crucial role within one of my Investment Bank clients in London. This role is at Director level as they require a … likely to grow and have line management responsibilities in the future. Due to this there is an emphasis on current, hands on experience within Data & AI. Key Responsibilities: Leading data engineering practices Support current applications Introduce AI practices to the team/project Communicate key successes with stakeholders … Key Skills: Azure Databricks Apache Spark Datascience, AI, ML Certifications or continued upskilling/contribution to blog posts within Data & AI beneficial but not essential. This is a full-time role offering up to £150k salary plus bonus and benefits. 3 days minimum per week in the office in more »

ROLE SUMMARY DATA ENGINEER REMOTE/TRAVEL TO CLIENT SITE IN LONDON Valcon UK are looking to recruit a self-motivated, highly logical and intellectually curious Data Engineer’s to join our expanding Data capability in the UK. As a growing business area, the ideal … strategy, turn it into an actionable blueprint and help the client get it done. Who have deep expertise in operationalising strategy, process design, digitisation, data and analytics, automation, technology and change. RESPONSIBILITIES: Analyse and organise raw data Build data systems and pipelines Evaluate business needs and objectives … Interpret trends and patterns Conduct complex data analysis and report on results Prepare data for prescriptive and predictive modelling Build algorithms and prototypes Combine raw information from different sources Explore ways to enhance data quality and reliability Identify opportunities for data acquisition Develop analytical tools and more »

Lead Data Engineer85,000 – 103,000Location: United Kingdom (London – London) Type: PermanentPrincipal Data EngineerLocation: London (2 days a week in the office)Salary: 90k - 105k (DOE)About the Company:Our client, a leading technology-driven organization, is seeking a talented and experienced Lead Data Engineer to … cutting-edge technology to drive business success. This is a fantastic opportunity to work with a team of experts who are passionate about harnessing data to create impactful solutions.Key Responsibilities:Design, develop, and maintain robust ETL (Extract, Transform, Load) processes to ensure efficient data flow and integration across … various systems.Utilize Python for data manipulation, transformation, and automation tasks.Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions.Implement data pipelines and workflows to support real-time and batch data processing.Optimize database performance, including tuning queries and managing more »

Working with a top tier Digital Asset Management firm who are looking for an adept and experienced Data Engineer to play a critical role in shaping and managing their data engineering platform. This role demands strong technical skills and a proven ability to work closely with quantitative … researchers, ensuring seamless integration of data engineering processes to support our quantitative investment strategies. Key Responsibilities: Collaborate closely with quantitative researchers to understand their data needs, offer technical solutions, and effectively integrate data engineering with quantitative strategies. Design, develop, and optimize robust data pipelines, facilitating ETL … processes that support quantitative research, analysis, alpha forecasting, and execution. Implement stringent data quality assurance measures to ensure the accuracy, reliability, and consistency of data inputs and outputs. Evaluate, select, and manage appropriate data engineering tools, technologies, and infrastructure, with a focus on scalability and automation. Work more »

Data Engineer I London I Salary + Bonus I am currently working with a leading market-making and programmatic trading company that specialise in the crypto market. They are looking for a Data Engineer to join their Data Analytics team. The role: Working with the … quantitative teams to understand data requirements Work with other teams to build analytical datasets Integrate with external APIs Maintaining databases Recommending process improvements Develop solutions Essential qualifications: 3 - 8 years in related role Passion for data analytics Strong understanding of order book mechanics Java SQL REST and WS more »

Data Engineer - Exchange trading platform Location: London, 3 days per week in the office Salary range: £60,000-£65,000 + benefits Purpose: Design, build, and maintain scalable data architectures Tech: Python (NumPy, Pandas), SQL, ETL, Cloud (AWS, Azure or GCP), Snowflake, Airflow, BigQuery, PowerBI/Tableau … specialist consultancy who solely specialise in the Maritime trading industry. You will work onsite with 1 specific client to design, build and maintain scalable data architectures working with key stakeholders in their business to shape their data-driven strategies. The Company: They have a long history providing IT … services to the Maritime industry and are looking to provide its Data Insights services to key business partners who require Data Engineering expertise to support data management activities. The Role: The successful candidate will work on all aspects of our client's data architecture, collection, pipelining more »