51 to 75 of 204 Permanent Data Engineer Jobs in London

Senior Azure Data Engineer - 6 Month Contract - Inside IR35 This is an Azure Data Engineer 6 month contract position for a financial services end client helping them on delivering and implementing new data pipelines. You will need prior financial services experience as well as having … strong Azure Data Factory and Databricks experience. Work Involved: Implementing and delivering data pipelines Providing mentorship to junior members of the team Working with the Platform team defining capabilities for the lake framework Developing business conceptual data models Producing new frameworks using design patterns and data ingestion Requirements: Strong Data Pipeline experience Databricks Azure Data Factory Spark Azure cloud Financial Services If you're interested get in touch ASAP more »

Data Engineer - Azure Databricks CONTRACT - London (Hybrid) Data warehousing - Trading - Credit/Market Risk Harrington Starr is working with a leading Energy trading firm in London on an initial 6-month contract for a market-leading project. The project is signed off and they are looking to … start interviewing ASAP. Responsibilities: Azure Cloud Data Engineering using Azure Databricks Data Warehousing Data Engineering Very strong with the Microsoft Stack ESSENTIAL knowledge of PySpark clusters Python & C# Scripting experience Experience of message queues (Kafka) Experience of containerization (Docker) FINANCIAL SERVICES EXPERIENCE (Energy/commodities trading) If more »

Intelligence technologies and leading and educating a technical team across two global territories. The client is in the initial stages of deploying the Collibra Data Catalog tool to assist in accurate reporting of IT Asset Management. Collaborate with key stakeholders to understand business requirements and translate them into Collibra … solutions. Lead the implementation of Collibra Data Catalog, including configuration, customisation, and integration with other systems. Design and implement data governance workflows, data dictionaries, and data lineage within Collibra. Develop and maintain Collibra data governance policies, standards, and rules. Provide technical guidance and support to … users on Collibra platform usage and best practices. Develop custom reports and dashboards to monitor data governance metrics and KPIs. Conduct training sessions and workshops for end-users to promote adoption and usage of Collibra. Work closely with the Collibra vendor and internal IT teams to resolve technical issues more »

Data Engineer – Power BI, SQL, DBT, Airbyte, Python, Snowflake This a permanent position to work with a prominent business in the Property sector, paying £65-70k and working on a hybrid basis (1 day p/wk in London). This is a new position created to … support the existing (and growing) Data team. The business has grown significantly, mainly by acquisition and as such there are lots of data integration projects as well as a varied technology estate. As a Data team, they are technologically agnostic so when it comes to new approaches … so you will have a say on the best tooling. Technical experience required includes: SQL Server Power BI Advantageous: DBT Airbyte Python Snowflake The data environment requires a more robust structure so much of the role will focus around improving: - Data Governance - Data Warehousing - Developing and implementing more »

Principal Data Engineer Here at Anson McCade we are partnering with a leading Digital Transformation Consultancy who are in need of an experienced Data Engineer to join a multi-disciplinary team building, supporting and maintaining User-Centred digital solutions that offer real value and work for … databases is also desirable. Solid experience of at least one Cloud provider such as AWS, Azure or GCP. Strong experience of working with different data formats, e.g., CSV, JSON and XML Building reliable Data Pipelines Broader knowledge of IT — e.g., Security and Networking Working in an Agile Environment more »

Eames Consulting are delighted to be supporting an established Investment management company that are looking for a Data engineer. Responsibilities: Develop and maintain complex SQL queries, customize reports, and optimize data usage. Create tools to address business challenges and empower users with third-party tools. Design and implement … cloud-based data platforms, ETL pipelines, and data integration. Collaborate with colleagues to ensure data integrity, quality, and security standards are met. Experience required: 3 years experience working as a Data engineer or similar Strong proficiency in SQL or Data Bricks and database development … including complex query optimization and performance tuning. Comfortable using programming languages such as Python Strong Data Warehousing experience - building data pipelines from scratch Good understanding of open source, big data, and cloud data platforms (e.g. AWS, Azure); given a business problem, you can analyse and evaluate more »

We are working on behalf of an International (Re)Insurance client based in London to recruit a Lead/Senior Data Engineer, joining an established team of Analytics Engineers helping optimise the Actuarial teams' efficiency through data automation and the use of emerging technologies. The successful candidate … will work on the following: - Actuarial Data Infrastructure - Data Engineering - Data Analysis & Visualisation We are looking for someone with Python and ideally SQL in conjunction, working knowledge of Power BI, and ideally Microsoft Azure (or similar such as AWS). Knowledge of API's is also helpful. … It will appeal to someone eager to join a collaborative team who are playing an important role in driving the use of data forward. This candidate is expected to have prior relevant experience as a Lead or Co-Lead on development projects, not necessarily within an insurance environment. Ability more »

Data Engineers needed for 6-12 month project based in London paying £450 a day inside IR35. This is an Urgent role an ideally we need the data engineers to be able to start asap or within 3 weeks as a maximum. All data engineers have to … with Teams across multiple locations and time zones interpersonal and communication skills with an ability to lead a team and keep them motivated. Role – Data Engineer Location – London Rate - £450 a day all inclusive Location - London more »

Data Engineer Azure/Snowflake/Python London (Contract) Role: Our client is looking to expand their data engineering team and add in the utilisation of Snowflake which is currently being used by a select few members of the team, and upskilling taking place alongside. They want … to add in an additional team member who has multiple years of experience using Snowflake as a data tool and can hit the ground running Experience Snowflake Financial services Cloud (Ideally azure) Airflow would be an advantage more »

employees worldwide. We aim to create diversity in the tech market and support the growth of the renewable energy sector. As a Management Information & Engineer, you will play a pivotal role in supporting and enhancing our business applications landscape, with an initial focus on Mercury XRM, our PowerApps-based … Customer Relationship Management (CRM) solution built on MS Dynamics 365. This role demands a deep understanding of data modelling, application integration, and support mechanisms to ensure optimal performance and user satisfaction. You will leverage Power Automate to streamline CRM workflows and require strong PowerBI skills for data analysis … and reporting. Additionally, expertise in JSON and Java is essential for potential integrations and customization tasks along with skills in Python for handling large data sets. This hands-on position requires not only technical acumen but also a strategic vision for data management information reporting within our organisation. more »

Data Engineer – Crypto Infrastructure Hybrid in London - 3/4 days a week Python, SQL, Git, Docker, MongoDB This is your opportunity to join a venture-backed research-driven crypto platform at the forefront of building trading and MEV-related infrastructure, shaping the future of finance. You’ll more »

shop and this role will face off with a range of business leads in order to build the pipelines that will ultimately ingest the data for their new strats! Responsibilities: Design and implement scalable ETL solutions (structured and unstructured; batch and streaming) Building data pipelines, standardizing, and cleansing … data for the investment team Define and set best practice standards surrounding data (i.e., data modelling, database design, ETL design, job scheduling and monitoring, etc) Manage the entire data flow, from acquisition to transformation into actionable insights using SQL and Python/Java Design and maintain … APIs Requirements: Degree in Computer Science. 4+ years of professional software development experience. A passion for data and experience in applying that passion to high quality data products. Strong knowledge of software engineering best practices, object-oriented concepts, and the ins and outs of data-focused development. more »

We are looking for a Data Engineer to join our Y Combinator backed start-up. They are using AI and ML technology to build a SaaS product. You will be working closely with the Data Scientists and wider engineering teams. Responsibilities Maintaining Python/SQL ETL pipelines … AI capabilities Collaborate with several teams to provide technical solutions Requirements Early-stage start-up passion Strong Python knowledge Experience building and optimizing "big data" pipelines more »

We have a very important mandate from a leading hedge fund that who are looking for a Senior Data Engineer to join a group formed only 3 months ago. They would be one of the first Data Engineers on the ground with full autonomy. This organization specifically … within the firm. The project itself cannot be disclosed yet as it is in such early stages but in regard to the amount of data you would be dealing with - THE SKY IS THE LIMIT!! Additionally, the firm has a real focus on introducing new technology if it can more »

Data Science & ML Consultant Location : London – Hybrid Employment : Full Time All applicants must hold a DV (Developed Vetting) clearance to apply. The Opportunity : For the Ministry of Defence (MOD), maintaining national security is a 24-hour-a-day, 365-day-a-year mission. For this reason, it partners with … this Big 4 Firm to support its multidisciplinary Data Science and Machine Learning team within DSSV (Data Science, Simulation and Visualisation). The Teams work together to drive innovation and insight from data, using cutting-edge Data Science and Machine Learning techniques alongside Digital Transformation to … solve complex problems through AI and Data. The Role : Working closely with senior data scientists, the Consultant's responsibilities span the entire data science lifecycle, from Proof of Concept to fully tested production solutions. Additional duties include preparing technical documentation, participating in client proposal responses, and pitching data more »

My leading Energy and Commodities conglomerate are currently seeking a skilled individual with experience in Python-based data pipeline, data lake house development and an appreciation for Object orientated languages such as C# or Java, using leading orchestration tools. In this role, you'll lead the development of … robust, fully tested data pipelines in Python using cutting-edge platforms like Dagster/Airflow and apply your expertise in real-time data streaming solutions using Kafka. You'll play a key role in expanding their on prem data lake infrastructure to help enhance support for new … lines of businesses they have including Systematic trading, Trading and Shipping commodities, ensuring strong data lineage. The successful candidate will have: A strong background in data engineering using Python Strong understanding of Test Driven Development Experience building Star Schemer Databases Strong experience with SQL design patterns Experience in more »

BettingJobs are working with an established sports betting odds provider who are based in London who are looking to add a Data Acquisition Engineer to their team. Responsibilities: Develop, test, run and monitor software that consumes data efficiently from approved sources. Ensure proper documentation is written and … date. Adopt and follow a good pace of software refactoring ensuring fast delivery of accurate data. Use internal tools to evaluate and validate all data acquired. Ensure all data shipped to the customers meets the quality standards. Quickly address customer issues following escalation from the Client Services Team … Keep learning and improving, sharing the acquired knowledge with the wider group. Maintain good relationships with wider Data Acquisition Team. Maintain clear and open path of communication with Client Services Team. Requirements: Coding proficiency preferably in Scala; alternatively Java, Python or any other high level language. A Bachelors degree more »

Data Migration Analyst/Engineer - Superb Opportunity Are you passionate about data? Do you have a keen eye for detail? Thrive in a fast-paced environment? If yes, this could be the role for you! Up to £80k plus excellent benefits package - Hybrid from London Our client … is seeking a skilled Data Analyst Engineer to join their busy integrations team. Role Overview: Reportting to the Head of IT Integrations you will play a crucial role in driving efficiency and alignment with business goals. - Work closely with cross-functional teams to design, implement, and optimise data … Model. About You Bachelor's or master's degree in computer science, information technology, or a related field. Proven experience with Insurance Broking Systems data migration (ideally Acturis). Proficiency in SQL and SSIS. Experience with ETL tools. Strong analytical and critical thinking skills, with a focus on practical more »

Lead Data Engineer - up to £100K - Hybrid London Our client a global brand based out of lovely offices in West London are looking for a Lead Data Engineer to work on a business-critical, brand new, innovative high availability application which will be used by thousands … someone who is looking to take their next step in their career and wants to take on more responsibility. Technical Skillset: Experience as a data engineer developing and maintenance of ETL/ELT processes Good experience in Data Modeling within a cloud-based data platform Strong … experience with SQL Server Azure data engineering stack, including Azure Synapse and Azure Data Lake Python, PySpark and T-SQL In return you will be offered a competitive salary and benefits package, remote working options and an opportunity to work with a household brand that are committed to more »

Data Engineer - Azure Databricks - London - £75K I'm looking for a Data Engineer to work on developing products and solutions in Azure. you will have the opportunity to up skill in complex areas of cloud based engineering solutions in the very latest tech. My client sit … looking to really get the most from their data. They are looking for someone with core skills in SQL complimented with Azure experience (Azure Data Factory, Databricks, PySpark etc) This is a very exciting time to join as they shake things up across the industry, so please get in … touch asap to hear more! Role & Responsibilities Design and Architecture of Azure Data solutions Be the technical expert with the latest technologies. Make recommendations to the wider business as to how to keep up to date with the best data solutions. Working with and modelling data warehouses. more »

fear of heart and circulatory disease. The Technology directorate is an integral internal partner for BHF to help deliver our strategy and as our Data Engineer, you'll support the successful delivery of a scalable data intelligence platform in Azure. This will provide the services and tools … to extract deeper insights from big and complex data using predictive analytics and AI, with a particular focus on Health Intelligence and Analysis. This in turn will enable the uncovering of actionable insights previously hidden in data. You'll support the roll out of this platform and ensure these … BHF to deliver against its core mission-led strategic objectives. The platform will be designed to be iterative and adaptive, allowing exploration of new data sources, models, and algorithms over time, ensuring that BHF stays current and leverages the latest advancements in data intelligence. You'll work closely more »

Data Visualisation Engineer Location: UK Salary: £41,000 per annum We are Forward, the social enterprise that empowers people to break the cycle of crime or addiction to move forward with their lives. For more than 25 years we have been working with people to build positive and … to make positive changes and build productive lives with a job, family, friends and a sense of community. What you will be doing The Data Visualisation Engineer (DVE) is responsible for designing, developing, and maintaining data visualisation systems and dashboards. Using a variety of tools and technologies … to create interactive and visually appealing representations of data that enable users to quickly and easily understand complex data sets. Services are designed to deliver a range of interventions, programmes, workshops, advice and guidance for our clients. As a member of the Data & Performance Team, the DVE more »

Lead Data Engineer/Data Lead/Senior Data Engineer/Lead Data Engineer Lead Data engineer We are searching for a Lead Data Engineer with significant experience in Python, Snowflake, Segment, ELT, SQL (PostgreSQL, MySQL). The client … is a world renowned leading Non-profit organization. Lead Data Engineer/Data Lead/Senior Data Engineer/Lead Data Engineer Responsibilities: Spearhead the advancement of their innovative data strategy. Plan, create, validate, document, and oversee a variety of data migration procedures for transferring data from current systems to a new data infrastructure. Oversee the entire data lifecycle to ensure usability, facilitating analysis and insights crucial for informing business decisions. Support, mentor and manage a small to midsize team of Data Engineers. Requirements: Solid and more »

Data Engineer A brand new and exciting opportunity has recently arisen for a Data Engineer with an excellent knowledge in ETL, Azure Data Factory, Azure Databricks and SQL to join one of the UK's Largest Charity based in London. As the Data Engineer you will be shaping the data eco-system and being influential in the migration to Salesforce. This is an excellent opportunity for a Data Engineer who is looking to work for the Largest UK Charity who are working on greenfield projects and improving their data function. If you are currently a Data Engineer with experience in ETL, Azure Data Factory, Azure DataBricks, SQL and keen to be influential in greenfield projects then this is the perfect opportunity for you! Skills that are required for a Data Engineer are: Experience more »

Position: Data Engineer Reporting to: Lead Data Engineer Contract type: Full Time, Permanent, Remote (with Occasional Travel) This is an exciting opportunity to join one of Europe's fastest growing healthtech startups About Cera At Cera Care, our mission is to empower people to live longer … be the global leader in revolutionising affordable care for the better, for our service users and society and the perfect coordination across care practice, data, science and technology is how we’ll get there. . About Data at Cera Data has a critical role to play and … our operational workforce, from caregiver recruitment to care delivery to our client base, and provides insights for performance improvement and cost-efficiency. Health-related data offers a comprehensive financial overview that could lead to cost savings and crucially lead to health deterioration prevention. The primary mission of our Data more »