181 to 205 of 211 Data Engineer Jobs in London

Our client, a leading energy-focused trading house are seeking a commodity pricing focused developer/data engineer for their European Cross Commodities portfolio in London. The role will be focused on using pricing data for the commercial trading teams, and playing a key role between internal … clients and technical staff. A major part of the role will consist of facilitating the creation of large and automated data pipelines for commercial trading stakeholders. The individual hired will be hands-on in helping to collect, cleanse and analyse data from multiple sources, identifying trends, patterns and … hiring an individual who can harness cross-functional collaboration, across all technology, infrastructure, devops, and commercial trading stakeholders, ensuring alignment and successful implementation of data projects and initiatives. Requirements: Degree program in Computer Science or related field 2+ years of Python programming experience in financial services or within energy more »

and infrastructure investments. Be part of a dynamic team driving growth and maximizing value in the alternative asset management industry. Key Responsibilities: Support the Data Team Lead in system updates. Develop, modify, and maintain software components. Resolve data/software issues and suggest technical solutions. Collaborate with stakeholders … Conduct peer reviews and offer technical guidance. Identify process improvements and adhere to IT policies. Essential Technical Skills: 2-3 years' experience in Azure data systems. Proficiency in Data Warehouse technologies and SQL. Familiarity with Azure services like Data Lake and Data Factory. Essential Experience: Supporting … traditional Data Warehouses. Building Azure data pipelines and data lakes. Agile development experience. Strong problem-solving skills. Awareness of industry trends and stakeholder interaction. Desired Experience: Familiarity with Business Objects Reporting and Power BI. more »

I'm currently looking for a Data Engineer for an Insurance client of mine based in London. The ideal candidate will have 4+ years of Data Engineering experience and will have experience with DataBricks, SQL and Python. This is a 6-month contract that requires 2 days more »

Our client a global Fintech based in central London is looking for a Lead Data Engineer. The role will be looking after a team of Data analyst and will be looking after strategy. The Lead Data Engineer will be working on are Insurance analytic projects, Actuarial more »

Are you ready to join a global investment manager who are at the forefront of shaping the future of data technology? You’ll play an integral role in the new team where you will be instrumental in driving the development of their new data analytics platform. Your contributions … about technology; then this could be the perfect role for you. Key Responsibilities: Spearhead the architectural design and implementation of a greenfield cutting-edge data platform, contributing to the transformation of our client's data landscape. Collaborate with a cross-functional team of software engineers, data engineers … and data analysts to support and enhance both existing and new data platforms. Varied role including improving the data quality and software development Be the driving force in identifying anomalies within the data, leveraging your expertise to enhance decision-making processes and optimise the value derived more »

We have a very important mandate from a leading hedge fund that who are looking for a Senior Data Engineer to join a group formed only 3 months ago. They would be one of the first Data Engineers on the ground with full autonomy. This organization specifically … within the firm. The project itself cannot be disclosed yet as it is in such early stages but in regard to the amount of data you would be dealing with - THE SKY IS THE LIMIT!! Additionally, the firm has a real focus on introducing new technology if it can more »

Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security policies. Essential … Technical Skills 2-3 years Azure data systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. Building Azure data pipelines. Agile methodology more »

Location: London Hybrid: 2/3 days in Salary: £85,000 (DOE) Are you a snowflake senior data engineer looking to work on a NetZero focused product? This role is for a disruptive greenfield project that's found within a multi-billion-pound business delivering critical work - it more »

Location: London Hybrid: 2/3 days in Salary: £100,000 (DOE) Are you a lead snowflake data engineer looking to work on a NetZero focused product? This role is for a disruptive greenfield project that's within a multi-billion-pound business delivering critical work - it's … only been live for 2 years and has already become one of their most successful products 🌱 Alongside leading other highly talented data engineers, you’ll also be working for a company who really value their employees. As a testament to this, you’ll also receive an unrivalled benefits package. more »

of our new solutions for the future. We are currently made up of 4 key areas: Marketer & Media Owner, Sustainability, Enterprises Business Applications and Data Intelligence. The Data Intelligence team helps our clients and their partners better understand their customers and how to serve them, by equipping them … decisions. We currently serve clients predominantly in such industries as retail, leisure and hospitality, real estate and smart cities. Our team of industry experts, data and insights consultants, data scientists, data engineers and machine learning engineers use advanced analytics to uncover the rich profile of customers’ current … and future behaviours to inform how clients can better serve and communicate with their customers. Responsibilities We are seeking candidates with strong data science or machine learning engineering experience to deliver projects in the customer and front office domain. Duties and responsibilities (dependent on the mix of data more »

Data Science & ML Consultant Location : London – Hybrid Employment : Full Time All applicants must hold a DV (Developed Vetting) clearance to apply. The Opportunity : For the Ministry of Defence (MOD), maintaining national security is a 24-hour-a-day, 365-day-a-year mission. For this reason, it partners with … this Big 4 Firm to support its multidisciplinary Data Science and Machine Learning team within DSSV (Data Science, Simulation and Visualisation). The Teams work together to drive innovation and insight from data, using cutting-edge Data Science and Machine Learning techniques alongside Digital Transformation to … solve complex problems through AI and Data. The Role : Working closely with senior data scientists, the Consultant's responsibilities span the entire data science lifecycle, from Proof of Concept to fully tested production solutions. Additional duties include preparing technical documentation, participating in client proposal responses, and pitching data more »

About Tredence­: - Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making. … development methodology; think strategically and execute methodically Develop and manage capacity and growth projection forecasts of the environment within budgets Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional/non-functional business requirements Drive optimization, testing and tooling to improve quality … 8+ years of relevant experience At least two years of experience building and leading highly complex, technical engineering teams. Strong hands-on experience in Data bricks Experience managing distributed teams preferred. Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project management skills more »

My leading Energy and Commodities conglomerate are currently seeking a skilled individual with experience in Python-based data pipeline, data lake house development and an appreciation for Object orientated languages such as C# or Java, using leading orchestration tools. In this role, you'll lead the development of … robust, fully tested data pipelines in Python using cutting-edge platforms like Dagster/Airflow and apply your expertise in real-time data streaming solutions using Kafka. You'll play a key role in expanding their on prem data lake infrastructure to help enhance support for new … lines of businesses they have including Systematic trading, Trading and Shipping commodities, ensuring strong data lineage. The successful candidate will have: A strong background in data engineering using Python Strong understanding of Test Driven Development Experience building Star Schemer Databases Strong experience with SQL design patterns Experience in more »

is fragile and career outlook right now is very uncertain. What about working at a hedge fund where their growth is almost certain? This data engineering team hired multiple people last year – most from big-tech – and plan to do the same this year. A large portion of your … work will technically be non-finance, with the main finance focused work completed by other teams. The real-world, complex data engineering problems are all yours. You’ll be joining a team that builds and has built thousands of ingestion pipelines, with data coming from every single potential … avenue it possibly can. To get the best understanding of an investment, all data points are considered. You’ll bring the data into the business, build the data infrastructure around it and deliver the data to the right person in the business to build their investment more »

in the office Salary: Up to £160k + Bonus A tech-driven investment firm in the city is looking to add a number of Data Engineers to their big build-out. The firm has set up a new team, focused on building a massively distributed cloud-hosted data … Dremio, Snowflake, Iceberg, PySpark, Glue, EMR, dbt and Airflow/Dagster. Cloud: AWS, Lambdas, ECS services This role would focus on various areas of Data Engineering including: End to End ETL pipeline development and deployment onto the Cloud Contributing to a centralised Data platform's architecture and design. … Extract, transform and load data from various sources into the data lakehouse. Metadata Management processes and tools Implementing Data Curation, metadata management and data quality tooling. Requirements: Strong Python/Java Software Engineering skills Excellent AWS knowledge, ideally with exposure to Airflow, Glue, Iceberg and Snowflake more »

LEAD AZURE DATA CONSULTANT £76K - £90k + BONUS & BENEFITS HOME-BASED CONTRACT + CUSTOMER TRAVEL I’m working with a leading Microsoft Partner who currently hold 13 specialisations across the Azure tech stack. This is a great opportunity to join an experienced team of Microsoft specialists who can help … to grow your professional and technical skills each day. I am looking for Lead Data Consultants to join the team due to a number of recent project wins which means there is an increased workload. The successful candidate will draw upon their experience with business intelligence tools and techniques … deliver analytics capability on time and to budget. I’m looking for candidates with the following skills and experience: Expert with SQL and Azure Data Engineering Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure Data Factory, Azure Databricks, Azure Synapse more »

I am working with a market leading Advertising client, who are currently hiring a Senior Data Engineer. Data is a key component for this client, and this opportunity will allow you to shape and build there Data platform. You will be involved in the design and construction … of new data capabilities from the ground up, and is a unique opportunity to influence key architectural decisions. The role is split with up to 70% of your time being dedicated to designing and writing software, 30% managing infrastructure. What you'll be working on Designing APIs around data … streaming joins. Building a high throughput service to push events to third parties. Managing key infrastructure such as Kafka, Aurora, DynamoDB, and owning the Data infrastructure. We see around 3 Billion kafka messages per day. Key infrastructure migration and upgrades. Write software using Java/Python/Scala. You more »

Seeking a proficient Data Platform Engineer to spearhead a cloud data infrastructure transformation. You will have experience constructing robust cloud-hosted platforms, executing seamless data migration from on-premises SQL, and streamlining operational workflows through automation. Key Requirements: Cloud Proficiency: Expertise in AWS, Azure, or GC … to architect and deploy scalable cloud solutions. Architectural Excellence: Proven track record in designing and implementing scalable data platforms to accommodate high-volume data processing. Technology Versatility: Ability to evaluate and select appropriate technologies to meet business requirements effectively. Stakeholder Management: Strong communication skills to engage with stakeholders … domains. Automation Expertise: Drive efficiency by automating manual processes, enhancing operational productivity. This is a 6-month, outside, contract responsible for shaping the future data landscape. more »

Be the first hire of this brand-new data engineering team and build it from the ground up. First up, you’re going to need to have done something similar before within finance, ideally algorithmic or systematic trading, with ETFs. You’re going to be given total autonomy to … build the team in the way you want. You’ll work closely with the quant teams to understand their requirements, but data strategy will be down to you. Using the right technologies will be down to you. It’s a hands-on engineering role to begin with, with engineering … leadership responsibilities in future. The focus is on collecting and processing data that’s critical to the business, so you’re not going to be building data ingestion strategies for every piece of data you can find. There’ll be specific data types, looking at things more »

fairly new, with a lot of what needs to be done not even built yet. You’ll be coming in to work closely with data scientists and the wider business to build all ETL solutions behind round the clock trading decisions. This is a great chance to get into … of autonomy. You will decide on the best solution and work with the business to deliver it to their requirements. Initial projects will include data infrastructure migration, building research data services and lots of ad-hoc data science projects. With the business still being small and growing … quickly, there a lots of times when you’ll need to be nimble and reactive. The majority of data projects are completed using a mix of technologies. It’s essential that you have a solid background in data engineering, ideally with a computer science degree. Strong Python, SQL more »

BettingJobs are working with an established sports betting odds provider who are based in London who are looking to add a Data Acquisition Engineer to their team. Responsibilities: Develop, test, run and monitor software that consumes data efficiently from approved sources. Ensure proper documentation is written and … date. Adopt and follow a good pace of software refactoring ensuring fast delivery of accurate data. Use internal tools to evaluate and validate all data acquired. Ensure all data shipped to the customers meets the quality standards. Quickly address customer issues following escalation from the Client Services Team … Keep learning and improving, sharing the acquired knowledge with the wider group. Maintain good relationships with wider Data Acquisition Team. Maintain clear and open path of communication with Client Services Team. Requirements: Coding proficiency preferably in Scala; alternatively Java, Python or any other high level language. A Bachelors degree more »

Keen on testing your data engineering skillset in an autonomous role? You will be leading a developing engineering team at a market-leading trading firm, crafting your own data processes, datawarehouses and pipelines from scratch, whilst acting as the connector between stakeholders and mountains of raw data. Every … an ideal opportunity expert SQL developers who are comfortable with deploying the MSBI stack, particularly SSIS, SSRS and PowerBI. Having exposure to Python for data manipulation and AWS or Azure is also a big plus. You will be using your expertise to shape your team, your projects and the … company’s data dictionary, quickly becoming a fundamental piece of the company’s plans. The day-to-day will incorporate a mixture of hands-on and leadership responsibilities, giving you the control over the direction that you and your team take. You’ll need to come from a strong more »

days p/w in office Salary: £75,000-£85,000 Industry: Insurance Tech Stack: Python, SQL, Spark, Azure 👩🏻‍💻 Great opportunity for a talented Engineer (Python, SQL, Spark, Azure) to join a market leading cyber insurance company. The Company 🚀 Tech driven insurance business that are expanding into emerging risk … by over 100,000 business around the world to provide unique, competitive and secure insurance packages. The Role ✨ They are seeking a highly pragmatic Engineer (Python, SQL, Spark, Azure) to help build out their new data platform. You (Python, SQL, Spark, Azure) will work closely with Architects, Data … heart of London with work from home options Opportunity to work in small, diverse and skilled cross-functional teams If you are a skilled engineer (Python, SQL, Spark, Azure) who is interested in this role then please apply below and I will be in touch with more details. If more »

This role is to join the quantitative analysis and technology team at one of Europe’s leading financial institutions to help build out the data and visualization tools required to support the business in all parts of the investment lifecycle. As a business data analyst, you will: Develop … and deploy dashboards to provide data-backed insights Interpret key business data sets Deliver insights on potential areas of growth, optimization, and improvements Support business intelligence strategies with quantitative analysis What we would like from you: Proven working experience as a Data Analyst or Business Data more »

A start-up developing revolutionary SaaS product using AI/ML technology. Responsibilities: Collaborating with multiple teams to provide technical solutions Build and optimise data pipelines Design and configure the future data architecture Essential Attributes: Passion for working in an early-stage start-up Strong knowledge of Python more »