101 to 125 of 223 Permanent Data Engineer Jobs in London

We are seeking a qualified Data Engineer to join our team, where your responsibilities will include: Designing, optimizing, and maintaining scalable data pipelines and ETL processes using Spark, ensuring streamlined data processing and integration. Collaborating cross-functionally to translate complex data requirements into actionable technical … solutions that drive business objectives. Leveraging Microsoft Azure and Databricks to architect robust data solutions, prioritizing performance optimization for enhanced operational efficiency. Conducting data modeling, profiling, and quality assessments to uphold the integrity and reliability of our data assets. Executing data governance, transformation, and integration initiatives … to support advanced analytics and reporting requirements. Integrating machine learning models seamlessly into data pipelines to facilitate predictive and prescriptive analytics. Ensuring adherence to data security protocols and regulatory compliance standards, maintaining the highest levels of database integrity and operational excellence. This position is available at either our more »

we do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally. Job Description This is an exciting opportunity for an experienced Data Engineer. You will join a team delivering a design & development of modern data management tools to curate important data sets, models and processes, while identifying areas for process automation and further … a related quantitative discipline) Strong object-oriented design and programming skills and experience in OO languages (Python and/or Java) Previous experience in Data manipulation, Data Analysis or Data Modelling Deep understanding of multidimensionality of data, data curation and data quality, such as more »

Role: Senior Data Engineer Salary: £65,000 - £75,000 Location: London Pattern: Hybrid – 1x per week on-site Vitals: Python, Synapse, PowerBI, Data Factory, Kubernetes Visa Sponsorship: Not Available Responsibilities: Develop leading data warehousing solution. Support data and BI analysts by providing top quality data. … Act as key contact on data strategy across company. Design and develop data models, delivering ingestion of data sources into warehouse. The Perfect Candidate: Experience with delivery leading in data teams. Experience at different business levels and varied solutions. Capability and familiarity with BI, Synapse, Python … Data Factory & Kubernetes. Excellent communication and unrelenting curiosity. Submit your CV and if suitable, a consultant will get in touch ASAP more »

a business, put this down to not just their skilled work force but also their head office support team. This role is for a Data Engineer/BI developer who wants to continue to excel using the latest Data technologies. The role is primarily focused around building … but then also created some awesome dashboards and reports using Power BI. The successful applicants will be helping to really utilise the power of data to help them across a range of projects. This ranges from internal projects to improve the business but also, external projects that lead to … interest then get in touch ASAP. Send across your CV to t.shahid@nigelfrank.com or alternatively, give me a call on 0191 3387551. Keywords: Azure Data Factory, Azure Databricks, Databricks Lakehouse, MS Power BI, Power BI, Spark, Delta Lake, T-SQL, DevOps, ETL, Data Modelling, DAX, Data Warehousing more »

Senior Azure Data Engineer £85K - £90K (D.O.E) Hybrid: 2 - 3 days a week on-site in London Must be already eligible to work in the UK and not Sponsoship dependant Previous exclusive(ly) contracting experience will not be considered (unfortunately) As the Senior Azure Engineer, you will … oversee Azure governance, manage Azure subscriptions, and provide architectural design oversight for Azure infrastructure. Additionally, you will lead the Service Team within the Data Center Department. Responsibilities: Establish and enforce Azure usage standards. Manage budgets and provide cost reporting for Azure resources. Collaborate with various teams to design, deploy … of cloud resources. Support Microsoft Power Platform components including CRM, Power Apps, Power Automate, and Power BI. Share knowledge and support tools like Synapse, Data Factory, DataBricks, MS on-prem data gateway, Entra ID, and databases. Own the Kanban process, conduct bi-weekly standups, and coordinate team tasks. more »

Data Engineer Intern A unique opportunity to join a data driven STEM recruitment/executive search business that supplies the world’s leading Hedge Funds & Quant Trading firms with best in class technology talent. Your profile: Computer Science/STEM Graduate with a passion for building software … Directors Commercial experience in a fast paced industry Exposure to multiple business areas Opportunity to learn about the FinTech space Work on a strategic data project at the forefront of our growth *Potential for full time offer on successful completion of the internship* Apply now or get in touch more »

to be working with a London-based B2B SaaS startup who are looking to expand the engineering team by bringing in a business-savvy data engineer to be the third member of the data team. The role: This role primarily covers building out the core product by … to create a scalable SaaS product. Once this has achieved a certain level of product maturity, this role will also involve building their own data platform. We they offer: • Senior mentorship • Competitive compensation package, incl. stock options • Flexible hours and hybrid working, typically 3 days a week in the … be a net-zero CO2 company and donate 1% of their revenues to social impact causes. Requirements: • A proven level of commercial experience in data engineering • Experience at seed to series A/B stage companies or an excitement to experience first-hand the joys and pains the come more »

Our client, a leading energy-focused trading house are seeking a commodity pricing focused developer/data engineer for their European Cross Commodities portfolio in London. The role will be focused on using pricing data for the commercial trading teams, and playing a key role between internal … clients and technical staff. A major part of the role will consist of facilitating the creation of large and automated data pipelines for commercial trading stakeholders. The individual hired will be hands-on in helping to collect, cleanse and analyse data from multiple sources, identifying trends, patterns and … hiring an individual who can harness cross-functional collaboration, across all technology, infrastructure, devops, and commercial trading stakeholders, ensuring alignment and successful implementation of data projects and initiatives. Requirements: Degree program in Computer Science or related field 2+ years of Python programming experience in financial services or within energy more »

Role Profile Enter role description, key responsibilities, and job description: Hands on Senior Engineer with experience of working within high performance development teams Significant AWS Engineering experience implementing Amazon well architected frameworks, serverless solutions and improving existing platforms using AWS technologies with Agile delivery methods Demonstrable experience of Python … Python data management/manipulation libraries and usage of Python with AWS components Demonstrable experience working in the Data domain, covering the full data pipeline from ingestion, mastering, management and consumption/distribution of large datasets Financial Services expertise preferred working with Equity and Fixed Income asset … classes and a working knowledge of Indices Experience with No-SQL and Relational databases and data analysis using SQL. Enter key behaviours and skills required to be successful in the role: Education & Work experience: 7+ years of AWS and Python development engineer experience within the Financial Services and more »

fairly new, with a lot of what needs to be done not even built yet. You’ll be coming in to work closely with data scientists and the wider business to build all ETL solutions behind round the clock trading decisions. This is a great chance to get into … of autonomy. You will decide on the best solution and work with the business to deliver it to their requirements. Initial projects will include data infrastructure migration, building research data services and lots of ad-hoc data science projects. With the business still being small and growing … quickly, there a lots of times when you’ll need to be nimble and reactive. The majority of data projects are completed using a mix of technologies. It’s essential that you have a solid background in data engineering, ideally with a computer science degree. Strong Python, SQL more »

Enter the world of quantitative trading and learn all about automated trading systems. You’ll be working closely with a highly technical data team that’s filled with bright and technically strong engineers. This isn’t just a support team where you sit around waiting for things to happen … you’re proactively working with Quants, traders, software and data engineers supporting the trading and back office database estate and data pipelines. You'll provide first line support for the trading data pipelines and systems used around the world. In the past, graduates from these team have … progressed to become Data, Cloud, Infrastructure or Python engineers within the business. You’re not expected to stay in this team forever. Think of it as a perfect learning experience for a couple of years, understand the inner workings of the trading platform and then progress to a new more »

Job Title: Data Engineer Job Type: Permanent Location: London or Fully remote Salary: £50,000-£70,000 (Dependant on experience) + Bonus + Benefits Skills: Python, SQL, Posgress SQL, Snowflake, Powershell Roc Search`s client provides real-time decisions and active risk monitoring to enable their customers to … maximize profitability while managing risk. their solutions are continually adapting to changing market conditions. They 20+ years of retail data science expertise and experience. They work with a global base of leading commerce partners, representing a big proportion of all US omnichannel retail sales activity across hundreds of thousands … intelligence to operations, finance, marketing, and loss prevention. Their performance-improvement solutions yield measurable results with significant return on investment. About the role The Data Engineer will be part of a team that follows DataOps best practices and owns the standardized data assets and the processes around more »

not afraid to speak our minds to help steer our customers towards understanding and achieving their key goals. We are looking for a Lead Data Consultant to help us grow and on our journey of taking OC to the next level. Your experience as a data focused technologist … strategise, and deal with the ingestion, processing, integration and ability to get insights out of their data. What you’ll spend your time on: Data Strategy & Architecture: Help customers make sense of, and understand their data in the context of what their business is trying to achieve. Create … data models and articulate the tradeoffs around different data approaches. Design and Architect complex data platforms and solutions across a variety of different scenarios. Leadership & Consulting: Provide technical leadership and guidance for our customers and your fellow team-mates in the area of data and data more »

we thrive on pioneering new businesses and seizing energy investment opportunities. Job Summary The job holder will be responsible for expanding and optimising our data and data pipeline architecture, as well as optimising data flow and collection for cross functional teams. The Data Engineer will … support our software developers, database architects, and Trading teams with data initiatives that will ensure optimal data delivery architecture is consistent throughout ongoing projects. This role requires the jobholder to be self-directed and comfortable supporting the data needs of multiple teams, systems and products. They will … design, build and optimise the data architecture to support our next generation of products and data initiatives. Key Responsibilities: Create and maintain optimal data pipeline architecture Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key more »

Senior Data Engineer About us HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning. … Our team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and a dedication … and commercial decisions are driven by this innovative collection of art market data. Role overview We are seeking a highly skilled and experienced Senior Data Engineer. You would be joining a strong team of roughly 20 people (software and data engineers, data scientists, analysts), in a fast more »

Senior Data Engineer - Azure Paying up to 70K Hybrid: 2 days onsite About the Role My food retail business client is looking for a senior Data Engineer to join the team. My client operate on a global scale, but their Data and Analytics function embodies … significant career progression opportunities as part of our technology transformation journey. Paying up to £70K Hybrid (2 days onsite) Main Duties Design and deliver data pipelines. Build and manage Azure Data Factory data flows. Ingest data into an Azure Data Lake. Design data models … for large datasets, including creating dimensional multivariate models. Utilize non-relational data storage solutions such as MongoDB. Work with SQL Server Integration Services (SSIS) and other ETL tools. Develop solutions with SSIS, SSRS, T-SQL (On-prem/Cloud). Manage NoSQL environments, Data Lakes, and Lake-Houses more »

Data Software Engineer– London Sports Analytics & Statistics Company Fulltime onsite *Please note this role cannot sponsor. Please do not apply if you are seeking sponsorship* A Data Engineer is required for an exciting and innovative Software sports betting company based in London. The successful candidates will … quantitative researchers and alongside other extremely talented and driven engineers to build and support systematic trading models. You will be working on real-time data pipelines for live sports events where your expertise will help the company advance their in-play sports analytics and pricing function. Your day-to … day will involve developing robust and scalable data pipelines, implementing new feeds into the business, and integrating them with their quantitative decision models. Essential Skills Proven experience as a data engineer or similar, with a track record of handling mid to large scale data projects. Strong more »

Senior Data Engineer 💰 £85,000-£100,000 🖥️ Snowflake, AWS, dbt, Terraform 🌍 London, 2-3 days a week in London office We are partnered with one the UK's most exciting e-commerce platforms, operating within the luxury beauty and wellness industry, and supporting them on their search for … a Senior Data Engineer. The role... As a Senior Data Engineer you'll be at the forefront of transforming and interpreting complex data into valuable insights that drive the business. Your expertise will be crucial in leveraging key technologies like Snowflake, AWS, DBT, and Terraform to … enhance understanding of customer behaviors, market trends, and operational efficiencies. What you'll be doing... You will gather, analyse, and transform data from diverse sources, ensuring cleanliness and quality. You will be architecting and building the next generation Data Platform. You will construct data models, pipelines, and more »

Title: Data Engineer, 40 hours per week, fixed-term contract – DE001. Location: White City, London, UK. Compensation: £45-65,000 plus health insurance and free lunch! Posted date: Monday 6 th , 2024. Closing date: June 7 th , 2024. Start date: July 1 st , 2024, or before. Company: Esox … platform harnesses metagenomics to resolve this biological dark-matter and improve pathogen detection and prevention efforts for global aquaculture. Role: We are hiring a Data Engineer to join our Detect team. Our Detect platform enables clients to identify total microbiomes sampled from livestock and the environment surrounding their … farms. This data is pivotal in advancing our understanding and management of aquatic ecosystems. Our metagenomics pipelines produce significant quantities of DNA data and accompanying sample metadata. You’ll play a central role in supporting the growth of our company by designing and building the infrastructure necessary to more »

profitable since early 2022. FullCircl was formed in 2021 following the merger of Artesian Solutions and DueDil. In September 2023 FullCircl acquired W2 Global Data Solutions. FullCircl is backed by top-tier investors which include Octopus Investments, Notion Capital, Augmentum Fintech and notable angel investors which include Dr Steve … provide competitive compensation and benefits and believe employee ownership is a key part of cultivating the mindset we want from everyone. The Role Lead Data Engineer We realise at FullCircl that it takes a dedicated team of brilliant people to continually innovate, push boundaries and exceed expectations. We … do amazing things. Still led by our three original founders, we’re constantly on the lookout for rising stars. We are seeking a lead data engineer to join our team and to work on a variety of assignments alongside our product and commercial management teams. The role will more »

Principal Data Engineer London (hybrid) Up to £100,000 base + package Here at Anson McCade we are partnering with a leading Digital Transformation Consultancy who are in need of an experienced Data Engineer to join a multi-disciplinary team building, supporting and maintaining User-Centred … databases is also desirable. Solid experience of at least one Cloud provider such as AWS, Azure or GCP. Strong experience of working with different data formats, e.g., CSV, JSON and XML Building reliable Data Pipelines Broader knowledge of IT — e.g., Security and Networking Working in an Agile Environment … office Salary up to £100,000 per annum Professional growth and career development Collaborative and inclusive work environment Health and well-being initiatives Principal Data Engineer London (hybrid) Up to £100,000 base + package If this position is of interest please don't hesitate and apply down more »

Junior/Mid Data Engineer - London (Hybrid) - Permanent - £35,000-£45,000 Market Research, e-commerce, AWS, Python, ETL, SQL *You must be based in London, and have full permanent right to work in the UK to apply for this role* I'm currently working with an exciting … leading market research and analytics company specialising in data analysis on the alcohol and beverages market. They provide data to a range of major multinational beverage corporations, to provide essential market insights. They're looking to strengthen their team with a Data Engineer, with: Experience building … this opportunity matches your ability and expectations, please apply through the job advert above ASAP and I will be in touch. Junior/Mid Data Engineer - London (Hybrid) - Permanent - £35,000-£45,000 Market Research, e-commerce, AWS, Python, ETL, SQL more »

Data Engineer - Azure Databricks CONTRACT - London (Hybrid) Data warehousing - Trading - Credit/Market Risk Harrington Starr is working with a leading Energy trading firm in London on an initial 6-month contract for a market-leading project. The project is signed off and they are looking to … start interviewing ASAP. Responsibilities: Azure Cloud Data Engineering using Azure Databricks Data Warehousing Data Engineering Very strong with the Microsoft Stack ESSENTIAL knowledge of PySpark clusters Python & C# Scripting experience Experience of message queues (Kafka) Experience of containerization (Docker) FINANCIAL SERVICES EXPERIENCE (Energy/commodities trading) If more »

Intelligence technologies and leading and educating a technical team across two global territories. The client is in the initial stages of deploying the Collibra Data Catalog tool to assist in accurate reporting of IT Asset Management. Collaborate with key stakeholders to understand business requirements and translate them into Collibra … solutions. Lead the implementation of Collibra Data Catalog, including configuration, customisation, and integration with other systems. Design and implement data governance workflows, data dictionaries, and data lineage within Collibra. Develop and maintain Collibra data governance policies, standards, and rules. Provide technical guidance and support to … users on Collibra platform usage and best practices. Develop custom reports and dashboards to monitor data governance metrics and KPIs. Conduct training sessions and workshops for end-users to promote adoption and usage of Collibra. Work closely with the Collibra vendor and internal IT teams to resolve technical issues more »

make energy fairer for everyone, empowering individuals and creating a more sustainable future. Role Description This is a full-time, hybrid role as a Data Engineer at Open Power. The engineer will be responsible for the development of the data infrastructure of our product. They will … design and implement ETL/ELT pipelines that draw heterogenous data from multiple different sources, at different time scales and with different characteristics, in order to process, store and make available useful and actionable data for experimentation and production. They will work closely with data scientists and … product managers, and will play an important part in defining the direction of development at a strategic level. Qualifications Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills Data Warehousing and Data Analytics skills Experience with REST and Data APIs Database management systems (PostgreSQL more »