26 to 50 of 159 Data Engineering Jobs in London

a holistic and multi-disciplinary approach to each of these mega processes. As part of Shepherd, a new role has been created to lead Data & Analytics within those process areas. What are we looking for? Bachelor s degree or Equivalent (IT Degree preferred in particular computer science, Data … to Retire (HR) Experience working in sizeable and complex digital transformations in large global organizations resulting in high adoption of new tools Experience in Data cleansing/enrichment/migration along with over Data & Analytic skills. Hands-on data engineering/development experience, preferably in a … cloud/big data environment Able to manage expectations in an ambiguous and fast-paced environment and deliver excellence Strong people management skills with a track record of nurturing high-performing teams Excellent communication skills, capable of distilling complex concepts for a variety of audiences Demonstrated proactive and results more »

Data Engineer - Azure Databricks CONTRACT - London (Hybrid) Data warehousing - Trading - Credit/Market Risk Harrington Starr is working with a leading Energy trading firm in London on an initial 6-month contract for a market-leading project. The project is signed off and they are looking to start … interviewing ASAP. Responsibilities: Azure Cloud Data Engineering using Azure Databricks Data Warehousing Data Engineering Very strong with the Microsoft Stack ESSENTIAL knowledge of PySpark clusters Python & C# Scripting experience Experience of message queues (Kafka) Experience of containerization (Docker) FINANCIAL SERVICES EXPERIENCE (Energy/commodities trading more »

employees, they are always looking to adapt to technological changes to stay at the forefront of the industry About the Role: As a Principal Data Engineer, you ll play a pivotal role to help drive the adoption of Microsoft Power platform and streamline reporting and analytics processes across the … organisation, we are looking for a Data Engineer with extensive multi-cloud data engineering experience and in-depth understanding of end-to-end development and deployment processes. Whilst this is a data engineer role, the focus is on data analytics and migrating from Tableau to … Power BI. Experience/skills required: Proficient in data analysis, data modelling and designing ETL processes. Familiar with Data Mesh architecture and Data Products Highly skilled in T-SQL with experience in performance tuning and dealing with large data volumes Extensive experience of developing end more »

Lead Data Engineer London x3-4 days per week in office Up to £95,000 Salary Bonus OVERVIEW Multi-billion-pound property company are hiring for a Data Engineering Lead/Lead Data Engineer to spearhead their Data Engineering team in London Interesting and … the whole pipeline on a breadth of impactful projects Great scope for career progression & you ll be leading and managing a small team of Data Engineers Your responsibilities as a Lead Data Engineer/Data Engineering Lead will include but not be limited to: Lead a … team of Data Engineers on a range of interesting and complex commercial projects. Extract value and insights from the Data Engineering work to contribute towards the Data Science/Analytics. Work across the whole Data pipeline (Data Engineering, Data Warehousing, Analytics) Help more »

Are you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that transcend … to surpassing expectations drives them to explore every avenue for growth, harnessing opportunities that benefit their teams, projects, communities, and industry. As an Azure Data Engineer, you will play a pivotal role in the data engineering and business intelligence journey of global and regional operations. Collaborating with … cross-functional teams, you'll lead the charge in designing and implementing scalable azure data engineering and Power BI data visualisation solutions that meet diverse business needs. Your experience as an Azure Data Engineer and BI Developer will be key to optimizing data storage and more »

located in London, is in search of a highly skilled Principal Consultant. This role is ideal for a seasoned professional with extensive experience in data engineering and a passion for leading transformational projects. The firm prides itself on delivering innovative solutions that drive business success across a wide … array of industries. As a Principal Consultant, you will lead and oversee complex data engineering projects, ensuring the delivery of high-quality solutions that meet and exceed client expectations. You will utilize your expertise in ETL pipelines, AWS, and Python to guide projects from inception to completion. Additionally … a pivotal role in business development, client management, and mentoring junior consultants. Key Responsibilities: Lead the design and implementation of robust ETL pipelines and data architectures. Oversee the deployment and optimization of AWS-based data solutions. Develop advanced Python scripts for data processing and analysis. Manage client more »

DATA ANALYST CENTRAL LONDON - HYBRID (2 DAYS IN OFFICE) £40,000 - £50,000 THE COMPANY This rapidly growing entertainment park business had its initial success through four main sites and recently acquired 13 more, with a vision to grow up to 40 in the next four years. Due to … this rapid expansion, they are quickly moving towards being at the forefront of innovation in the leisure industry. The company has established a data warehouse in BigQuery through a third party and is beginning to utilise tools such as Looker for data visualisations. Now, there is a strong … push to further enhance data analytics capabilities, particularly through the expansion of reporting. With planned growth in the next few years, they are deeply committed to leveraging data for strategic advantage. THE ROLE AND RESPONSIBILITIES Reporting directly to the C-suite, this Data Analyst will take ownership more »

ENGINEER CENTRAL LONDON HYBRID (3 DAYS A WEEK) £50,000 - £70,000 A great opportunity for a BI Engineer to bridge the gap between Data Engineering and BI reporting at an asset management firm expanding their data and analytics team. THE COMPANY Join a forward-thinking asset … financial returns. With a focus on secured loans, high-yield bonds, and structured credit, they operate at the forefront of the financial markets, leveraging data and analytics to drive informed decision-making. THE ROLE AND RESPONSIBILITIES As a BI Engineer, you will be responsible for supporting data cleansing … and fast-paced environment, working with cutting-edge technologies such as Alteryx, Tableau, SQL, and Python. Responsibilities: Contribute to the setup and maintenance of data infrastructure, including data lakes, warehouses, and SQL Server databases. Utilize your technical expertise in SQL and Python to extract, transform, and analyse data more »

commodities house is seeking a Senior PowerBI Developer to enhance their reporting capabilities. This role involves collaborating with multiple business functions and partnering with Data Science and Data Engineering teams to optimize data models and pipelines, driving business performance. Experience within commodities is a must and … the start date wont be until August so please bear this in mind. Key Responsibilities: Develop comprehensive visualisations and reports in PowerBI Collaborate with Data Science and Data Engineering teams Maintain and enhance PowerBI dashboards Address and solve data issues Requirements: Proven experience as a BI … Developer or similar role Proficient in PowerBI, DAX, Power Query, and SQL Strong understanding of data modelling and database concepts Familiarity with data visualisation techniques Experience with Azure and Databricks is a plus Prior experience in financial services or commodities is a must If interested please come back more »

Lead Data Engineer/Data Lead/Senior Data Engineer/Lead Data Engineer Lead Data engineer We are searching for a Lead Data Engineer with significant experience in Python, Snowflake, Segment, ELT, SQL (PostgreSQL, MySQL). The client is a world renowned leading … Non-profit organization. Lead Data Engineer/Data Lead/Senior Data Engineer/Lead Data Engineer Responsibilities: Spearhead the advancement of their innovative data strategy. Plan, create, validate, document, and oversee a variety of data migration procedures for transferring data from current … systems to a new data infrastructure. Oversee the entire data lifecycle to ensure usability, facilitating analysis and insights crucial for informing business decisions. Support, mentor and manage a small to midsize team of Data Engineers. Requirements: Solid and comprehensive experience in data engineering positions Expert more »

Scalexperts are partnered with a VC backed education group who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function. They are looking for a Senior Data Engineer to join them to work on building a brand new … data platform which is still in early stage development. They are looking to combine all the data into one common data platform heavily on Azure so that reporting & insight/analytics becomes much clearer and more consistent. This role will require someone to line manage 2 data … first time Previous management is not essential at all Key Experience Required: In-depth knowledge of and experience with Databricks 3 years experience in Data Engineering Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etc Experience with SQL is a more »

This is an exciting opportunity to join one of Europe's fastest growing health-tech startups, working in a Data team that has made huge steps in moving our innovative platform forwards This role is Hybrid but only requires 1-2 days a month in our London office About … be the UK leader in revolutionising affordable care for the better, for our service users and society and the perfect coordination across care practice, data, science and technology is how we ll get there. About Data at Cera Data has a critical role to play in two … distinct areas. First, data about our operations, covering everything from hiring and retaining carers to the delivery of care, helps us to observe and understand how we are performing, what is working and what we could do to better deliver care. Second, data about service users' health, covering more »

INFOData Engineer - Tech LeadFintechLondon110,000As a Tech Lead, you will be leading and managing a greenfield implementation for a disruptive Fintech. The data platform will be used to facilitate the launch of a new product.THE COMPANY:This company has gone through a period of hyper-growth over the last … credit card space and have launched multiple successful products and are now one of the most trusted brands out there. They have several big data teams looking after their client's data for the advanced analytics team to gather insights on. They have established a robust AWS architecture … that allows the business to store and stream big data coming in from all types of sources.THE ROLE:As a Tech Lead you will be expected to be hands-on with Spark/Python, Kafka. You will be part of the design team to enhance their AWS platform, introducing more »

Job Title: Software Engineer (Rust/HPC/Real Time Data) Client: Elite Tech Firm Salary: Up to £200k 1st Year Compensation Location: London Sells: Cutting-edge tech, ownership of multiple greenfield projects, no red tape, a friendly/collaborative environment, beautiful offices, personal projects on Fridays An Elite … Working as part of a team of engineers looking after and building a zero-down time low latency solutions for multi petabyte/exabyte data sets Working heavily in Rust Building/Optimising some of the world's most advanced data pipelines Collaborating with ML Engineers, Data … Working with other incredibly passionate technologists Skills: 5 years experience working as a Software Engineer ideally using Rust Outstanding CompSci Fundamentals needed Knowledge of data engineering principles/data lake architectures - Arrow/Parquet etc. Excellent knowledge of low-level concepts (e.g. compilers, x86, LLVM etc. more »

Lead Azure Data Engineer PySpark (Python) & Synapse Tech for Good/Charity Essential skills required: Azure solid experience required of the Azure Data ecosystem Python - ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure Data Engineers This is the chance to work for a unique organisation Our client is a not-for-profit charity that reviews/certifies companies … circa in the UK). You will be reporting to the CTO who manages the tech team of circa 30 people comprising developers, data engineers, QA and DevOps. Essential skills required: Azure solid experience required of the Azure Data ecosystem Python - ESSENTIAL as PySpark is used heavily. You more »

is fragile and career outlook right now is very uncertain. What about working at a hedge fund where their growth is almost certain? This data engineering team hired multiple people last year most from big-tech and plan to do the same this year. A large portion of … your work will technically be non-finance, with the main finance focused work completed by other teams. The real-world, complex data engineering problems are all yours. You ll be joining a team that builds and has built thousands of ingestion pipelines, with data coming from every … single potential avenue it possibly can. To get the best understanding of an investment, all data points are considered. You ll bring the data into the business, build the data infrastructure around it and deliver the data to the right person in the business to build more »

Data Engineer Azure/Snowflake/Python London (Contract) Role: Our client is looking to expand their data engineering team and add in the utilisation of Snowflake which is currently being used by a select few members of the team, and upskilling taking place alongside. They want … to add in an additional team member who has multiple years of experience using Snowflake as a data tool and can hit the ground running Experience Snowflake Financial services Cloud (Ideally azure) Airflow would be an advantage more »

Data Platform Manager Location: dmg::media Headquarters – London Position: Permanent Package Description Our benefits package increases the longer you’ve been with us. Here’s what to expect: 25 days’ holiday (increasing by 1 per year up to a total of 30) Upon joining you will be automatically enrolled … Plus many other benefits…. Job Introduction DMG:Media own some of the world’s biggest news brands, and as such processes billions of data points every month in order to provide insights and targeting criteria for teams and stakeholders as part of our ambition to be the world … s leading Publisher when it comes to the sophisticated application of data – to power relentless growth. DMG:Media is seeking an experienced and talented Data Platform Manager to evolve its Big Data Platform and advance its overall data proposition. The successful candidate will work closely with more »

their success, they are expanding certain teams including their Quantitative Research: Strategy and Frameworks team. This team is where their quantitative researchers analyse large data sets and build systematic trading strategies, trading and research frameworks, and strategy monitoring capabilities. They re currently looking for a Python Developer to work … assisting with the design and implementation of systematic strategies in production, build tools to monitor strategies, build research infrastructure - with a heavy focus on data engineering. Tech stack: Python, Pandas, AWS, Kafka Requirements: Bachelors or Masters in an engineering or quantitative subject Strong Python production coding skills (deployed … to AWS) Strong data engineering skills (e.g. ETL) Experience working in a financial investment or FinTech firm Excellent communication skills - and the ability to communicate with quantitative researchers more »

responsibility for the roadmap and strategy of reporting across the business. You will also ensure that reports can be used be stakeholders to make data driven decisions across multiple departments The organisation have invested in its BI platforms and you will be tasked to ensure that all reporting is … standardised. You will be involved in ensuring the adoption of reports by different departments as the organisation have a goal to be truly data driven. As part of this role, you will be responsible for some of the following areas. Build effective relationships with key business stakeholders to champion … the BI department across the business Ensure data is stored in one centralised location ready for reporting Standardise reporting across the business Work with data engineering team to ensure cross departmental goals can be delivered This is a hybrid role where you will work from the organisations more »

based in the Tooting area is looking to recruit a BI & Analytics Manager to join their expanding systems department and lead a team of Data Engineers and Data Analysts who will be responsible for Azure Data Platform development/maintenance and Power BI reporting. In this role … as well as stakeholders across the organisation right up to C-suite level. This role offers the opportunity to effect change within a truly data-driven organisation going through a new period of growth. You will be offered continuous training and development, as well as progression opportunities. You will … well as a very good understanding of the implementation and benefits of Agile working. You should have an appreciation for the commercial use of data analysis and a good mix of the following technical experience: Azure Data Engineering MS BI development SQL Server database development/maintenance more »

Data Architect (fully remote) Salary: £85,000 + company benefits Full time - Permanent Must be able to gain SC Clearance Job Purpose: To work within a team of architects providing support to core infrastructure and business led projects, providing specific data architecture expertise to solution and enterprise architects. … The person appointed will be an integral member of the Architecture Team and will be responsible for ensuring that all initiatives explicitly consider data as part of their approach, and that all elements of the data lifecycle are adequately provisioned. They will also be expected to be involved … in the design and implementation of the enterprise data strategy, ensuring the strategy supports the current and future business needs. The role will involve collaborating with Business and IT stakeholders at all levels to ensure the enterprise data strategy and associated implementation is adding value to the business. more »

us with problems that need genuine thought, intelligence and knowledge; we're not just putting bodies on seats. We are currently seeking a skilled Data Engineer with Quantexa experience to join one of our most trusted clients. The project is key to the business and focuses on implementation of … across all departments within the bank. Experience & Skills: Background in hands-on technical development, with at least five years of industry experience in a data engineering role or engineering equivalent Proficiency in Scala, Java, Python, or a programming language associated with data engineering Expertise building … and deploying production level data processing batch systems maintained by application support teams Experience with a variety of modern development tooling (eg Git, Gradle, Nexus) and technologies supporting automation and DevOps (eg Jenkins, Docker) Experience working in an Agile environment A strong technical communication ability with demonstrable experience of more »

ValueDriven is a leading Artificial Intelligence and Data Consulting company dedicated to providing credible, reliable, and value-driven outcomes for transformative impact. We specialize in the development of AI and data-driven solutions, helping organizations of all sizes make data-informed decisions and optimize their operations. Our … on innovation, collaboration, and the delivery of outstanding results for our clients. We are currently seeking an experienced and highly skilled Senior Consultant in Data Engineering to join our team at ValueDriven. The Senior Consultant will play a crucial role in designing, implementing, and optimizing data solutions … for our clients, ensuring that their data infrastructure meets their unique needs and requirements. The ideal candidate will have extensive knowledge of data engineering best practices, technologies, and tools, as well as a passion for solving complex data challenges. Responsibilities: Collaborate with clients to understand their more »

Technologies: Enterprise Data Architect Data Engineer Financial Services Insurance Our client, one of the worlds largest commercial insurance companies with operations in 54 countries and territories has a need for a skilled Data Architect/Data Engineer to join its London based team. The role is … days onsite and 2 days remote. The role: Do you have data engineering or architecture experience within the financial services industry? If you are interested in growing your skills and career within one of the largest commercial insurers in the world, then we would love to hear from … you! Data Architect will be responsible for the design of the enterprise-wide data architecture and supporting the development of the organisation's functional data strategy and roadmaps. The successful candidate will be responsible for first, determining and classifying which data assets should be treated as more »