DataEngineer London|Hybrid|Full-time AreyouaskilledDataEngineereagertoworkwithhigh-volumedatasetsandcutting-edgetechnologies We’relookingforadata-drivenprofessionaltodevelopandoptimiseascalabledataplatformthatsupportsadvancedanalyticsandquantitativeresearch.You’llplayakeyroleindesigningrobustdatapipelines,integratingreal-timefeeds,andensuringtheseamlessflowofstructuredandunstructureddata. Inthisrole,you'llberesponsibleforbuildingandmaintaininghigh-performancedatapipelinesthatprocesscomplexandlarge-scaledatasets.You'llworkcloselywithanalystsandresearcherstounderstandtheirdatarequirements,optimisingreal-timedataingestionbyintegratingexternalAPIsandalternativedatasources.Youwillfocusonenhancingthedataarchitecturetoimproveaccessibility,efficiency,andsecuritywhileautomatingETLworkflowstostreamlinedatamodellingandanalysis.You’llalsosupportevent-drivensystemsbyimplementingtechnologieslikeKafkaandProtobuf,ensuringseamlessdatastreamingandprocessing.Akeyaspectofyourrolewillbeimplementingrigorousqualityassurancemeasures,ensuringdataintegrityandconsistencyacrossallinputsandoutputs.Additionally,you'llcollaboratewithteamstosupportmachinelearningapplications,facilitatingdatapreparationformodeltraininganddeployment. WhatYou’llNeed 3+yearsofexperienceinadataengineering StrongproficiencyinPythonandRust Hands-onexperiencewithAWScloud,Linux,andDocker. Expertiseindistributedcomputingframeworks(Ray,Dask,orApacheArrow). Stronganalyticalskills,withtheabilitytohandlelarge-scale,high-frequencydata … .SolidunderstandingofETLpipelines,datamodelling,anddatabaseoptimisation. Experienceworkingwithreal-timestreamingtechnologies Thisisafantasticopportunitytobepartofafast-moving,data-drivenenvironmentwhereyourtechnicalexpertisewillhavearealimpact.You'llworkwithcutting-edgetools,collaboratewithtop-tierprofessionals,andcontributetotheefficiencyandinnovationofagrowingdatateam. Ifyou’rereadytotakeyourdataengineeringcareertothenextlevel,we’dlovetohearfromyou! #J-18808-Ljbffr ...