1 to 25 of 65 Data Pipeline Jobs in the South East

Job DescriptionAre you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future!With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that … to surpassing expectations drives them to explore every avenue for growth, harnessing opportunities that benefit their teams, projects, communities, and industry.As an Azure Data Engineer, you will play a pivotal role in the data engineering and business intelligence journey of global and regional operations. Collaborating with … cross-functional teams, you'll lead the charge in designing and implementing scalable azure data engineering and Power BI data visualisation solutions that meet diverse business needs. Your experience as an Azure Data Engineer and BI Developer will be key to optimizing data more »

Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great scope for career progression & you’ll be leading and managing a small team of Data … insights from the Data Engineering work to contribute towards the Data Science/Analytics.Work across the whole Data pipeline (Data Engineering, Data Warehousing, Analytics)Help shape the strategy and roadmap for whole Data function and contribute towards … Engineering pipeline.Preferably someone who is capable of ‘wearing many hats’ and getting hands on in other areas across the Data Engineering pipeline if necessary!Experience leading team of Data Engineers/Scientists.Min. Bachelors’ degree in STEM subject (ideally from UK university).THE BENEFITSCompetitive SalaryDiscretionary more »

Job DescriptionRequirementsAt least two years of professional experience as a data engineer with a proven ability to provide effective data solutions in a production setting.Knowledge of developing real-time data stream systems (ideally Kafka).Proven track record in developing data systems using … PySpark and Apache Spark for batch processing.Capable of managing data intake from various sources, including data streams, unstructured data, relational databases, and NoSQL databases.Extensive knowledge in distributed systems, cloud architecture, and data pipelines.Proficiency in Python programming (knowledge of Scala or Rust is … a plus).Familiarity with ETL principles in contemporary data applications (Dagster, Airflow, Perfect).Familiarity with AWS services such as Glue, Redshift, Athena, and S3.Proficiency with Terraform, Kubernetes, and ArgoCD (expertise not required; cloud team support available).Thorough understanding of software engineering techniques, including version control, continuous integration and more »

Job DescriptionAWS Data Architect (Must have current SC)Amber Labs was born out of the recognition that many organisations require support on their data maturity journey. Our team is passionate and experienced in delivering cutting-edge data capability. Amber Labs was established with a … vision to provide specialist services, automation, accelerators competitively to organisations across EMEA.Job SummaryWe are seeking a highly skilled AWS Data Architect to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and optimizing our data architecture on the AWS platform. You will … work closely with various teams to ensure data integrity, security, and availability, driving our data strategy forwardKey ResponsibilitiesDesign and Implement Data Solutions:Develop scalable and efficient data architecture solutions on AWS.Create and maintain data pipelines using AWS services such as more »

Job DescriptionRole Overview The successful candidate will set and execute the data engineering roadmap for International systems to align with the goals of the Lyra global data strategy and Lyra International Technology roadmap. You will be responsible for running a small data engineering team … managing team members’ workloads and utilising your experience to guide the team to solutions to complex problems.You will be responsible for ensuring that data shared across borders, whether to our parent company, subsidiaries, or approved third parties, observes expected safeguards, technical controls, and minimization techniques to comply with … necessary data regulations in the 150+ countries Lyra operates in.Working closely with BI, Analytics and Reporting teams you will help plan and manage the migration of current reporting workloads from legacy systems to our new data infrastructure, implementing improvements to existing processes and pipelines where possible.Within more »

Job DescriptionAzure Data Engineers wanted by a London based company at the forefront of revolutionising healthcare through cutting-edge technology and data-driven solutions. Our mission is to improve patient outcomes and streamline healthcare processes by leveraging the power of data. We are looking for a … talented Azure Data Engineer to join our dynamic team and help us drive our mission forward.As an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining the data infrastructure. You will work closely with our data science … analytics, and engineering teams to ensure that data systems are robust, scalable, and secure. Your expertise will help us harness the full potential of our data to deliver innovative healthtech solutions.The business is already a well established leader within their domain. However, they like to keep more »

About The RoleHippo is recruiting for a Senior Data Architect to join our Hippo Herd. Our Senior Data Architect will work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. As a Senior Data Architect, you will be working as part of teams to build solutions that make data accessible to enable solutions to be optimised by using an evidence-based approach. Engaging with our clients you will design and implement data solutions ensuring solutions are integrated with … technical strategyBuild and maintain appropriate Enterprise Architecture artefacts including Entity Relationship Models, Data Dictionary, ETL/ELT definitions and Data Pipeline/Lineage ModelsBe accountable to the client for the rationale of the architecture and detailed solutionDefine the methods of governance to ensure ongoing integrity more »

Job DescriptionJob Title: Junior Data EngineerLocation: London (Anywhere in UK)Pay Rate: £150/DayWe are looking to hire a Junior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures on AWS. You will work closely with … senior data … engineers, data scientists, and other stakeholders to ensure data is accessible, reliable, and ready for analysis.Key Responsibilities:Data Pipeline Development: Design, build, and maintain data pipelines to ingest, transform, and load data from various sources into AWS data more »

Job DescriptionData Engineer – London - £100,000DescriptionMy client, a prominent figure in the insurance industry are on the hunt for a Data Engineer to join there ever growing Data team. The right individual will have a passion for Data as well as being able to … communicate to non-technical stakeholders. The right Data Engineer will ideally have experience working with Azure however my client are open to seeing people equally AWS/GCP.ResponsibilitiesDesigning and implementing scalable and efficient data storage solutions on Azure.Building and maintaining data pipelines to ingest … data.Collaborating with data scientists and analysts to understand their requirements and develop optimized data models.Monitoring and troubleshooting data pipeline performance issues.Implementing security measures to protect our data assets.Conducting regular data quality checks and applying necessary fixes.Keeping up-to-date more »

teams focused on delivering quality services and solutions.Able to distill complex technical challenges to actionable and explainable decisions.Having in-depth knowledge on Azure data components with this feature to provide solutions and necessary recommendations on the architecture.Inspire teams by building consensus and mediating compromises when necessary.Demonstrate excellent technical … emerging technologies and developing a vision of their suitability and role as a new product within a platform & product landscape.Having knowledge on the data components such as Azure datafactory, data lake, Azure SQL DB, Synapse and visualization with expertise skills in terms of performance tuning and … advanced troubleshooting.8+ years of experience in data architecture, analytics, design and developmentGood working knowledge in trouble shooting data warehouse/analytical systems using Azure Synapse.Strong, in-depth experience in data modelling and experience with business intelligenceDesign and develop batch and real-time streaming of more »

Job DescriptionJob Title: Data Operations AnalystCompany: Global Asset ManagerLocation: City of London, 3 days per week in officeSalary: £85,000 per annum + BenefitsAbout the Company:Join a prestigious global asset manager with over $200 billion in assets under management. Our firm is renowned for its innovative approach … excellence. Based in the heart of London's financial district, you'll be part of a dynamic team shaping the future of financial data operations.Role Overview:As a Data Operations Analyst, you will play a pivotal role in implementing a cutting-edge global platform aimed at … centralizing data management processes. Leveraging your expertise in R, Python, SQL, and Enterprise Data Management (EDM), you'll contribute to streamlining data workflows and optimizing data quality across the organization.Key Responsibilities:Collaborate with cross-functional teams to understand data requirements more »

profitable since early 2022.FullCircl was formed in 2021 following the merger of Artesian Solutions and DueDil. In September 2023 FullCircl acquired W2 Global Data Solutions. FullCircl is backed by top-tier investors which include Octopus Investments, Notion Capital, Augmentum Fintech and notable angel investors which include Dr Steve … provide competitive compensation and benefits and believe employee ownership is a key part of cultivating the mindset we want from everyone.The Role Lead Data Engineer We realise at FullCircl that it takes a dedicated team of brilliant people to continually innovate, push boundaries and exceed expectations. We pride … do amazing things. Still led by our three original founders, we’re constantly on the lookout for rising stars.We are seeking a lead data engineer to join our team and to work on a variety of assignments alongside our product and commercial management teams. The role will require more »

Job DescriptionJob Title: Data EngineerJob Type: PermanentLocation: London or Fully remoteSalary: £50,000-£70,000 (Dependant on experience) + Bonus + BenefitsSkills: Python, SQL, Posgress SQL, Snowflake, PowershellRoc Search`s client provides real-time decisions and active risk monitoring to enable their customers to maximize profitability while managing … risk. their solutions are continually adapting to changing market conditions. They 20+ years of retail data science expertise and experience. They work with a global base of leading commerce partners, representing a big proportion of all US omnichannel retail sales activity across hundreds of thousands of retail locations … collective intelligence to operations, finance, marketing, and loss prevention. Their performance-improvement solutions yield measurable results with significant return on investment.About the roleThe Data Engineer will be part of a team that follows DataOps best practices and owns the standardized data assets and the processes around more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »

our work in digital avatars and human clones. Role: MLOps EngineerLocation: LondonSalary: Up to £100,000Responsibilities:Develop ML Pipelines: Build and maintain scalable data processing systems. Ensure data quality and integrity.Automate ML Processes: Integrate machine learning solutions into existing systems and automate workflows.Deploy and Scale Models … performance and implementation practices.Ensure Security: Adhere to security and compliance standards in ML deployments.Requirements:Education: Bachelor’s or Master’s in Computer Science, Data Science, or related field.Experience: 2-3 years in ML, data engineering, or MLOps.Abilities: Strong analytical … problem-solving, and communication skills.Skills:Proficient in Python, ML frameworks like TensorFlow or PyTorch.Experienced with CI/CD, Docker, Kubernetes, and data pipeline tools like Airflow. more »

the needs of the business, within the broader context of overall business and technology strategy.Preference will be given to candidates with experience in data and information management/strategy, and scientific solutions and services, as well as experience working on a broad range of projects.You will be:Working … SkillsStrong solutions architecture skills and experienceKnowledge and experience of implementing large and medium scale data storage, archiving, transformation and data pipeline solutions with a focus on scientific dataKnowledge and experience of various forms of data storage and processing and data governance … and ExperienceExperience working in a science organisation or with Science R&DKnowledge of TCP/IP networking, HTTP/REST, APIs and other data transfer mechanisms such as SSH, SFTP, VPN linksKnowledge and experience with MS Azure solution architectures (esp. IaaS, PaaS and SaaS based solutions)Experience in more »

DescriptionGraduate Software Engineer - London - Exciting Fin-Tech Scale-Up 🚀📢 Permanent + Fun Social Team + Share optionsAre you a 2024 graduate passionate about Data Engineering and working with MLOps? Are you looking for a fantastic environment to start your career in?Here’s your chance to be a … FinTech scale-up and take the first big step in your career! This firm is looking for a Software Engineer to join their Data team and work with developing new data pipelines, helping to deploy new features to their stack, and help build and run their … have 🖥️:Degree from top Russell Group universities in a related field (i.e. Maths, Physics, Computer Science, etc.)Experience using Python and SQLExperience with data engineering, data cleaning, data pipelinesA passion for pushing boundaries in technologyGreat problem-solving abilitiesExcellent time management and communication skillsWhat’s more »

Job DescriptionData Engineer – SAS/SQL/Power BI* Sponsorship is not available with this position *Role – Data EngineerSalary – Up to £75k DOELocation – Manchester or London (Hybrid)A well established and award-winning Data consultancy are looking to add a Senior Data Consultant to … join their talented data team. You’ll be at the centre of everything they do as a business, supporting a range of top tier clients.The position is offering a basic salary up to £75,000 depending on experience as well as a discretionary bonus, 25-day annual leave … generous pension and much more;Flexible working environmentInclusive and friendly culturePrivate Medical InsuranceBuy and Sell additional annual leaveFunded Learning and development programmesThe Successful Data Engineer will have:Experience in developing and designing data pipelines and ETL processesPrevious experience of data warehousingUtilise SAS for data more »

a dynamic and experienced Business Intelligence Developer to join their innovative team. This role presents an exciting opportunity for individuals passionate about leveraging data to drive business insights and decisions. With a salary range of up to £70,000 per annum, this position offers competitive compensation and ample … room for professional growth.Key Responsibilities:Engineering: Design, develop, and maintain data pipelines using Azure Data Factory (ADF) and Databricks, ensuring the seamless flow of data across various systems and platforms.BI Reporting: Utilize Power BI to create visually appealing and insightful reports and dashboards that … provide actionable insights to stakeholders across the organization.Collaborate closely with cross-functional teams, including data scientists, business analysts, and IT professionals, to understand business requirements and translate them into technical solutions.Optimization: Implement performance tuning techniques to enhance the efficiency and scalability of data processing and reporting more »

Job DescriptionPrincipal Data Engineer London (hybrid)Up to £100,000 base + packageHere at Anson McCade we are partnering with a leading Digital Transformation Consultancy who are in need of an experienced Data Engineer to join a multi-disciplinary team building, supporting and maintaining User-Centred … NoSQL databases is also desirable.Solid experience of at least one Cloud provider such as AWS, Azure or GCP.Strong experience of working with different data formats, e.g., CSV, JSON and XMLBuilding reliable Data PipelinesBroader knowledge of IT — e.g., Security and NetworkingWorking in an Agile EnvironmentTest-Driven Development … the London or Bristol officeSalary up to £100,000 per annumProfessional growth and career developmentCollaborative and inclusive work environmentHealth and well-being initiativesPrincipal Data Engineer London (hybrid)Up to £100,000 base + packageIf this position is of interest please don't hesitate and apply down below more »

with one of the best leading insurance companies, in collaboration with a prestigious bank in London. We're actively seeking a talented Senior Data Engineer to enrich our dynamic team.Responsibilities:Experience designing data models and developing industrialized data pipelines.Strong knowledge of database and data more »

Job DescriptionDATA ENGINEER LONDON BASED£75,000-95,000 PER ANNUMThis growing e-commerce trading company are searching for a new Data Engineer. You will be responsible for building and maintaining a new AWS serverless platform. You will also be responsible for building and maintaining data pipelines, using Python.THE COMPANYThis E-commerce trading company have been growing since their formation. They are expanding their Data and Analytics team as the CEO has realised how important Data and Technology are to the business and is investing further in Machine Learning variables.THE … ROLEYou will be joining an expanding Data and Analytics team, which currently has more than 20 employees. You will be responsible for building and maintaining a new AWS serverless data platform.Improve best coding practices within the Business.Stream real-time Data using Kafka.Build and maintain more »

Job DescriptionReferment are working closely with the Investment Team for a global Multi-Strategy Hedge Fund to help hire a Weather Data Scientist for their London team. Their commodities division has been going from strength to strength and with their innovative weather research and forecasting platform, they’re … looking for a skilled Weather Data Scientist to work on PM engagement in advising how these analytics can be applied to trading within the Commodities Markets.This is an individual contributor role and will require someone who can work closely with portfolio managers covering weather analytics focusing on temperature … precipitation, and wind patterns impact on the commodity markets. You will work closely with data engineers focusing on the analytics and modelling side of the platform being built. Statistical analysis, weather mapping and visualisation reports will be required to show the impact of the prices on the commodities more »

based projects, alongside deep learning and neural networks to support core internal projectsPart of a team of 7 reporting to the Head of Data ScienceChance to upskill and mentor juniors whilst remaining fully hands onFocusing on end-to-end data pipelines, for training, evaluating and deploying … ML modelsWorking closely with Data Scientists on client partners, advising on best practice ML and MLOps infrastructureDriving best practices in a fast paced environment, within a well established companyYour Skills and Experience:MSc or PhD level education in STEM subjects.Strong experience in building and deploying ML modelsPreference for more »

per day (Inside IR35).The BI Development with also work across Analytics Engineering to maintain and evolve dashboards to provide stakeholders with data insight across European markets. Key responsibilities:Technical maintenance of Looker Dashboards, developing accuracy, reliability and support for business requirements.Ideate, create and deliver Looker data models that define business requirements processes and structures around data.Monitor performance of dashboards, data pipelines, technical queries and delivery on time.utilise Looker features, staying abreast of technical updates to continuously improve effectiveness of Business Intelligence solutions.Provide training and support. Help internal understanding of the platform and … demonstrate the benefits and full usability to support data teams.Your background:Minimum 4 years experience within Looker Development or a similar BI role.Track record of LookML development, data modelling and creation of dashboards.Strong skills within SQL for manipulating and querying data.Data analysis skills through complex datasets more »