1 to 25 of 71 Data Pipeline Jobs in the South East

We are searching for an experienced and talented Head of Data Engineering for a critical role working for a successful and expanding business, a company that is a market leader in its field, producing award-winning software solutions and services for a diverse portfolio of customers. The role … UK without company sponsorship. In this role you will be responsible for the following: - Creating and managing a complex service model that delivers data timely and accurately to a wide variety of stakeholders and downstream consuming applications and services. Defining and managing the cost model for the Data Platform and the staff who work on the platform. Working hand-in-hand with Data Operations and Data Insight teams to build key data pipelines and platform processes, deploying models and implementing orchestrations. Implementing governance models for data access, data more »

Job DescriptionThe Role The Data Pipeline Engineers ensure that our customer work with updated and correct data in our data analytics tool. You are the first to respond to data health failures on key pipelines. You will be comfortable reading code … that pipelines run effectively. Setting up and maintaining health checks on different data pipelines Respond, Triage, and debug the data pipeline when broken. Reading code and writing code changes and/or modifying the monitoring set-up Knowing and understanding how to navigate the data … providers when data is incorrect or not received on time. Communicating outages with the end users of a data pipeline What We Value Comfortable reading and writing code in Python, Pyspark and Java. Basic understanding of Spark and interested in learning the basics of more »

Job DescriptionAre you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future!With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that … to surpassing expectations drives them to explore every avenue for growth, harnessing opportunities that benefit their teams, projects, communities, and industry.As an Azure Data Engineer, you will play a pivotal role in the data engineering and business intelligence journey of global and regional operations. Collaborating with … cross-functional teams, you'll lead the charge in designing and implementing scalable azure data engineering and Power BI data visualisation solutions that meet diverse business needs. Your experience as an Azure Data Engineer and BI Developer will be key to optimizing data more »

the uptake and success of electric vehicles with GRIDSERVE Car Leasing. Everything we do is underpinned and connected by a technology-agnostic, proprietary data platform that grows and improves every day. Get in touch ROLE OVERVIEW Join GRIDSERVE as the Head of Data. This will be a critical … member of our leadership team, responsible for establishing and driving the data vision and strategy across the company. This role involves harnessing the power of data to optimize our operations, enhance decision-making, and unlock innovative solutions in the renewable energy space. You will lead our … journey towards becoming a data-mature organisation, building a team to leverage data for operational excellence, strategic insights, and market innovations.You will be able to communicate complex data concepts in simple business language, cutting out the jargon and getting to the point of what more »

Engineer to spearhead their Data Engineering team in London! Interesting and varied role where you can work across the whole pipeline on a breadth of impactful projects! Great scope for career progression & you’ll be leading and managing a small team of Data … insights from the Data Engineering work to contribute towards the Data Science/Analytics.Work across the whole Data pipeline (Data Engineering, Data Warehousing, Analytics)Help shape the strategy and roadmap for whole Data function and contribute towards … Engineering pipeline.Preferably someone who is capable of ‘wearing many hats’ and getting hands on in other areas across the Data Engineering pipeline if necessary!Experience leading team of Data Engineers/Scientists.Min. Bachelors’ degree in STEM subject (ideally from UK university).THE BENEFITSCompetitive SalaryDiscretionary more »

management firm that utilizes long-short equities, long-only, fixed income and commodities futures strategies across its funds seek to add a experienced Data Engineer Risk Developer. They have deep expertise in trading, technology and operations and attribute their success to rigorous scientific research. As a technology and … data - driven firm, they design and build their own cutting - edge systems, from high- performance trading platforms to large- scale data analysis and compute farms. The group manages the lifecycle of data used by investment for trading, backtesting and research. Working with quants and … role (strong understanding of data engineering principles and best practices)experience in database technologies (PostgreSQL, SQL), and query optimizationwith data pipeline development and automation.coding skills (mainly with Python)knowledge (understanding of risk concepts such as VaR calculations) and good understanding of statistics with version control more »

Job DescriptionJob Summary: We are looking for a skilled and experienced Data Architect Technical to work as part of our IT team. As a Data Architect Technical, you will be responsible for designing, developing, and maintaining the data architecture for our organization. You will … have a strong understanding of data integration best practices and will play a key role in driving successful data integration and transformation initiatives. Responsibilities:Overall Solution:Over 15 years of IT experience and over 7 years of experience in architecting, designing, developing and maintaining an End … visualization skills for data models and logical workflows. Continuous Improvement:Analyze performance metrics and propose improvements. Provide resolution to data pipeline challenges. Cloud Data Technologies:Work with Cloud Infrastructure Architects to create data security, backup, disaster recovery, and archiving strategies. Advocate more »

do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … the fastest-growing consultancies globally.Job DescriptionAs a Data Engineer you will join a team delivering transformative cloud hosted data platforms for a Version 1 customers.You will have a proven track record as a Data Engineer and be adept in your ability to implement data … multiple sourcesDevelop scalable and re-usable frameworks for ingestion and transformation of large data setsIntegrate the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is more »

Job DescriptionStott and May has partnered with a global healthcare organisation within the private sector, to source a senior data engineer to join their growing tech team. Hybrid (3/4 days per month in London or Manchester) Salary: Circa £80k p/annum Key Responsibilities:Lead the … consolidation and migration of legacy data to our new cloud-based data platform.Design and implement master and transactional data models to ensure data integrity and consistency.Develop ETL pipelines and cloud data storage solutions that meet business requirements and non-functional … needs.Collaborate closely with data analysts, visualization engineers, and project managers to deliver data solutions.Surface data for analytical consumption and prepare data for ML/predictive and prescriptive models.What we are looking for: Proficiency with Databricks and building data pipelines on more »

are recruiting for a Sports Analytics company - a clear leader in their market with considerable expansion plans.Purpose of role:The purpose of the Data Engineer is to implement and … maintain data infrastructure that facilitates data-driven decision making, innovation and operational efficiency while ensuring that the data pipeline is secure, reliable, and scalable. The role holder will build and maintain high-performance data systems that are foundational to driving business … growth and success. Key responsibilities:Implementing scalable data architectures and systems.Developing and maintaining ETL (Extract, Transform, Load) pipelines.Managing data storage, backup, and recovery mechanisms.Writing complex SQL queries to extract data for analysis.Developing and implementing data security and privacy.Interfacing with clients, end users more »

Job DescriptionSenior Data EngineerLondon (Hybrid Role)£80,000 per annumAbout:We are partnering with a hyper-growth financial services firm. This firm, highly regarded in the industry, is seeking a Senior Data Engineer to join their dynamic IT team and play a pivotal role in shaping … the futureRole Overview:As a Senior Data Engineer, you will contribute significantly to the development and maintenance of data infrastructure and analytics solutions, driving data-based decision-making across the organisation. Working in collaboration with cross-functional teams, including Heads of Departments, Analysts, and … Product Managers, you will be at the forefront of designing and implementing scalable, efficient, and reliable data pipelines and systems.Responsibilities:Design, build, and maintain scalable data pipelines and systems.Develop and optimize data integration, transformation, and cleansing processes.Collaborate with cross-functional teams to understand data more »

Job DescriptionJob Title: Data Operations AnalystCompany: Global Asset ManagerLocation: City of London, 3 days per week in officeSalary: £85,000 per annum + BenefitsAbout the Company:Join a prestigious global asset manager with over $200 billion in assets under management. Our firm is renowned for its innovative approach … excellence. Based in the heart of London's financial district, you'll be part of a dynamic team shaping the future of financial data operations.Role Overview:As a Data Operations Analyst, you will play a pivotal role in implementing a cutting-edge global platform aimed at … centralizing data management processes. Leveraging your expertise in R, Python, SQL, and Enterprise Data Management (EDM), you'll contribute to streamlining data workflows and optimizing data quality across the organization.Key Responsibilities:Collaborate with cross-functional teams to understand data requirements more »

have the financial capital and expertise to grow their capabilities and reach, with a real emphasis on building out a truly world class data function.The roleAs a Senior Analytics Engineer, you contribute to the development, enhancement, and maintenance of scalable and resilient data pipelines, reports, and … dashboards, as part of the businesses ongoing analytics evolution. You will also play an essential role in executing the data strategy and roadmap, leading the delivery of one or more key analytics projects, and working closely with and mentoring junior team members.What you'll be doing...You will contribute … enhancement, and maintenance of data models and ELT processes within a data mesh architecture using Python for data pipeline development and automation, following best practices with dbt and Snowflake.You will play a pivotal role in the delivery of key analytics projects, ensuring they more »

change the status quo, we’ll help you make your moment. Join Team Purple. Join IFS. Job Description As a Principal/Senior Data Engineer, you will spearhead our data initiatives, transforming raw data into strategic assets that propel our business forward. This role … who excel in a dynamic environment, offering the freedom to innovate and the responsibility to deliver. Core Responsibilities: Identify and harness high-value data opportunities within our product suite, converting raw data into impactful features and reusable assets. Act as the authoritative voice on data … Strong programming skills in Python, Scala, C#, or Java, and adeptness with cloud SDKs and APIs. Deep understanding of AI/ML to enhance pipeline efficiency, with experience in TensorFlow, PyTorch, AutoML, Python/R, and MLOps platforms like MLflow and Kubeflow. Solid background in DevOps , including CI/ more »

Job DescriptionSenior Data Engineer - Investment Firm - London - Up to £150k base + bonusAbout Us:We are working with a prominent investment firm based in London, renowned for their innovative approach and commitment to delivering exceptional results for our clients. As part of our continuous growth and evolution, we … are seeking a talented Senior Data Engineer to join our dynamic team.Role Overview:As a Senior Data Engineer, you will play a pivotal role in managing and optimising our data infrastructure, ensuring the reliability, security, and efficiency of our data processes. You … will work closely with various teams to design, implement, and maintain robust data pipelines, leveraging cutting-edge technologies to drive insights and inform strategic decisions.Key Responsibilities:Develop and maintain data pipelines for security and index data, sourced from Bloomberg, Reuters, and other relevant providers.Utilise more »

Job DescriptionSenior Data Platform EngineerUp to £80,0001 day a week in office (flexible)Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps.ResponsibilitiesDesign and implement Data Pipelines for both structured and unstructured data.Support and improve ML infrastructure – particularly Azure ML.Data Engineering: Guarantee … data access, Data quality, ETL, Data pipelines Platform administration: Help set up accesses, infrastructure, create new storage, enforce best practicesProduction: Help the preparation of the data science pipelines, interact with data scientists, re-shape code, support towards some ML Ops more »

Senior Data Engineer Location: Hybrid, with 2 days per month to be onsite (Abingdon) We have the pleasure to be representing a business that is on a mission to increase the number of people who can live longer, healthier lives and reduce unnecessary medical costs while doing so. … To help with the success of this strategy They are recruiting for a Senior Data Engineer that will take a pivotal role in driving the Data team forward. Responsibilities: Lead Cloud Data Warehouse Project : Take charge of leading the Cloud data warehouse … project through its next phase of development, ensuring its scalability, reliability, and performance meet the highest standards. Ownership of Data Management : Assume ownership of all aspects of data management, serving as the go-to person for any data queries from the internal team. Your more »

Job DescriptionAbout Tredence­: -Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve … methodology; think strategically and execute methodicallyDevelop and manage capacity and growth projection forecasts of the environment within budgetsCreate and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional/non-functional business requirementsDrive optimization, testing and tooling to improve quality of … Skills:8+ years of relevant experienceAt least two years of experience building and leading highly complex, technical engineering teams.Strong hands-on experience in Data bricksExperience managing distributed teams preferred.Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project management skills more »

Job DescriptionData Engineer – Pricing/Market DataA leading financial services firm are improving their data product offering and have an opportunity for a Data Engineer paly a key role in the development of key data platforms.You will have expertise in Microsoft technologies for data engineering including significant ETL development experience, including MS SQL, Azure, Fabric, and .NET technologies. This includes creating data pipelines, ingesting data and data modelling. You will be working in a fast-paced execution environment, with a focus on providing data solutions for market data and pricing within a financial markets context.You should apply for this role if you are/have:5+ years data engineering experience within financial servicesFinancial markets (buy or sell side) with pricing and/or market data experience more »

Job DescriptionFounding Data EngineerCentral London 3 days a week, hybridNB – we are looking for someone with specific experience around fintech, finance, banking, eCommerce transactions, insurance, payments, fraud, consumer scams or related areas. Please only apply if you have specific/relatable experience. You should also be fine to … have validated some of the big problems to solve. The mission is big. They have a new approach tested with retail banks. The data engineer will be key to bringing some of the solutions and the early stage product to life.The role> We’re looking for someone that … really fancies building a data platform from scratch alongside some very solid technical founders> Designing, building, and maintaining scalable data pipelines.> Collaborating with various teams to understand data requirements and implement solutions.> Optimizing data workflows and processes to enhance data more »

Job DescriptionSoftware Engineer (Data)£110,000-£120,000London, Hybrid (2x days)Permanent roleI am seeking an experienced Software Engineer (Data) who can be passionate about designing, optimising, and maintaining AI-native data processing pipelines. Your role will involve tackling complex challenges with robust data pipelines across diverse sources, enhancing the quality of data for our systems, and readiness to meet the challenges of scale.Responsibilities:Manage cloud orchestration and data infrastructure, applying your expertise with various data processing and indexing tools to ensure scalability and reliability.Design robust … data processing and indexing pipelines handling large amounts of data across several modalities, ensuring robustness and timeliness.Curate and manage large-scale data ingestion and indexing pipelines, ensure data quality and error handling.Ensure the secure handling of data through end-to more »

Job DescriptionA highly prestigious Investment Management firm are looking to hire a Senior Cloud Data Engineer with strong Python and Snowflake experience to join their new Data & AI team in a permanent position.The Cloud Data Engineer will join alongside Data Scientists and … Data Modellers to manage and improve the cloud-based Data Warehouse (Azure, Snowflake), and guide the organisation through an unprecedented period of data change.Your Key responsibilities will be:Engineering scalable and secure cloud data solutions for high-performance Data Science … workloads and Generative AI applicationsEnhancing and managing the cloud-based Data Warehouse (Azure, Snowflake)Designing, building and deploying data pipelines to support advanced analytics and the development of Machine Learning algorithms and Generative AI (GenAi) applicationsProviding technology thought leadership and supporting the business in adoption of more »

Job DescriptionAre you an experienced Senior Data Engineer ?Would you like to work for a fast growing business that specialises in Business Intelligence & Data Analytics ?Its a Hybrid working role and you will be based from either their London, Leeds, Manchester or Edinburgh office, typically …/on client site.Preferred skills:Experience with Azure and DatabricksProficiency in SQL and/or similar data technologiesFamiliarity with data pipeline tools and ETL processesKnowledge of cloud platforms and data architectureExperience working in the Retail Banking sector or financial services would be highly more »

Job DescriptionJob Title: Data EngineerJob Type: PermanentLocation: London or Fully remoteSalary: £50,000-£70,000 (Dependant on experience) + Bonus + BenefitsSkills: Python, SQL, Posgress SQL, Snowflake, PowershellRoc Search`s client provides real-time decisions and active risk monitoring to enable their customers to maximize profitability while managing … risk. their solutions are continually adapting to changing market conditions. They 20+ years of retail data science expertise and experience. They work with a global base of leading commerce partners, representing a big proportion of all US omnichannel retail sales activity across hundreds of thousands of retail locations … collective intelligence to operations, finance, marketing, and loss prevention. Their performance-improvement solutions yield measurable results with significant return on investment.About the roleThe Data Engineer will be part of a team that follows DataOps best practices and owns the standardized data assets and the processes around more »

people just like you! About the Role We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to … which means we get to work with a wide range of tools and technologies and there are always new things to learn. BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software … engineering with the knowledge and experience of building data solutions in order to deliver business value. As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps more »