26 to 50 of 143 Data Engineering Jobs in the South East

Data Engineer Location: London – Hybrid Employment: Full Time All applicants must hold a DV (Developed Vetting) clearance to apply. The Opportunity: For the Ministry of Defence (MOD), maintaining National Security is a 24-hour-a-day, 365-day-a-year mission. For this reason, it partners with this Big … Firm to support its multidisciplinary AI & Cloud Data Engineering Capabilities. The Role: As an AI & Cloud Data Engineering practitioner, you’ll build large-scale data pipelines and infrastructure, utilising data integration tools to optimise complex data solutions. Collaborating with high-performing Data Science and ML Engineering teams to drive innovation and insight through AI and Data across the Defence & Security sector. Required Skills/Experience: British Passport Holder with active DV (Developed Vetting Clearance) End-to-end development with data pipelines, ETL processes, and workflow orchestration - using core more »

Job Title: Data Engineer Job Type: Full Time, Permanent Working location: London, Hybrid Role Purpose At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. Our data architecture is becoming more service-oriented and more real-time … which creates a range of engineering problems for you to solve. Our work is fast-paced although our team remains collaborative and flexible even when delivering fast. Your role as data engineer has a wide remit: working with product owners, subject matter experts and managers across the company … to design and deliver new components of our data landscape. You will have an end-to-end responsibility for your deliverables: from leading the work to agree the right approach, through coding, configuration and documentation, all the way to going live. In this process you will have significant impact more »

We're an innovative company based in Byfleet, currently experiencing an exciting phase of growth. As part of our expansion, we're bringing our data operations in-house to unlock its full potential and drive informed decision-making through data analysis. We're seeking a talented individual to … spearhead this initiative, taking ownership of our entire data function using the Microsoft stack. Why Join Us: This role presents a unique opportunity for you to shape the future of our data strategy. You'll have the autonomy to influence how we approach data analysis and engineering, with the potential to lead a team as we continue to grow. Key Responsibilities: Lead the development and maintenance of our data infrastructure using the Microsoft stack. Drive data engineering and modelling efforts to ensure data accuracy, reliability, and accessibility. Implement Extract, Transform, Load (ETL more »

investment management firm that utilizes long-short equities, long-only, fixed income and commodities futures strategies across its funds seek to add a experienced Data Engineer Risk Developer. They have deep expertise in trading, technology and operations and attribute their success to rigorous scientific research. As a technology and … data - driven firm, they design and build their own cutting - edge systems, from high- performance trading platforms to large- scale data analysis and compute farms. The group manages the lifecycle of data used by investment for trading, backtesting and research. Working with quants and tech teams to … integrate, process and serve data from vendors and public sources in the firm's data infrastructure (alpha data and cross-asset referential data). Currently seeking new data developers to join their growing teams. You will be part of a learning culture, where teamwork and more »

Senior Data Engineer (Inside IR35) - £700 to 825 per day Location: Remote/Hybrid (London) Rate: £825 per day Contract: Inside IR35 Are you an experienced Data Engineer with a strong background in banking? Our client are seeking Senior Data Engineers to contribute to innovative data projects within a leading financial institution. Key Responsibilities: Data Engineering: Design and implement data models, ETL processes, and data warehousing solutions. Programming: Utilize Python, Java, Scala, or GoLang to build and optimize data pipelines. Distributed Processing: Work with Hadoop, Spark, and other platforms for … large-scale data processing. Real-Time Data Streaming: Develop and manage pipelines using CDC, Kafka, and Apache Spark. Database Management: Handle SQL databases like Oracle, MySQL, or PostgreSQL. Data Governance: Ensure data quality, security, and compliance with best practices. Ideal Candidate: Significant experience in data more »

This Challenger Bank are looking for a Data Science and Analytics Leader to drive data-driven decisions across their organisation. Your role involves providing actionable insights to departments such as product development, marketing, and customer service, ensuring our actions are informed and impactful. Responsibilities: You'll enforce data governance and adherence to GDPR and PSD2 standards, safeguarding data integrity, privacy, and security. Manage and develop our data infrastructure to be scalable, reliable, and cost-efficient. Design a modern data management stack supporting a self-service data analytics model across all company functions for … quick, informed decision-making. Integrate AI and machine learning to enhance customer experiences and operational efficiencies, managing the full data lifecycle from collection to quality control. Stay updated with data science trends and guide strategic adjustments. Communicate data's importance to executives and staff, and lead the more »

Data Engineer (Azure) Up to £80,000 North London office x1 day per week OVERVIEW A successful & established B2C Insurance giant are hiring for a Data Engineer to join a strong, cross-functional Data team in the UK. You will be spearheading some of their key Data Engineering projects, working on an Azure tech stack. Proven experience using Azure Cloud Technology is essential for this role. Your responsibilities as a Data Engineer will include, but not be limited to: Spearhead Data Engineering work within the team, including ETL pipelines, CI/CD … platform engineering. Help guide and mentor junior team members on key Data Engineering projects for the business. Engage with senior business stakeholders and communicate technical concepts and projects to non-technical audiences. YOUR SKILLS & EXPERIENCE A successful Data Engineer (Azure) will have the following. Strong proficiency with more »

Founding Data Engineer Role update - this role is now contract only. And really a mix of data science and engineering... Central London 3 days a week, hybrid NB – we are looking for someone with specific experience around fintech, finance, banking, eCommerce transactions, insurance, payments, fraud, consumer scams or … they have validated some of the big problems to solve. The mission is big. They have a new approach tested with retail banks. The data engineer will be key to bringing some of the solutions and the early stage product to life. The role > We’re looking for someone … that really fancies building a data platform from scratch alongside some very solid technical founders > Designing, building, and maintaining scalable data pipelines. > Collaborating with various teams to understand data requirements and implement solutions. > Optimizing data workflows and processes to enhance data quality, reliability, and performance. more »

Data Engineer - Fixed Term Contract About our Team At LexisNexis Intellectual Property (LNIP), our mission is to bring clarity to innovation by delivering better outcomes to the innovation community. We help innovators make more informed decisions, be more productive, and ultimately achieve superior results. By helping our customers achieve … their goals, we support the development of new technologies and processes that ultimately advance humanity About the Role As a Data Engineer at LexisNexis Intellectual Property (LNIP), you'll contribute to new product development. Your role will focus on complex natural language datasets, implementing cutting-edge data solutions … like Data Lakehouses and embracing DataOps for operational excellence. Responsibilities Developing and maintaining data infrastructure supporting real-time data processing in streaming architectures Implementing scalable data ingestion and ML pipelines, incorporating Data Lakehouse concepts for unified data management Designing APIs for diverse business units more »

DATA ENGINEER £60,000 - £75,000 HYBRID - LONDON This new position is with a global consultancy who have recently expanded into supporting niche but data-driven companies in growing their data capabilities. This is a great position if you are looking to not only expand your knowledge … in data engineering but also in data science, BI, and Software Engineering, given the versatile nature of the role. THE COMPANY As mentioned, this consultancy operates on a global scale. Some of the clients you would therefore be working with are based overseas, not necessarily just … improve their capabilities, and you will become a big part of this. THE ROLE The team looking to tackle the various projects is very Data Science heavy, and you would be working closely with the Software Engineering team also. You are therefore going to be the first Data more »

Job Description: I am currently looking to hire for a Lead/Senior Data Engineer to lead modernisation efforts for a client of ours who are a leading company at the top of their game in their respective field. Duties and responsibilities: Develop and refine ETL and data integration solutions leveraging a variety of technologies and data sources. Maintain and enhance the Data Engineering Architecture. Gather and process raw data from various sources. Investigate methods to improve data quality and reliability. Identify and implement internal process enhancements, such as automating manual tasks … and optimising data delivery. Utilise cloud-based infrastructure (Azure) for hosting data solutions and applications. Collaborate with architects, data analysts, and data scientists to achieve business objectives. Requirements: Demonstrated expertise in developing and maintaining ETL/ELT processes within a medallion architecture. Proficient in Data more »

I have partnered with a cutting-edge software business who are looking to hire a Head of Data Engineering, As the Head of Data Engineering, you will be responsible for designing, developing, and maintaining our data infrastructure on GCP. You will work closely with cross … functional teams to ensure that our data pipelines are robust, scalable and efficient. The best-matched Head of Data Engineering will have the following experience and abilities: Led a team of data engineers in designing, building, and maintaining data pipelines on the Google Cloud Platform. … Evaluate and recommend new technologies and tools to improve our data infrastructure and processes. Monitor and optimize the performance of data pipelines to ensure reliability, scalability, and cost-effectiveness. Hybrid working in London, 2 days a week in the office If this looks like it could be of more »

is fragile and career outlook right now is very uncertain. What about working at a hedge fund where their growth is almost certain? This data engineering team hired multiple people last year – most from big-tech – and plan to do the same this year. A large portion of … your work will technically be non-finance, with the main finance focused work completed by other teams. The real-world, complex data engineering problems are all yours. You’ll be joining a team that builds and has built thousands of ingestion pipelines, with data coming from every … single potential avenue it possibly can. To get the best understanding of an investment, all data points are considered. You’ll bring the data into the business, build the data infrastructure around it and deliver the data to the right person in the business to build more »

Graduate Software Engineer - London - Exciting Fin-Tech Scale-Up 🚀 📢 Permanent + Fun Social Team + Share options Are you a 2024 graduate passionate about Data Engineering and working with MLOps? Are you looking for a fantastic environment to start your career in? Here’s your chance to be … social FinTech scale-up and take the first big step in your career! This firm is looking for a Software Engineer to join their Data team and work with developing new data pipelines, helping to deploy new features to their stack, and help build and run their MLOps … have 🖥️: Degree from top Russell Group universities in a related field (i.e. Maths, Physics, Computer Science, etc.) Experience using Python and SQL Experience with data engineering, data cleaning, data pipelines A passion for pushing boundaries in technology Great problem-solving abilities Excellent time management and communication more »

Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good/Charity Rate: £500-650 per day Duration: 6-12 months IR35: Outside Location: Remote with occasional travel to London (Once every two months max) Essential skills required: Azure – solid experience required of the Azure Data ecosystem Python … ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure Data Engineers This … circa in the UK). You will be reporting to the CTO who manages the tech team of circa 30 people comprising developers, data engineers, QA and DevOps. As this is a lead role 50% of your time will be leading and assisting the other data engineers and more »

Data Engineer - Databricks - £70-75,000 - London/Hybrid Scalexperts are partnered with an education business who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function. They are looking for a Data Engineer to join them … to work on building a brand new data platform which is still in early stage development. They are looking to combine all the data into one common data warehouse so that reporting & insight/analytics becomes much clearer and more consistent. This role would suit someone who … is currently working as a Data Engineer and who wants a role that can grow into a senior position, as that is the longer term plan for this role. Key Experience Required: In-depth knowledge of and experience with Databricks 3+ years experience in Data Engineering Azure more »

for our clients. We have deep expertise in trading, technology and operations and attribute our success to rigorous scientific research. As a technology and data-driven firm, we design and build our own cutting-edge systems, from high performance trading platforms to large scale data analysis and compute … offices around the globe, we emphasize true, global collaboration by aligning our investment, technology and operations teams functionally around the world. Role: Software Developer - Data Infrastructure Team: Data Infrastructure Department: Data Development Location(s): London, Montreal The Data Infrastructure team manages the service-oriented data storage infrastructure for the firm. We implement microservices that provide high performance solutions to access large data sets required in trading and research. We are looking for an experienced Software Developer with a strong background in C++ to join our team. In this role, you will be responsible more »

Senior Data Platform Engineer Up to £80,000 1 day a week in office (flexible) Xcede are delighted to be working with a well-renowned insurance company based in Hertfordshire. The company have an excellent Data Science and Machine Learning unit supported by a group of Data Engineers who are responsible for Data Pipelines. As a bonus - Data Engineers are also able to help with ML model deployment and MLOps. Responsibilities Design and implement Data Pipelines for both structured and unstructured data. Support and improve ML infrastructure – particularly Azure ML. Data Engineering: Guarantee data access, Data quality, ETL, Data pipelines Platform administration: Help set up accesses, infrastructure, create new storage, enforce best practices Production: Help the preparation of the data science pipelines, interact with data scientists, re-shape code, support towards some ML Ops principles, make more »

Job title: Lead Data Engineer Client: Elite Quant Fund Salary: Up to £160,000 Location: London/Hybrid My client are seeking a Lead Data Engineer to own delivery of scalable data pipelines that are critical to the entire firms infrastructure. Being a Lead Data Engineer … cutting edge technologies and boast a world class technical team where you will work with and learn from the best. Responsibilities: As a Lead Data Engineer, you will engage with data scientists, software engineer's and product managers to deliver high-quality product based on very specifically tailored … data requirements. Architect and implement data ingestion, transformation, and storage processes. Optimise data pipeline performance. Keep up with market developments in the data engineering and AI space and implement these best practices. Requirements and Skills: Bachelor's Degree in Computer Science, Engineering (or other more »

Client: A global financial services company About the Role: We are seeking a talented Principal Data Engineer to join our team in London. As a Principal Data Engineer, you will play a crucial role in developing and maintaining our data infrastructure, ensuring scalability, reliability, and efficiency. Key … Responsibilities: Design, develop, and maintain scalable data pipelines using BigQuery, Python, and CloudRun. Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions. Implement best practices for data modeling, ETL processes, and data governance. Optimize and fine-tune data processes to improve performance and reliability. Stay up-to-date with the latest technologies and trends in data engineering and recommend innovative solutions to enhance our data infrastructure. Required Skills: Strong proficiency in BigQuery, Python, and CloudRun. Experience with building and optimizing data pipelines for more »

Senior Data Engineer £50-£60k DOE Mainly Remote working, in office twice a month in Exter offices. The company : Manages a wide portfolio of leading PropTech businesses across various markets and technology platforms. With well-known application suites, online services, and extensive national property data, along with premier … winning solutions to estate agencies, conveyancing, surveying, lender valuations, land asset management, environmental consultancy, and Government markets. The Opportunity : This senior role in the Data department is ideal for an experienced Data Engineer to work on their modern Data platform. Currently undergoing an ambitious data transformation … to shape the future of Data and revolutionize the property industry. This role is diverse and involves creating data-as-product solutions, including: Assembling large, complex data sets that meet functional and non-functional business needs Building infrastructure for optimal data extraction, transformation, and loading from more »

employees, they are always looking to adapt to technological changes to stay at the forefront of the industry About the Role: As a Principal Data Engineer, you’ll play a pivotal role to help drive the adoption of Microsoft Power platform and streamline reporting and analytics processes across the … organisation, we are looking for a Data Engineer with extensive multi-cloud data engineering experience and in-depth understanding of end-to-end development and deployment processes. Whilst this is a data engineer role, the focus is on data analytics and migrating from Tableau to … Power BI. Experience/skills required: Proficient in data analysis, data modelling and designing ETL processes. Familiar with Data Mesh architecture and Data Products Highly skilled in T-SQL with experience in performance tuning and dealing with large data volumes Extensive experience of developing end more »

Head of Data Engineering - up to £100,000 - London My client's company is a pioneering AI firm in the HealthTech sector, dedicated to revolutionising healthcare through cutting-edge technology. Using advanced AI systems, they are committed to enhancing patient care, improving outcomes, and driving innovation in the … address the complex challenges facing healthcare providers and patients alike. How do they do it? Their AI-powered solutions analyse vast amounts of medical data to provide actionable insights for healthcare professionals, enabling them to deliver personalised care and streamline operations. By harnessing the power of artificial intelligence, they … healthcare. They're collaborative, innovative, and driven by a shared purpose to revolutionise the future of healthcare. They are looking for a Head of Data Engineering to lead their Data & MLOps initiatives and drive the development of AI-driven solutions in the healthcare space. This pivotal role more »

Data Engineer/Scientist London (Hybrid) £50,000-£60,000 (+bens) 83DATA are partnered with a leading Internet provider seeking the skills of a Data Engineer/Scientist. The successful candidate can expect to be tasked to connect data sources to pre-existing Azure data infrastructure. … You will lead projects with a data centric approach, for this reason, a passion and aptitude for critical analysis of large and complex datasets is vital. Responsibilities: Build data engineering pipelines to ingest, transform, store, and serve high quality data for Data Scientists Writing and … tuning complex data pipelines, workflows, and data structures. Identify opportunities for increasing performance, minimising costs and increase platform monitoring. Experience with components such as Azure Active Directory, Management Groups, Subscriptions, vNets, Route Tables, NSG’s and Azure Firewalls. Ensuring data security and maintaining quality assurance across all more »

machine teaming, delivers assured open-source intelligence across military capabilities and order of battle, equipment, events, countries, companies, and markets. Linking millions of assured data points, Janes data model creates a framework of interconnected open source defence intelligence. This allows our customers to integrate all relevant data … to get to better decisions with higher confidence, more quickly. Job purpose Janes is currently seeking a Senior Software Engineer with experience working with data, search technologies pipelines and diverse data stores such as Graph and NoSQL to work as part of a full stack agile unit with … be working with AWS cloud, OpenSearch and graph technologies. How you will contribute to Janes Architect and develop solutions to ingest, transform, and serve data, both for internal purposes and for customers. Be customer outcome focused and work closely with key customers, partners, project stakeholders, SMEs, and product owners more »