Data Engineer I, Business Data Technologies Business Data Technologies (BDT) makes it easier for teams across Amazon to produce, store, catalog, secure, move, and analyze data at massive scale. Our managed solutions combine standard AWS tooling, open-source products, and custom services to free teams from worrying about the complexities of operating … lets BDT customers move beyond the engineering and operational burden associated with managing and scaling platforms, and instead focus on scaling the value they can glean from their data, both for their customers and their teams. We own the one of the biggest (largest) datalakes for Amazon where 1000's of Amazon teams can search … share, and store EB (Exabytes) of data in a secure and seamless way; using our solutions, teams around the world can schedule/process millions of workloads on a daily basis. We provide enterprise solutions that focus on compliance, security, integrity, and cost efficiency of operating and managing EBs of Amazon data. Key job responsibilities CORE RESPONSIBILITIES: Be More ❯
Data Architect Tyseley, Birmingham £70,000-£90,000 Are you passionate about leveraging data to drive business insight and transformation? Do you thrive on designing and delivering modern data platforms using the latest in Azure cloud technologies? If so, this could be your next big opportunity. TXP are working with a leading European IT … services and solutions provider experiencing rapid growth in their Hybrid Infrastructure offerings. As part of this expansion, they are looking for a skilled Data Technical Architect to join their high-performing team. What You'll Do: Work directly with customers to understand their business data challenges and architect innovative solutions that deliver real value. Collaborate with … in cloud infrastructure or data-focused roles within technology service providers. Expertise with Azure data services including Synapse, Data Factory, DataLake, and the Microsoft data stack. Strong understanding of data architecture , modelling, and cloud-native data engineering principles. Experience implementing datalakesMore ❯
Delivery Consultant - Data Analytics, AWS Professional Services Job ID: Amazon Web Services Australia Pty Ltd Are you a Data Analytics specialist? Do you have Real-time Data Analytics, Data Warehousing, Big Data, Modern Data Strategy, DataLake and Data engineering experience? Do you like to solve the most complex and high scale (billions+ records) data challenges in the world today? Do you … learn and use services such as AWS Glue, Amazon S3, Amazon DynamoDB, Amazon Relational Database Service (RDS), Amazon Elastic Map Reduce (EMR), Amazon Kinesis, Amazon Redshift, Amazon Athena, AWS Lake Formation, Amazon DataZone, Amazon SageMaker and Amazon Quicksight - Solutions - Deliver technical engagements with partners and customers. This includes participating in pre-sales visits, understanding customer requirements, creating consulting proposals More ❯
Manchester Area, United Kingdom Hybrid / WFH Options
Opus Recruitment Solutions
Are you a passionate Data Engineering Manager ready to unlock the power of data? Our client is a leading UK-based consultancy seeking a skilled professional to shape data strategies, mentor dynamic teams, and deliver cutting-edge solutions. With hands-on expertise in Spark, SQL, and cloud platforms like Azure, you’ll lead end … to-end projects, drive innovation, and collaborate with clients across industries. What You’ll Do: Lead complex data engineering solutions with technical excellence. Mentor teams and foster a culture of growth and quality. Showcase your expertise in pre-sales and client workshops. Design data pipelines, lakes, and warehouses with best practices. Skills They're Looking For … Proven Data Engineering experience (5+ years). Consultancy experience is a must. Leadership and multi-project environments experience. Expertise in ETL, data modelling, and Azure Data Services. Experience in designing and implementing data pipelines, datalakes, and data warehouses. Hands-on experience with Apache Spark and bonus points More ❯
Leeds, England, United Kingdom Hybrid / WFH Options
Fruition Group
Job Title: Senior Data Engineer Location: Leeds, on-site 2x per week Salary: Up to £85,000 Why Apply? Our client is looking for a talented Data Engineer to play a key role in … their ongoing digital transformation. This full-time, permanent position offers the chance to develop the initial data strategy, design scalable pipelines, and create a datalake that will be central to their reporting initiatives. If you are experienced in managing cloud-based data infrastructures and eager to drive innovative solutions, this role is … and maintain scalable, automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup of a centralised datalake to unify data from various sources, supporting BI and analytics needs across the business. Partner with teams across the business, including Product, Analytics, and IT, to ensure More ❯
South East, England, United Kingdom Hybrid / WFH Options
Data Science Talent
Data Engineer (Databricks & Azure) - Clean Energy Location: South East England (Hybrid - 1 day onsite per week) Salary: £60k - £70k + benefits package 18 months. That’s all the time it took for the client’s Databricks platform to evolve into a key driver of innovative green technologies. Now, they’re looking for someone to take it even further. … will maintain, monitor, and enhance the Databricks platform that powers the client’s data services. You’ll work on building robust pipelines using Azure DataLake and Python while collaborating closely with data scientists, simulation engineers, and the wider business. Reporting to the Head of Data Management, you’ll be a … need: 18 months or more of Databricks experience , with a strong background in managing and maintaining data services on the platform. Expertise in Azure DataLake , Python , and CI/CD pipelines using Azure DevOps. Practical experience in industries like manufacturing , product development , or automotive , with a focus on real-world applications. Familiarity with dataMore ❯
mission dedicated to driving positive change. Read on to learn more about the opportunity and how you can have a positive impact! About the Role The Insight and Data team is a recently formed team focusing on analytics, data extraction, transformation, and load, as well as governance and stewardship. The team is primarily responsible for enabling … is quickly growing. Key Responsibilities: Oversee a team of 2 ETL Developers to ensure all source systems in EcoOnline's landscape are properly ingested into the datalake hosted within AWS S3. Own and develop all data pipelines and infrastructure using a combination of Talend Data Studio, Stitch Data Replication, and … SQL. Own development of automation to enable near real time data availability within datasets and datalake (AWS Redshift and AWS S3). Own initial development of datasets from the datalake to enable surfacing topical data with light normalization to end users. Ensure methodology used is compliant with best More ❯
Principal Data Engineer £95,000 - £105,000 + Bonus London (other UK locations available) A top-tier global consultancy is in search of a Data Engineer (Principal Consultant) to drive the delivery of cloud-native data platforms across complex, high-impact environments. If you’re passionate about data engineering, experienced in building …/RFP), and want to work in an organisation that values creativity, autonomy, and technical excellence — this could be the one. What you’ll do as a Principal Data Engineer: • Lead the architecture and build of modern data platforms using AWS-native tools (S3, Redshift, Lambda, Glue, DynamoDB, Matillion, etc.). • Drive best practices in CI …/CD, Infrastructure-as-Code, and data ops methodologies. • Liaise directly with clients to define requirements, shape technical solutions, and oversee successful delivery. • Contribute to practice growth through recruitment, coaching, and mentoring. • Lead business development activities including RFI/RFP responses and proposal development. • Ensure solutions are secure, scalable, and production-ready. • Be an advocate of clean code More ❯
Principal Data Engineer £95,000 - £105,000 + Bonus London (other UK locations available) A top-tier global consultancy is in search of a Data Engineer (Principal Consultant) to drive the delivery of cloud-native data platforms across complex, high-impact environments. If you’re passionate about data engineering, experienced in building …/RFP), and want to work in an organisation that values creativity, autonomy, and technical excellence — this could be the one. What you’ll do as a Principal Data Engineer: • Lead the architecture and build of modern data platforms using AWS-native tools (S3, Redshift, Lambda, Glue, DynamoDB, Matillion, etc.). • Drive best practices in CI …/CD, Infrastructure-as-Code, and data ops methodologies. • Liaise directly with clients to define requirements, shape technical solutions, and oversee successful delivery. • Contribute to practice growth through recruitment, coaching, and mentoring. • Lead business development activities including RFI/RFP responses and proposal development. • Ensure solutions are secure, scalable, and production-ready. • Be an advocate of clean code More ❯
Location: London (2-3 days on site) Department: Data & Analytics About the Role We are looking for a skilled and strategic Data Architect to lead the design and implementation of scalable, secure, and high-performing data solutions across our cloud environment. In this role, you will play a critical part in shaping our enterprise … data architecture using Microsoft Azure, Microsoft Fabric, and related technologies. You will work across teams to integrate diverse data sources, optimize database performance, and ensure compliance with evolving data governance standards. Key Responsibilities Architect Scalable Data Solutions: Design and implement efficient data models and database architectures to support current and … future business needs. Develop Documentation & Metadata Standards: Maintain clear and up-to-date architectural documentation, including metadata definitions and data lineage diagrams. Establish Data Standards & Best Practices: Define and enforce data architecture principles, governance policies, and operational procedures to maintain consistency and compliance. Enhance Performance & Reliability: Continuously refine and optimize database environments for speed More ❯
Job Title: Solutions Architect (Data) Terms: Permanent, full-time Salary: c.£75,000 Employee Benefits: Local Government pension scheme, 31 days annual leave (plus Bank Holidays) Allen Lane is delighted to be supporting a London-based Local Authority in their search for a Solutions Architect . This is a new role in the structure, with a particular focus … on data architecture and data platforms . The postholder will own end-to-end solution designs, working closely with senior stakeholders cross the Council. We are looking for applicants that can demonstrate outstanding collaboration and engagement skills, communicating effectively will a diverse range of stakeholders up to and including Director level and with external partners. You … will play a critical role in leading the definition, design and delivery of modern data solutions and products. You will have excellent Cloud knowledge, either with Azure or AWS . Applicants are expected to demonstrate the following skills and experience against the following essential criteria: Relevant certifications (e.g. Azure Solutions Architect, Azure Data Scientist, Azure AI More ❯
Job Title: Solutions Architect (Data) Terms: Permanent, full-time Salary: c.£75,000 Employee Benefits: Local Government pension scheme, 31 days annual leave (plus Bank Holidays) Allen Lane is delighted to be supporting a London-based Local Authority in their search for a Solutions Architect . This is a new role in the structure, with a particular focus … on data architecture and data platforms . The postholder will own end-to-end solution designs, working closely with senior stakeholders cross the Council. We are looking for applicants that can demonstrate outstanding collaboration and engagement skills, communicating effectively will a diverse range of stakeholders up to and including Director level and with external partners. You … will play a critical role in leading the definition, design and delivery of modern data solutions and products. You will have excellent Cloud knowledge, either with Azure or AWS . Applicants are expected to demonstrate the following skills and experience against the following essential criteria: Relevant certifications (e.g. Azure Solutions Architect, Azure Data Scientist, Azure AI More ❯
Job Title: Solutions Architect (Data) Terms: Permanent, full-time Salary: c.£75,000 Employee Benefits: Local Government pension scheme, 31 days annual leave (plus Bank Holidays) Allen Lane is delighted to be supporting a London-based Local Authority in their search for a Solutions Architect . This is a new role in the structure, with a particular focus … on data architecture and data platforms . The postholder will own end-to-end solution designs, working closely with senior stakeholders cross the Council. We are looking for applicants that can demonstrate outstanding collaboration and engagement skills, communicating effectively will a diverse range of stakeholders up to and including Director level and with external partners. You … will play a critical role in leading the definition, design and delivery of modern data solutions and products. You will have excellent Cloud knowledge, either with Azure or AWS . Applicants are expected to demonstrate the following skills and experience against the following essential criteria: Relevant certifications (e.g. Azure Solutions Architect, Azure Data Scientist, Azure AI More ❯
Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work culture focused on innovation … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … workflows with Composer or Vertex Pipelines. Data Architecture & Modelling: Ability to translate diverse business requirements into scalable data models and architect a datalake/lakehouse environment on GCP. Engineering Best Practices: Proficiency with Git, CI/CD for data systems, and robust testing methodologies. Highly desirable skills include: Domain Experience More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Singular Recruitment
Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work culture focused on innovation … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … workflows with Composer or Vertex Pipelines. Data Architecture & Modelling: Ability to translate diverse business requirements into scalable data models and architect a datalake/lakehouse environment on GCP. Engineering Best Practices: Proficiency with Git, CI/CD for data systems, and robust testing methodologies. Highly desirable skills include: Domain Experience More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Singular Recruitment
Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work culture focused on innovation … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … workflows with Composer or Vertex Pipelines. Data Architecture & Modelling: Ability to translate diverse business requirements into scalable data models and architect a datalake/lakehouse environment on GCP. Engineering Best Practices: Proficiency with Git, CI/CD for data systems, and robust testing methodologies. Highly desirable skills include: Domain Experience More ❯
South East London, England, United Kingdom Hybrid / WFH Options
Singular Recruitment
Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work culture focused on innovation … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … workflows with Composer or Vertex Pipelines. Data Architecture & Modelling: Ability to translate diverse business requirements into scalable data models and architect a datalake/lakehouse environment on GCP. Engineering Best Practices: Proficiency with Git, CI/CD for data systems, and robust testing methodologies. Highly desirable skills include: Domain Experience More ❯
The Control-M product line is BMC's orchestration and automation platform. It helps the world's largest companies to automate time-sensitive, business-critical workflows. We orchestrate data and machine learning pipelines, supply chains, production lines, financial transactions, and other processes in complex IT environments worldwide. We continuously grow by adding and implementing the most cutting-edge … AWS serverless services and enables powerful querying and analytics through Amazon Athena. In this role, you'll work on a system that combines streaming ingestion (Firehose), datalake technologies (Parquet, Apache Iceberg), scalable storage (S3), event-driven processing (Lambda, EventBridge), fast access databases (DynamoDB), and robust APIs (Spring Boot microservices on EC2). Your role will involve … AWS. 5+ years of Java backend development experience. 3+ years of Python development. Strong hands-on experience with AWS services: Lambda, S3, K8S. Deep understanding of datalake architectures and formats such as Parquet and Iceberg. Proficiency in Spring Boot and working experience with microservices. Experience with high-scale, event-driven systems and serverless patterns. Nice to More ❯
Senior Delivery Consultant: Data Analytics & GenAI Job ID: Amazon Web Services Australia Pty Ltd Are you a Senior Data Analytics … and GenAI consulting specialist? Do you have real-time Data Analytics, Data Warehousing, Big Data, Modern Data Strategy, DataLake, Data Engineering and GenAI experience? Do you have senior stakeholder engagement experience to support pre-sales and deliver consulting engagements? Do you like to solve the most … learn and use services such as AWS Glue, Amazon S3, Amazon DynamoDB, Amazon Relational Database Service (RDS), Amazon Elastic Map Reduce (EMR), Amazon Kinesis, Amazon Redshift, Amazon Athena, AWS Lake Formation, Amazon DataZone, Amazon SageMaker, Amazon Quicksight and Amazon Bedrock. Solutions: Support pre-sales and deliver technical engagements with partners and customers. This includes participating in pre-sales visits More ❯
at our Head Office. You must live within a reasonable distance to the office or be willing to relocate by the role commencement date. Job Purpose As a Data Analyst, you will play a critical role in leveraging data to drive … insights, optimise business performance, and support decision-making. You will work with existing data platforms while contributing to the development of an Azure-based datalake, ensuring seamless integration and enabling advanced analytics. Your responsibilities will span across data extraction, cleaning, visualisation, and analysis, as well as collaborating with stakeholders to identify key … business challenges and opportunities. This role will require a bright and enthusiastic individual who has a proven track record of working in a data reporting team supporting all areas of the business. Candidates will need retail experience and a minimum 5 years IT experience of SQL SSIS and SSRS software. Strong communication is key for this role as More ❯
Greater London, England, United Kingdom Hybrid / WFH Options
Xcede
A leading, technology driven multi-strategy Hedge Fund, based in London, are seeking a talented Software Developer – Data Integration Specialist to join their innovative and highly experienced team. Essential Skills: Skilled software developer with 5+ years of experience in a related field … Strong communicator with the ability to translate complex, user needs into smart, scalable solutions A Polygot developer – particularly strong knowledge of Python Comfortable with AWS technologies and familiar with datalakes and databases A natural curiosity to explore new technologies, tools and techniques Experienced with Git and collaborative development workflows Confident working independently within a fast-paced, globally distributed team Worked … with both structured and unstructured data (bonus) Prior exposure to financial data sets (equities/derivatives) (bonus) This dynamic, global company, at the forefront of the investment industry, is looking for top-tier talent to contribute to their collaborative culture, focused upon innovation, technology and research. In this flexible role (2 days WFH), you’ll be More ❯
for Technology for Group and Operations The Enterprise Solution Architect for Technology plays a critical role in shaping Aztec Group's technology landscape, ensuring that systems, integrations, and data architectures align with business objectives and market needs. Reporting to the Director for Group and Operations, you will define and govern enterprise-wide technology strategies, focusing on scalability, security … eFront, Yardi, Viewpoint, Fenergo, and Aztec Connect (Client Portal). You will also play a key role in evaluating emerging technologies and establishing best practices for system architecture, data management, and cloud adoption. As a key advisor to senior stakeholders, the Enterprise Solution Architect will bridge business needs with technology capabilities, contributing to the transformation of legacy systems … relevant to enhance scalability and performance. Ensure security, compliance, and resilience are embedded in all architectural designs, addressing key risks in financial services technology. Design and implement robust data management strategies, ensuring high-quality, secure, and accessible data across Aztec's ecosystem. Oversee the development of data pipelines, master data management (MDM More ❯
for Technology for Group and Operations The Enterprise Solution Architect for Technology plays a critical role in shaping Aztec Group's technology landscape, ensuring that systems, integrations, and data architectures align with business objectives and market needs. Reporting to the Director for Group and Operations, you will define and govern enterprise-wide technology strategies, focusing on scalability, security … eFront, Yardi, Viewpoint, Fenergo, and Aztec Connect (Client Portal). You will also play a key role in evaluating emerging technologies and establishing best practices for system architecture, data management, and cloud adoption. As a key advisor to senior stakeholders, the Enterprise Solution Architect will bridge business needs with technology capabilities, contributing to the transformation of legacy systems … relevant to enhance scalability and performance. Ensure security, compliance, and resilience are embedded in all architectural designs, addressing key risks in financial services technology. Design and implement robust data management strategies, ensuring high-quality, secure, and accessible data across Aztec's ecosystem. Oversee the development of data pipelines, master data management (MDM More ❯
