401 to 425 of 982 Data Engineering Jobs

and fine tuning large language models. Monitoring & Performance: Proficiency with monitoring tools such as Prometheus and Grafana. Programming & Automation: Strong proficiency in Python, with experience in developing production applications. Data Engineering & Streaming: Familiarity with data streaming tools and Elastic to ensure high performance in data-driven environments. Nice to Have: Neo4j Data Streaming e.g. Kafka … lots of money through our salary sacrifice scheme! Top-Quality Equipment Get the tools you need to perform at your best, from cutting-edge tech to ergonomic office setups. Data Privacy Notice By submitting your application, you agree that DEFEYENE LEGAL SOLUTIONS LIMITED ('Definely') may collect, process, and store your personal data as part of our recruitment process. … We will use the information you provide to assess your qualifications for the role you are applying for and to communicate with you regarding your application.Your personal data will be stored for up to 12 months, after which it will be securely deleted unless we have another lawful basis to retain it. You have the right to access, correct More ❯

Title: Senior Full Stack Software Engineer - P4 Location: Remote/Swansea, United Kingdom Headquarters Reports To: Head of UK Operations Join Us in Shaping the Future of Data Analytics and AI Are you ready to make a real impact? At J.D. Power, we're global leaders in consumer insights, advisory services, and data analytics. We're driving innovation … and experiment with AI-driven solutions that push boundaries. Your Role: Innovator, Problem-Solver, and Collaborator As a key member of our team, you will: Harness the power of data: Design, implement, and maintain efficient data pipelines using technologies like Python, Spark, .NET, SQL and more. Lead by design: Develop innovative solutions that transform raw data into … degree in Computer Science (or related field) - a Master's degree is a bonus! 5+ years of software development experience , with expertise in backend development. A strong foundation in data engineering , including designing practical data schemas and working with large-scale distributed systems. Proficiency in Python, PySpark, SQL, C#, .NET, and Typescript -and a willingness to quickly More ❯

Hometrack is seeking an accomplished Head of/Principal Data Engineer, to lead the delivery of the UK's best Property Data Platform. We offer a competitive salary, fantastic benefits, and flexible, hybrid working. Hometrack's market-leading property data sets, valuation models, and risk insights are delivered via our suite of B2B SaaS applications for mortgage …/SSIS pipelines to PySpark and Databricks, and we're in the home stretch of our modernisation programme. Now we're looking to unlock the power of our disparate data, and make it accessible and reusable across our teams and products, and enable our customers to self-serve. Come help us architect and deliver the UK's best Property … Data Platform. What we're looking for in a Head of Data Engineering: Collaborative, across product teams, and functions (Data Science, Analytics, Legal, Software, etc) A pragmatist, who can align multiple product workstreams towards the coherent vision of a unified high quality, high trust data platform to support production services, including dashboards, new product delivery More ❯

Head of Enterprise Data Engineering - FCDO - G6 London, Milton Keynes or East Kilbride - You will be required to work from this location in line with FCDO policies on Hybrid Working (minimum 60% in the office). About the job Job summary The Foreign, Commonwealth & Development Office pursues our national interests and projects the UK's role in the … Digital Directorate (IDD) is responsible for delivering the Foreign Secretary's ambition to make the FCDO the most technologically integrated and innovative foreign ministry globally. This means harnessing digital, data, technology, IT security and information management to support the FCDO and UK Government partners on our platform to deliver our diplomatic, development and consular aims. All while keeping our … rights to global network management, from supporting staff in using the latest Microsoft toolsets, to creating corporate applications, harnessing AI and much more in line with the FCDO Digital, Data and Technology (DDaT) Strategy. The Directorate is made up of a wide range of talented staff and experts including specialist, contractors, home civil servants and diplomats who have served More ❯

Head of Enterprise Data Engineering - FCDO - G6 London, Milton Keynes or East Kilbride - You will be required to work from this location in line with FCDO policies on Hybrid Working (minimum 60% in the office). About the job Job summary The Foreign, Commonwealth & Development Office pursues our national interests and projects the UK's role in the … Digital Directorate (IDD) is responsible for delivering the Foreign Secretary's ambition to make the FCDO the most technologically integrated and innovative foreign ministry globally. This means harnessing digital, data, technology, IT security and information management to support the FCDO and UK Government partners on our platform to deliver our diplomatic, development and consular aims. All while keeping our … rights to global network management, from supporting staff in using the latest Microsoft toolsets, to creating corporate applications, harnessing AI and much more in line with the FCDO Digital, Data and Technology (DDaT) Strategy. The Directorate is made up of a wide range of talented staff and experts including specialist, contractors, home civil servants and diplomats who have served More ❯

Head of Enterprise Data Engineering - FCDO - G6 London, Milton Keynes or East Kilbride - You will be required to work from this location in line with FCDO policies on Hybrid Working (minimum 60% in the office). About the job Job summary The Foreign, Commonwealth & Development Office pursues our national interests and projects the UK's role in the … Digital Directorate (IDD) is responsible for delivering the Foreign Secretary's ambition to make the FCDO the most technologically integrated and innovative foreign ministry globally. This means harnessing digital, data, technology, IT security and information management to support the FCDO and UK Government partners on our platform to deliver our diplomatic, development and consular aims. All while keeping our … rights to global network management, from supporting staff in using the latest Microsoft toolsets, to creating corporate applications, harnessing AI and much more in line with the FCDO Digital, Data and Technology (DDaT) Strategy. The Directorate is made up of a wide range of talented staff and experts including specialist, contractors, home civil servants and diplomats who have served More ❯

Contact email: Job ref: ADE/HH/90 Startdate: ASAP We'e looking for a Senior AWS Data Engineer to join a high-impact team driving a next-generation data platform initiative. This is a greenfield opportunity to shape the architecture and engineering of a cutting-edge data solution from scratch. You'll be working … with modern technologies like Databricks, Snowflake, and the latest in AWS data tooling, helping to solve complex data challenges that have wide-reaching impact across multiple business domains. Key Requirements: Strong experience in AWS data engineering tools (e.g., Glue, Athena, PySpark, Lake Formation) Solid skills in Python and SQL for data processing and analysis Deep … understanding of data governance, quality, and security A passion for building scalable, secure, and efficient data pipelines Nice to Have: Broader experience across data platforms or tools Familiarity with analytics, ML, or financial data This is a unique chance to make your mark on a major data transformation! By submitting your details you agree to More ❯

IMG is seeking individuals with exceptional communication abilities, the capacity to thrive in a dynamic setting, and a strong drive to tackle intricate data challenges. The preferred candidate should possess experience in data engineering, along with a demonstrated history of creating effective data applications. As part of a team of data engineers, the candidate will … collaborate on the design, development, testing, documentation, deployment, and management of data systems. Qualifications The ideal candidate should have at least 3 years of experience in data engineering and possess professional expertise in the following areas: i. Data modeling and data architecture ii. SQL databases (e.g. Oracle, PostgeSQL, or MySQL) iii. Python programming language Experience … in the following: i. Data integration and ETL tools (e.g., Talend, Informatica, Knime, or Apache NiFi) ii. Data visualization tools (e.g., Tableau or Power BI). iii. Agile methodologies and project management tools and utilization of project management tools (e.g., JIRA). iv. Statistical, mathematical, and database Python packages (e.g., NumPy, SQLAlchemy, or Pandas More ❯

is a world-leading major global contractor, building, maintaining and operating on some of the world's biggest infrastructure projects. Due to continued growth, they are seeking a Lead Data Engineer to join their team in London, UK RESPONSIBILITIES Leading the design, development, and deployment of a secure, scalable data platform on Microsoft Azure, turning complex construction data into actionable insight Managing the data platform roadmap and delivery using high quality engineering practices Overseeing a high-performing data engineering team and mentoring technical talent Collaborating frequently across departments to define data requirements, structure, and strategy Ensuring adherence to data governance, MDM standards, and nuclear safety protocols Overseeing incident management processes and … technical documentation for live environments PROFILE Experienced in Microsoft Azure Data services, e.g. Data Factory, Databricks, Azure SQL, Synapse Experience in SQL, NoSQL, and API-based data pipelines Demonstrable history of using Agile methodologies such as SCRUM or Kanban Previously led engineering teams in complex environments Ability to translate business needs into scalable data architecture More ❯

Our client, a technology-driven leader in the insurance software space, is seeking a Technical Lead - Data Science & Engineering to help architect and scale their unified data platform and Data-as-a-Service (DaaS) capabilities. This is a hands-on leadership role ideal for someone who thrives at the intersection of data engineering, machine … learning, and modern cloud infrastructure. You'll provide technical direction to a growing team of engineers and data scientists while collaborating with cross-functional stakeholders across product, engineering, and the wider business. Key Responsibilities: Lead the architecture and development of scalable data platforms and DaaS infrastructure (cloud & hybrid). Define best practices and technical standards across data engineering and ML workflows. Mentor and guide a multidisciplinary team, promoting robust CI/CD and monitoring strategies. Oversee deployment and governance of ML models in production environments. Collaborate on the design of secure, scalable data APIs for self-serve analytics. Evaluate and introduce new tools and technologies to drive performance and scalability. Required Experience: Extensive background More ❯

Our client, a technology-driven leader in the insurance software space, is seeking a Technical Lead - Data Science & Engineering to help architect and scale their unified data platform and Data-as-a-Service (DaaS) capabilities. This is a hands-on leadership role ideal for someone who thrives at the intersection of data engineering, machine … learning, and modern cloud infrastructure. You'll provide technical direction to a growing team of engineers and data scientists while collaborating with cross-functional stakeholders across product, engineering, and the wider business. Key Responsibilities: Lead the architecture and development of scalable data platforms and DaaS infrastructure (cloud & hybrid). Define best practices and technical standards across data engineering and ML workflows. Mentor and guide a multidisciplinary team, promoting robust CI/CD and monitoring strategies. Oversee deployment and governance of ML models in production environments. Collaborate on the design of secure, scalable data APIs for self-serve analytics. Evaluate and introduce new tools and technologies to drive performance and scalability. Required Experience: Extensive background More ❯

We're seeking a Data Engineer to design and maintain robust, secure data infrastructure. This role focuses on building resilient data pipelines that support analytics and decision-making systems in high-security environments. Primary Responsibilities • Design and maintain secure, auditable data pipelines supporting ML and analytics workflows. • Oversee data ingestion, transformation, and validation using best … practices for security and traceability. • Collaborate with mission engineers and data scientists to align infrastructure with operational goals. • Optimize data processing and storage for both real-time and batch operations. • Ensure compliance with data governance and cross-domain security policies. Required Experience • Active Secret clearance • Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, or a related technical field required • 4+ years in data engineering, preferably within secure or classified environments • Strong proficiency in Python, Spark, SQL, and orchestration tools such as Airflow • Hands-on experience with classified data management, secure networking, and infrastructure performance tuning Preferred Experience • Familiarity with secure cloud environments (e.g., AWS GovCloud, C2S) • Strong troubleshooting More ❯

Senior Data Engineer – Data Modelling & Engineering – London Area – 6 Months Contract We are seeking a highly skilled and collaborative Senior Data Engineer to join a dynamic Data Modelling and Engineering team. You will play a key role in building and maintaining data pipelines, enabling seamless access to trusted data for analysts, performance … teams, and data scientists. Your work will directly support the development of robust, automated, and maintainable data processes that drive confident, data-informed decision-making.This is an exciting opportunity to join a forward-thinking organisation focused on modernising and stabilising complex data landscapes. You’ll be part of a team that values innovation, flexibility, and user … centric design, working in a supportive environment that encourages continuous learning and improvement. About the Role: You will work closely with upstream teams to bring critical data onto an Analytical Platform and help develop a new data layer. Your responsibilities will include establishing connectivity with downstream systems, conducting user needs analysis, and contributing to the design of dimensional More ❯

The Green Recruitment Company is working with an Environmental and Sustainability Business that supports and empowers their customers' journey to net zero. To join their Data-Technology team, we have an opportunity for a Data Engineer to help support the wider business (cross-functional) to meet their reporting and data requirements. About the role: The Data Engineer will work with the latest innovative technologies to design, build, and maintain data solutions, constructing processes to surface data both internally for reporting purposes and externally through the customer portal. The Data Engineer will be responsible for developing scalable data pipelines to integrate diverse data sources while ensuring data quality under the … framework of a new Data Platform for real-time application integration and reporting. They will work closely with business stakeholders to support data-driven decision-making by delivering clean, well-structured datasets that can be utilized for reporting purposes in a performant, secure way. Key responsibilities: Taking full ownership of assigned projects and BAU tasks. Maintaining current pipelines More ❯

Data Engineer | Data Consultant | Azure | Fabric | Python | SQL | PySpark Fabric Data Consultant - Up to £75,000 London - 3 days in-office Method Resourcing are thrilled to be partnering with a Microsoft Solutions Partner to support them in hiring a Data Consultant to focus on and specialise on their current and upcoming Fabric projects. This is a … pipeline of projects confirmed for the coming 18 months. You will be an in-house specialist for Microsoft fabric and work on a variety of projects, focusing largely on Data Engineering tasks and work streams to deliver Fabric/Azure solutions for a range of clients. For this role, we are looking for someone who can demonstrate experience … in the following areas: Very strong Azure experience - Ideally using ADF, Databricks, ADLS etc - Fabric experience is very desirable Data Engineering background - ETL development, data storage platforms such as Data Warehouse, Lake, or Lakehouse architectures You will ideally have come from a consultancy background, and henceforth understand how to balance multiple projects with different clients at More ❯

Data Solutions Architect-Growing Digital Organisation Permanent, Northern Ireland Hybrid working model Consulting/Services background Our client have exciting growth plans for Northern Ireland. They are a leading provider of Digital and IT Managed Services with long term clients across both Public and Private Sector. They have strong core values and a focus on diversity, development and collaboration. … As part of their growth plans, they seek an additional experienced Data Lead Your role will include: developing future work pipelines of the practice in liaison with the Digital Practice Lead w orking closely with clients to understand their data requirements Proactively support ing sales and presales to meet sales targets You should possess relevant experience across the … following: Microsoft Platform knowledge of Azure Data Services , the Microsoft Data and/or analytics cloud stack and/or Microsoft BI technologies Experience in pre-sales activities such as leading the creation of proposals, tender responses, SOWs (and delivery of sales presentations. Experience of standard data engineering ETL processes Microsoft Fabric or Databricks expertise is More ❯

Data Engineer Application Deadline: 27 June 2025 Department: Information Technology Employment Type: Permanent - Full Time Location: Southampton Reporting To: Head of Data Description Zenergi supports and empowers our customers' journey to net zero. With a unique range of services, we tailor sustainable solutions for all our customers. What sets us apart? We drive major reductions in costs, energy … consumption and carbon emissions with our market-leading procurement service; informed advice, and unrivalled engineering expertise. We're here to guide you every step of the way. We strongly believe in supporting every member of the team to become the best they can during their Zenergi journey. We are committed to providing a positive environment where people can grow … and develop both professionally and personally. About the role As a Data Engineer at Zenergi, you will work as part of the Data Team to help support the wider business to meet their reporting and data requirements. Working with the latest innovative technologies, you will work to design, build and maintain data solutions, constructing process to More ❯

Data Engineer - Manager x5 There are data teams and then there are data teams! Our customer puts enterprise at a new scale, not only with the size of their client engagements, but also with their own size as one of the big 4 and one of the first ever Microsoft Global Alliance Partners ( all data technologies … will be delivered (GCP/AWS/Big data) although Microsoft Azure is at the forefront of some roles). As a result of insane customer wins, they are now looking to expand the teams by 5 experienced Data Engineering Managers who can be at the level to lead and assist them in their varied Cloud Data transformation projects. This internationally renowned global consulting leader has a proven track record of delivering leading edge enterprise data engineering projects/programmes for a variety of Private and Public sector organisations including banking, pharma and government; and not only will you get fantastic project diversity, you will also get the opportunity to work with the latest More ❯

Data Scientist Start: ASAP Duration: 6-12 months Location: Wokingham, 3-days per week Pay: negotiable, INSIDE IR35 We're seeking a Data Scientist with expertise in LLM use cases, data engineering, and hands-on experience with Graph and Vector Databases. You'll work on large-scale time series datasets, develop predictive models, and deliver data-driven insights to support business decisions. Key Responsibilities: - Analyse and pre-process time series data; build forecasting and predictive models. - Develop machine learning algorithms and statistical models. - Collaborate with business and technical teams to deliver data science solutions. - Optimise data pipelines in partnership with data engineers. - Communicate insights clearly to stakeholders and support data-driven strategies. Essential Skills: - Experience with LLM applications, Graph DBs, and Vector DBs. - Strong background in Python, time series analysis, and machine learning. - Proficient in data visualisation, SQL, and Agile methodologies. - Skilled at handling complex, unstructured datasets. Desirable: - Degree in Data Science, Statistics, or related field. - Experience with cloud platforms (AWS, Azure, GCP), big data tools More ❯

Not only will you directly contribute to our client deliverables, but you will have the opportunity to experiment with a range of cutting-edge techniques and deliver full-stack data science projects, from solution design through to deployment. You'll form an integral part of our close-knit team and will have the opportunity to directly contribute to the … continued success of the business. We're looking for someone with a co-operative, can-do attitude who can build high-quality data engineering solutions. If this sounds like you, we can't wait to hear from you! KEY RESPONSIBILITIES: Lead the design, development, testing, and evaluation of complex software engineering solutions for the successful delivery of … multiple client projects Build strong client relationships and lead project-centred client interaction Manage and mentor engineering project teams Encourage innovation and continuous improvement Collaborate with stakeholders to understand business needs and develop technical strategies Build processes for extracting, cleaning and transforming data (SQL/Python) Oversee the delivery of high-quality code and successful project outcomes Line More ❯

Principal Data Engineer Salary: up to £85,000 (DOE) Fixed term contract Location: Remote, UK iO Associates have partnered with a leading Prop-Tech business to find a Principal Data Engineer. In this role, you'll lead by example - driving hands-on technical delivery, mentoring a high-performing data team, and shaping scalable data solutions in … a cloud-first environment. You'll play a key role in delivering one of the UK Government's largest digital data transformation programmes. Key Responsibilities: Provide hands-on technical leadership in designing and optimising data infrastructure and pipelines Mentor and lead a team of data engineers and analysts, promoting best practices and continuous improvement Develop and deliver … scalable, cloud-based data solutions using AWS and on-premises services Own and drive the technical roadmap, aligning data strategy with business goals Collaborate with stakeholders to deliver high-impact, cost-effective data solutions Requirements: Hands-on experience in data engineering, automation, and analytics Proficient in 2+ languages (e.g. Python, Java, Scala, Spark) Strong AWS More ❯

Principal Data Engineer Salary: up to £85,000 (DOE) Fixed term contract Location: Remote, UK iO Associates have partnered with a leading Prop-Tech business to find a Principal Data Engineer. In this role, you'll lead by example - driving hands-on technical delivery, mentoring a high-performing data team, and shaping scalable data solutions in … a cloud-first environment. You'll play a key role in delivering one of the UK Government's largest digital data transformation programmes. Key Responsibilities: Provide hands-on technical leadership in designing and optimising data infrastructure and pipelines Mentor and lead a team of data engineers and analysts, promoting best practices and continuous improvement Develop and deliver … scalable, cloud-based data solutions using AWS and on-premises services Own and drive the technical roadmap, aligning data strategy with business goals Collaborate with stakeholders to deliver high-impact, cost-effective data solutions Requirements: Hands-on experience in data engineering, automation, and analytics Proficient in 2+ languages (e.g. Python, Java, Scala, Spark) Strong AWS More ❯

Lead Data Engineer, £ 70000 - 80000 + benefits. SQL, ETL, Data Warehousing, Databricks etc. Home Based with one day a month at the office in Nottingham. Expanding SaaS product company are looking for a Lead Data Engineer as they continue to grow. In this hands-on role you will be part of the team responsible for designing, creating … deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean and high performant code. Responsibilities include - Work with the Data Architects to determine technical delivery and functionality. Design data solutions based on optimal performance, scalability and … reliability. Create, optimise and maintain logical and physical data models, including data warehouses and data lakes. Design and manage the data integration process. Work with the team to improve their skills and knowledge (mentoring, training coaching, etc) Contribute as a member of the agile team. Work closely with Data Scientists, Data Engineers and BA More ❯

Lead Data Engineer, £ 70000 - 80000 + benefits. SQL, ETL, Data Warehousing etc. Home Based with one day a month at the office in Nottingham. Expanding SaaS product company are looking for a Lead Data Engineer as they continue to grow. In this hands-on role you will be part of the team responsible for designing, creating, deploying … and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean and high performant code. Responsibilities include - Work with the Data Architects to determine technical delivery and functionality. Design data solutions based on optimal performance, scalability and reliability. … Create, optimise and maintain logical and physical data models, including data warehouses and data lakes. Design and manage the data integration process. Work with the team to improve their skills and knowledge (mentoring, training coaching, etc) Contribute as a member of the agile team. Work closely with Data Scientists, Data Engineers and BA's More ❯

Information and Digital Directorate is responsible for delivering the Foreign Secretarys ambition to make the FCDO the most technologically integrated and innovative foreign ministry globally. This involves harnessing digital, data, technology, IT security and information management to deliver our diplomatic, development and consular aims while keeping our people and information safe and secure. Were currently looking to recruit two … Senior Data Engineers, and if you join us youll be a key member of a team that is primarily Azure focused but uses a number of other Cloud technologies including Oracle and Amazon Web Services. Working with your colleagues to develop product that aligns with best practice, youll also assist the Power Business Intelligence team to deliver reporting products … to our organisation. Youll have a range of other tasks these include delivering data products to business domain stakeholders and teams, mentoring and developing the skills of junior members of staff, and working with the Lead Data Engineer to develop a deep understanding of our data and systems. Committed to offering performance data products in line More ❯