1,001 to 1,025 of 2,844 Data Engineer Jobs

Key Responsibilities Design and implement real-time data pipelines using tools like Apache Kafka, Apache Flink, or Spark Streaming. Develop and maintain event schemas using Avro, Protobuf, or JSON Schema. Collaborate with backend teams to integrate event-driven microservices. Ensure data quality, lineage, and observability across streaming systems. Optimize performance and scalability of streaming applications. Implement CI/… CD pipelines for data infrastructure. Monitor and troubleshoot production data flows and streaming jobs. Required Skills & Qualifications 3+ years of experience in data engineering or backend development. Strong programming skills in Python, Java, or Scala. Hands-on experience with Kafka, Kinesis, or similar messaging systems. Familiarity with stream processing frameworks like Flink, Kafka Streams, or Spark Structured … Streaming. Solid understanding of event-driven design patterns (e.g., event sourcing, CQRS). Experience with cloud platforms (AWS, GCP, or Azure) and infrastructure-as-code tools. Knowledge of data modeling, schema evolution, and serialization formats More ❯

Key Responsibilities Design and implement real-time data pipelines using tools like Apache Kafka, Apache Flink, or Spark Streaming. Develop and maintain event schemas using Avro, Protobuf, or JSON Schema. Collaborate with backend teams to integrate event-driven microservices. Ensure data quality, lineage, and observability across streaming systems. Optimize performance and scalability of streaming applications. Implement CI/… CD pipelines for data infrastructure. Monitor and troubleshoot production data flows and streaming jobs. Required Skills & Qualifications 3+ years of experience in data engineering or backend development. Strong programming skills in Python, Java, or Scala. Hands-on experience with Kafka, Kinesis, or similar messaging systems. Familiarity with stream processing frameworks like Flink, Kafka Streams, or Spark Structured … Streaming. Solid understanding of event-driven design patterns (e.g., event sourcing, CQRS). Experience with cloud platforms (AWS, GCP, or Azure) and infrastructure-as-code tools. Knowledge of data modeling, schema evolution, and serialization formats More ❯

will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Fruition Group Job Title: Senior Data Engineer Location: Leeds, on-site 2x per week Salary: Up to £85,000 Why Apply? Our client is looking for a talented Data Engineer to play … a key role in their ongoing digital transformation. This full-time, permanent position offers the chance to develop the initial data strategy, design scalable pipelines, and create a data lake that will be central to their reporting initiatives. If you are experienced in managing cloud-based data infrastructures and eager to drive innovative solutions, this role is … perfect for you. Design and maintain scalable, automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup of a centralised data lake to unify data from various sources, supporting BI and analytics needs across the business. Partner with teams across the business, including Product, Analytics, and IT, to ensure data More ❯

among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Direct message the job poster from SR2 | Socially Responsible Recruitment | Certified B Corporation Data Engineering Recruitment Consultant @ SR2 | Certified B Corporation Lead Data Engineer Lead Data Engineer Salary: £85,000–£90,000 +Up to 10% Bonus + 15% Non … Contributory Pension Location: Hybrid working (3 days P/W On-Site) |Edinburgh Level: Lead We’re looking for a Lead Data Engineer to play a key role in expanding our client's data-driven capabilities and driving the evolution of our enterprise data ecosystem. This is a strategic, hands-on position where you’ll lead … the design and delivery of large-scale data solutions that power critical business decisions. You'll work with a high-performing Data & Analytics team on mission-critical systems across Data Warehousing, Data Lakes, BI platforms, and advanced analytics. The role offers the opportunity to influence architecture, improve existing processes, and collaborate closely with business and technical More ❯

Key Responsibilities Design and implement real-time data pipelines using tools like Apache Kafka, Apache Flink, or Spark Streaming. Develop and maintain event schemas using Avro, Protobuf, or JSON Schema. Collaborate with backend teams to integrate event-driven microservices. Ensure data quality, lineage, and observability across streaming systems. Optimize performance and scalability of streaming applications. Implement CI/… CD pipelines for data infrastructure. Monitor and troubleshoot production data flows and streaming jobs. Required Skills & Qualifications 3+ years of experience in data engineering or backend development. Strong programming skills in Python, Java, or Scala. Hands-on experience with Kafka, Kinesis, or similar messaging systems. Familiarity with stream processing frameworks like Flink, Kafka Streams, or Spark Structured … Streaming. Solid understanding of event-driven design patterns (e.g., event sourcing, CQRS). Experience with cloud platforms (AWS, GCP, or Azure) and infrastructure-as-code tools. Knowledge of data modeling, schema evolution, and serialization formats More ❯

Data Engineer (Snowflake) - Nationwide Charity Location: London-based (Hybrid - 1 day per week in the office) Contract: FTC - 23 months £56,500 Overview: We are currently recruiting on behalf of a well-established nationwide charity for a Snowflake Data Engineer . This is an exciting opportunity to play a key role in designing and developing data products and services that improve how data is accessed and used across the organisation. You'll help ensure data is accurate, timely, and fit for purpose, supporting a wide range of departments and strategic goals. Role Summary: As a Data Engineer, you will work to connect systems, streamline business processes, and optimise data warehouse … platforms. You'll collaborate with stakeholders to deliver bespoke BI solutions, ranging from custom queries to dashboards and reports. Your work will transform raw data into actionable insights that drive the charity's mission forward. In addition to building and maintaining data integration pipelines, you'll help ensure the ongoing performance and reliability of the charity's core More ❯

talk with your recruiter to learn more. Base pay range Direct message the job poster from Recruit with Purpose Social Housing Technology Specialist | Recruit with Purpose Are you a Data Engineer who is looking for a more purposeful career? Feel like your current role, limits you to what you can achieve and that there isn’t any more … is yes, I could have just the role for you. Recruit with Purpose are supporting one the UK’s largest and leading housing associations to help them find a Data Engineer to join their growing team. This organisation is at the forefront for how housing associations modernise and utilise their data. Constantly evolving and leading the way within … the sector. This is a fantastic opportunity for a senior/lead data engineer to come in and put their stamp on how this organisation utilises its data. In this role, you’ll be at the heart of designing, building, and maintaining trusted, reusable data products that create better decision-making and deeper insights across the organisation. More ❯

Social network you want to login/join with: London, Manchester, Birmingham Locations Available Looking for your next challenge in Data Engineering ? We’re seeking talented professionals to help businesses unlock the power of their data using cutting-edge technologies. ? Are you passionate about Azure-based data solutions ? ? Do you have expertise in SQL, Python, and modern … data platforms ? ? Want to work on high-impact projects with leading organizations? ? What You’ll Do: Design and deliver data solutions using Fabric, Azure Data Factory, and Synapse Work with SQL, Python, Spark, Kafka, Snowflake , and more Apply best practices in Data Architecture, Governance, and Engineering Collaborate with clients to drive real business impact Be part … of a supportive, high-performing team ? What We’re Looking For: ️ Strong data engineering experience in Azure ️ Hands-on expertise in SQL, Python , and data pipeline development ️ Familiarity with Agile, DevOps, Git, APIs, and Cloud Data Platforms ️ A team player with problem-solving skills and a consulting mindset ? Bonus: DP-203 or Fabric Analytics certifications are a More ❯

Social network you want to login/join with: London, Manchester, Birmingham Locations Available Looking for your next challenge in Data Engineering ? We’re seeking talented professionals to help businesses unlock the power of their data using cutting-edge technologies. ? Are you passionate about Azure-based data solutions ? ? Do you have expertise in SQL, Python, and modern … data platforms ? ? Want to work on high-impact projects with leading organizations? ? What You’ll Do: Design and deliver data solutions using Fabric, Azure Data Factory, and Synapse Work with SQL, Python, Spark, Kafka, Snowflake , and more Apply best practices in Data Architecture, Governance, and Engineering Collaborate with clients to drive real business impact Be part … of a supportive, high-performing team ? What We’re Looking For: ️ Strong data engineering experience in Azure ️ Hands-on expertise in SQL, Python , and data pipeline development ️ Familiarity with Agile, DevOps, Git, APIs, and Cloud Data Platforms ️ A team player with problem-solving skills and a consulting mindset ? Bonus: DP-203 or Fabric Analytics certifications are a More ❯

Our Purpose Nourish Care is a leading digital social care record company and is dedicated to harnessing data-driven insights to propel innovation and drive business growth. We are seeking a talented and experienced Data Engineer specialising in data using Azure Synapse to join our dynamic team. This role offers an exciting opportunity to use our … fast amount of data to provide insightful information into the care providers we support. As a current market leader, Nourish Care provides a digital solution to the health and social care sector which enhances the process of recording, analysing, and sharing of information. We are in the midst of one of the most exciting times in our history and … our purpose of a better life for everyone. We continue to revolutionise the care sector and our incredible employees are what make this possible. About the Job As a Data Engineer specialising in Azure Synapse Data Pipelining, you will play a pivotal role in designing, developing, and maintaining data movement pipelines using Azure Synapse to facilitate More ❯

Data Engineer Skills and Technologies Data Engineering: Strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc. Strong understanding of complex JSON manipulation. Experience working with Data Pipelines using a custom Python/PySpark frameworks. Strong understanding of the 4 core Data categories (Reference, Master … Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data. Strong understanding of Data Security principles. Experience managing data owners and access controls. Knowledge of row and column level security, GDPR, and handling sensitive datasets. Strong problem-solving and analytical skills, particularly able to demonstrate these intuitively. Required skills: Languages/Frameworks: JSON YAML Python … Delta Lake Bash (both CLI usage and scripting) Git Markdown Scala (bonus, not compulsory) Azure SQL Server as a HIVE Metastore (bonus) Technologies: Azure Databricks Apache Spark Delta Tables Data processing with Python PowerBI (Integration/Data Ingestion) JIRA Due to the nature and urgency of this post, candidates holding or who have held high-level security clearance More ❯

Movera Greater Manchester, England, United Kingdom Join or sign in to find your next job Join to apply for the Data Engineer role at Movera Movera Greater Manchester, England, United Kingdom Join to apply for the Data Engineer role at Movera Get AI-powered advice on this job and more exclusive features. Are you a Data Engineer with experience building & managing data engines looking for the next step in your career? Here at Movera, we are leveraging technology to improve the home moving industry and we’re looking for a Data Engineer to design, build, and maintain Movera's Azure data environment. Join our Data & Insight team to architect … Movera's data ecosystem on Azure. You'll develop data pipelines, manage the data lake, and transform data for high-performance Power BI reporting. Collaborate with stakeholders to deliver the Data roadmap, ensuring a single source of truth and robust analytics and partner with developers to define data strategy for a stable, high-performing More ❯

Data Analytics Engineer - London Hybrid (2-3 days per week) - Salary up to £60,000 dependent on skills & experience - J12916 Founded a decade ago, this organisation is an International Digital Solutions provider that offers a range of Hosting related services, including web hosting, domain registration, VPS, complex hosting, dedicated servers, and private data centres located across the … structure and an open and fun company culture. They value self-development and advise their employees to pursue growth and learning, both inside and outside the office. As a Data Analytics Engineer, you will be at the forefront of data-driven decision-making, helping them stay ahead of the competition and deliver outstanding value to clients. Reporting … trends. Prepare comprehensive reports and visualizations to communicate findings clearly. Deliver monthly trade reporting, revenue, margin, and profitability analysis. Support pricing analysis across different regions. Enhance the scope of data captured and drive improvements in data quality and consistency. Stay up to date with industry best practices and advancements in data analytics. Skills required: Experience in a More ❯

day ago Be among the first 25 applicants Direct message the job poster from Amici Procurement Solutions Experienced Tech Recruiter with extensive experience in the Scottish market Senior Data Software Engineer – Java, Python & Search | Amici GLASGOW (HYBRID, 1 DAY PER WEEK IN OFFICE) Eden Scott is delighted to be retained by Amici to recruit an experienced Senior Data Software Engineer to help drive the development of a cutting-edge platform at the heart of the biotech industry. With significant business growth and an ambitious technology roadmap ahead, we’re seeking a skilled engineer with strong Java, Python, and data expertise to join the team and shape the future of Amici’s MyAmici platform. Why … in their mission to make life-changing discoveries. You'll be part of an agile and highly collaborative environment, leveraging modern technology stacks to build and optimize a powerful data platform and search engine. With search being a core focus for the next generation of our platform, this is an exciting opportunity to explore vector search, machine learning, and More ❯

A popular British brand is seeking a an experienced Data Engineer to play a pivotal role in a major data modernization initiative. With offices just outside of Bristol, this role will require being on-site 3 days per week to collaborate with your team and business stakeholders. As part of a transformative project leveraging Microsoft Fabric, you … ll lead the design and implementation of a scalable, metadata-driven Medallion architecture. You'll work closely with cross-functional teams to deliver robust, trusted, and timely data solutions that power advanced analytics and business intelligence. What You'll Do: Architect and build scalable data pipelines using Microsoft Fabric, PySpark, and T-SQL Lead the development of Star … Schema Lakehouse tables to support BI and self-service analytics Collaborate with stakeholders to translate business needs into data models and solutions Mentor engineers and act as a technical leader within the team Ensure data integrity, compliance, and performance across the platform What You'll Bring: Expertise in Microsoft Fabric, Azure, PySpark, SparkSQL, and modern data engineering More ❯

A popular British brand is seeking a an experienced Data Engineer to play a pivotal role in a major data modernization initiative. With offices just outside of Bristol, this role will require being on-site 3 days per week to collaborate with your team and business stakeholders. As part of a transformative project leveraging Microsoft Fabric, you … ll lead the design and implementation of a scalable, metadata-driven Medallion architecture. You'll work closely with cross-functional teams to deliver robust, trusted, and timely data solutions that power advanced analytics and business intelligence. What You'll Do: Architect and build scalable data pipelines using Microsoft Fabric, PySpark, and T-SQL Lead the development of Star … Schema Lakehouse tables to support BI and self-service analytics Collaborate with stakeholders to translate business needs into data models and solutions Mentor engineers and act as a technical leader within the team Ensure data integrity, compliance, and performance across the platform What You'll Bring: Expertise in Microsoft Fabric, Azure, PySpark, SparkSQL, and modern data engineering More ❯

helping clients to answer crucial questions, such as how to target audiences, maximise attention across platforms, enhance audience experience, and demonstrate or increase audience value. We are recruiting a Data Engineer for one of our flagship accounts, Out Of Home – Route. Your work will be essential for the Route project's success. Building robust and scalable infrastructure and … being the linchpin between the data platform and data science teams in an ‘advisory-like’ role will enable data scientists to focus on research and innovation in synthetic data, enhancing data-driven solutions for clients and Ipsos. You will often support the productionisation and scaling of local ML models, guiding the data science teams … and providing the guardrails as they develop and iterate. What will I be doing? As a Data Engineer on the ground-breaking Route project, you'll develop and maintain the data infrastructure for a first-of-its-kind synthetic travel survey, generating audience figures for Out-of-Home media in Great Britain. Reporting to a Principal Data More ❯

Join to apply for the Azure Data Engineer role at IBM 2 days ago Be among the first 25 applicants Join to apply for the Azure Data Engineer role at IBM Introduction In this role, you’ll work in one of our IBM Consulting Client Innovation Centres (Delivery Centres), where we deliver deep technical and industry … Assistance Program, a group personal pension plan of an additional 5% of your base salary paid by us monthly to save for your future. Your Role And Responsibilities A data engineer with expertise in Azure toolset advises on, develops, and maintains data engineering solutions on the Azure Cloud ecosystem. They design, build, and operate batch and real … time data pipelines using Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub. This role also involves designing, building, and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB. The data engineer is proficient in Azure Data Platform components, including ADLS2, Blob Storage, SQLDW More ❯

Social network you want to login/join with: A dynamic and prestigious professional services company based in the heart of the City of London is seeking a talented Data Engineer to join their team in this newly created role. This multifaceted position offers an exceptional opportunity for an experienced professional to work broadly across the business, planning … developing and implementing data solutions. The successful candidate must possess strong analytical skills, in-depth understanding of data engineering principles and the ability to translate business requirements into high quality data solutions The main focus of the role will include: Designs and develops data pipelines for the preparation, transformation and loading of data into the … appropriate data storage systems, following standard medallion architecture principles. Oversee ETL (Extract, Transform, Load) operations to ensure data from various sources is accurately transformed and loaded Implement data quality check, validation rules, and profiling techniques to maintain high data integrity. Work on data cleansing and normalisation to ensure data usability for business reporting and More ❯

Social network you want to login/join with: A dynamic and prestigious professional services company based in the heart of the City of London is seeking a talented Data Engineer to join their team in this newly created role. This multifaceted position offers an exceptional opportunity for an experienced professional to work broadly across the business, planning … developing and implementing data solutions. The successful candidate must possess strong analytical skills, in-depth understanding of data engineering principles and the ability to translate business requirements into high quality data solutions The main focus of the role will include: Designs and develops data pipelines for the preparation, transformation and loading of data into the … appropriate data storage systems, following standard medallion architecture principles. Oversee ETL (Extract, Transform, Load) operations to ensure data from various sources is accurately transformed and loaded Implement data quality check, validation rules, and profiling techniques to maintain high data integrity. Work on data cleansing and normalisation to ensure data usability for business reporting and More ❯

Social network you want to login/join with: A dynamic and prestigious professional services company based in the heart of the City of London is seeking a talented Data Engineer to join their team in this newly created role. This multifaceted position offers an exceptional opportunity for an experienced professional to work broadly across the business, planning … developing and implementing data solutions. The successful candidate must possess strong analytical skills, in-depth understanding of data engineering principles and the ability to translate business requirements into high quality data solutions The main focus of the role will include: Designs and develops data pipelines for the preparation, transformation and loading of data into the … appropriate data storage systems, following standard medallion architecture principles. Oversee ETL (Extract, Transform, Load) operations to ensure data from various sources is accurately transformed and loaded Implement data quality check, validation rules, and profiling techniques to maintain high data integrity. Work on data cleansing and normalisation to ensure data usability for business reporting and More ❯

Social network you want to login/join with: A dynamic and prestigious professional services company based in the heart of the City of London is seeking a talented Data Engineer to join their team in this newly created role. This multifaceted position offers an exceptional opportunity for an experienced professional to work broadly across the business, planning … developing and implementing data solutions. The successful candidate must possess strong analytical skills, in-depth understanding of data engineering principles and the ability to translate business requirements into high quality data solutions The main focus of the role will include: Designs and develops data pipelines for the preparation, transformation and loading of data into the … appropriate data storage systems, following standard medallion architecture principles. Oversee ETL (Extract, Transform, Load) operations to ensure data from various sources is accurately transformed and loaded Implement data quality check, validation rules, and profiling techniques to maintain high data integrity. Work on data cleansing and normalisation to ensure data usability for business reporting and More ❯

Social network you want to login/join with: A dynamic and prestigious professional services company based in the heart of the City of London is seeking a talented Data Engineer to join their team in this newly created role. This multifaceted position offers an exceptional opportunity for an experienced professional to work broadly across the business, planning … developing and implementing data solutions. The successful candidate must possess strong analytical skills, in-depth understanding of data engineering principles and the ability to translate business requirements into high quality data solutions The main focus of the role will include: Designs and develops data pipelines for the preparation, transformation and loading of data into the … appropriate data storage systems, following standard medallion architecture principles. Oversee ETL (Extract, Transform, Load) operations to ensure data from various sources is accurately transformed and loaded Implement data quality check, validation rules, and profiling techniques to maintain high data integrity. Work on data cleansing and normalisation to ensure data usability for business reporting and More ❯

ideal candidate will have a minimum of 5+ years of experience with strong expertise in Snowflake, DBT, Python, and AWS to deliver ETL/ELT pipelines. Proficiency in Snowflake data warehouse architecture and the ability to design, build, and optimize ETL/ELT pipelines using DBT (Data Build Tool) and Snowflake. Experience with DBT for data transformation … and modeling, implementing data transformation workflows using DBT (core/cloud). Strong Python programming skills for automation and data processing, leveraging Python to create automation scripts and optimize data processing tasks. Proficiency in SQL performance tuning and query optimization techniques using Snowflake. Troubleshooting and optimizing DBT models and Snowflake performance. Knowledge of CI/CD and … version control (Git) tools. Experience with orchestration tools such as Airflow. Strong analytical and problem-solving skills, with the ability to work independently in an agile development environment. Ensure data quality, reliability, and consistency across different environments. Collaborate with other data engineers, data analysts, and business stakeholders to understand data needs and translate them into engineering More ❯

week ago Be among the first 25 applicants hackajob is collaborating with Kainos to connect them with exceptional tech professionals for this role. As a Lead Data Engineer (Consultant) at Kainos you will be responsible for designing and developing data processing and data persistence software components for solutions which handle data at scale. Working in … agile teams, Lead Data Engineers provide strong development leadership for team members and take responsibility for the quality of the codebase as well as the match to user needs. Your Responsibilities Will Include Taking responsibility for the development of whole components or subsystems within a team. Development incorporates design, code, test and defect resolution. Focusing on hands-on design … commercial platforms. Defining and enforcing development best practice and coaching team members to ensure consistency. Working with project architects, taking responsibility for non-functional needs of ETL/ELT data processing pipelines such as robustness and performance. Taking responsibility for standards and execution of unit and integration testing done within the team. Taking responsibility for software product due diligence More ❯