Data Engineer Job Vacancies

1,101 to 1,125 of 2,965 Data Engineer Jobs

Senior Data Engineer

Bristol, England, United Kingdom
Hybrid / WFH Options
ZipRecruiter
Job Description Senior Data Engineer | Bristol (Hybrid) | £50,000-£65,000 Peaple Talent have partnered exclusively with an award winning Data Analytics & Business Intelligence agency. They provide custom data services that empower industry leading clients across Media & Sports entertainment. Due to exciting growth plans in the Data team we are now looking for a Senior … Data Engineer to inspire and support the team's development in best of class service delivery. We are looking for: A well-rounded skillset with exposure to Data Analytics, Visualisation & Reporting An excellent communicator and positive, supportive, solution-oriented team player A number of years of commercial experience as a Data Engineer or relevant role … Advanced experience using Python Data warehouse knowledge such as Databricks and Snowflake Nice to haves: Cloud experience in AWS/Azure/GCP Experience using Google Analytics, Adobe Analytics etc. What's in it for you: Location: Bristol, flexible hours, remote working Salary: £50,000-£65,000 Collaborative culture and great team support Vast L&D opportunities both internally More ❯
Posted:

Jr Data Engineer London Hybrid

London, England, United Kingdom
Hybrid / WFH Options
TieTalent
Join to apply for the Jr Data Engineer_London_Hybrid role at TieTalent 1 week ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. About the Role As a Data Engineer, you will play a crucial role in designing, developing, and maintaining data architecture and infrastructure. … Python, Pyspark, SQL, and ETL processes, with the ability to implement solutions in a cloud environment. Position Details Location: London Job Type: Hybrid, Permanent Mandatory Skills Design, build, maintain data pipelines using Python, Pyspark, and SQL Develop and maintain ETL processes to move data from various sources to our data warehouse on AWS/Azure/GCP … Collaborate with data scientists and business analysts to understand their data needs and develop solutions Develop and maintain data models and data dictionaries for our data warehouse Maintain documentation for data pipelines and data warehouse Improve performance and scalability of data solutions Qualifications Minimum 4+ years of total experience At least 2+ More ❯
Posted:

Senior Data Engineer

England, United Kingdom
Hybrid / WFH Options
JSS Transform
We’re working with a leading insurance organisation undergoing a large-scale data transformation, and they’re now seeking a Senior Data Engineer to play a key role in building and improving their data architecture and governance capabilities as part of a major programme of work. Key Responsibilities: Design and implement robust data pipelines and … integration frameworks. Support the implementation and enhancement of Master Data Management (MDM) solutions. Work with business and technical stakeholders to ensure data quality, consistency, and governance across systems. Collaborate closely with data architects, analysts, and engineering teams to support strategic data initiatives. Key Skills & Experience: Strong experience as a Data Engineer in enterprise environments. … Proven expertise with MDM tools (e.g. Informatica MDM, Reltio, Semarchy, IBM InfoSphere, etc.). Solid background in data integration, ETL, and data warehousing concepts. Proficiency in SQL and modern data engineering tools/platforms. Experience working in the insurance or financial services sector is highly desirable. Excellent communication skills and stakeholder management. Why apply? Outside IR35 engagement More ❯
Posted:

Senior Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Hunter Bond
My leading Financial services client are looking for a talented and motivated Senior Data Engineer to help define and enforce their strategic data strategy across the organisation. In order to do this you will be working closely with multiple development teams to understand their pain points and propose robust solutions. You will be conducting multiple proof of … concepts using different technical solutions to help the business choose the products they need for different parts of their data landscape. This is a high profile role where you can really make your mark in the company. A brilliant opportunity! The following skills/experience is required: Strong Data Engineer background Experience in Front office banking or … commodity trading environments essential Data warehousing, ETL processes, and database design Must have strong Python and Java Cloud experience (AWS, Azure) Previously worked in Financial Services Excellent communication skills Rate: Up to £700/day Duration: 6 months + (multiple extensions) Location: London (good work from home options available) If you are interested in this Senior Data Engineer More ❯
Posted:

Senior Data Engineer

City of London, London, United Kingdom
Hybrid / WFH Options
Hunter Bond
My leading Financial services client are looking for a talented and motivated Senior Data Engineer to help define and enforce their strategic data strategy across the organisation. In order to do this you will be working closely with multiple development teams to understand their pain points and propose robust solutions. You will be conducting multiple proof of … concepts using different technical solutions to help the business choose the products they need for different parts of their data landscape. This is a high profile role where you can really make your mark in the company. A brilliant opportunity! The following skills/experience is required: Strong Data Engineer background Experience in Front office banking or … commodity trading environments essential Data warehousing, ETL processes, and database design Must have strong Python and Java Cloud experience (AWS, Azure) Previously worked in Financial Services Excellent communication skills Rate: Up to £700/day Duration: 6 months + (multiple extensions) Location: London (good work from home options available) If you are interested in this Senior Data Engineer More ❯
Posted:

Data Engineer

Edinburgh, Scotland, United Kingdom
Hybrid / WFH Options
In Technology Group
Job Title: Data Engineer Location: Edinburgh, UK About Us: Join one of the leading utilities companies in Edinburgh, driving innovation through data! We are looking for a skilled Data Engineer to support our data infrastructure and empower our teams with reliable and efficient data solutions. If you’re passionate about building robust data pipelines and transforming raw data into valuable insights, we want you on our team! Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes. Collaborate with data analysts and stakeholders to understand data requirements. Ensure data integrity, security, and compliance with industry standards. Optimize data architectures for performance and scalability. Monitor … and maintain data systems to ensure high availability. Key Requirements: Proven experience as a Data Engineer or similar role. Proficiency in SQL, Python, or other data processing languages. Experience with cloud platforms (e.g., Azure, AWS, or Google Cloud). Knowledge of data warehousing concepts and big data technologies. Strong problem-solving skills and attention More ❯
Posted:

Azure Data Engineer

Manchester, North West, United Kingdom
Adria Solutions
Azure Data Engineer Manchester Up to £65k On behalf of our industry-leading client, we are recruiting for a talented Azure Data Engineer. As Azure Data Engineer, you will be working closely with Data Engineering, Business Services, and Technical Partners to create and integrate Azure Data Engineering pipelines transforming core systems data into knowledge. The Azure Data Engineer will be responsible for: Working with other members of the Data Engineering team, you will actively participate in the design and development of processes and technologies that support secure and efficient data ETL, connecting to a variety of on- and off-premises data sources Ensure data is … cleansed, mapped, transformed, and otherwise optimized for storage, and to meet requirements for business and technical use cases Apply business and logic rules to derive insight from company data, and deliver these in real-time to the quote rating engine Generate and schedule data enrichment processes Develop effective, scalable solutions that can be efficiently tested, deployed, updated, maintained More ❯
Employment Type: Permanent
Salary: £65,000
Posted:

Data Engineer

Manchester Area, United Kingdom
Gravitas Recruitment Group (Global) Ltd
Data Engineer – Insurance Sector (Manchester) We’re working with a forward-thinking insurance company looking to hire a skilled Data Engineer to support its growing data infrastructure. The role is based in Manchester , within a Public Sector team managing over £250 million in portfolio assets. The Role: You'll design and maintain modern data pipelines, support analytical workflows, and collaborate closely with underwriters and analysts. The focus is on building robust, scalable solutions while promoting a data-driven culture. You’ll also help coach analysts to use models and tools effectively. Key Requirements: ~4 years in a data engineering, analytics, or development role (insurance industry preferred) Strong SQL and ETL experience … e.g., DBT, Dataform) Familiar with cloud data platforms (BigQuery, AWS, or Azure) Programming skills (Python or R) Strong communicator and team collaborator Open to exceptional recent graduates who meet most of the criteria. Culture & Benefits: The company promotes innovation, collaboration, and performance. Expect a dynamic environment with regular social events, low bureaucracy, and fast decision-making. More ❯
Posted:

Azure Data Engineer

Salford, England, United Kingdom
Adria Solutions Ltd
Azure Data Engineer – Manchester– Up to £65k On behalf of our industry-leading client, we are recruiting for a talented Azure Data Engineer. As Azure Data Engineer, you will be working closely with Data Engineering, Business Services, and Technical Partners to create and integrate Azure Data Engineering pipelines transforming core systems data into knowledge. The Azure Data Engineer will be responsible for: Working with other members of the Data Engineering team, you will actively participate in the design and development of processes and technologies that support secure and efficient data ETL, connecting to a variety of on- and off-premises data sources Ensure data is … cleansed, mapped, transformed, and otherwise optimized for storage, and to meet requirements for business and technical use cases Apply business and logic rules to derive insight from company data, and deliver these in real-time to the quote rating engine Generate and schedule data enrichment processes Develop effective, scalable solutions that can be efficiently tested, deployed, updated, maintained More ❯
Posted:

Data Engineer (Airflow)

Manchester, England, United Kingdom
Harnham
Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Harnham Building Data Engineering Teams Across the North of England and Midlands DATA ENGINEER PRIMARILY REMOTE UK An established company in the Media/Advertising space is seeking a proactive … Data Engineer to join their innovative team as they grow and invest. THE COMPANY: This company is currently investing in their data team and is looking for a Data Engineer to help gather requirements and build solutions. This is an exciting opportunity to help build out the data platforms and create frameworks to enable … data-driven decision making across the business. THE ROLE: A Data Engineer will need to: Work closely with stakeholders across the business Manage data warehouse (gathering requirements and building solutions) Ensure alignment with data management and quality YOUR SKILLS AND EXPERIENCE: A successful Data Engineer will have the following skills and experience: Ability More ❯
Posted:

Data Engineer

Leeds, England, United Kingdom
KDR Talent Solutions
Data Engineer | Location: Leeds (4 days per week in office with some flexibility) | Salary: £60,000-£80,000 The Opportunity Our client is seeking a skilled and motivated Data Engineer to play a key role in the creation of a brand-new data platform within the Azure ecosystem including Azure Data Factory (ADF), Synapse … and PySpark/Databricks and Snowflake. You will be a data ingestion and ETL Pipeline guru, tackling complex problems at source in order to retrieve the data and ensure to can flow upstream to the Snowflake DWH. You will not be an analytics engineer or someone who operates at the latter stages of the development lifecycle unless … you have skills and desire to work on data ingestion, ETL/ELT. Key Responsibilities Build & Develop robust ETL/Data Ingestion pipelines leveraging Azure Data Factory, Synapse, PySpark and Python. Connect APIs, databases, and data streams to the platform, implementing ETL/ELT processes. Data Integrity – Embed quality measures, monitoring, and alerting mechanisms. CI More ❯
Posted:

Senior Data Engineer

London, England, United Kingdom
Hybrid / WFH Options
INTEC SELECT LIMITED
Senior Data Engineer – Up to £90,000 + Bonus – London (Hybrid) – Gaming Overview: A market leading Digital Marketing agency specializing within the online gaming sector are searching for a Senior Data Engineer to join one of their growing teams in London on a hybrid basis. Role & Responsibilities: Design, implement, and maintain robust ETL pipelines to integrate … data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data to meet evolving business requirements. Perform customer behavior analysis, gaming analytics, and create actionable insights … to enhance customer experiences and revenue streams. Collaborate with stakeholders to deliver visually compelling reports and dashboards using tools like Tableau. Oversee the administration, monitoring, and maintenance of data infrastructure and services. Ensure compliance with data security and governance best practices Technical Requirements: 5+ years of experience in data engineering roles, with a proven ability to lead More ❯
Posted:

Data Engineer

Inverurie, Scotland, United Kingdom
JR United Kingdom
and gas firms in Aberdeen. We are committed to leveraging cutting-edge technology to drive efficiency and sustainability in the energy sector. Job Description: We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a strong background in data management, analytics, and engineering, with a passion for solving complex problems and … optimising data processes. Key Responsibilities: Design, develop, and maintain data pipelines and architectures. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Implement data integration and transformation processes. Ensure data quality and integrity across various platforms. Optimize data storage and retrieval systems for performance and scalability. Develop and maintain documentation for … data processes and systems. Qualifications: Bachelor's degree in Computer Science, Engineering, or related field. Proven experience as a Data Engineer or in a similar role. Proficiency in SQL, Python, and data warehousing solutions. Experience with cloud platforms such as AWS, Azure, or Google Cloud. Strong problem-solving skills and attention to detail. Excellent communication and More ❯
Posted:

Data Engineer

City of London, London, United Kingdom
Hybrid / WFH Options
Searchability®
Data Engineer Opportunity for a Data Engineer to join an organisation operating in the Consumer Goods space who’re on an exciting growth journey Salary up to £50,000 + some fantastic benefits including remote working, bonus opportunity, wellness days, employee assistance programmes and much more Apply online or contact Chelsea Hackett via Chelsea.hackett@searchability.com WHO … WE ARE: We collaborate with companies in the consumer goods sector to strengthen their data capabilities, unlock growth opportunities, and generate actionable insights. Our specialised technology platform is built to serve the unique needs of Consumer Goods teams, offering both flexibility and scalability. By working closely with our clients, we support them in reaching their objectives across Retail, Foodservice … Company social events Mental wellbeing and support Pension Contribution Life Insurance Flexible/remote working And more... WHAT WILL YOU BE DOING? We are looking for a self-driven Data Engineer with strong expertise in data modeling, ETL processes, and cloud-based data solutions, with a particular focus on advanced SQL for data transformation and More ❯
Posted:

Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Searchability®
Data Engineer Opportunity for a Data Engineer to join an organisation operating in the Consumer Goods space who’re on an exciting growth journey Salary up to £50,000 + some fantastic benefits including remote working, bonus opportunity, wellness days, employee assistance programmes and much more Apply online or contact Chelsea Hackett via Chelsea.hackett@searchability.com WHO … WE ARE: We collaborate with companies in the consumer goods sector to strengthen their data capabilities, unlock growth opportunities, and generate actionable insights. Our specialised technology platform is built to serve the unique needs of Consumer Goods teams, offering both flexibility and scalability. By working closely with our clients, we support them in reaching their objectives across Retail, Foodservice … Company social events Mental wellbeing and support Pension Contribution Life Insurance Flexible/remote working And more... WHAT WILL YOU BE DOING? We are looking for a self-driven Data Engineer with strong expertise in data modeling, ETL processes, and cloud-based data solutions, with a particular focus on advanced SQL for data transformation and More ❯
Posted:

Senior Data Engineer

Newcastle Upon Tyne, England, United Kingdom
Hybrid / WFH Options
Jackson Hogg
The Senior Data Engineer plays a key role in driving the development and ongoing enhancement of the modern data platform. This platform is designed to provide reliable, actionable insights by integrating data from various systems into a single resource that informs business strategy and decision-making. This position focuses primarily on backend data engineering tasks … including data ingestion, transformation, curation, and analysis, while also shaping the overall data architecture. Working with technologies such as Snowflake, Python, and Matillion, the Senior Data Engineer collaborates closely with internal teams and external partners to deliver high-quality, well-structured, and thoroughly documented datasets. These outputs enable product innovation and support data-driven decisions … throughout the organisation. This role offers remote working however you must be commutable to the Newcastle office on an ad-hoc basis. Key responsibilities: Data Pipeline Development Data Modelling & Architecture Data Quality, Testing & Performance Data Enablement & Platform Strategy Data Standards Stakeholder Engagement & Training Ideally you’ll have: Experience of building out modern data stacks More ❯
Posted:

Data Engineer

Paris, France
Solvex Solutions
Job Title: GCP Data Engineer Location: Paris, France. Employment Type: Contract Duration: 6 Months + Extension. Job Overview: We are currently supporting one of our esteemed enterprise clients in hiring a GCP Data Engineer with strong experience across the Google Cloud Platform (GCP) ecosystem and deep technical expertise in data engineering with hands-on experience … in GCP BigQuery, Data Fusion, Composer (Airflow) , and Python scripting Key Responsibilities: Design, build, and maintain ETL/ELT data pipelines using GCP Data Fusion , integrating across multiple databases and plugins. Develop and orchestrate workflows with Composer (Apache Airflow) by creating and managing DAGs. Write efficient, production-grade Python scripts for automation and data processing. Use … Google Cloud SDK and APIs to automate environment setups and manage infrastructure. Implement Cloud Functions for event-driven processing. Apply data security standards using Cloud DLP, Cloud KMS, and AEAD encryption. Write and optimise queries in BigQuery . Automate infrastructure and deployment using Cloud Build or similar CI/CD tools. Perform data testing, validation , and contribute to More ❯
Employment Type: Permanent
Salary: EUR Annual
Posted:

Data Engineer

City of London, Greater London, UK
Hybrid / WFH Options
Pioneer Search
Data Engineer Azure | Databricks | PySpark | Hybrid Cloud | Fabric Location: London (Hybrid) Salary: £85,000 + Bonus + Benefits Type: Permanent A Data Engineer is required for a fast-evolving (re)insurance business at the heart of the Lloyd's market, currently undergoing a major data transformation. With a strong foundation in the industry and a … clear vision for the future, they're investing heavily in their data capabilities to build a best-in-class platform that supports smarter, faster decision-making across the business. As part of this journey, they're looking for a Data Engineer to join their growing team. This is a hands-on role focused on building scalable data … currently hybrid cloud and on-prem, with a strategic move towards Microsoft Fabric-so experience across both is highly valued. What you'll be doing: Building and maintaining robust data pipelines using Databricks, PySpark, and Azure Data Factory. Enhance and maintain a Lakehouse architecture using Medallion principles Working across both cloud and on-prem environments, supporting the transition More ❯
Posted:

SQL Developer / Data Engineer

Whiteley, England, United Kingdom
Endeavour Recruitment Solutions
Technologies: SQL Data Warehouse, Azure stored procedures SQL Developer/Data Engineer Our financial client based on the outskirts of Southampton and Portsmouth on the south coast has an opportunity for a SQL Developer/Data Engineer to join the team. You will sit within the Data Team and work with technical and non … technical people across the whole company. What will you be doing? Development and maintenance of data warehouse (Azure Data Factory, SQL Server) Writing SQL views and stored procedures Assisting with Power BI development and maintenance Database modelling, development and optimisation Azure DevOps Requirements gathering from senior stakeholders We are looking for someone who: Has a can-do attitude … able to use initiative to bring about positive change and take initiative in spotting opportunities and finding ways to solve challenges with data Has experience in using PowerBI Has a strong command of SQL Thrives on problem solving and able to suggest solutions Can communicate effectively and be comfortable communicating ideas to people at all levels across the firm More ❯
Posted:

Pyspark Data Engineer

United Kingdom
IO Associates
PySpark Data Engineer | up to £450/day Inside | Remote with occasional London travel We are seeking a PySpark Data Engineer to support the development of a modern, scalable data lake for a new strategic programme. This is a greenfield initiative to replace fragmented legacy reporting solutions, offering the opportunity to shape a long-term … high-impact platform from the ground up. Key Responsibilities: * Design, build, and maintain scalable data pipelines using PySpark 3/4 and Python 3. * Contribute to the creation of a unified data lake following medallion architecture principles. * Leverage Databricks and Delta Lake (Parquet format) for efficient, reliable data processing. * Apply BDD testing practices using Python Behave and … Agile delivery workflows. * Manage configurations and workflows using YAML, Git, and Azure DevOps. Required Skills & Experience: * Proven expertise in PySpark 3/4 and Python 3 for large-scale data engineering. * Hands-on experience with Databricks, Delta Lake, and medallion architecture. * Familiarity with Python Behave for Behaviour Driven Development. * Strong understanding of YAML, code quality tools (e.g. Python Coverage More ❯
Employment Type: Contract
Posted:

Senior Snowflake / AWS Data Engineer

City of London, London, United Kingdom
Hybrid / WFH Options
I3 Resourcing Limited
Senior Data Engineer MUST HAVE SNOWFLAKE, AWS, SNOWPRO CORE Salary - £70-80k with 15% bonus Hybrid working - couple of days in the office City of London We are looking for: Good understanding of data engineering principles A good technical grasp of Snowflake and automating it, and transforming complex datasets SnowPro core certification. AWS Skillset Delivery experience … Building solutions in snowflake Insurance experience - advantageous but not necessary MUST HAVE SNOWFLAKE, AWS, SNOWPRO CORE Key Responsibilities: Lead the design and implementation of Snowflake [and Redshift] based data warehousing solutions within an AWS environment Mentoring of team members through code reviews and pair programming Build and support new AWS native cloud data warehouse solutions Develop and optimize … ETL processes using AWS services (e.g. AWS Glue, Lambda) to ensure efficient data ingestion, transformation, storage, and cost optimization. Deliver data to presentation layers to power reporting and analytics Collaborate with stakeholders, product owners, and developers Create and maintain data models that serve as a foundation for reporting and analytics Monitor performance metrics and troubleshoot issues within More ❯
Employment Type: Permanent, Work From Home
Salary: £80,000
Posted:

Pyspark Data Engineer

England, United Kingdom
iO Associates - UK/EU
PySpark Data Engineer | up to £450/day Inside | Remote with occasional London travel We are seeking a PySpark Data Engineer to support the development of a modern, scalable data lake for a new strategic programme. This is a greenfield initiative to replace fragmented legacy reporting solutions, offering the opportunity to shape a long-term … high-impact platform from the ground up. Key Responsibilities: * Design, build, and maintain scalable data pipelines using PySpark 3/4 and Python 3. * Contribute to the creation of a unified data lake following medallion architecture principles. * Leverage Databricks and Delta Lake (Parquet format) for efficient, reliable data processing. * Apply BDD testing practices using Python Behave and … Agile delivery workflows. * Manage configurations and workflows using YAML, Git, and Azure DevOps. Required Skills & Experience: * Proven expertise in PySpark 3/4 and Python 3 for large-scale data engineering. * Hands-on experience with Databricks, Delta Lake, and medallion architecture. * Familiarity with Python Behave for Behaviour Driven Development. * Strong understanding of YAML, code quality tools (e.g. Python Coverage More ❯
Posted:

Data Engineer - £75,000 per annum - Azure - Snowflake - Finance

London, England, United Kingdom
VirtueTech Recruitment Group
Data Engineer - £75,000 per annum - Azure - Snowflake - Finance Data Engineer - £75,000 per annum - Azure - Snowflake - Finance Direct message the job poster from VirtueTech Recruitment Group Head of Permanent - Data, Product and Infrastructure at VirtueTech Recruitment Group Data Engineer - £75,000 per annum - Azure - Snowflake - Finance My client are seeking a Data Engineer to join their tech function, this role will report to the Lead Data Engineer, and has a focus on building and maintaining a robust data infrastructure to support the business's strategic goals. This role involves developing and managing data ingestion and transformation pipelines using modern tools such as Fivetran, DBT, and GitLab … end-users to ensure systems are continuously enhanced to meet evolving needs. In this role you’ll play a crucial part in the migration of legacy systems to modern data platforms, supporting the creation of insightful management information dashboards and scalable data solutions. The role requires hands-on experience in developing and maintaining high-quality code aligned with More ❯
Posted:

Data Engineer / SQL Developer

Fareham, England, United Kingdom
Endeavour Recruitment Solutions
SQL Developer/Data Engineer Our financial client based on the outskirts of Southampton and Portsmouth on the south coast has an opportunity for a SQL Developer/Data Engineer to join the team. You will sit within the Data Team and work with technical and non-technical people across the whole company. What will … you be doing? Development and maintenance of data warehouse (Azure Data Factory, SQL Server) Writing SQL views and stored procedures Assisting with Power BI development and maintenance Database modelling, development and optimisation Azure DevOps Requirements gathering from senior stakeholders We are looking for someone who: Has a can-do attitude – able to use initiative to bring about positive … change and take initiative in spotting opportunities and finding ways to solve challenges with data Has experience in using PowerBI Has a strong command of SQL Thrives on problem solving and able to suggest solutions Can communicate effectively and be comfortable communicating ideas to people at all levels across the firm Can distil a complex problem into a workable More ❯
Posted:

Pyspark Data Engineer

London, England, United Kingdom
iO Associates
PySpark Data Engineer | up to £450/day Inside | Remote with occasional London travel We are seeking a PySpark Data Engineer to support the development of a modern, scalable data lake for a new strategic programme. This is a greenfield initiative to replace fragmented legacy reporting solutions, offering the opportunity to shape a long-term … high-impact platform from the ground up. Key Responsibilities: * Design, build, and maintain scalable data pipelines using PySpark 3/4 and Python 3. * Contribute to the creation of a unified data lake following medallion architecture principles. * Leverage Databricks and Delta Lake (Parquet format) for efficient, reliable data processing. * Apply BDD testing practices using Python Behave and … Agile delivery workflows. * Manage configurations and workflows using YAML, Git, and Azure DevOps. Required Skills & Experience: * Proven expertise in PySpark 3/4 and Python 3 for large-scale data engineering. * Hands-on experience with Databricks, Delta Lake, and medallion architecture. * Familiarity with Python Behave for Behaviour Driven Development. * Strong understanding of YAML, code quality tools (e.g. Python Coverage More ❯
Posted:
Data Engineer
10th Percentile
£46,250
25th Percentile
£55,000
Median
£72,500
75th Percentile
£95,000
90th Percentile
£115,000