Data Engineer Jobs in the East of England

1 to 25 of 93 Data Engineer Jobs in the East of England

Senior Data Platform Engineer

Luton, England, United Kingdom
easyJet
employ over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast paced … organisation. You will join as a Senior Platform Data Engineer providing technical leadership to the Data Engineering team. You will work closely with our Data Scientists and business stakeholders to ensure value is delivered through our solutions. Job Accountabilities Develop robust, scalable data pipelines to serve the easyJet analyst and data science community. Highly … competent hands-on experience with relevant Data Engineering technologies, such as Databricks, Spark, Spark API, Python, SQL Server, Scala. Work with data scientists, machine learning engineers and DevOps engineers to develop, develop and deploy machine learning models and algorithms aimed at addressing specific business challenges and opportunities. Coach and mentor the team (including contractors) to improve development standards. More ❯
Posted:

Senior Data Engineer

Hertfordshire, United Kingdom
Hybrid / WFH Options
Tenth Revolution Group
Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization … of diverse business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating data pipelines with Azure Data Factory (ADF) Proficiency managing … API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments Azure Synapse experience Power BI knowledge Benefits: Salary: £70,000 - £80,000 depending on experience Hybrid working More ❯
Employment Type: Permanent
Salary: £70000 - £80000/annum
Posted:

Senior Data Engineer

Bedford, England, United Kingdom
ZipRecruiter
Job Description Description: We are actively seeking a Data Engineer responsible for designing, building, and maintaining infrastructure that supports data storage, processing, and retrieval. The role involves working with large data sets and developing data pipelines to transfer data from source systems to data warehouses, data lakes, and other storage and processing … systems. The Data Engineer will collaborate with stakeholders to address data-related technical issues and support their data infrastructure needs during the development, maintenance, and sustainment of the KR data architecture and data-driven solutions. Note: Due to federal security clearance requirements, applicants must be U.S. citizens or Permanent Residents with the ability to … full-time employment after the contract. Benefits include Medical, Dental, Vision, 401k with company matching, and life insurance. Rate: $80 - $86/hr W2 Responsibilities: Develop, optimize, and maintain data ingestion flows using Apache Kafka, Apache Nifi, and MySQL/PostgreSQL. Develop within AWS cloud services such as RedShift, SageMaker, API Gateway, QuickSight, and Athena. Coordinate with data More ❯
Posted:

Data Engineer

Stevenage, England, United Kingdom
Akkodis
Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group, Akkodis combines the expertise of AKKA and Modis, with over 50,000 engineers and digital specialists across 30 countries in North America, EMEA, and … APAC. Our teams bring extensive cross-sector knowledge in critical technology areas such as mobility, software services, robotics, simulations, cybersecurity, AI, and data analytics, enabling clients to tackle complex challenges in today’s rapidly evolving markets. Scope: Akkodis is launching a new technical delivery team to drive a UK national program in collaboration with key partners, designed to transform … candidate-centric experience tailored to meet tomorrow’s public sector skill demands. This high-impact initiative offers a unique opportunity to join a team dedicated to building a scalable, data-driven recruitment ecosystem. Through redesigning, building, and rolling out a sophisticated Big Data system, our diverse roles span across architecture, project management, data analytics, development, and technical More ❯
Posted:

Data Engineer

Ipswich, Suffolk, England, United Kingdom
Agilis Search
An established organisation with a strong data-driven culture is seeking an experienced Data Engineer or Data specialist to play a key role in shaping the future of its business intelligence and analytics capabilities. As a skilled and versatile senior Data professional you will bridge the gap between data engineering and business intelligence. This … role is ideal for someone who is equally comfortable designing complex data infrastructure and building intuitive, insight-driven dashboards. You’ll play a key role in the full lifecycle of data - from ingestion and modelling through to reporting and decision support - helping shape the way our organisation uses data to drive performance and strategy. What You’ll … Do: Back-End Architecture & Modelling Design and implement scalable, high-performance data warehouse and data lake architectures. Develop conceptual, logical, and physical data models to support analytical requirements. Build and optimise data pipelines (ETL/ELT) using tools such as Azure Synapse, Snowflake, Redshift, or similar. Ensure robust data governance, security, and quality management practices. More ❯
Employment Type: Full-Time
Salary: £60,000 - £70,000 per annum
Posted:

Data Engineer - Azure & Databricks

Hertfordshire, United Kingdom
Hybrid / WFH Options
Tenth Revolution Group
Are you an experienced Data Engineer looking to make a real impact in a high-growth, data-driven environment? We're exclusively partnered with a major UK construction and infrastructure company to find a technically strong and collaborative Data Engineer to join their team. Why This Role? This is a chance to shape the future … of data engineering within a business that's investing heavily in its data strategy. With a newly appointed Head of Data and a strong architectural lead in place, you'll be working side-by-side with other data professionals and senior stakeholders to build scalable, modern data solutions that drive real business value. In line … week either in their Central London office or in their Hertfordshire office to collaborate with your team and business stakeholders. What You'll Be Doing: Designing and orchestrating robust data pipelines using Azure Data Factory and Databricks. Ingesting and transforming data from diverse sources including CRM (D365), finance, procurement, and fleet systems. Collaborating with a cross-functional More ❯
Employment Type: Permanent
Salary: £60000 - £80000/annum
Posted:

Data Product Engineer

Luton, England, United Kingdom
easyJet
we employ over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks and a large amount of interesting data this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast paced … organisation. You will join as a Data Platform Engineer joining a team of committed data specialists. As our data strategy begins to take shape, we aim to become the most data driven airline in the world. To achieve this goal, we want to use our data to improve all our business processes and that … means allowing our teams to experiment and innovate as they deem fit. Within data platform engineering, this translates to building the frameworks and tooling data engineers, analysts and scientists utilise, enabling platform users to focus on value delivery Job Accountabilities Support the business in harnessing the power of data within easyJet. Work in a fast-paced agile More ❯
Posted:

Senior Azure Data Engineer

Colchester, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: High-calibre IT Managed Services Provider seeking an Azure Data Engineer to join their expanding applications team. In this role, you’ll support a crucial reporting project and play a key part in driving business transformation with the very latest Microsoft cloud technologies. The ideal candidate will have extensive … experience as a data engineer within large organisations working on enterprise-class platforms. This opportunity is ideal for someone who enjoys staying up to date with technology through active involvement in solution delivery and is keen to advance their career by enhancing their skills in digital transformation. Key Responsibilities: Deliver hands-on solutions to internal clients. Stay updated … with technology trends and actively participate in solution delivery. Required Technical Skills: Proficiency in Azure Data Platform (Data Lake, Synapse Analytics, SQL Database, Data Factory). Strong knowledge of Power BI and Microsoft reference architectures. Experience in Data Platform Design and Azure DevOps. Understanding of Azure data integration technologies and Modern Workplace. Experience with Fabric More ❯
Posted:

Senior Azure Data Engineer

Cambridge, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: High-calibre IT Managed Services Provider seeking an Azure Data Engineer to join their expanding applications team. In this role, you’ll support a crucial reporting project and play a key part in driving business transformation with the very latest Microsoft cloud technologies. The ideal candidate will have extensive … experience as a data engineer within large organisations working on enterprise-class platforms. This opportunity is ideal for someone who enjoys staying up to date with technology through active involvement in solution delivery and is keen to advance their career by enhancing their skills in digital transformation. Key Responsibilities: Deliver hands-on solutions to internal clients. Stay updated … with technology trends and actively participate in solution delivery. Required Technical Skills: Proficiency in Azure Data Platform (Data Lake, Synapse Analytics, SQL Database, Data Factory). Strong knowledge of Power BI and Microsoft reference architectures. Experience in Data Platform Design and Azure DevOps. Understanding of Azure data integration technologies and Modern Workplace. Experience with Fabric More ❯
Posted:

Senior Azure Data Engineer

Stevenage, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: High-calibre IT Managed Services Provider seeking an Azure Data Engineer to join their expanding applications team. In this role, you’ll support a crucial reporting project and play a key part in driving business transformation with the very latest Microsoft cloud technologies. The ideal candidate will have extensive … experience as a data engineer within large organisations working on enterprise-class platforms. This opportunity is ideal for someone who enjoys staying up to date with technology through active involvement in solution delivery and is keen to advance their career by enhancing their skills in digital transformation. Key Responsibilities: Deliver hands-on solutions to internal clients. Stay updated … with technology trends and actively participate in solution delivery. Required Technical Skills: Proficiency in Azure Data Platform (Data Lake, Synapse Analytics, SQL Database, Data Factory). Strong knowledge of Power BI and Microsoft reference architectures. Experience in Data Platform Design and Azure DevOps. Understanding of Azure data integration technologies and Modern Workplace. Experience with Fabric More ❯
Posted:

Senior Azure Data Engineer

Chelmsford, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: High-calibre IT Managed Services Provider seeking an Azure Data Engineer to join their expanding applications team. In this role, you’ll support a crucial reporting project and play a key part in driving business transformation with the very latest Microsoft cloud technologies. The ideal candidate will have extensive … experience as a data engineer within large organisations working on enterprise-class platforms. This opportunity is ideal for someone who enjoys staying up to date with technology through active involvement in solution delivery and is keen to advance their career by enhancing their skills in digital transformation. Key Responsibilities: Deliver hands-on solutions to internal clients. Stay updated … with technology trends and actively participate in solution delivery. Required Technical Skills: Proficiency in Azure Data Platform (Data Lake, Synapse Analytics, SQL Database, Data Factory). Strong knowledge of Power BI and Microsoft reference architectures. Experience in Data Platform Design and Azure DevOps. Understanding of Azure data integration technologies and Modern Workplace. Experience with Fabric More ❯
Posted:

Senior Azure Data Engineer

Bedford, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: High-calibre IT Managed Services Provider seeking an Azure Data Engineer to join their expanding applications team. In this role, you’ll support a crucial reporting project and play a key part in driving business transformation with the very latest Microsoft cloud technologies. The ideal candidate will have extensive … experience as a data engineer within large organisations working on enterprise-class platforms. This opportunity is ideal for someone who enjoys staying up to date with technology through active involvement in solution delivery and is keen to advance their career by enhancing their skills in digital transformation. Key Responsibilities: Deliver hands-on solutions to internal clients. Stay updated … with technology trends and actively participate in solution delivery. Required Technical Skills: Proficiency in Azure Data Platform (Data Lake, Synapse Analytics, SQL Database, Data Factory). Strong knowledge of Power BI and Microsoft reference architectures. Experience in Data Platform Design and Azure DevOps. Understanding of Azure data integration technologies and Modern Workplace. Experience with Fabric More ❯
Posted:

Senior Azure Data Engineer

Hemel Hempstead, England, United Kingdom
JR United Kingdom
col-narrow-right Job Views: 3 Posted: 26.06.2025 Expiry Date: 10.08.2025 col-wide Job Description: Remote Up to 75k DoE High-calibre IT Managed Services Provider seeking an Azure Data Engineer to join their expanding applications team. In this role, you’ll support a crucial reporting project and play a key part in driving business transformation with the … very latest Microsoft cloud technologies. The ideal candidate will have extensive experience as a data engineer within large organisations working on enterprise-class platforms. This opportunity is ideal for someone who enjoys staying up to date with technology through active involvement in solution delivery and is keen to advance their career by enhancing their skills in digital transformation. … Key Responsibilities: Deliver hands-on solutions to internal clients. Stay updated with technology trends and actively participate in solution delivery. Required Technical Skills: Proficiency in Azure Data Platform (Data Lake, Synapse Analytics, SQL Database, Data Factory). Strong knowledge of Power BI and Microsoft reference architectures. Experience in Data Platform Design and Azure DevOps. Understanding of More ❯
Posted:

Senior Azure Data Engineer

Norwich, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: High-calibre IT Managed Services Provider seeking an Azure Data Engineer to join their expanding applications team. In this role, you’ll support a crucial reporting project and play a key part in driving business transformation with the very latest Microsoft cloud technologies. The ideal candidate will have extensive … experience as a data engineer within large organisations working on enterprise-class platforms. This opportunity is ideal for someone who enjoys staying up to date with technology through active involvement in solution delivery and is keen to advance their career by enhancing their skills in digital transformation. Key Responsibilities: Deliver hands-on solutions to internal clients. Stay updated … with technology trends and actively participate in solution delivery. Required Technical Skills: Proficiency in Azure Data Platform (Data Lake, Synapse Analytics, SQL Database, Data Factory). Strong knowledge of Power BI and Microsoft reference architectures. Experience in Data Platform Design and Azure DevOps. Understanding of Azure data integration technologies and Modern Workplace. Experience with Fabric More ❯
Posted:

Senior Azure Data Engineer

Watford, England, United Kingdom
JR United Kingdom
EU work permit required: Yes Job Views: 4 Posted: 26.06.2025 Expiry Date: 10.08.2025 Job Description: Remote Up to 75k DoE High-calibre IT Managed Services Provider seeking an Azure Data Engineer to join their expanding applications team. In this role, you’ll support a crucial reporting project and play a key part in driving business transformation with the … very latest Microsoft cloud technologies. The ideal candidate will have extensive experience as a data engineer within large organisations working on enterprise-class platforms. This opportunity is ideal for someone who enjoys staying up to date with technology through active involvement in solution delivery and is keen to advance their career by enhancing their skills in digital transformation. … Key Responsibilities: Deliver hands-on solutions to internal clients. Stay updated with technology trends and actively participate in solution delivery. Required Technical Skills: Proficiency in Azure Data Platform (Data Lake, Synapse Analytics, SQL Database, Data Factory). Strong knowledge of Power BI and Microsoft reference architectures. Experience in Data Platform Design and Azure DevOps. Understanding of More ❯
Posted:

Data Engineer - Non-Profit / Health Charity - Cambridge

Cambridge, England, United Kingdom
Hybrid / WFH Options
Noir
Social network you want to login/join with: Data Engineer - Non-Profit/Health Charity - Cambridge, Cambridge col-narrow-left Location: Cambridge, United Kingdom Job Category: Information Technology EU work permit required: Yes col-narrow-right Job Reference: NC/RG/DE_1747616449 Job Views: 3 Posted: 19.05.2025 Expiry Date: 03.07.2025 col-wide Job Description: Data Engineer - Non-Profit/Health Charity - Cambridge (Tech Stack: Data Engineer, Python, Azure, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) A leading health charity based in Cambridge is seeking a talented and driven Lead Data Engineer to join their team. This is a fantastic opportunity to take on a strategic role within … basis, with a mix of home and office-based working. Key Responsibilities: * Apply comprehensive experience with IaaS services, including Microsoft Azure and AWS, to design and deliver robust, scalable data solutions. * Lead the development of databases and manage CI/CD pipelines to support efficient and reliable deployments. * Work with Azure Synapse and Azure Data Factory to develop More ❯
Posted:

Senior Data Engineer

Cambridge, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: We have partnered with a company that empowers underwriters to serve their insureds more effectively. They are using advanced data intelligence tools to rebuild the way that underwriters share and exchange risk. With a current focus on the small and medium-sized businesses that power our global economy and their … each policy to deliver unprecedented insight into insurance pools, and their speciality portfolio is fully diversified with very low catastrophe, aggregation or systemic risk. The Role: Designing and implementing data pipelines and models, ensuring data quality and integrity. Solving challenging data integration problems, utilising optimal patterns, frameworks, query techniques, sourcing from vast and varying data sources. … Building, maintaining, and optimising our Data Warehouse to support reporting and analytics needs. Collaborating with product managers, business stakeholders and engineers to understand the data needs, representing key data insights in a meaningful way. Staying up-to-date with industry trends and best practices in data modelling, database development, and analytics. Optimising pipelines, frameworks, and systems More ❯
Posted:

Senior Data Engineer

Basildon, England, United Kingdom
JR United Kingdom
Social network you want to login/join with: We have partnered with a company that empowers underwriters to serve their insureds more effectively. They are using advanced data intelligence tools to rebuild the way that underwriters share and exchange risk. With a current focus on the small and medium-sized businesses that power our global economy and their … each policy to deliver unprecedented insight into insurance pools, and their speciality portfolio is fully diversified with very low catastrophe, aggregation or systemic risk. The Role: Designing and implementing data pipelines and models, ensuring data quality and integrity. Solving challenging data integration problems, utilising optimal patterns, frameworks, query techniques, sourcing from vast and varying data sources. … Building, maintaining, and optimising our Data Warehouse to support reporting and analytics needs. Collaborating with product managers, business stakeholders and engineers to understand the data needs, representing key data insights in a meaningful way. Staying up-to-date with industry trends and best practices in data modelling, database development, and analytics. Optimising pipelines, frameworks, and systems More ❯
Posted:

Global Data Engineer

Billericay, England, United Kingdom
Hybrid / WFH Options
epay, a Euronet Worldwide Company
Overview of the job: At epay, data is at the core of everything we do. We've built a global team of Developers, Engineers, and Analysts who transform complex datasets into actionable insights for both internal stakeholders and external partners. As we continue to scale our commercial data services, we are looking to hire a mid-level Data Engineer (2+ years' experience) who has worked with Azure and Databricks , and can contribute immediately across pipeline development, categorisation, and optimisation for AI/ML use cases. You'll work with diverse datasets spanning prepaid, financial services, gambling, and payments, supporting business-critical decisions with high-quality, well-structured data. While engineering will be your focus, you'll … ideal candidate will also need to be able to travel globally when required. Three best things about the job: Be part of a high-performing team building modern, scalable data solutions used globally. Work hands-on with cutting-edge Azure technologies, with a strong focus on Databricks and Python development. Play a key role in evolving epay's data More ❯
Posted:

Senior Data Engineer

Luton, England, United Kingdom
JR United Kingdom
wide Job Description: Location: Remote (United Kingdom) About The Company: We have partnered with a company that empowers underwriters to serve their insureds more effectively. They are using advanced data intelligence tools to rebuild the way that underwriters share and exchange risk. With a current focus on the small and medium-sized businesses that power our global economy and … each policy to deliver unprecedented insight into insurance pools, and their speciality portfolio is fully diversified with very low catastrophe, aggregation or systemic risk. The Role: Designing and implementing data pipelines and models, ensuring data quality and integrity. Solving challenging data integration problems, utilising optimal patterns, frameworks, query techniques, sourcing from vast and varying data sources. … Building, maintaining, and optimising our Data Warehouse to support reporting and analytics needs. Collaborating with product managers, business stakeholders and engineers to understand the data needs, representing key data insights in a meaningful way. Staying up-to-date with industry trends and best practices in data modelling, database development, and analytics. Optimising pipelines, frameworks, and systems More ❯
Posted:

Data Engineer

Biggleswade, England, United Kingdom
Hybrid / WFH Options
Kramp
Driving the digital future of Kramp Group by discovering and building great products, making life easy for our customers. Kramp Group discovers and builds e-commerce, supply chain, finance & data science solutions that aim to give the ag-tech industry a push forward. We’re building a digital platform serving thousands of customers and generating a turnover of over … one billion euros per year. Who is your team? You will be part of Data Office , an international cross-functional team comprising: Data Modernization; Data Foundation. As part of the Data Foundation team, we drive data innovations from the core, ensuring data is secure, scalable, and intelligent. Our mission? To build and maintain the … foundation that powers Kramp’s data-driven future. This involves enabling a modern, secure, and scalable data infrastructure that ingests raw data and transforms it into valuable assets across the organization. We’re not just supporting the business — we’re leading transformation. Using cutting-edge tools like DBT Cloud, a modern tech stack, and a Data More ❯
Posted:

GCP Data Engineer

Luton, Bedfordshire, South East, United Kingdom
Hybrid / WFH Options
Anson Mccade
GCP Data Engineer £100,000 - 115,000 GBP Hybrid WORKING Location: United Kingdom (Greater London) Type: Permanent GCP Data Engineer London (Hybrid) Salary: Up to £115,000 + benefits A global consultancy is looking for a Google Cloud Platform (GCP) Data Engineer to join a cross-functional data team delivering high-impact projects … across multiple industries. This role focuses on building and managing end-to-end data solutions within the GCP ecosystem, working with or building Agentic AI systems - supporting clients with scalable, cloud-native platforms and tools. Key Responsibilities: Design and implement data platforms using GCP Manage data workflows from ingestion to reporting Collaborate across teams to ensure seamless … data integration Evaluate and implement the right technologies for each use case Support knowledge sharing and technical best practice Essential Experience: Proven expertise in building data warehouses and ensuring data quality on GCP Strong hands-on experience with BigQuery, Dataproc, Dataform, Composer, Pub/Sub Skilled in PySpark, Python and SQL Solid understanding of ETL/ELT More ❯
Employment Type: Permanent, Work From Home
Posted:

Data Engineer

Cambridge, England, United Kingdom
Hybrid / WFH Options
Axiom Software Solutions Limited
Position: Data Engineer Location: Cambridge/Luton, UK (Hybrid 2-3 days onsite in a week) Duration: Long Term B2B Contract Job Description: The ideal candidate will have a minimum of 5+ years of experience working with Snowflake, DBT, Python, and AWS to deliver ETL/ELT pipelines using various resources. Proficiency in Snowflake data warehouse architecture. … Design, build, and optimize ETL/ELT pipelines using DBT (Data Build Tool) and Snowflake. Experience with DBT (Data Build Tool) for data transformation and modeling. Implement data transformation workflows using DBT (core/cloud). Strong Python programming skills for automation and data processing. Leverage Python to create automation scripts and optimize data … version control (Git) tools. Experience with orchestration tools such as Airflow. Strong analytical and problem-solving skills with the ability to work independently in an agile development environment. Ensure data quality, reliability, and consistency across different environments. Collaborate with other data engineers, data analysts, and business stakeholders to understand data needs and translate them into engineering More ❯
Posted:

AWS data engineer - Ireland

Belfast, Abbots Langley, Hertfordshire
LA International Computer Consultants Ltd
Systems Architecture - AWS data engineer Job Description Location: UK - Will require travel to customer site ](Belfast) Job Summary: We are seeking a skilled and experienced AWS Data Engineer to join our team. The successful candidate will be responsible for implementing, and managing data architecture solutions for our customers, with a strong emphasis on Cloud technologies … Preferably AWS) and tooling. This role requires understanding of data modelling, database design, and data integration techniques. Key Responsibilities -Data Ingestion and Extraction: Design and implement efficient data ingestion pipelines to and from databases and file storage services. -Data Transformation and Cleaning: Transform and clean raw data to ensure data quality and consistency. … Data Pipelines: Build, maintain, and optimise data pipelines to automate data flows and enable real-time data processing. -Data Quality Assurance: Monitor data quality and implement measures to ensure data accuracy and completeness. -Database Administration: Manage and maintain databases (e.g., SQL, NoSQL) to ensure optimal performance and security. -Cloud Infrastructure: Deploy and manage More ❯
Employment Type: Contract
Rate: £400 - £650
Posted:

Junior Data Engineer

Abbots Langley, England, United Kingdom
Onyx-Conseil
Data Engineer Skills and Technologies Data Engineering: Strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc. Strong understanding of complex JSON manipulation. Experience working with Data Pipelines using a custom Python/PySpark frameworks. Strong understanding of the 4 core Data categories (Reference, Master … Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data. Strong understanding of Data Security principles. Experience managing data owners and access controls. Knowledge of row and column level security, GDPR, and handling sensitive datasets. Strong problem-solving and analytical skills, particularly able to demonstrate these intuitively. Required skills: Languages/Frameworks: JSON YAML Python … Delta Lake Bash (both CLI usage and scripting) Git Markdown Scala (bonus, not compulsory) Azure SQL Server as a HIVE Metastore (bonus) Technologies: Azure Databricks Apache Spark Delta Tables Data processing with Python PowerBI (Integration/Data Ingestion) JIRA Due to the nature and urgency of this post, candidates holding or who have held high-level security clearance More ❯
Posted:
Data Engineer
the East of England
25th Percentile
£50,000
Median
£66,253
75th Percentile
£75,002
90th Percentile
£83,750