4 of 4 Permanent Apache Airflow Jobs in Nottingham

complex data initiatives, providing guidance on solution design, engineering standards and implementation approaches Design, build and optimise distributed data processing pipelines using PySpark, Python, Airflow and AWS services Drive engineering excellence through code reviews, technical coaching, design reviews and adoption of software engineering best practices Partner closely with Product … Engineer, Principal Data Engineer or Technical Lead within a large-scale, data-driven organisation Strong hands-on software engineering expertise with Python, PySpark and Apache Airflow Deep experience designing and building distributed data processing systems and large-scale data platforms on AWS Strong knowledge of modern AWS data ...

Architectural Leaders hipDefine and evolve the enterprise data architecture strategy, with a primary focus on Cloud-scale Distributed Data Processing using Apache Spark and PySpark at the core of the platf ormEstablish and maintain architectural artefacts, reference architectures, Architecture Decision Records (ADRs), technical standards, and architecture roadmaps … Architect in a large, complex, data-led organisation, operating at an influence and strategy level rather than hands-on de liveryExpert-level understanding of Apache Spark and PySpark as the foundation of distributed data processing architectures, including tuning, optimisation, and enterprise-scale deployment pa tternsDeep expertise in designing ...

ideally within a large‐scale or regulated environment. AWS Experience: Strong working knowledge of AWS and cloud‐first data pipeline orchestration tools such as Airflow, Glue, or EMR. A Security Mindset: Understanding of compliance and security when managing sensitive data pipelines. Strong Automation Skills: Comfortable using Python and Shell ...

large‐scale or regulated environment. AWS Experience: You have a strong working knowledge of AWS and cloud‐first data pipeline orchestration tools (like Airflow, Glue, or EMR). A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines. Strong Automation Skills ...