1 to 25 of 34 Apache Airflow Jobs in the East of England

such as AWS, Azure, or GCP · Docker · Documenting code, architectures, and experiments · Linux systems and bash terminals Preferred Qualifications o Databases and/or data warehousing technologies, such as Apache Hive, Iceberg etc. o Data transformation via SQL and DBT. o Orchestration platforms such as Apache Airflow, Argo Workflows, etc. o Data catalogs and metadata management tools More ❯

HuggingFace, scikit-learn, PyTorch, Pandas, NumPy, SciPy Experience with AWS (principally EC2, S3, SageMaker) or Azure/GCP equivalents Some experience of designing, developing and deploying scalable infrastructure (eg Apache Airflow, Luigi or other cluster management software) Object Orientated concepts and design The ability to design and build unit-tested and well documented modular code Understanding of Agile More ❯

Job Description Avensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation, and managed services. Given our decade of success, we have evolved to become one More ❯

data warehousing concepts and data modeling . Excellent problem-solving and communication skills focused on delivering high-quality solutions. Understanding or hands-on experience with orchestration tools such as Apache Airflow . Deep knowledge of non-functional requirements such as availability , scalability , operability , and maintainability . #J-18808-Ljbffr More ❯

of data warehousing concepts and data modeling. Excellent problem-solving and communication skills focused on delivering high-quality solutions. Understanding or hands-on experience with orchestration tools such as Apache Airflow. Deep knowledge of non-functional requirements such as availability, scalability, operability, and maintainability. Seniority level Seniority level Mid-Senior level Employment type Employment type Full-time Job function More ❯

ETL development using tools like Spark, Python, or SQL Familiarity with cloud platforms (AWS, Azure, or MODCloud) and data services Experience building and automating data pipelines using tools like Airflow, dbt, or similar An understanding of data security and privacy in sensitive environments Ideally exposure to geospatial tools or libraries such as PostGIS, GDAL, QGIS, or geospatial APIs Experience More ❯

Position: Data Engineer Location: Cambridge/Luton, UK (Hybrid 2-3 days onsite in a week) Duration: Long Term B2B Contract Job Description: The ideal candidate will have a minimum of 5+ years of experience working with Snowflake, DBT, Python More ❯

Snowflake Architect - ETL, AIRFLOW, AWS, SQL, Python, and ETL tools (Streamsets, DBT), RDBMS A Snowflake Architect is required for a long-term project with a fast-growing company. Responsibilities: -Design, develop, and maintain robust data pipelines and ETL processes using Snowflake on AWS. -Implement data warehousing solutions, ensuring efficient storage, retrieval, and transformation of large datasets. -Collaborate with data … warehousing concepts and data modeling. >Excellent problem-solving and communication skills, with a focus on delivering high-quality solutions. >Understanding/hands on experience in Orchestration solutions such as Airflow >Deep knowledge of key non-functional requirements such as availability, scalability, operability, and maintainability More ❯

warehousing concepts and data modeling. Excellent problem-solving and communication skills, with a focus on delivering high-quality solutions. Understanding/hands on experience in Orchestration solutions such as Airflow Deep knowledge of key non-functional requirements such as availability, scalability, operability, and maintainability #J-18808-Ljbffr More ❯

warehousing concepts and data modeling. Excellent problem-solving and communication skills, with a focus on delivering high-quality solutions. Understanding/hands on experience in Orchestration solutions such as Airflow Deep knowledge of key non-functional requirements such as availability, scalability, operability, and maintainability Coforge is an equal opportunities employer and welcomes applications from all sections of society and More ❯

warehousing concepts and data modeling. Excellent problem-solving and communication skills, with a focus on delivering high-quality solutions. Understanding/hands on experience in Orchestration solutions such as Airflow Deep knowledge of key non-functional requirements such as availability, scalability, operability, and maintainability Seniority level Seniority level Mid-Senior level Employment type Employment type Contract Job function Job More ❯

Job Description Snowflake Architect with Azure (Permanent Role) Basildon, UK (Work from Client office 5 days a week) Responsibilities: Design, develop, and maintain robust data pipelines and ETL processes using Snowflake on AWS. Implement data warehousing solutions, ensuring efficient storage More ❯

Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group, Akkodis combines the expertise of More ❯

by managing data integrations between Salesforce Health Cloud and Informatica, ensuring seamless data flow between systems. You’ll troubleshoot virtual machine access via SSH, facilitate migration of outputs into Airflow, and support AWS infrastructure while interfacing with Google Cloud-hosted systems. The position plays a key role in enabling actionable insights and operational stability across complex, cross-platform data … or Informatica Cloud Solid understanding of data extraction, transformation, and loading (ETL) processes Proficiency in SSH and managing/troubleshooting virtual machine environments Familiarity with orchestration tools such as Apache Airflow Experience with AWS services (e.g., S3, EC2, RDS) Understanding of cloud-based environments (Google Cloud Platform experience a plus) Ability to collaborate across infrastructure, data engineering, and … Manage and optimize data flows between Salesforce Health Cloud and Informatica Perform infrastructure-level troubleshooting using SSH and virtual machine access Ensure high-quality data migration and integration into Airflow-managed pipelines Support AWS-based data operations and contribute to multi-cloud data management Collaborate with infrastructure and application teams to maintain seamless operations Analyze and validate data transformations More ❯

by managing data integrations between Salesforce Health Cloud and Informatica, ensuring seamless data flow between systems. You’ll troubleshoot virtual machine access via SSH, facilitate migration of outputs into Airflow, and support AWS infrastructure while interfacing with Google Cloud-hosted systems. The position plays a key role in enabling actionable insights and operational stability across complex, cross-platform data … or Informatica Cloud Solid understanding of data extraction, transformation, and loading (ETL) processes Proficiency in SSH and managing/troubleshooting virtual machine environments Familiarity with orchestration tools such as Apache Airflow Experience with AWS services (e.g., S3, EC2, RDS) Understanding of cloud-based environments (Google Cloud Platform experience a plus) Ability to collaborate across infrastructure, data engineering, and … Manage and optimize data flows between Salesforce Health Cloud and Informatica Perform infrastructure-level troubleshooting using SSH and virtual machine access Ensure high-quality data migration and integration into Airflow-managed pipelines Support AWS-based data operations and contribute to multi-cloud data management Collaborate with infrastructure and application teams to maintain seamless operations Analyze and validate data transformations More ❯

by managing data integrations between Salesforce Health Cloud and Informatica, ensuring seamless data flow between systems. You’ll troubleshoot virtual machine access via SSH, facilitate migration of outputs into Airflow, and support AWS infrastructure while interfacing with Google Cloud-hosted systems. The position plays a key role in enabling actionable insights and operational stability across complex, cross-platform data … or Informatica Cloud Solid understanding of data extraction, transformation, and loading (ETL) processes Proficiency in SSH and managing/troubleshooting virtual machine environments Familiarity with orchestration tools such as Apache Airflow Experience with AWS services (e.g., S3, EC2, RDS) Understanding of cloud-based environments (Google Cloud Platform experience a plus) Ability to collaborate across infrastructure, data engineering, and … Manage and optimize data flows between Salesforce Health Cloud and Informatica Perform infrastructure-level troubleshooting using SSH and virtual machine access Ensure high-quality data migration and integration into Airflow-managed pipelines Support AWS-based data operations and contribute to multi-cloud data management Collaborate with infrastructure and application teams to maintain seamless operations Analyze and validate data transformations More ❯

by managing data integrations between Salesforce Health Cloud and Informatica, ensuring seamless data flow between systems. You’ll troubleshoot virtual machine access via SSH, facilitate migration of outputs into Airflow, and support AWS infrastructure while interfacing with Google Cloud-hosted systems. The position plays a key role in enabling actionable insights and operational stability across complex, cross-platform data … or Informatica Cloud Solid understanding of data extraction, transformation, and loading (ETL) processes Proficiency in SSH and managing/troubleshooting virtual machine environments Familiarity with orchestration tools such as Apache Airflow Experience with AWS services (e.g., S3, EC2, RDS) Understanding of cloud-based environments (Google Cloud Platform experience a plus) Ability to collaborate across infrastructure, data engineering, and … Manage and optimize data flows between Salesforce Health Cloud and Informatica Perform infrastructure-level troubleshooting using SSH and virtual machine access Ensure high-quality data migration and integration into Airflow-managed pipelines Support AWS-based data operations and contribute to multi-cloud data management Collaborate with infrastructure and application teams to maintain seamless operations Analyze and validate data transformations More ❯

by managing data integrations between Salesforce Health Cloud and Informatica, ensuring seamless data flow between systems. You’ll troubleshoot virtual machine access via SSH, facilitate migration of outputs into Airflow, and support AWS infrastructure while interfacing with Google Cloud-hosted systems. The position plays a key role in enabling actionable insights and operational stability across complex, cross-platform data … or Informatica Cloud Solid understanding of data extraction, transformation, and loading (ETL) processes Proficiency in SSH and managing/troubleshooting virtual machine environments Familiarity with orchestration tools such as Apache Airflow Experience with AWS services (e.g., S3, EC2, RDS) Understanding of cloud-based environments (Google Cloud Platform experience a plus) Ability to collaborate across infrastructure, data engineering, and … Manage and optimize data flows between Salesforce Health Cloud and Informatica Perform infrastructure-level troubleshooting using SSH and virtual machine access Ensure high-quality data migration and integration into Airflow-managed pipelines Support AWS-based data operations and contribute to multi-cloud data management Collaborate with infrastructure and application teams to maintain seamless operations Analyze and validate data transformations More ❯

by managing data integrations between Salesforce Health Cloud and Informatica, ensuring seamless data flow between systems. You’ll troubleshoot virtual machine access via SSH, facilitate migration of outputs into Airflow, and support AWS infrastructure while interfacing with Google Cloud-hosted systems. The position plays a key role in enabling actionable insights and operational stability across complex, cross-platform data … or Informatica Cloud Solid understanding of data extraction, transformation, and loading (ETL) processes Proficiency in SSH and managing/troubleshooting virtual machine environments Familiarity with orchestration tools such as Apache Airflow Experience with AWS services (e.g., S3, EC2, RDS) Understanding of cloud-based environments (Google Cloud Platform experience a plus) Ability to collaborate across infrastructure, data engineering, and … Manage and optimize data flows between Salesforce Health Cloud and Informatica Perform infrastructure-level troubleshooting using SSH and virtual machine access Ensure high-quality data migration and integration into Airflow-managed pipelines Support AWS-based data operations and contribute to multi-cloud data management Collaborate with infrastructure and application teams to maintain seamless operations Analyze and validate data transformations More ❯

by managing data integrations between Salesforce Health Cloud and Informatica, ensuring seamless data flow between systems. You’ll troubleshoot virtual machine access via SSH, facilitate migration of outputs into Airflow, and support AWS infrastructure while interfacing with Google Cloud-hosted systems. The position plays a key role in enabling actionable insights and operational stability across complex, cross-platform data … or Informatica Cloud Solid understanding of data extraction, transformation, and loading (ETL) processes Proficiency in SSH and managing/troubleshooting virtual machine environments Familiarity with orchestration tools such as Apache Airflow Experience with AWS services (e.g., S3, EC2, RDS) Understanding of cloud-based environments (Google Cloud Platform experience a plus) Ability to collaborate across infrastructure, data engineering, and … Manage and optimize data flows between Salesforce Health Cloud and Informatica Perform infrastructure-level troubleshooting using SSH and virtual machine access Ensure high-quality data migration and integration into Airflow-managed pipelines Support AWS-based data operations and contribute to multi-cloud data management Collaborate with infrastructure and application teams to maintain seamless operations Analyze and validate data transformations More ❯

by managing data integrations between Salesforce Health Cloud and Informatica, ensuring seamless data flow between systems. You’ll troubleshoot virtual machine access via SSH, facilitate migration of outputs into Airflow, and support AWS infrastructure while interfacing with Google Cloud-hosted systems. The position plays a key role in enabling actionable insights and operational stability across complex, cross-platform data … or Informatica Cloud Solid understanding of data extraction, transformation, and loading (ETL) processes Proficiency in SSH and managing/troubleshooting virtual machine environments Familiarity with orchestration tools such as Apache Airflow Experience with AWS services (e.g., S3, EC2, RDS) Understanding of cloud-based environments (Google Cloud Platform experience a plus) Ability to collaborate across infrastructure, data engineering, and … Manage and optimize data flows between Salesforce Health Cloud and Informatica Perform infrastructure-level troubleshooting using SSH and virtual machine access Ensure high-quality data migration and integration into Airflow-managed pipelines Support AWS-based data operations and contribute to multi-cloud data management Collaborate with infrastructure and application teams to maintain seamless operations Analyze and validate data transformations More ❯

platform, ensuring scalability, reliability, and security. Drive modernisation by transitioning from legacy systems to a lean, scalable platform. Act as a lead expert for technologies such as AWS, DBT, Airflow, and Databricks. Establish best practices for data modelling, ingestion, storage, streaming, and APIs. Governance & Standards Ensure all technical decisions are well-justified, documented, and aligned with business needs. Lead … in data engineering and cloud engineering, including data ingestion, transformation, and storage. Significant hands-on experience with AWS and its data services. Expert-level skills in SQL, Python, DBT, Airflow and Redshift. Confidence in coding, scripting, configuring, versioning, debugging, testing, and deploying. Ability to guide and mentor others in technical best practices. A product mindset, focusing on user needs More ❯

common life sciences data acquisition software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and container orchestration tools (e.g., Docker, Kubernetes). ZONTAL is an More ❯

common life sciences data acquisition software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and container orchestration tools (e.g., Docker, Kubernetes). ZONTAL is an More ❯

common life sciences data acquisition software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and container orchestration tools (e.g., Docker, Kubernetes). ZONTAL is an More ❯