5 of 5 Remote/Hybrid Contract Apache Airflow Jobs

grade data pipelines. Familiarity with Git, CI/CD and Agile delivery practices. Excellent communication and stakeholder engagement skills. Nice to Have Experience with Apache Airflow for workflow orchestration. Experience with Databricks . #dataengineer #aws #snowflake #dbt #airflow #databricks #contractrole #outsideir35 Reasonable Adjustments: Respect and equality are core ...

environment. Key Responsibilities Design, develop and maintain scalable data pipelines using Python and Databricks. Build, optimise and support enterprise ETL/ELT workflows using Apache Spark and Delta Lake. Design and develop robust data models and Lakehouse architectures. Implement and manage data workflows within the Databricks ecosystem. Ensure high … commercial experience developing data engineering solutions using Python . Extensive hands-on experience with Databricks , including Workflows, Notebooks and Delta Lake. Strong experience with Apache Spark/PySpark . Proven experience building scalable ETL/ELT pipelines. Strong SQL and data modelling skills. Experience designing modern Lakehouse architectures. Experience ...

similar hands-on leadership role Strong hands-on expertise in Python Extensive experience with Databricks, including workflows, notebooks and Delta Lake Strong experience with Apache Spark/PySpark Experience building and optimising enterprise-scale ETL pipelines Strong understanding of modern data architecture and Lakehouse concepts Advanced SQL and distributed … other highly regulated enterprise environments would be highly advantageous Desirable experience includes: Databricks certifications Kafka or Structured Streaming CI/CD and DevOps practices Airflow or Databricks Workflows Delta Lake optimisation techniques Docker and Kubernetes Exposure to machine learning pipelines Job Offer Competitive day rate ...

specialist consultancy renowned for delivering mission-critical solutions, working with modern technologies in a secure, cutting-edge environment Key Skills required: - PyTorch - TensorFlow - SciKit - Airflow or Prefect - ML flow (really nice to have) - Python - SQL - Data Modelling This role will require an active SC Clearance and British Citizenship ...

This is a great opportunity to contribute greatly to an extremely engineering-focused organization and further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform, Google Cloud Platform, etc; You will own engineering efforts to provide partner teams within the organisation with data sources that build … opportunity for the role to go permanent. What You'll Do: Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow; Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality ...