15 of 15 Permanent Apache Airflow Jobs in Berkshire

maintain highly reliable and well-tested data and ML pipelines to extract, transform, and structure large datasets for ML applications. Expertise in using Apache Airflow (or similar orchestration tools like Prefect/Dagster) to define, schedule, and monitor complex data and ML workflows (DAGs). Implement comprehensive software … engineering teams. Bonus Skills to Stand Out (Optional): Experience with CI/CD tooling (e.g., GitHub Actions, Jenkins) specifically for ML pipelines and Airflow DAG deployment. Experience with data quality monitoring tools and frameworks. Master's or PhD in Computer Science, Data Science, or a related field. Relevant certifications ...

governance, and data architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data governance, data sharing across ...

experience developing dashboards for analysis and reporting, leveraging tools such as Databricks Workspaces, Streamlit or Jupyter notebooks. Familiarity with workflow orchestration tools (e.g. Apache Airflow) or data transformation frameworks (e.g. dbt) a plus. Familiarity with autonomous systems development (e.g., perception, planning, control) or relevant domains such as robotics ...

performance optimization Comfortable working in agile, collaborative, and fully remote environments Fluent in English (spoken and written) Nice to Have (Not Required) Experience with Airflow, Kafka, or similar orchestration/message tools Exposure to basic data governance or privacy standards Unit testing and CI/CD pipelines for data ...

performance optimization Comfortable working in agile, collaborative, and fully remote environments Fluent in English (spoken and written) Nice to Have (Not Required) Experience with Airflow, Kafka, or similar orchestration/message tools Exposure to basic data governance or privacy standards Unit testing and CI/CD pipelines for data ...

investment professionals, and who thrives in fast-paced financial environments... Key Responsibilities Help users adopt and make effective use of AWS, Kubernetes, Terraform, Airflow, Jenkins, Coder, and other cloud/platform technologies Streamline operational workflows by automating routine tasks, enhancing documentation, and building out knowledge bases Work with engineering ...

Docker and Kubernetes. Experience writing and deploying software within cloud-based environments, ideally AWS. Experience with frameworks and technologies used in component orchestration, including Airflow or equivalent. Experience working with sporting data or demonstrable knowledge and interest in this area, including an interest in sports betting. Good knowledge ...

/CD, testing frameworks, type-hinting, code reviews); and can build scalable, maintainable solutions Nice-to-have skills: Experience with DevOps tools (Airflow, Kubernetes, Terraform, GCP), data integration/ETL and pipeline optimization, or reinforcement learning algorithms Customer collaborator: Comfortable working directly with clients and cross-functional teams, aligning ...

decisions. Strong analytical thinker - you can take a fuzzy problem, structure it and solve it. SQL, Python and data modelling (we use dbt and airflow but don't mind if you haven't used these, as long as you know how to model data). Bias to action ...

product company (experience in edtech or marketplace environments is a plus). Deep technical expertise in modern data and ML stacks, .e.g., Kafka, Spark, Airflow, SageMaker, MLflow, or similar cloud-native architectures. Practical understanding of machine learning workflows and the infrastructure required to support them (feature computation, training, deployment ...

plan. Cooling Requirements Define and validate cooling strategies for high‐density GPU racks (air‐cooled and liquid‐ready): hot/cold aisle, ΔT targets, airflow direction, blanking, containment. Where applicable, plan for rear‐door heat exchangers (RDHx) or direct‐to‐chip (D2C) liquid cooling: CDUs, facility water parameters, quick ...

company's requirements. Design and build data storage solutions to address different use cases. Be technology agnostic and favour open standards (e.g., Parquet, Apache Iceberg). Find the right balance between cost and performance of the proposed solutions. Create scalable ingestion and transformation workflows, covering aspects such as observability … Standards: Hands-on experience with a data lakehouse implementation (either vendor based or open source) which is based open standards such as Parquet and Apache Iceberg. Experience in building data models, partition strategies and performance optimization (e.g. data compaction). Data Transformation & Lineage: Experience in performing data transformation ...

MLflow to manage the end-to-end ML lifecycle, including experiment tracking, model registry, and deployment. Automate and orchestrate: Use orchestration tools like Airflow to manage complex ML workflows and ensure seamless execution at scale. Optimize infrastructure: Design efficient ML pipelines and leverage cloud services like AWS to ensure … Enterprise RAG Systems, including chunking, reranking techniques, etc. Extra awesome: You have experience working in a B2B SaaS company Experience with orchestration tools (e.g. Airflow) Familiarity with SQL, Spark, or other data processing frameworks Knowledge of Snowflake or other cloud data warehouses. Strong familiarity with agentic frameworks for decision ...

MLflow to manage the end-to-end ML lifecycle, including experiment tracking, model registry, and deployment. Automate and orchestrate: Use orchestration tools like Airflow to manage complex ML workflows and ensure seamless execution at scale. Optimize infrastructure: Design efficient ML pipelines and leverage cloud services like AWS to ensure … Enterprise RAG Systems, including chunking, reranking techniques, etc. Extra awesome: You have experience working in a B2B SaaS company Experience with orchestration tools (e.g. Airflow) Familiarity with SQL, Spark, or other data processing frameworks Knowledge of Snowflake or other cloud data warehouses. Strong familiarity with agentic frameworks for decision ...

The Vacancy Are you a Senior Software Development Engineer looking to join a company where your work truly makes a difference? Where you're empowered to innovate, collaborate, and help shape the future of healthcare ...