76 to 100 of 237 Apache Airflow Jobs in the UK

systems Excellent communication skills, able to explain complex technical systems to commercial, operations and senior leadership teams. Experience with Google Cloud, Docker, Kafka, Spark, Airflow, ElasticSearch, ClickHouse or similar production infrastructure Experience owning product roadmaps, release governance or cross-functional delivery across distributed teams and time zones. What ...

interpersonal skills Preferred qualifications: Experience in the gaming or entertainment industry Experience working with tools and technologies such as Spark, Snowflake, Qwak, MLFlow, Airflow, etc Contributions to open‐source AI/ML projects or participation in AI/ML competitions (e.g., Kaggle) Experience with training and fine‐tuning large ...

interpersonal skills Preferred qualifications: Experience in the gaming or entertainment industry Experience working with tools and technologies such as Spark, Snowflake, Qwak, MLFlow, Airflow, etc Contributions to open‐source AI/ML projects or participation in AI/ML competitions (e.g., Kaggle) Experience with training and fine‐tuning large ...

understanding of cloud infrastructure, observability, monitoring, incident response, and operational best practices relevant technologies (we use): AWS incl. S3, ECS, API Gateway, Batch, Redshift, Airflow, GitHub Actions, Docker, Pulumi, Python, Javascript/react high ownership mentality who can work across the stack with a primary responsibility for DevOps reliability ...

reproducibility, dataset versioning, and efficient access Working knowledge of cloud platforms (AWS, GCP, or Azure) and modern MLOps tooling (e.g. MLflow, Weights & Biases, DVC, Airflow) Strong experience with Python and associated scientific software packages such as PyTorch, OpenCV, Pandas, SciPy, NumPy, SciKit-learn, etc. Strong software engineering practices including ...

requirements into Data Science deliverables. The opportunity to work with leading data engineering technologies, including Google Vertex AI tools, Google BigQuery, BigQuery Pipelines, and Airflow, with leading Data Science tools and emerging technologies for model building and deployment. Opportunities to develop your career in a friendly, diverse, innovative, international ...

engineering mindset and experience building production-grade systems Experience developing ETL processes and large-scale financial data pipelines Strong Azure experience Docker and Kubernetes Apache Airflow GitHub and CI/CD (GitHub Actions) Experience building cloud-native research or production platforms Experience working with market data, security master ...

best practices and coding standards. Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using Apache Airflow, Spark, SQL, Python, and ETL tools. CI/CD & DevOps Design and implement CI/CD pipelines for data platforms. Automate code ...

such as customer lifetime value, attribution modelling, real-time bidding, and audience targeting is a plus Familiarity with data pipeline orchestration tools such as Apache Airflow and Kubernetes is a plus You do your best work as part of a team and enjoy sharing knowledge just as much ...

join their London-based team. Key Responsibilities: Design and maintain scalable data pipelines across diverse sources. Automate and optimise workflows using tools like Airflow, dbt, and Spark. Support data modelling for analytics, dashboards, and A/B testing. Collaborate with cross-functional teams to deliver data-driven insights. Work ...

isolation Experience with CI/CD, databases, infra-as-code Comfortable debugging production systems Nice to Have Security/compliance (SOC2, HIPAA) Exposure to AirFlow and MLFlow for scientific workflows MSC/PHD in Machine Learning Biotech/pharma experience Why Helical Live with top pharma High ownership, small ...

learning services. Experience with machine learning frameworks such as TensorFlow, PyTorch, or scikit-learn. Knowledge of pipeline orchestration and data workflow tools such as Airflow, Dataform, or dbt. Experience delivering advanced measurement and modelling solutions, including marketing mix modelling, incrementality testing, causal impact analysis, attribution modelling, propensity modelling, churn ...

platform as the business continues to invest Tech Environment: Azure Python SQL Server Azure Data Services Data Warehousing Data Engineering & ETL Workflow orchestration (Airflow, Luigi or similar) You'll probably be someone who: Has experience leading or mentoring Data Engineers Still enjoys writing code and solving engineering problems ...

modern cloud based data platforms. Solid understanding of data modelling and data transformation principles. Ability to work effectively within collaborative engineering teams. Desirable Experience: Airflow Databricks Experience supporting AI or machine learning initiatives. Semantic layer experience. Exposure to Azure and multi cloud environments. Understanding of Inmon 3NF data modelling ...

including governance Who you are Strong in SQL and Python, with real pipeline experience, not just querying Comfortable with Spark or PySpark, dbt and Airflow for orchestration Experience with at least one major cloud platform (AWS, GCP or Azure) You've worked with vector databases or feature stores ...

with Snowflake. Knowledge of MongoDB or other NoSQL databases. Experience working within AWS or other cloud environments. Familiarity with workflow orchestration tools such as Airflow, Prefect or Dagster. Experience with market data providers such as Bloomberg, Refinitiv or ICE. Exposure to enterprise data management platforms. Knowledge of Kafka ...

implementing batch and stream data processing systems. Experience with Datadog, SQL, Terraform, Docker, AWS (ECS, Kinesis, SQS, CloudWatch), GCP (BigQuery). Knowledge of Airflow, Kafka, Flink, dbt, Kubernetes is highly beneficial. Good understanding of AI platforms, experience building infrastructure for LLM orchestration (e.g., vector databases, RAG pipelines, GPU scaling ...

with Snowflake. Knowledge of MongoDB or other NoSQL databases. Experience working within AWS or other cloud environments. Familiarity with workflow orchestration tools such as Airflow, Prefect or Dagster. Experience with market data providers such as Bloomberg, Refinitiv or ICE. Exposure to enterprise data management platforms. Knowledge of Kafka ...

MLOps principles with experience deploying models in production Proficiency in Python and tools/platforms such as Azure, AWS, GCP, Databricks, MLFlow, and Airflow Strong communication skills with the ability to engage business and technical stakeholders We offer/Benefits EPAM Employee Stock Purchase Plan (ESPP) Protection benefits including ...

cluster management and ML training workloads (NVIDIA, CUDA, distributed training). Familiarity with MLOps tooling: Experiment tracking (MLflow, Weights & Biases). Workflow orchestration (Airflow, Prefect, Argo). Data versioning (DVC). Background in scientific computing or HPC environments. Prior experience at a deep tech or computational science company. ...

database querying languages Experience in large‐scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal) Demonstrated experience leading effective use of enterprise‐authorized AI‐assist­ed software development tools within the work environment (e.g., for coding, code review, test acceleration ...

when it isn’t. The ability to communicate model behaviour and limitations clearly to non‐technical stakeholders. Familiarity with data pipeline tooling (e.g. Airflow, dbt, Spark) and an understanding of how ML fits within a broader data platform. There’s always room to grow and learn with our roles ...

organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design, Data Governance ...

necessary infrastructure, resources, and interfaces to enable data loading and LLM workflows. Use Python/Java and large-scale data workflow orchestration platforms e.g. Airflow to construct software artifacts for ETL, interfacing with diverse data formats and storage technologies, and incorporate them into robust data workflows and dynamic systems ...

organisation* Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI* Expertise in Streaming Data, Event Driven Design, Data Governance ...