376 to 400 of 458 Apache Airflow Jobs in England

lifecycle. What you’ll be doing Build and maintain ML pipelines for training, evaluation, and deployment using tools like Databricks, MLFlow, Airflow, DBT, Sagemaker, Tecton Support AI scientist creating reproducible, containerized model training environments (on-demand and scheduled), and manage compute at scale (e.g., spot/GPU autoscaling) Define … looking for Proven experience designing and deploying ML systems in production (5+ years in relevant roles) Proficiency in Python and SQL, and orchestration tools (Airflow, Kubeflow, Dagster, etc.) Experience with modern cloud platforms (preferably GCP or AWS), Kubernetes, and CI/CD workflows Understanding of ML model lifecycles: training ...

product and the company. Your Contribution Will Be The stack is modern: StarRocks as our primary analytical layer, Flink for processing, DBT for transformation, Airflow for orchestration and various tooling for surfacing insights. The hard work of making it genuinely reliable is still in front of us — and that …/lakehouse architecture patterns. Verbal and written fluency in English is required — we're a distributed team and written communication is important. Preferred Qualifications Airflow for orchestration. Experience with Apache Hudi. Experience with financial, transactional, or payment data. What We Offer at Yuno Competitive Compensation. Remote Work ...

bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than … Salesforce) and sales enablement platforms. Bonus Points If You Have: Experience selling to data teams, developers, or technical buyers. Background in data orchestration or Airflow-related technologies. Prior success in a startup or high-growth environment. The estimated OTE is up to £225,000 uncapped, along with a generous ...

operate pipelines feeding daily reporting, attribution, and LTV, ingesting data from ads, payments, and product backends into our lakehouse. You will orchestrate jobs with Apache Airflow, maintain silver/gold tables, and work with Analytics, Marketing, and Data Science to impact products and processes. This 3-month contract ...

related activities for datasets used by Quants and Traders. The role requires strong SQL and Python skills (PySpark, Pandas, Jupyter Notebooks), plus experience with Airflow, Linux/Bash, and data-quality practices. You will collaborate with stakeholders and help improve data pipelines. #J-18808-Ljbffr ...

/batch pipelines, and partner with marketing, analytics and engineering to deliver a scalable data platform. You will drive data resilience, implement dbt and Airflow workflows, and mentor engineers while shaping the CDP and MarTech data flows for global growth. #J-18808-Ljbffr ...

data platform, blending hands-on delivery with leadership and mentorship responsibilities. The role requires strong GCP experience (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Airflow), advanced Python and SQL, and a track record of building scalable batch and real-time pipelines. #J-18808-Ljbffr ...

monitor models, build cloud-native infra with Kubernetes, and drive CI/CD and observability to scale AI services. You will work with Dagster, Airflow, or Prefect, use Terraform or Bicep, and collaborate with data scientists #J-18808-Ljbffr ...

understand and outperform the markets. Data science and machine learning skills are a strong plus. Exposure to modern development and operations tools, such as Airflow, Kubernetes, or similar technologies, is a plus. Prior fixed-income trading or portfolio management experience is not required. London, UKSummaryLocation: London, UKType: Full time ...

data analysis packages such as Numpy, Pandas, etc. Experience with SQL and/or other database technologies Knowledge of modern technologies such as AWS, Airflow, Docker, GitLab and Redis Ideally working with data visualization technologies such as Dash, Plotly, You will be joining a progressive and exciting company committed ...

understand and outperform the markets.* Data science and machine learning skills are a strong plus.* Exposure to modern development and operations tools, such as Airflow, Kubernetes, or similar technologies, is a plus. Prior fixed-income trading or portfolio management experience is not required.London, UK### About UsWe are a leading ...

taken a model through its full lifecycle before, from training through to serving it in production. You work with Python, PyTorch, SageMaker, and Airflow day to day. You default to owning problems end to end rather than waiting to be told what's next, and you're comfortable when ...

clear, performant, and reliable queries to transform large complex datasets) You have experience building and owning automated data pipelines with tools like DBT/Airflow Experimentation & Statistics: Experience running A/B tests and analysing the results to drive product decisions Ownership: You enjoy working independently in a fast ...

economy. Familiarity with Supabase specifically, or with similar BaaS platforms. BigQuery experience. Familiarity with n8n. Equivalent experience with code‐first orchestrators such as Temporal, Airflow or Prefect is welcome. Design sensibility. You care how things look and feel, not just how they function. Experience replacing legacy or external vendor ...

Spark for building and optimizing large-scale data pipelines, with a strong grasp of data structuring for performance and efficiencyHands-on experience with Airflow for orchestrating complex data workflows, and Apache Iceberg for table format management at scaleExtensive AWS experience including EKS, Docker, and Kubernetes; comfortable owning infrastructure ...

technical design reviews. Must Haves (Hard Skills) Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake. Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi-structured financial data logs (JSON/… Avro). Robust ETL/ELT Orchestration: Expert proficiency in data transformation engines (such as dbt) and scheduling tools (such as Airflow). Stream/Message Queues: Solid understanding of event-driven architectures and streaming processing via Apache Kafka. Strong Programming Foundations: Proficiency in Python ...

FastAPI) a huge plus; Experience in Kubernetes, Docker, Spark and related monitoring tools (e.g. DataDog, Grafana, Prometheus) for DataOps a huge plus; Experience with Airflow a huge plus; Experience with dbt for pipeline modelling also beneficial; Skilled at shaping needs into a solid set of requirements and designing scalable … main programming language Databricks Spark for data processing Databricks/dbt/SQL for data modelling and analytics Streamlit for data applications and visualisations Airflow for job scheduling and tracking CircleCI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Terraform for our infrastructure ...

wherever your expertise can have the greatest impact. Our application data lives primarily in CockroachDB, with a modern data platform built around BigQuery, dbt, Airflow and pub/sub. Data flows both ways: into analytics and modelling, and back into the products our customers use. That culture translates into … comfortable working beyond a narrowly defined specialism when that is what the problem requires. Experience that will set you apart Experience with BigQuery, Airflow and dbt, or equivalent modern data technologies. Experience with CockroachDB, Postgres or other distributed/relational databases, including CDC or event-driven data pipelines. Knowledge ...

CDO. What you’ll need for this role Hands-on experience designing and operating large-scale data pipelines on GCP (BigQuery, Cloud Composer/Airflow, GCS), with proven knowledge of Apache Kafka and real-time streaming architectures Demonstrated experience leading or technically mentoring a team of data engineers ...

data team automate it. Initially you’ll run and validate reports, meet deadlines across jurisdictions, and replace manual steps with dbt, SQL and Airflow pipelines, with comprehensive documentation for handover. #J-18808-Ljbffr ...

data from multiple sources, turning chaos into a reliable, secure foundation. You’ll work with founders to shape architecture, be hands-on with Python, Airflow, dbt and distributed systems, and build infrastructure enabling autonomous software agents. This is a visa-sponsored, early-stage opportunity with high ownership and impact ...

that feed daily reporting, attribution, and LTV. Ingest data from ad platforms, payment systems, and product backends into Databricks. Orchestrate and monitor jobs in Apache Airflow. Keep silver/gold tables accurate, tested, and delivered on time. Proactively identify, troubleshoot, and resolve issues to optimize internal and external processes. … getting a failed daily run back on track. Required Skills & Experience Technical Skills Strong experience with Python and SQL. Hands-on experience with Apache Spark. Experience with Databricks (Unity Catalog/Delta Lake). Experience orchestrating workflows with Apache Airflow. Familiarity with GCP services (GCS, BigQuery). Experience ...

payments or fintech industry. Nice to Have Running multi‐tenant AI platforms or GPU/resource management at scale. Data pipelines and orchestration (Airflow, Prefect) and warehouses like Databricks, Snowflake, or BigQuery. Spanish proficiency. Tech Stack Languages — Python (AI/ML), Go and Kotlin (platform services). AI & LLMs … APIs and open models, agent frameworks, MCP, RAG. AI evaluation & observability — LangFuse, LangSmith, Braintrust, MLflow. Data & retrieval — vector databases, feature stores. Messaging — Apache Kafka, SQS. Databases — PostgreSQL, Redis. Infrastructure — AWS, Kubernetes, Docker, Terraform. Observability — Datadog, OpenTelemetry. CI/CD — GitHub Actions, ArgoCD. Version Control — Git/GitHub. What ...

enhance scalable data pipelines and ETL solutions across AWS. Develop robust batch and near real-time data processing capabilities. Work with Python, SQL, Airflow, AWS Glue and Redshift to deliver reliable data solutions. Improve platform performance, resilience and cost efficiency. Build effective monitoring, alerting and support processes to keep … Redshift, S3, Glue and Lambda. Advanced SQL and Python capability. Proven experience designing, developing and supporting data pipelines and ETL frameworks. Practical knowledge of Airflow and Spark. Strong understanding of data modelling, data warehousing and performance optimisation. Experience working with GitHub, CI/CD and Agile delivery. Experience within ...

maintain standardized data models, schemas, and metadata that make commodities datasets easy to understand, discover, and reuse. Schedule, monitor, and manage data pipelines using Airflow or similar workflow orchestration tools to ensure reliable, timely data delivery. Implement validation, reconciliation, and anomaly-detection controls to maintain data completeness, accuracy … building and maintaining ETL pipelines. Strong Python and SQL skills, including experience working with large datasets and complex data transformations. Hands-on experience with Airflow or comparable workflow orchestration tools. Experience with Git, CI/CD pipelines such as GitHub Actions, and automated testing frameworks such as PyTest. Strong ...