201 to 225 of 281 Apache Airflow Jobs in London

experimentation, statistical analysis and performance measurement. Ability to influence senior stakeholders and translate analytics into commercial outcomes. Experience with tools such as BigQuery, dbt, Airflow, Git, Tableau or Looker is advantageous. Python experience is beneficial. What They Offer Up to £100,000 base salary plus bonus and benefits. Hybrid ...

Proven background as a Machine Learning Engineer Programming skills: Strong in SQL and Python (Pandas, Scikit-learn, Jupyter, Matplotlib) Data transformation & manipulation : experience with Airflow, DBT and Kubeflow Cloud: Experience with GCP and Vertex AI (developing ML services) Expertise: Solid understanding of computer science fundamentals and time-series forecasting ...

automated manual operational processes (not tests). Built solutions that replaced or eliminated manual work. Worked with operational/scheduling tools (Control-M, Airflow, Step Functions, Kubernetes jobs, etc.).4. Process Understanding & DesignCan understand operational workflows and identify which parts can be automated. Works with ops teams to optimize ...

Strong programming skills and production experience in Python. Experience building and maintaining data or ML pipelines with an orchestration tool such as Dagster (or Airflow, Prefect, etc.). Hands-on experience with common ML libraries and frameworks, e.g. PyTorch, scikit-learn, and gradient-boosting libraries such as XGBoost ...

things done. Good to have: Experience in Financial Crime and/or Customer Onboarding domain Knowledge of the fintech ecosystem Knowledge of utilities like Airflow/Github/DBT Experience with user-facing products and data Additional Information What do we offer: Salary: £75,000 - £115,000 Company Restricted ...

computational improvements Making improvements and/or fixing bugs by submitting patches to open-source projects in our stack, such as Spark, Iceberg, Hadoop, Airflow, and many others Acting as an expert on Spark and Scala Mentoring engineers (including through pairing, design discussions, and knowledge-sharing sessions) and helping ...

mentality. You can take work beyond the analysis and get things done. Good to have: Experience in the Fintech domain Knowledge of utilities like Airflow/Github/DBT Experience with user-facing products and data Additional Information Some of our benefits: Base salary ...

mentality. You can take work beyond the analysis and get things done. Good to have: Experience in the Fintech domain Knowledge of utilities like Airflow/Github/DBT Experience with user-facing products and data Additional Information Some of our benefits: Base salary ...

reliability Contribute to the target architecture and long‐term platform direction Data Engineering & Delivery Design and build robust, scalable data pipelines (Snowflake, dbt, Airflow, ADF, Python) Apply strong practices in test‐driven development, monitoring, logging, and observability Own more complex technical solutions and problem‐solving Support production issues … Python, with hands‐on experience building data pipelines and transformations at scale Hands‐on experience with a modern cloud data stack, including Snowflake, dbt, Airflow, and Databricks, on a cloud platform (Azure preferred) Demonstrated experience delivering data lineage and traceability within a regulated environment (e.g. SOX, financial services, healthcare ...

estate is growing faster than our two-person data team can support. Our data platform runs on Google BigQuery, with dbt Core for transformation, Airflow 3 on Cloud Composer for orchestration, Airbyte and custom Python pipelines for ingestion, Terraform for infrastructure and GitHub Actions for CI/CD. Some … ingestion and integration – bring data into BigQuery from a varied source estate, including product databases, Contentful, HubSpot, Notion and LLM tracing tools, using Airflow, Airbyte and Python pipelines that fail loudly rather than silently. Run the data platform – operate orchestration, Terraform-managed infrastructure, containerised workloads ...

with data integrations and efficient data transfers. Knowledge of data modeling, data warehousing concepts, and query optimization techniques. Experience with distributed data processing using Apache Spark. Experience with Airflow for workflow orchestration, scheduling, and monitoring data pipelines. Cloud expertise, particularly AWS, including services such as S3, Glue, Athena ...

pragmatic engineering mindset focused on automation, reliability, and maintainable solutions. Preferred Qualifications Experience with Argo CD, Helm, or other GitOps tooling. Familiarity with Airflow, Snowflake, or Apache Iceberg. Experience with Apache Kafka or Amazon MSK. Experience with hybrid cloud, enterprise networking, or multi-account AWS environments. Experience ...

deploy Astronomer (Astro) within a leading asset management environment. The role focuses on leading build activities, owning deployment, and ensuring smooth operational pipelines with Airflow, dbt and Snowflake. The successful candidate will collaborate with the existing data engineering team, provide training, and establish best practices for pipeline development ...

account management Access management and access governance Strong understanding of security best practices Experience working within enterprise cloud environments Desirable Skills Cloud Composer/Airflow Dataflow Pub/Sub Terraform Python Policy Tags Data Classification Fivetran dbt Vulnerability management Role Breakdown IAM/RBAC/Access Management ...

Scala Play or other MVC/Rest API frameworks SQL AWS Suite Continuous Integration Agile methodologies Desirable: Containerisation principles/Docker Jenkins Kibana Grafana Airflow #J-18808-Ljbffr ...

support/SRE awareness * SC Security Clearance It would be an added advantage if you had any of the following: Jenkins/Kibana/Airflow/Docker/Containerisation/Grafana. Apply now for immediate interview! CBSbutler is operating and advertising as an Employment Agency for permanent positions ...

collaborate effectively with product, engineering and UX stakeholders Good communication skills and passion for knowledge sharing in a team environment Some exposure to Airflow, GitHub, and Jira in a collaborative environment (preferred not essential) Knowledge of programming languages – e.g. R, Python is a plus but not essential ...

harnessing, mounting and internal assembly, defining the interface requirements and constraints that keep electrical and mechanical designs coherent. Validate mechanical designs for electrical fit, airflow, thermal performance, manufacturability and secure-by-design alignment, and represent electrical, integration and security requirements in mechanical design reviews. Lead EMC design, EMC testing ...

Learning, or AI workloads. Experience with MLOps tooling such as MLflow, Kubeflow, Vertex AI, or similar technologies. Knowledge of workflow orchestration platforms such as Apache Airflow. Experience with data processing technologies such as Pandas, Apache Beam, Spark, or similar frameworks. Strong SQL skills and experience with analytical databases ...

develop. On the data pipeline side, we value awareness across both established tools such as SSIS/SSRS and newer approaches such as dbt, Airflow, or AWS Glue — dbt experience is essential, with the others a strong plus. Previous experience in working in cloud environments (AWS preferred … definite plus. Familiarity with legacy SSIS/SSRS, useful for maintaining existing packages, as well as newer orchestration/ingestion tools such as Airflow or AWS Glue. Exposure to cloud data warehouse/data fabric platforms such as Snowflake or Databricks. A good understanding of financial markets. Background ...

provenance. Hands‐on experience with data lineage/metadata tooling in enterprise environments (e.g., Collibra, Alation, Informatica EDC/IDMC, IBM Infosphere, Microsoft Purview, Apache Atlas, Amundsen, DataHub or similar). Proven ability to build lineage for complex platforms: data lakes, warehouses, marts, and distributed processing (Spark‐based pipelines … production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet. Advanced SQL skills; experience with Oracle databases is preferred. Working knowledge of Autosys & Apache Airflow. Experience with CI/CD tools (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift). Familiarity with AWS S3 for large-scale data storage. ...

What you'll do Design, build and operate scalable data pipelines, data models and end-to-end solution architectures on GCP (BigQuery, Python, dbt, Airflow, Dataform), balancing reliability, maintainability, performance and cost. Own technical delivery on your projects and accounts, from scoping to production: making the design decisions, managing … operating reliable data pipelines, data models and cloud platforms (GCP preferred, AWS or Azure also welcome), with transformation and orchestration tooling such as dbt, Airflow or Dataform. Strong software engineering practices: Git-based workflows, code review, automated testing and CI/CD. Hands-on experience building with LLMs (Gemini ...

lifecycle. What you’ll be doing Build and maintain ML pipelines for training, evaluation, and deployment using tools like Databricks, MLFlow, Airflow, DBT, Sagemaker, Tecton Support AI scientist creating reproducible, containerized model training environments (on-demand and scheduled), and manage compute at scale (e.g., spot/GPU autoscaling) Define … looking for Proven experience designing and deploying ML systems in production (5+ years in relevant roles) Proficiency in Python and SQL, and orchestration tools (Airflow, Kubeflow, Dagster, etc.) Experience with modern cloud platforms (preferably GCP or AWS), Kubernetes, and CI/CD workflows Understanding of ML model lifecycles: training ...

product and the company. Your Contribution Will Be The stack is modern: StarRocks as our primary analytical layer, Flink for processing, DBT for transformation, Airflow for orchestration and various tooling for surfacing insights. The hard work of making it genuinely reliable is still in front of us — and that …/lakehouse architecture patterns. Verbal and written fluency in English is required — we're a distributed team and written communication is important. Preferred Qualifications Airflow for orchestration. Experience with Apache Hudi. Experience with financial, transactional, or payment data. What We Offer at Yuno Competitive Compensation. Remote Work ...

bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than … Salesforce) and sales enablement platforms. Bonus Points If You Have: Experience selling to data teams, developers, or technical buyers. Background in data orchestration or Airflow-related technologies. Prior success in a startup or high-growth environment. The estimated OTE is up to £225,000 uncapped, along with a generous ...