51 to 75 of 75 Remote Apache Airflow Jobs

search, and Generative AI architectures. Practical experience using Hugging Face, OpenAI, LangChain, Retrieval Augmented Generation, and diffusion models. Strong MLOps experience including MLflow, Kubeflow, Airflow, Docker, Kubernetes, and CI and CD tooling. Strong programming skills in Python. Bash, SQL, and JavaScript are desirable. Proven experience working with large, complex ...

stacks Proficiency in Python and SQL; additional experience with other languages is a plus Experience working with tools and frameworks such as Spark, Kafka, Airflow, MLflow, TensorFlow, PyTorch, Scikit-learn, etc. Excellent communication and interpersonal skills; ability to work with both technical and business stakeholders. Strong command of German ...

stacks Proficiency in Python and SQL; additional experience with other languages is a plus Experience working with tools and frameworks such as Spark, Kafka, Airflow, MLflow, TensorFlow, PyTorch, Scikit-learn, etc. Excellent communication and interpersonal skills; ability to work with both technical and business stakeholders. Strong command of English ...

Principal Data Engineer: Experience as a lead or principal data engineer. Prior experience designing data platform(s) within GCP, working hands on with; Airflow, Big Query, Data Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously ...

Principal Data Engineer: Experience as a lead or principal data engineer. Prior experience designing data platform(s) within GCP, working hands on with; Airflow, Big Query, Data Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously ...

Strong skills in Python, Spark, SQL and experience with SQL databases. Terraform experience for cloud infrastructure as code. Experience with Azure and workflow tools (Airflow, ADF). Excellent problem-solving ability, communication skills, and attention to detail. Experience across Waterfall and Agile methodologies. Curious, inclusive, and committed to continuous ...

Have) Exposure to large language models (LLMs) or foundational model adaptation. Previous work in cybersecurity, anomaly detection, or behavioural analytics. Familiarity with orchestration frameworks (Airflow or similar). Experience with scalable ML systems, pipelines, or real-time data processing. Advanced degree or equivalent experience in ML/AI research ...

solutions end-to-end Experience working with large datasets and complex data ecosystems Familiarity with modern data platforms and tools (e.g., Snowflake, dbt, GCP, Airflow) is a plus, but not a requirement Strong analytical and problem-solving skills, with a keen eye for detail and data quality Excellent communication ...

management. Requirements for the Principal Data Engineer: Experience as a lead or principal data engineer. Prior experience designing data platform(s) within GCP, across Airflow, Big Query, Data Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh design and Data Lake/Warehouse solutions. Previously led teams ...

testable systems Solid background in microservices architecture Proficiency with Postgres & MongoDB (relational + non-relational) Experience with event-driven architectures and asynchronous workflows (Kafka, Airflow, etc.) Solid coding practices (clean, testable, automated) The mindset of a builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus ...

operate effectively in a fast-paced, scaling organisation. Excellent communication skills and a collaborative approach. Desirable Skills Experience with analytics engineering tools (e.g., dbt, Airflow). Familiarity with experimentation frameworks and A/B testing platforms. Exposure to cloud-based data environments (e.g., Google Cloud Platform). Experience within ...

Adobe Analytics, GTM and Adobe Dynamic Tag Manager) changes. Integrate data sources via web and REST APIs. Data pipping and modelling using SQL, DBT, Airflow, ETL, Data Warehousing, Redshift and Python. Transfer knowledge of the business processes and requirements to the development teams. Collaborate with Product, Marketing and Development ...

What We're Looking For Significant experience with Databricks (including Unity Catalog) Strong skills in Python, Spark, SQL Cloud expertise Knowledge of pipeline tools (Airflow, ADF) Leadership and problem-solving ability Ready to take the next step? Apply now and join us as our Senior Databricks Engineer ...

experienced team members and fostering a culture of knowledge sharing Communicating clearly and effectively with diverse technical and non-technical audiences Tech stack Python , Airflow , Terraform Azure (but open to other cloud experience) DBT (nice to have) Exposure to ML pipelines beneficial ...

testable systems Solid background in microservices architecture Proficiency with Postgres & MongoDB (relational + non-relational) Experience with event-driven architectures and asynchronous workflows (Kafka, Airflow, etc.) Solid coding practices (clean, testable, automated) The mindset of a builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus ...

Build and optimise scalable data pipelines for a new Data Lake Work with Python, SQL, Spark, AWS, Docker, CI/CD Orchestrate workflows using Airflow, Prefect, or Dagster Support ETL, API integrations, and high-quality data validation Translate business needs into technical solutions with full ownership What You Need … engineering/analytics/software Strong Python + SQL 2+ years ETL, APIs, CI/CD, Docker, AWS Ideally but not essential experience with Airflow/Prefect/Dagster Background in Financial Services, FinTech, Insurance, PE/VC, or Banking Package & Benefits High performance bonus 25 days holiday Pension ...

right individual. You will play a pivotal role in evolving the company's data stack, working with modern tools such as DBT and Airflow, and developing scalable, high-quality data pipelines and infrastructure. Key Responsibilities: Lead the evolution of the company's data stack, with a focus on automation … managing complex data estates and developing automated data pipelines. Good understanding of testing principles and deployment processes. Experience with technologies such as Redshift, Airflow, DBT, and AWS. Strong grasp of data modelling, database architecture, and governance principles. Hands-on experience with Git and modern development workflows. Excellent problem-solving ...

Nice-to-Have Skills: Experience with GCP/BigQuery or other cloud data warehouses (e.g., Snowflake, Redshift). Familiarity with data orchestration tools (e.g., Airflow). Experience with data visualisation platforms (such as Preset.io/Apache Superset or other). Exposure to CI/CD pipelines, ideally using ...

Nice-to-Have Skills: ·Experience with GCP/BigQuery or other cloud data warehouses (e.g., Snowflake, Redshift). ·Familiarity with data orchestration tools (e.g., Airflow). ·Experience with data visualisation platforms (such as Preset.io/Apache Superset or other). ·Exposure to CI/CD pipelines, ideally using ...

access controls, including RBAC, SSO, token policies, and pseudonymisation frameworks.Develop resilient data flows for both batch and streaming workloads using technologies such as Kafka, Airflow, DBT, and Terraform.Shape data strategy and standards by contributing to architectural decisions, authoring ADRs, and participating in reviews, data councils, and platform enablement initiatives.QualificationsWhat … cloud-native data infrastructures (Databricks, Snowflake) especially in AWS environments is a plusExperience in building and maintaining batch and streaming data pipelines using Kafka, Airflow, or SparkFamiliarity with governance frameworks, access controls (RBAC), and implementation of pseudonymisation and retention policiesExposure to enabling GenAI and ML workloads by preparing model ...

access controls, including RBAC, SSO, token policies, and pseudonymisation frameworks.Develop resilient data flows for both batch and streaming workloads using technologies such as Kafka, Airflow, DBT, and Terraform.Shape data strategy and standards by contributing to architectural decisions, authoring ADRs, and participating in reviews, data councils, and platform enablement initiatives.QualificationsWhat … cloud-native data infrastructures (Databricks, Snowflake) especially in AWS environments is a plusExperience in building and maintaining batch and streaming data pipelines using Kafka, Airflow, or SparkFamiliarity with governance frameworks, access controls (RBAC), and implementation of pseudonymisation and retention policiesExposure to enabling GenAI and ML workloads by preparing model ...

scale. In this role, you will: Build robust ML and MLOps pipelines for scalable, reproducible model development, deployment, and monitoring. Use tools such as Airflow for workflow orchestration and MLflow for experiment tracking, model registry, and lifecycle management. Work within an agile development environment and help prioritise high-value … development skills Hands-on experience developing ML and/or deep learning models for scientific or engineering problems Experience with MLOps tools such as Airflow, MLflow, and containerisation (e.g., Docker) Strong data-visualisation and storytelling skills Interest in materials discovery, computer vision, big data, or optimisation Collaborative communicator, organised ...

Data Engineer Location: London (Hybrid - 3 Days in Office) Salary: £75,000 Be the backbone of dynamic pricing and cloud-driven insights, where your expertise turns data into a competitive edge. The Opportunity This is ...

Senior Data Analytics Manager l Analytics l omni l tableau l looker l dbt l airflow l leadership l Start up l Stakeholder management l £600 PD l Outside IR35 l 3 months l London - hybrid We're looking for a hands-on Analytics Lead to jump … Omni Experimentation and statistical analysis experience Hands-on Python or R Good understanding of analytics pipelines and ETL Bonus points if you have Airflow or DBT experience Contract: Outside IR35 Remote with office visits as and when required in London £600 per day 3 months initial with potential ...

Design, develop, debug, and optimize end-to-end (E2E) data analytics systems by performing data sourcing, data ingestion, Extract, Transform and Load (ETL) processes, and semantic layer building. Develop/validate E2E pipelines and analyze ...