326 to 350 of 477 Apache Airflow Jobs in the UK

years of experience working in version control environments such as GitLab or GitHub; Have 2+ years of experience with job orchestration tools such as Apache Airflow as both a pipeline developer and reviewer; Have 2+ years of experience with data ingestion and transformation frameworks such as dbt, Fivetran ...

infrastructure. Well versed and proven experience in programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Longstanding experience ...

infrastructure. Well versed and proven experiencein programming languages such as Python, Java, or C++. Experience with data pipeline and workflow management tools (e.g., Apache Airflow, Kubeflow). Strong problem-solving skills and ability to work in a fast-paced environment. Excellent communication and collaboration skills. Longstanding experience ...

join our Data Engineering team in the UK. You will build and govern data infrastructure powering our platforms, using Python ingestion pipelines, Airflow orchestration, and Snowflake/Databricks to move data securely from source to decision-ready output. You will implement end-to-end ingestion sources, investigate ...

analytics and governance while promoting self-service insights for business users. Key skills include data lakehouse design (Iceberg), AWS/Azure data services, dbt, Airflow, and BI/dashboard experience. The role emphasizes automation, quality, and collaboration with architects. #J-18808-Ljbffr ...

platform products at scale Excellent written and verbal communication; comfortable engaging directly with clients Right to work in the UK Required skills Snowflake dbt Airflow Python Benefits at SREEYAMSOFT Top‐of‐market pay with annual reviews and performance bonuses. £2,000/year for certifications, conferences and learning. Modern ...

Product-oriented approach focused on production outcomes; Comfortable owning ambiguity and making trade-offs; English; Nice to have: workflow orchestration tools such as Temporal, Airflow, or Step Functions; experience building internal tools or agents; familiarity with regulated or enterprise environments; exposure to MLOps or AI evaluation frameworks. Условия: Hybrid ...

improve platform reliability. Required Skills & Qualifications: Extensive hands-on experience with Google Cloud Platform , including BigQuery , GCS , IAM , and Kubernetes . Proficiency in Python, Airflow, dbt, and familiarity with Terraform and CI/CD pipelines. Experience with data governance tools like Alation , Fivetran , and Tableau . Strong understanding ...

production Solid software engineering skills (Python, APIs, systems) Good understanding of MLOps stack (CI/CD, monitoring, pipelines) Familiarity with tools like MLflow, Airflow, Evidently, DVC, Docker, Kubernetes. Cloud experience (AWS/GCP/Azure) Some mentoring/leadership experience + desire to grow into management Nice to have ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

diligence work. Experience with MLOps or model lifecycle tooling such as MLflow, model registries, or feature stores. Experience with workflow orchestration tools such as Airflow, dbt, or Databricks Workflows. Experience with data product or data mesh operating models. Knowledge of European banking or EU regulatory frameworks. Experience with Teradata ...

results post-migration (before/after comparison) -Release management — experience managing releases in an enterprise environment Nice to have - Experience with other orchestration tools (Airflow, AWS Glue Workflows) - AWS certification (Solutions Architect/DevOps Engineer) - Knowledge of AWS Lambda, EventBridge (commonly used- alongside Step Functions) - Experience in financial domain ...

results post-migration (before/after comparison) Release management — experience managing releases in an enterprise environment Nice to have Experience with other orchestration tools (Airflow, AWS Glue Workflows) AWS certification (Solutions Architect/DevOps Engineer) Knowledge of AWS Lambda, EventBridge (commonly used alongside Step Functions) Experience in financial domain ...

integration and deployment Experience supporting production systems Experience with any of the following: gRPC microservices, Postgres, Pandas, Golang, R, Git, Jenkins, Bazel, Prometheus, Grafana, Airflow, Kubernetes Equal Opportunity EmployerThe the company Group is an Equal Opportunity employer. Applicants are considered without regard to race, color, religion, creed, national origin ...

happens next. Technical Mastery: You bring expert-level SQL skills and are fully comfortable building and maintaining your own robust data pipelines using dbt, Airflow, and Snowflake. Beyond querying, you use Python for advanced automation and forecasting, and you apply statistical rigor (e.g., Bayesian statistics, causal inference) to solve ...

narratives Entrepreneurial mentality: You can take work beyond the analysis and drive outcomes. Useful additional experience: Experience in Fintech domain Knowledge of utilities like Airflow/Github/DBT Experience with user-facing products and data Please note: we are not able to offer visa sponsorship for this role ...

creating stakeholder‐ready visualizations and narratives Ability to connect insights to business outcomes and influence strategy Familiarity with modern data platforms (e.g., Spark, Snowflake, Airflow) and ML Ops tooling Passion for fostering inclusive team environments and valuing diverse perspectives Clear communicator who can translate complex technical concepts into actionable ...

focused on what works in production. Comfortable owning ambiguity and making trade-overs. Languages: English A plus, but not required: workflow orchestration tools (Temporal, Airflow, Step Functions); experience building internal tools or agents; familiarity with regulated or enterprise environments; exposure to MLOps or AI evaluation frameworks. Why Planet Planet ...

will include Design, build and maintain robust, scalable data pipelines that support data science workflows and advanced analytics use cases Develop and manage complex Airflow orchestration, ensuring pipelines are reliable, observable and maintainable Work hands-on with Databricks suite to deliver high-quality data engineering solutions for data science ...

understanding of data pipelines, databases and warehouses Experience reconciling data from multiple, heterogeneous sources Hands-on experience with orchestration and transformation tools such as Airflow, Dagster or dbt Familiarity with columnar data systems such as ClickHouse or DuckDB Experience with distributed systems and third-party integrations A pragmatic mindset ...

such as DDP or FSDP. Experience with observability tools such as Prometheus, Grafana, Datadog, or OpenTelemetry. Experience with data pipeline orchestration tools such as Airflow, Flyte, Ray, Metaflow, or Argo Workflows. Experience with containerisation and infrastructure tooling such as Docker, Kubernetes, or Terraform.Experience profiling or optimising ML systems ...

schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client …/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving ...

data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar). Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.). Strong understanding of data quality, security … with business and technical stakeholders. Preferred qualifications, capabilities, and skills Knowledge of regulatory reporting and financial data aggregation techniques. Experience with data orchestration tools (Airflow, Step Functions, etc.). Databricks or AWS certifications. Demonstrated proficiency in cloud-native development (e.g., cloud, artificial intelligence, machine learning). Experience with Parquet ...

data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience with data lake platforms (Databricks, Apache Spark, or similar). Experience with AWS cloud services (S3, ECS, SNS/SQS, Lambda, etc.). Strong understanding of data quality, security … with business and technical stakeholders. Preferred qualifications, capabilities, and skills Knowledge of regulatory reporting and financial data aggregation techniques. Experience with data orchestration tools (Airflow, Step Functions, etc.). Databricks or AWS certifications. Demonstrated proficiency in cloud-native development (e.g., cloud, artificial intelligence, machine learning). Experience with Parquet ...

Senior Data Platform Engineer | Data Platform | Python | Databricks Location: UK Remote Salary: Up to £100,000 + 10% Bonus + Equity Python | Databricks | Airflow | dbt | AWS | Data Platform | Kafka | Spark | Terraform I'm currently looking for a Senior Data Platform Engineer to join a global consumer technology marketplace used … What You'll Bring Strong Python (or Scala) engineering experience with excellent software engineering fundamentals Hands-on experience with modern data platforms including Databricks, Airflow and dbt Strong cloud experience (AWS preferred, GCP/Azure also considered) Experience building and scaling production-grade data platforms and backend infrastructure Knowledge ...