76 to 100 of 377 Apache Airflow Jobs in England

certifications are a plus!). Containerization: Familiarity with Docker or the concept of containerized applications. Data Tools: Exposure to any data processing tools like Airflow, Kafka, or Spark. Infrastructure as Code: A desire to learn tools like Terraform/Terragrunt. Financial Tech Interest: An interest in Open Banking ...

experience you need Strong experience in Data Engineering and cloud-based data platforms. Hands-on knowledge of Databricks, Spark, SQL and Python. Understanding of Airflow, Terraform and modern engineering practices. Experience building large-scale batch and real-time data pipelines. Strong problem-solving and decision-making skills. Ability ...

relational databases (e.g., PostgreSQL, DuckDB). Experience with the modern data stack, building data ingestion pipelines and working with ETL and orchestration tools (e.g., Airflow, Luigi, Argo, dbt), big data technologies (Spark, Kafka, Parquet), and web frameworks for model serving (e.g. Flask or FastAPI). Data Science: Familiarity ...

safe to challenge ideas, learn, and grow. Nice to have Hands-on familiarity with the modern data stack — for example, Spark, Flink, Kafka, Debezium, Airflow, dbt, or similar — and with cloud platforms (AWS/GCP or equivalent) and modern DevOps practices. Experience leading teams that built data platforms used ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern ...

writing automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern ...

time Qualifications & Technical Skills Proficiency in SQL and experience with relational databases (e.g. MySQL, PostgreSQL) Experience with data pipeline and workflow management tools (e.g. Apache Airflow) Familiarity with programming languages such as Python, Java, or Scala Basic understanding of cloud platforms and services (e.g. AWS, Azure, Google Cloud ...

similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written and verbal English skills ...

workflows Skills and experience: Passionfor building scalable, resilient cloud data platforms Strongexperience with Databricks or Snowflake on AWS ProvenPython skills, including Spark and Airflow expertise AdvancedSQL skills and end‐to‐end data modelling experience Experiencebuilding batch and real-time data integrations Hands-onCICD skills with Git, Jenkins or similar ...

Strong Python and SQL skills, with experience building production-grade data pipelines Data Platform Experience: Hands-on experience with modern data tools (e.g. Snowflake, Airflow, dbt) and cloud environments (preferably AWS) Engineering Best Practice: Knowledge of CI/CD, testing, version control and infrastructure as code Data Quality & Governance ...

version control R experience is mandatory for this role. Desirable experience MySQL Python Docker and containerisation CI/CD pipelines Terraform or CloudFormation Airflow, AWS Step Functions or other workflow orchestration tools Building APIs or packaging models in R, such as plumber or R packages SaaS or software product ...

marketing teams to align data solutions with business needs Requirements Strong SQL skills and experience with ETL/ELT and pipeline orchestration tools (e.g., Airflow, dbt, Data Factory) Experience with cloud data platforms (e.g., Azure, AWS, or GCP) Proficiency in data modelling (dimensional, entity-relationship, event-driven) Understanding ...

with data pipelines, ELT workflows, and contemporary cloud data architectures.Experience with current cloud data platforms such as Snowflake, Azure Data Lake, Azure SQL, dbt, Airflow, or similar tools.Ability to understand and work with SQL queries and data models.Knowledge of data governance, privacy, security, regulatory reporting, and responsible data ...

programming experience with Python/PySpark along with proficiency in SQL. Extensive experience working with ETL and ELT frameworks and orchestration tools such as Airflow and dbt. Experience building robust data models on cloud platforms such as Databricks on Azure and implementing automated data quality frameworks and related controls. ...

/T‐SQL with proven experience refactoring and optimising complex logic Hands‐on experience with cloud data warehouses (e.g. BigQuery, Snowflake), ingestion tools (Airflow, Airbyte), and analytics tooling such as dbt and Power BI Strong working knowledge of Git/version control, CI/CD pipelines, and Python ...

analyse large datasets and communicate insights effectively. Experience with LLMs, generative AI, and prompt engineering. Knowledge of MLOps tools and frameworks (MLflow, Kubeflow, Airflow). Familiarity with SQL, NoSQL, and distributed data technologies. Experience deploying AI models in production environments. Publications, patents, or open-source contributions in ML/ ...

technical roadmap for data engineering across Elliptic. Leverage and deploy AI and agentic systems to operate more effectively. Tech environment Scala | Spark | Databricks | AWS | Airflow | Kubernetes | Terraform | Functional Programming You will thrive here if you Enjoy end‐to‐end ownership, from writing the code to architecture design to coaching ...

relational databases (e.g., PostgreSQL, DuckDB). Experience with the modern data stack, building data ingestion pipelines and working with ETL and orchestration tools (e.g., Airflow, Luigi, Argo, dbt), big data technologies (Spark, Kafka, Parquet), and web frameworks for model serving (e.g. Flask or FastAPI). Data Science: Familiarity ...

coupled with rigorous validation of code, data transformations and analytical conclusions. Desirable Skills and Experience Experience with Azure Data Lake, Azure Data Factory, dbt, Airflow, MLflow, Power BI, Microsoft Purview or comparable tools. Experience with search indexes, vector databases, graph databases, knowledge graphs, ontologies or master-data-management techniques. ...

data warehouse. You can expect to work with the following tech stack: BigQuery, Python, HubSpot, Zuora, and Vitally plus dbt, Fivetran/Census, or Airflow depending on your background. What you bring You’ll thrive in this role if you have: Proven experience building and maintaining production data pipelines ...

days a week in client office, 3 days remote)Job Type :Permanent, Contract, FTCJob Description:Mandatory Skillsets: Python, Snowflake, dBT, dremio, glue jobs, Apache iceberg, AWS ,SQLKey Responsibilities:Architect and Develop: Contribute to the platforms architectural design and build integration, modelling, data persistence, and analytical systems.Data Pipelines: Implement, maintain … Java.Cloud Expertise: Strong understanding of AWS services (e.g., Lambda, Step Functions, ECS).Data Platforms: Hands-on experience with Snowflake and data stack technologies like Apache Iceberg and Spark.Workflow Orchestration: Exposure to tools like Apache Airflow, Prefect, Dagster, or DBT.Data Services: Familiarity with AWS Glue, Lake Formation ...

pipelines and data quality frameworks (rules, thresholds, exception handling). Working knowledge of scheduling/orchestration tools such as Autosys and/or Apache Airflow (monitoring schedules, reruns, failure triage). Experience with CI/CD and release controls (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift ...

Oracle databases. Experience designing and supporting ETL/ELT pipelines and data quality frameworks (rules, thresholds, exception handling). Working knowledge of Autosys and Apache Airflow (monitoring schedules, reruns, failure triage). Experience with CI/CD and release controls (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift ...

Computer Science or equivalent practical experience Experience developing finance applications is a plus Working experience with Terraform is a plus Experience creating workflows for Apache Airflow is a plus #J-18808-Ljbffr ...