201 to 225 of 475 Apache Airflow Jobs in the UK

languages and database querying languagesExperience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal)Proficiency in automation, continuous delivery methods, and all aspects of the Software Development Life CycleAdvanced understanding of agile methodologies, CI/CD, application ...

practical experience. Preferred Skills Experience with gradient‐boosted tree models, neural networks, and optimization solvers in production. Familiarity with data orchestration tools (e.g., Prefect, Airflow, dbt) and modern data lake architectures. Experience working closely with data scientists to operationalize research code. Multi‐cloud experience across AWS, GCP, and Azure. ...

degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience. Preferred Skills Experience with data orchestration tools (e.g., Prefect, Airflow, dbt). Familiarity with MLOps tooling such as MLflow, or experience supporting ML workloads in production. Exposure to LLM or agentic application patterns ...

database querying languages Experience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal) Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, code review, test acceleration ...

technologies and practices such as Docker, Terraform, CI/CD pipelines and infrastructure‐as‐code. Familiarity with MLOps tools and practices such as MLflow, Airflow, model monitoring, API monitoring, data validation, data drift detection, autoscaling and access management. Strong Python experience, with helpful knowledge of Spark or PySpark ...

delivery (CI/CD) pipelines, containerisation, and workflow orchestration. Familiar with ETL/ELT frameworks, and experienced with Big Data Processing Tools (e.g. Spark, Airflow, Hive, etc.) Knowledge of programming languages (e.g. Java, Python, SQL) Hands-on experience with SQL/NoSQL database design. Degree in STEM, or similar ...

delivery (CI/CD) pipelines, containerisation, and workflow orchestration. Familiar with ETL/ELT frameworks, and experienced with Big Data Processing Tools (e.g. Spark, Airflow, Hive, etc.) Knowledge of programming languages (e.g. Java, Python, SQL) Hands-on experience with SQL/NoSQL database design. Degree in STEM, or similar ...

delivery (CI/CD) pipelines, containerisation, and workflow orchestration. Familiar with ETL/ELT frameworks, and experienced with Big Data Processing Tools (e.g. Spark, Airflow, Hive, etc.)Knowledge of programming languages (e.g. Java, Python, SQL)Hands-on experience with SQL/NoSQL database design. Degree in STEM, or similar ...

metrics layers. Experience applying AI to Analytics Engineering workflows or developing AI-ready data products. Knowledge of orchestration and ingestion tools such as Airflow,DagsterorFivetran. Python experience for automation or data engineering tasks. Experience working in regulated financial services or another highly data-driven organisation. Snowflake experience, given ...

implementation of modern data architectures and concepts such as cloud services (e.g., AWS, Azure, GCP), real-time data distribution (e.g., Kafka, Kinesis, DataFlow, Airflow), NoSQL (e.g., MongoDB, DynamoDB, HBase, CosmosDB), GraphQL and modern data warehouse tools including Snowflake and DataBricksAbility to think strategically and relate architectural decisions and recommendations ...

implementation of modern data architectures and concepts such as cloud services (e.g., AWS, Azure, GCP), real-time data distribution (e.g., Kafka, Kinesis, DataFlow, Airflow), NoSQL (e.g., MongoDB, DynamoDB, HBase, CosmosDB), GraphQL and modern data warehouse tools including Snowflake and DataBricksAbility to think strategically and relate architectural decisions and recommendations ...

lake, lakehouse, warehouse or large-scale analytical platform delivery. • Python, Bash or other scripting and automation approaches. • Workflow orchestration and scheduling tools, such as Airflow, TWS, JS7 or similar. • CI/CD, version control and modern engineering delivery practices. • Data quality, testing, observability and operational resilience. • Working with enterprise ...

models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools andtechnologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such asrelational, non-relational, or cloud-based. Working collaboratively with the client …/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving ...

will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop, and implement data warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations.We are looking … relational or analytical storage technologies. Examples include Kafka, Spark, PostgreSQL.* **Orchestration** Experience defining and running data workflows using modern orchestration frameworks. Examples include Airflow, Dagster or Prefect.* **Data Quality and Lineage** Familiarity with tools and techniques for data testing, documentation and lineage. Examples include Great Expectations or dbt. ...

data platform. You'll play a key role in building and optimising scalable data pipelines and analytics solutions, working across AWS, Snowflake, dbt and Airflow to deliver high-quality data products. The Company They are a well-established media organisation with a large and diverse audience, using data … models. Your Skills & Experience Strong experience with SQL and modern data engineering practices. Hands-on experience with Snowflake and dbt. Strong experience working with Apache Airflow for data orchestration. Experience working with AWS data services and cloud-based data platforms. Strong Python skills for data engineering and pipeline ...

data engineer to design, build, and support scalable data pipelines powering Moody’s next‐generation digital content platform. You will work with DataBricks, Snowflake, Apache Airflow, dbt (SQL), and Python within AWS, collaborating with cross‐functional partners to deliver reliable data solutions and continuously improve platform performance ...

such as customer lifetime value, attribution modelling, real-time bidding, and audience targeting is a plus Familiarity with data pipeline orchestration tools such as Apache Airflow and Kubernetes is a plus You do your best work as part of a team and enjoy sharing knowledge just as much ...

seeking a data engineer to design, build, and scale data pipelines powering its next-generation digital content platform. You’ll work with DataBricks, Snowflake, Airflow, dbt (SQL), and Python within AWS to deliver robust data solutions. Join a collaborative team and contribute to platform optimization, governance, and scalable architectures ...

pipelines, mentor engineers, and align data solutions with business goals. You will work with SQL, Python and cloud-native tools like Databricks, Snowflake, and Airflow, shaping data governance and CI/CD practices while collaborating with analysts, architects and stakeholders. #J-18808-Ljbffr ...

teams across multiple brands. Ideal candidates have 5+ years in data engineering, strong SQL and data modelling, and experience with dbt, Spark, Airflow, AWS, Kafka or Flink. #J-18808-Ljbffr ...

code Requirements: Must have strong, commercial AWS (contract) Data Engineering experience Must bring solid knowledge of data warehousing and modelling Experience with Airflow and infrastructure as a code (Terraform, CloudFormation) would be beneficial Must have experience with Redshift Nice to have: Experience with dbt/lake formation ...

code Requirements: - Must have strong, commercial AWS (contract) Data Engineering experience - Must bring solid knowledge of data warehousing and modelling - Experience with Airflow and infrastructure as a code (Terraform, CloudFormation) would be beneficial - Must have experience with Redshift Nice to have: - Experience with dbt/lake formation ...

isolation Experience with CI/CD, databases, infra-as-code Comfortable debugging production systems Nice to Have Security/compliance (SOC2, HIPAA) Exposure to AirFlow and MLFlow for scientific workflows MSC/PHD in Machine Learning Biotech/pharma experience Why Helical Live with top pharma High ownership, small ...

FastAPI) a huge plus; Experience in Kubernetes, Docker, Spark and related monitoring tools (e.g. DataDog, Grafana, Prometheus) for DataOps a huge plus; Experience with Airflow a huge plus; Experience with dbt for pipeline modelling also beneficial; Skilled at shaping needs into a solid set of requirements and designing scalable ...

ensure data accuracy and reliability. Required Technical SkillsStrong proficiency in Python. Experience with monitoring and observability tools. Hands-on experience with workflow orchestration tools - Apache Airflow. Familiarity with data pipelines and ETL processes. Proficiency with containerization and orchestration technologies - Docker, KubernetesStrong understanding of CI/CD pipelines and toolsStrong ...