351 to 375 of 458 Apache Airflow Jobs in England

PostgreSQL (or similar relational databases) and NoSQL databases. Experience with vector databases such as Qdrant, Milvus or pgvector . Familiarity with technologies such as Apache Spark, Airflow, Kafka, Elasticsearch/OpenSearch, Pandas and Polars . Strong understanding of data modelling, storage architecture and performance optimisation. Desirable Experience working ...

pragmatic engineering mindset focused on automation, reliability, and maintainable solutions. Preferred Qualifications Experience with Argo CD, Helm, or other GitOps tooling. Familiarity with Airflow, Snowflake, or Apache Iceberg. Experience with Apache Kafka or Amazon MSK. Experience with hybrid cloud, enterprise networking, or multi-account AWS environments. Experience ...

Skill Requirements:*** Strong experience in **Solution Architecture** and **Cloud-Native Architecture Design*** Hands-on expertise in **Snowflake Architecture*** Experience with **Data Lakehouse architectures**, including **Apache Iceberg*** Proficiency in designing and managing **S3-based Data Lakes*** Experience with **Apache Airflow/MWAA** for workflow orchestration* Strong knowledge … large-scale data processing* Ability to create **Architecture Design Documents (ADDs)*** Deep understanding of **cloud-native design patterns*** Experience in **performance tuning** across:* Snowflake* Airflow* Iceberg* Focus on **platform reliability, scalability, and observability*** Experience designing and operating **data platforms** in production environments #J-18808-Ljbffr ...

account management Access management and access governance Strong understanding of security best practices Experience working within enterprise cloud environments Desirable Skills Cloud Composer/Airflow Dataflow Pub/Sub Terraform Python Policy Tags Data Classification Fivetran dbt Vulnerability management Role Breakdown IAM/RBAC/Access Management ...

account management Access management and access governance Strong understanding of security best practices Experience working within enterprise cloud environments Desirable Skills Cloud Composer/Airflow Dataflow Pub/Sub Terraform Python Policy Tags Data Classification Fivetran dbt Vulnerability management Role Breakdown IAM/RBAC/Access Management ...

Scala Play or other MVC/Rest API frameworks SQL AWS Suite Continuous Integration Agile methodologies Desirable: Containerisation principles/Docker Jenkins Kibana Grafana Airflow #J-18808-Ljbffr ...

support/SRE awareness * SC Security Clearance It would be an added advantage if you had any of the following: Jenkins/Kibana/Airflow/Docker/Containerisation/Grafana. Apply now for immediate interview! CBSbutler is operating and advertising as an Employment Agency for permanent positions ...

technical direction and influencing engineering practices across teams; Hands-on experience with cloud ML platforms such as AWS SageMaker and orchestration tools such as Airflow and Step Functions; Strong communication skills and ability to collaborate across Data Science, Engineering, and Data Platforms; Comfortable operating at the boundary between experimentation ...

with product, engineering, and UX stakeholders Good communication skills and a passion for knowledge sharing in a team environment Nice to have: exposure to Airflow, GitHub, and Jira; knowledge of R or Python Условия Fixed-term contract for 12 months; No conditions specified. #J-18808-Ljbffr ...

codebase and pipelines Hands-on experience maintaining production ML models: refresh, retrain, monitor, and troubleshoot, rather than building from scratch Working knowledge of Looker, Airflow and Google Cloud Advanced degree in a quantitative discipline (Computer Science, Mathematics, Statistics, Physics, or similar), or equivalent experience Benefits Hybrid working (3 days ...

classification taxonomies. Working with model-derived inputs, understanding that NLP-generated exposures carry measurement error and revise over time. Task orchestration (Dagster or Airflow) and S3-based data flows. AWS fluency and CI/CD discipline. Competitive salary plus EMI share options 25 days holiday + bank holidays Private ...

methodsStrong experience with cloud environments, ideally Azure (Azure OpenAI, AI Foundry, AI Search)Competence in containerized deployments, CI/CD, and MLOps tooling (MLFlow, Airflow)Experience with Microsoft Agent Framework, Azure AI Agent ServiceKnowledge of vector databases (Pinecone, Weaviate, Qdrant, Milvus)Familiarity with guardrail and AI safety techniques (output ...

technologies Awareness of Site Reliability Engineering principles Experience restoring services during outage situations Desirable skills and experience Docker and containerisation principles Jenkins Kibana Grafana Airflow Desired behaviours Proactive and self-motivated User-centric mindset Evidence-driven decision making Strong collaboration and communication skills Comfortable with pairing, demonstrations and knowledge ...

coursework in financial engineering, or industry internshipsExperience developing in a production-facing environment and familiarity with standard concepts and tooling, e.g., CI/CD, Airflow“Friends of Voleon” Candidate Referral ProgramIf you have a great candidate in mind for this role and would like to have the potential ...

Scala Play or other MVC/Rest API frameworks SQL AWS Suite Continuous Integration Agile methodologies Desirable: Containerisation principles/Docker Jenkins Kibana Grafana Airflow If you receive suspicious outreach claiming to be from us, please contact us via the ManpowerGroup website. ...

Scala Play or other MVC/Rest API frameworks SQL AWS Suite Continuous Integration Agile methodologies Desirable: Containerisation principles/Docker Jenkins Kibana Grafana Airflow If you receive suspicious outreach claiming to be from us, please contact us via the ManpowerGroup website. ...

collaborate effectively with product, engineering and UX stakeholders Good communication skills and passion for knowledge sharing in a team environment Some exposure to Airflow, GitHub, and Jira in a collaborative environment (preferred not essential) Knowledge of programming languages – e.g. R, Python is a plus but not essential ...

integrate machine-learned graphics subsystems into the simulation platform Implement production quality software in Python About you Essential Experience with workflow orchestration systems (e.g. Airflow, Dagster, Flyte, etc.) and/or developing data intensive applications Excellent development skills in Python Deep knowledge of Kubernetes at the user level Good ...

harnessing, mounting and internal assembly, defining the interface requirements and constraints that keep electrical and mechanical designs coherent. Validate mechanical designs for electrical fit, airflow, thermal performance, manufacturability and secure-by-design alignment, and represent electrical, integration and security requirements in mechanical design reviews. Lead EMC design, EMC testing ...

Learning, or AI workloads. Experience with MLOps tooling such as MLflow, Kubeflow, Vertex AI, or similar technologies. Knowledge of workflow orchestration platforms such as Apache Airflow. Experience with data processing technologies such as Pandas, Apache Beam, Spark, or similar frameworks. Strong SQL skills and experience with analytical databases ...

Databricks REST APIs, Prometheus, or Azure Monitor. Maintain best practices for data engineering performance, testing, and documentation. Technical Skills Required Strong proficiency with Databricks, Apache Spark (SQL, PySpark, Scala), and Delta Lake. Deep understanding of Spark execution plans, shuffle optimization, and data partitioning strategies. Experience tuning job configurations (e.g. … memory management, parallelism, caching, adaptive query execution). Familiarity with orchestration tools: Databricks Workflows, Airflow, or Azure Data Factory. Proficiency in Python or Scala for data engineering and pipeline development. Hands-on experience with Azure, AWS, or multi-cloud Databricks deployments. Knowledge of data storage layers (Azure Data Lake ...

cost efficiency, scalability, and reliabilityContribute to the target architecture and long-term platform directionData Engineering & DeliveryDesign and build robust, scalable data pipelines (Snowflake, dbt, Airflow, ADF, Python)Apply strong practices in test-driven development, monitoring, logging, and observabilityOwn more complex technical solutions and problem-solvingSupport production issues and drive … Python, with hands-on experience building data pipelines and transformations at scaleHands-on experience with a modern cloud data stack, including Snowflake, dbt, Airflow, and Databricks, on a cloud platform (Azure preferred)Demonstrated experience delivering data lineage and traceability within a regulated environment (e.g. SOX, financial services, healthcare ...

develop. On the data pipeline side, we value awareness across both established tools such as SSIS/SSRS and newer approaches such as dbt, Airflow, or AWS Glue — dbt experience is essential, with the others a strong plus. Previous experience in working in cloud environments (AWS preferred … definite plus. Familiarity with legacy SSIS/SSRS, useful for maintaining existing packages, as well as newer orchestration/ingestion tools such as Airflow or AWS Glue. Exposure to cloud data warehouse/data fabric platforms such as Snowflake or Databricks. A good understanding of financial markets. Background ...

provenance. Hands‐on experience with data lineage/metadata tooling in enterprise environments (e.g., Collibra, Alation, Informatica EDC/IDMC, IBM Infosphere, Microsoft Purview, Apache Atlas, Amundsen, DataHub or similar). Proven ability to build lineage for complex platforms: data lakes, warehouses, marts, and distributed processing (Spark‐based pipelines … production environments. Solid knowledge of Hive, Impala, HDFS, and Parquet. Advanced SQL skills; experience with Oracle databases is preferred. Working knowledge of Autosys & Apache Airflow. Experience with CI/CD tools (Git, Harness, UrbanCode Deploy (UCD), Red Hat OpenShift). Familiarity with AWS S3 for large-scale data storage. ...

critical dashboards, enable self-service analytics, and fuel advanced machine learning models and real-time data products. Working with tools like DBT, Spark, and Airflow, you'll transform high volume raw event data into user-friendly, high impact datasets that support machine learning use cases across the business. … Comfort with data modelling and building efficient data marts and warehouses in the cloud. Experience building data pipelines using tools such as Spark and Airflow, or similar technologies, within a cloud environment such as AWS.Familiarity with both real-time and batch data workloads, along with modern data transformation ...