Argo Workflows Metrics Quick Fix - Prometheus Monitoring

Argo Workflows exposes Prometheus metrics for monitoring workflow execution. Misconfigured metrics or missing annotations prevent monitoring integration. This guide covers the fix.

Quick Fix

Wrong

metrics:
  prometheus:
  - name: workflow_duration_seconds
    help: "Duration of workflow"

The issue: missing counter or gauge type definition, no labels for filtering, and no metricScope to distinguish between workflow and step-level metrics.

Right

metrics:
  prometheus:
  - name: workflow_duration_seconds
    help: "Duration of workflow in seconds"
    gauge:
      value: "{{workflow.duration}}"
    labels:
    - key: name
      value: "{{workflow.name}}"
    - key: status
      value: "{{workflow.status}}"

# Expected output after applying the fix
# Prometheus metric: argo_workflows_workflow_duration_seconds
# Labels: name="my-workflow", status="Succeeded"
# Value: 123.45 (seconds)
# Available at /metrics endpoint on argo-server

Prevention

• Always specify metric type (gauge, counter, histogram)
• Add meaningful labels for metric filtering and aggregation
• Use {{workflow.*}} and {{steps.*}} variables for metric values
• Verify metrics at argo-server:2746/metrics
• Use metricScope: Step for step-level metrics instead of workflow-level

DodaTech Tools

Doda Browser's metrics dashboard visualizes Argo workflow metrics with Grafana. DodaZIP archives metric configurations for monitoring setup. Durga Antivirus Pro monitors metric anomalies for incident detection.

FAQ