torc 0.22.2

Workflow management system
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68

# How to View Resource Utilization Plots

Generate interactive visualizations of CPU and memory usage over time.

## Prerequisites

Enable time series monitoring in your workflow specification:

```yaml
resource_monitor:
  granularity: "time_series"
  sample_interval_seconds: 2
```

This creates a SQLite database with resource samples at regular intervals.

## Generate Plots

After your workflow completes, generate plots from the collected data:

```bash
torc plot-resources output/resource_utilization/resource_metrics_*.db -o plots/
```

This creates:

- **Individual job plots** — CPU, memory, and process count over time for each job
- **Overview plots** — Comparison across all jobs
- **Summary dashboard** — Bar charts of peak and average usage

## Plot Specific Jobs

Generate plots for only certain jobs:

```bash
torc plot-resources output/resource_utilization/resource_metrics_*.db \
  -o plots/ \
  --job-ids 15,16
```

## View the Plots

Open the generated HTML files in your browser:

```bash
open plots/job_15_resources.html
```

## Query Data Directly

For custom analysis, query the SQLite database:

```bash
sqlite3 -table output/resource_utilization/resource_metrics_1_1.db
```

```sql
-- View samples for a specific job
SELECT timestamp, cpu_percent, memory_bytes
FROM job_resource_samples
WHERE job_id = 1
ORDER BY timestamp;
```

## See Also

- [Resource Monitoring](../monitoring/resource-monitoring.md) — Configuration options
- [Resource Monitoring Database](../reference/resource-monitoring.md) — Database schema reference