raidz2/orchestrator.log
[04:00:13] ╔══════════════════════════════════════════════════════════════╗ [04:00:13] ║ F16 NVMe/ZFS Full Benchmark Suite ║ [04:00:13] ╠══════════════════════════════════════════════════════════════╣ [04:00:13] ║ Pool layout : raidz2 [04:00:13] ║ Target : fs:/tank-raidz2/bench [04:00:13] ║ Target type : file [04:00:13] ║ Runs/test : 3 [04:00:13] ║ Cooldown : 30s [04:00:13] ║ fio size : 64G [04:00:13] ║ fio runtime : 180s + 10s ramp [04:00:13] ║ Results : /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [04:00:13] ╚══════════════════════════════════════════════════════════════╝ [04:00:13] Capturing Phase 2 pool documentation for pool: tank-raidz2 [04:00:13] Pool documentation saved → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/pool-config/ [04:00:13] Generating Sequential Throughput jobs … [04:00:13] Generating Random IOPS jobs … [04:00:13] Generating Latency jobs … [04:00:13] Generating Mixed 70/30 jobs … [04:00:13] [04:00:13] Generated 53 fio jobs × 3 runs = 159 total runs [04:00:13] Estimated time: ~10h 22m [04:00:13] [04:00:13] [04:00:13] ╔══════════════════════════════════════════════════════════╗ [04:00:13] ║ Job 1/53: seq-read-qd1-nj1 [04:00:13] ║ Category: seq [04:00:13] ╚══════════════════════════════════════════════════════════╝ [04:00:13] ╔══════════════════════════════════════════════════════════╗ [04:00:13] ║ Benchmark: seq-read-qd1-nj1 [04:00:13] ║ Category: seq [04:00:13] ║ Runs: 3 × cooldown 30s [04:00:13] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [04:00:13] ╚══════════════════════════════════════════════════════════╝ [04:00:13] ──────────────────────────────────────────────────── [04:00:13] Run 1/3: seq-read-qd1-nj1_run1 [04:00:13] ──────────────────────────────────────────────────── [04:00:13] Cleaning fio test files from /tank-raidz2/bench … [04:00:13] Test files removed [04:00:13] Dropping Linux page cache + ZFS ARC … [04:00:14] Flushing ZFS ARC (was 1) … [04:00:19] ARC flushed — current size: 5541160 bytes [04:00:19] NVMe volatile write caches flushed [04:00:20] pmcd healthy (core ✓ pmdazfs ✓) [04:00:20] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd1-nj1_run1.ndjson [04:00:21] Collector running (PID 4173322), settling 5s … [04:00:26] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd1-nj1.fio [04:03:54] fio completed in 208s [04:03:54] Post-fio settle 5s … [04:03:59] Stopping collector [04:04:00] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd1-nj1_run1.manifest.json [04:04:00] Cooldown: 30s [04:04:30] ──────────────────────────────────────────────────── [04:04:30] Run 2/3: seq-read-qd1-nj1_run2 [04:04:30] ──────────────────────────────────────────────────── [04:04:30] Cleaning fio test files from /tank-raidz2/bench … [04:04:30] Test files removed [04:04:30] Dropping Linux page cache + ZFS ARC … [04:04:31] Flushing ZFS ARC (was 1) … [04:04:36] ARC flushed — current size: 3108816 bytes [04:04:36] NVMe volatile write caches flushed [04:04:37] pmcd healthy (core ✓ pmdazfs ✓) [04:04:37] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd1-nj1_run2.ndjson [04:04:38] Collector running (PID 4176069), settling 5s … [04:04:43] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd1-nj1.fio [04:08:11] fio completed in 208s [04:08:11] Post-fio settle 5s … [04:08:16] Stopping collector [04:08:17] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd1-nj1_run2.manifest.json [04:08:17] Cooldown: 30s [04:08:47] ──────────────────────────────────────────────────── [04:08:47] Run 3/3: seq-read-qd1-nj1_run3 [04:08:47] ──────────────────────────────────────────────────── [04:08:47] Cleaning fio test files from /tank-raidz2/bench … [04:08:48] Test files removed [04:08:48] Dropping Linux page cache + ZFS ARC … [04:08:48] Flushing ZFS ARC (was 1) … [04:08:53] ARC flushed — current size: 3217680 bytes [04:08:53] NVMe volatile write caches flushed [04:08:54] pmcd healthy (core ✓ pmdazfs ✓) [04:08:54] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd1-nj1_run3.ndjson [04:08:55] Collector running (PID 4178782), settling 5s … [04:09:00] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd1-nj1.fio [04:12:29] fio completed in 209s [04:12:29] Post-fio settle 5s … [04:12:34] Stopping collector [04:12:35] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd1-nj1_run3.manifest.json [04:12:35] ═══════════════════════════════════════════════════════════ [04:12:35] All 3 runs complete for: seq-read-qd1-nj1 [04:12:35] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq [04:12:35] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq [04:12:35] ═══════════════════════════════════════════════════════════ [04:12:35] Progress: 1/53 jobs | Elapsed: 0h12m | ETA: ~10h43m [04:12:35] [04:12:35] ╔══════════════════════════════════════════════════════════╗ [04:12:35] ║ Job 2/53: seq-read-qd1-nj4 [04:12:35] ║ Category: seq [04:12:35] ╚══════════════════════════════════════════════════════════╝ [04:12:35] ╔══════════════════════════════════════════════════════════╗ [04:12:35] ║ Benchmark: seq-read-qd1-nj4 [04:12:35] ║ Category: seq [04:12:35] ║ Runs: 3 × cooldown 30s [04:12:35] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [04:12:35] ╚══════════════════════════════════════════════════════════╝ [04:12:35] ──────────────────────────────────────────────────── [04:12:35] Run 1/3: seq-read-qd1-nj4_run1 [04:12:35] ──────────────────────────────────────────────────── [04:12:35] Cleaning fio test files from /tank-raidz2/bench … [04:12:35] Test files removed [04:12:35] Dropping Linux page cache + ZFS ARC … [04:12:35] Flushing ZFS ARC (was 1) … [04:12:40] ARC flushed — current size: 3426136 bytes [04:12:40] NVMe volatile write caches flushed [04:12:41] pmcd healthy (core ✓ pmdazfs ✓) [04:12:41] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd1-nj4_run1.ndjson [04:12:42] Collector running (PID 4181399), settling 5s … [04:12:47] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd1-nj4.fio [04:17:10] fio completed in 263s [04:17:10] Post-fio settle 5s … [04:17:15] Stopping collector [04:17:16] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd1-nj4_run1.manifest.json [04:17:16] Cooldown: 30s [04:17:46] ──────────────────────────────────────────────────── [04:17:46] Run 2/3: seq-read-qd1-nj4_run2 [04:17:46] ──────────────────────────────────────────────────── [04:17:46] Cleaning fio test files from /tank-raidz2/bench … [04:17:46] Test files removed [04:17:46] Dropping Linux page cache + ZFS ARC … [04:17:47] Flushing ZFS ARC (was 1) … [04:17:52] ARC flushed — current size: 33615740112 bytes [04:17:52] NVMe volatile write caches flushed [04:17:53] pmcd healthy (core ✓ pmdazfs ✓) [04:17:53] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd1-nj4_run2.ndjson [04:17:54] Collector running (PID 4184681), settling 5s … [04:17:59] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd1-nj4.fio [04:22:21] fio completed in 262s [04:22:21] Post-fio settle 5s … [04:22:26] Stopping collector [04:22:28] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd1-nj4_run2.manifest.json [04:22:28] Cooldown: 30s [04:22:58] ──────────────────────────────────────────────────── [04:22:58] Run 3/3: seq-read-qd1-nj4_run3 [04:22:58] ──────────────────────────────────────────────────── [04:22:58] Cleaning fio test files from /tank-raidz2/bench … [04:22:58] Test files removed [04:22:58] Dropping Linux page cache + ZFS ARC … [04:22:58] Flushing ZFS ARC (was 1) … [04:23:03] ARC flushed — current size: 8324449920 bytes [04:23:03] NVMe volatile write caches flushed [04:23:04] pmcd healthy (core ✓ pmdazfs ✓) [04:23:04] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd1-nj4_run3.ndjson [04:23:05] Collector running (PID 4187911), settling 5s … [04:23:10] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd1-nj4.fio [04:27:33] fio completed in 263s [04:27:33] Post-fio settle 5s … [04:27:38] Stopping collector [04:27:39] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd1-nj4_run3.manifest.json [04:27:39] ═══════════════════════════════════════════════════════════ [04:27:39] All 3 runs complete for: seq-read-qd1-nj4 [04:27:39] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq [04:27:39] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq [04:27:39] ═══════════════════════════════════════════════════════════ [04:27:39] Progress: 2/53 jobs | Elapsed: 0h27m | ETA: ~11h39m [04:27:39] [04:27:39] ╔══════════════════════════════════════════════════════════╗ [04:27:39] ║ Job 3/53: seq-read-qd1-nj8 [04:27:39] ║ Category: seq [04:27:39] ╚══════════════════════════════════════════════════════════╝ [04:27:39] ╔══════════════════════════════════════════════════════════╗ [04:27:39] ║ Benchmark: seq-read-qd1-nj8 [04:27:39] ║ Category: seq [04:27:39] ║ Runs: 3 × cooldown 30s [04:27:39] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [04:27:39] ╚══════════════════════════════════════════════════════════╝ [04:27:39] ──────────────────────────────────────────────────── [04:27:39] Run 1/3: seq-read-qd1-nj8_run1 [04:27:39] ──────────────────────────────────────────────────── [04:27:39] Cleaning fio test files from /tank-raidz2/bench … [04:27:40] Test files removed [04:27:40] Dropping Linux page cache + ZFS ARC … [04:27:40] Flushing ZFS ARC (was 1) … [04:27:45] ARC flushed — current size: 4596768 bytes [04:27:45] NVMe volatile write caches flushed [04:27:46] pmcd healthy (core ✓ pmdazfs ✓) [04:27:46] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd1-nj8_run1.ndjson [04:27:47] Collector running (PID 4191719), settling 5s … [04:27:52] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd1-nj8.fio [04:33:28] fio completed in 336s [04:33:28] Post-fio settle 5s … [04:33:33] Stopping collector [04:33:34] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd1-nj8_run1.manifest.json [04:33:34] Cooldown: 30s [04:34:04] ──────────────────────────────────────────────────── [04:34:04] Run 2/3: seq-read-qd1-nj8_run2 [04:34:04] ──────────────────────────────────────────────────── [04:34:04] Cleaning fio test files from /tank-raidz2/bench … [04:34:05] Test files removed [04:34:05] Dropping Linux page cache + ZFS ARC … [04:34:05] Flushing ZFS ARC (was 1) … [04:34:10] ARC flushed — current size: 38752179304 bytes [04:34:10] NVMe volatile write caches flushed [04:34:11] pmcd healthy (core ✓ pmdazfs ✓) [04:34:11] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd1-nj8_run2.ndjson [04:34:12] Collector running (PID 2251), settling 5s … [04:34:17] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd1-nj8.fio [04:39:54] fio completed in 337s [04:39:54] Post-fio settle 5s … [04:39:59] Stopping collector [04:40:01] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd1-nj8_run2.manifest.json [04:40:01] Cooldown: 30s [04:40:31] ──────────────────────────────────────────────────── [04:40:31] Run 3/3: seq-read-qd1-nj8_run3 [04:40:31] ──────────────────────────────────────────────────── [04:40:31] Cleaning fio test files from /tank-raidz2/bench … [04:40:31] Test files removed [04:40:31] Dropping Linux page cache + ZFS ARC … [04:40:32] Flushing ZFS ARC (was 1) … [04:40:37] ARC flushed — current size: 31590085736 bytes [04:40:37] NVMe volatile write caches flushed [04:40:38] pmcd healthy (core ✓ pmdazfs ✓) [04:40:38] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd1-nj8_run3.ndjson [04:40:39] Collector running (PID 6327), settling 5s … [04:40:44] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd1-nj8.fio [04:46:21] fio completed in 337s [04:46:21] Post-fio settle 5s … [04:46:26] Stopping collector [04:46:28] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd1-nj8_run3.manifest.json [04:46:28] ═══════════════════════════════════════════════════════════ [04:46:28] All 3 runs complete for: seq-read-qd1-nj8 [04:46:28] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq [04:46:28] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq [04:46:28] ═══════════════════════════════════════════════════════════ [04:46:28] Progress: 3/53 jobs | Elapsed: 0h46m | ETA: ~12h50m [04:46:28] [04:46:28] ╔══════════════════════════════════════════════════════════╗ [04:46:28] ║ Job 4/53: seq-read-qd1-nj16 [04:46:28] ║ Category: seq [04:46:28] ╚══════════════════════════════════════════════════════════╝ [04:46:28] ╔══════════════════════════════════════════════════════════╗ [04:46:28] ║ Benchmark: seq-read-qd1-nj16 [04:46:28] ║ Category: seq [04:46:28] ║ Runs: 3 × cooldown 30s [04:46:28] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [04:46:28] ╚══════════════════════════════════════════════════════════╝ [04:46:28] ──────────────────────────────────────────────────── [04:46:28] Run 1/3: seq-read-qd1-nj16_run1 [04:46:28] ──────────────────────────────────────────────────── [04:46:28] Cleaning fio test files from /tank-raidz2/bench … [04:46:28] Test files removed [04:46:28] Dropping Linux page cache + ZFS ARC … [04:46:28] Flushing ZFS ARC (was 1) … [04:46:33] ARC flushed — current size: 7028002712 bytes [04:46:33] NVMe volatile write caches flushed [04:46:35] pmcd healthy (core ✓ pmdazfs ✓) [04:46:35] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd1-nj16_run1.ndjson [04:46:36] Collector running (PID 10379), settling 5s … [04:46:41] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd1-nj16.fio [04:54:40] fio completed in 479s [04:54:40] Post-fio settle 5s … [04:54:45] Stopping collector [04:54:46] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd1-nj16_run1.manifest.json [04:54:46] Cooldown: 30s [04:55:16] ──────────────────────────────────────────────────── [04:55:16] Run 2/3: seq-read-qd1-nj16_run2 [04:55:16] ──────────────────────────────────────────────────── [04:55:16] Cleaning fio test files from /tank-raidz2/bench … [04:55:16] Test files removed [04:55:16] Dropping Linux page cache + ZFS ARC … [04:55:17] Flushing ZFS ARC (was 1) … [04:55:22] ARC flushed — current size: 42543719784 bytes [04:55:22] NVMe volatile write caches flushed [04:55:23] pmcd healthy (core ✓ pmdazfs ✓) [04:55:23] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd1-nj16_run2.ndjson [04:55:24] Collector running (PID 16435), settling 5s … [04:55:29] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd1-nj16.fio [05:03:29] fio completed in 480s [05:03:29] Post-fio settle 5s … [05:03:34] Stopping collector [05:03:36] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd1-nj16_run2.manifest.json [05:03:36] Cooldown: 30s [05:04:06] ──────────────────────────────────────────────────── [05:04:06] Run 3/3: seq-read-qd1-nj16_run3 [05:04:06] ──────────────────────────────────────────────────── [05:04:06] Cleaning fio test files from /tank-raidz2/bench … [05:04:07] Test files removed [05:04:07] Dropping Linux page cache + ZFS ARC … [05:04:07] Flushing ZFS ARC (was 1) … [05:04:12] ARC flushed — current size: 31515350800 bytes [05:04:12] NVMe volatile write caches flushed [05:04:13] pmcd healthy (core ✓ pmdazfs ✓) [05:04:13] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd1-nj16_run3.ndjson [05:04:14] Collector running (PID 21843), settling 5s … [05:04:19] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd1-nj16.fio [05:12:19] fio completed in 480s [05:12:19] Post-fio settle 5s … [05:12:24] Stopping collector [05:12:25] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd1-nj16_run3.manifest.json [05:12:25] ═══════════════════════════════════════════════════════════ [05:12:25] All 3 runs complete for: seq-read-qd1-nj16 [05:12:25] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq [05:12:25] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq [05:12:25] ═══════════════════════════════════════════════════════════ [05:12:25] Progress: 4/53 jobs | Elapsed: 1h12m | ETA: ~14h44m [05:12:25] [05:12:25] ╔══════════════════════════════════════════════════════════╗ [05:12:25] ║ Job 5/53: seq-read-qd32-nj1 [05:12:25] ║ Category: seq [05:12:25] ╚══════════════════════════════════════════════════════════╝ [05:12:25] ╔══════════════════════════════════════════════════════════╗ [05:12:25] ║ Benchmark: seq-read-qd32-nj1 [05:12:25] ║ Category: seq [05:12:25] ║ Runs: 3 × cooldown 30s [05:12:25] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [05:12:25] ╚══════════════════════════════════════════════════════════╝ [05:12:25] ──────────────────────────────────────────────────── [05:12:25] Run 1/3: seq-read-qd32-nj1_run1 [05:12:25] ──────────────────────────────────────────────────── [05:12:25] Cleaning fio test files from /tank-raidz2/bench … [05:12:25] Test files removed [05:12:25] Dropping Linux page cache + ZFS ARC … [05:12:26] Flushing ZFS ARC (was 1) … [05:12:31] ARC flushed — current size: 31573248600 bytes [05:12:31] NVMe volatile write caches flushed [05:12:32] pmcd healthy (core ✓ pmdazfs ✓) [05:12:32] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd32-nj1_run1.ndjson [05:12:33] Collector running (PID 27192), settling 5s … [05:12:38] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd32-nj1.fio [05:16:06] fio completed in 208s [05:16:06] Post-fio settle 5s … [05:16:11] Stopping collector [05:16:12] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd32-nj1_run1.manifest.json [05:16:12] Cooldown: 30s [05:16:42] ──────────────────────────────────────────────────── [05:16:42] Run 2/3: seq-read-qd32-nj1_run2 [05:16:42] ──────────────────────────────────────────────────── [05:16:42] Cleaning fio test files from /tank-raidz2/bench … [05:16:42] Test files removed [05:16:42] Dropping Linux page cache + ZFS ARC … [05:16:43] Flushing ZFS ARC (was 1) … [05:16:48] ARC flushed — current size: 89174888 bytes [05:16:48] NVMe volatile write caches flushed [05:16:49] pmcd healthy (core ✓ pmdazfs ✓) [05:16:49] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd32-nj1_run2.ndjson [05:16:50] Collector running (PID 29875), settling 5s … [05:16:55] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd32-nj1.fio [05:20:23] fio completed in 208s [05:20:23] Post-fio settle 5s … [05:20:28] Stopping collector [05:20:29] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd32-nj1_run2.manifest.json [05:20:29] Cooldown: 30s [05:20:59] ──────────────────────────────────────────────────── [05:20:59] Run 3/3: seq-read-qd32-nj1_run3 [05:20:59] ──────────────────────────────────────────────────── [05:20:59] Cleaning fio test files from /tank-raidz2/bench … [05:20:59] Test files removed [05:20:59] Dropping Linux page cache + ZFS ARC … [05:21:00] Flushing ZFS ARC (was 1) … [05:21:05] ARC flushed — current size: 10507272 bytes [05:21:05] NVMe volatile write caches flushed [05:21:06] pmcd healthy (core ✓ pmdazfs ✓) [05:21:06] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd32-nj1_run3.ndjson [05:21:07] Collector running (PID 32548), settling 5s … [05:21:12] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd32-nj1.fio [05:24:40] fio completed in 208s [05:24:40] Post-fio settle 5s … [05:24:45] Stopping collector [05:24:46] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd32-nj1_run3.manifest.json [05:24:46] ═══════════════════════════════════════════════════════════ [05:24:46] All 3 runs complete for: seq-read-qd32-nj1 [05:24:46] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq [05:24:46] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq [05:24:46] ═══════════════════════════════════════════════════════════ [05:24:46] Progress: 5/53 jobs | Elapsed: 1h24m | ETA: ~13h31m [05:24:46] [05:24:46] ╔══════════════════════════════════════════════════════════╗ [05:24:46] ║ Job 6/53: seq-read-qd32-nj4 [05:24:46] ║ Category: seq [05:24:46] ╚══════════════════════════════════════════════════════════╝ [05:24:46] ╔══════════════════════════════════════════════════════════╗ [05:24:46] ║ Benchmark: seq-read-qd32-nj4 [05:24:46] ║ Category: seq [05:24:46] ║ Runs: 3 × cooldown 30s [05:24:46] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [05:24:46] ╚══════════════════════════════════════════════════════════╝ [05:24:46] ──────────────────────────────────────────────────── [05:24:46] Run 1/3: seq-read-qd32-nj4_run1 [05:24:46] ──────────────────────────────────────────────────── [05:24:46] Cleaning fio test files from /tank-raidz2/bench … [05:24:47] Test files removed [05:24:47] Dropping Linux page cache + ZFS ARC … [05:24:47] Flushing ZFS ARC (was 1) … [05:24:52] ARC flushed — current size: 10264880 bytes [05:24:52] NVMe volatile write caches flushed [05:24:53] pmcd healthy (core ✓ pmdazfs ✓) [05:24:53] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd32-nj4_run1.ndjson [05:24:54] Collector running (PID 35160), settling 5s … [05:24:59] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd32-nj4.fio [05:29:22] fio completed in 263s [05:29:22] Post-fio settle 5s … [05:29:27] Stopping collector [05:29:29] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd32-nj4_run1.manifest.json [05:29:29] Cooldown: 30s [05:29:59] ──────────────────────────────────────────────────── [05:29:59] Run 2/3: seq-read-qd32-nj4_run2 [05:29:59] ──────────────────────────────────────────────────── [05:29:59] Cleaning fio test files from /tank-raidz2/bench … [05:29:59] Test files removed [05:29:59] Dropping Linux page cache + ZFS ARC … [05:29:59] Flushing ZFS ARC (was 1) … [05:30:04] ARC flushed — current size: 9866976 bytes [05:30:04] NVMe volatile write caches flushed [05:30:05] pmcd healthy (core ✓ pmdazfs ✓) [05:30:05] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd32-nj4_run2.ndjson [05:30:06] Collector running (PID 39165), settling 5s … [05:30:11] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd32-nj4.fio [05:34:34] fio completed in 263s [05:34:34] Post-fio settle 5s … [05:34:39] Stopping collector [05:34:40] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd32-nj4_run2.manifest.json [05:34:40] Cooldown: 30s [05:35:10] ──────────────────────────────────────────────────── [05:35:10] Run 3/3: seq-read-qd32-nj4_run3 [05:35:10] ──────────────────────────────────────────────────── [05:35:10] Cleaning fio test files from /tank-raidz2/bench … [05:35:11] Test files removed [05:35:11] Dropping Linux page cache + ZFS ARC … [05:35:11] Flushing ZFS ARC (was 1) … [05:35:16] ARC flushed — current size: 10420183896 bytes [05:35:16] NVMe volatile write caches flushed [05:35:17] pmcd healthy (core ✓ pmdazfs ✓) [05:35:17] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd32-nj4_run3.ndjson [05:35:18] Collector running (PID 42387), settling 5s … [05:35:23] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd32-nj4.fio [05:39:46] fio completed in 263s [05:39:46] Post-fio settle 5s … [05:39:51] Stopping collector [05:39:52] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd32-nj4_run3.manifest.json [05:39:52] ═══════════════════════════════════════════════════════════ [05:39:52] All 3 runs complete for: seq-read-qd32-nj4 [05:39:52] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq [05:39:52] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq [05:39:52] ═══════════════════════════════════════════════════════════ [05:39:52] Progress: 6/53 jobs | Elapsed: 1h39m | ETA: ~13h0m [05:39:52] [05:39:52] ╔══════════════════════════════════════════════════════════╗ [05:39:52] ║ Job 7/53: seq-read-qd32-nj8 [05:39:52] ║ Category: seq [05:39:52] ╚══════════════════════════════════════════════════════════╝ [05:39:52] ╔══════════════════════════════════════════════════════════╗ [05:39:52] ║ Benchmark: seq-read-qd32-nj8 [05:39:52] ║ Category: seq [05:39:52] ║ Runs: 3 × cooldown 30s [05:39:52] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [05:39:52] ╚══════════════════════════════════════════════════════════╝ [05:39:52] ──────────────────────────────────────────────────── [05:39:52] Run 1/3: seq-read-qd32-nj8_run1 [05:39:52] ──────────────────────────────────────────────────── [05:39:52] Cleaning fio test files from /tank-raidz2/bench … [05:39:53] Test files removed [05:39:53] Dropping Linux page cache + ZFS ARC … [05:39:53] Flushing ZFS ARC (was 1) … [05:39:58] ARC flushed — current size: 13371772440 bytes [05:39:58] NVMe volatile write caches flushed [05:39:59] pmcd healthy (core ✓ pmdazfs ✓) [05:39:59] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd32-nj8_run1.ndjson [05:40:00] Collector running (PID 45619), settling 5s … [05:40:05] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd32-nj8.fio [05:45:41] fio completed in 336s [05:45:41] Post-fio settle 5s … [05:45:46] Stopping collector [05:45:47] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd32-nj8_run1.manifest.json [05:45:47] Cooldown: 30s [05:46:17] ──────────────────────────────────────────────────── [05:46:17] Run 2/3: seq-read-qd32-nj8_run2 [05:46:17] ──────────────────────────────────────────────────── [05:46:17] Cleaning fio test files from /tank-raidz2/bench … [05:46:17] Test files removed [05:46:17] Dropping Linux page cache + ZFS ARC … [05:46:17] Flushing ZFS ARC (was 1) … [05:46:22] ARC flushed — current size: 107433781216 bytes [05:46:22] NVMe volatile write caches flushed [05:46:24] pmcd healthy (core ✓ pmdazfs ✓) [05:46:24] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd32-nj8_run2.ndjson [05:46:25] Collector running (PID 49587), settling 5s … [05:46:30] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd32-nj8.fio [05:52:06] fio completed in 336s [05:52:06] Post-fio settle 5s … [05:52:11] Stopping collector [05:52:12] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd32-nj8_run2.manifest.json [05:52:12] Cooldown: 30s [05:52:42] ──────────────────────────────────────────────────── [05:52:42] Run 3/3: seq-read-qd32-nj8_run3 [05:52:42] ──────────────────────────────────────────────────── [05:52:42] Cleaning fio test files from /tank-raidz2/bench … [05:52:42] Test files removed [05:52:42] Dropping Linux page cache + ZFS ARC … [05:52:43] Flushing ZFS ARC (was 1) … [05:52:48] ARC flushed — current size: 108161946648 bytes [05:52:48] NVMe volatile write caches flushed [05:52:49] pmcd healthy (core ✓ pmdazfs ✓) [05:52:49] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd32-nj8_run3.ndjson [05:52:50] Collector running (PID 53559), settling 5s … [05:52:55] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd32-nj8.fio [05:58:31] fio completed in 336s [05:58:31] Post-fio settle 5s … [05:58:36] Stopping collector [05:58:37] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd32-nj8_run3.manifest.json [05:58:37] ═══════════════════════════════════════════════════════════ [05:58:37] All 3 runs complete for: seq-read-qd32-nj8 [05:58:37] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq [05:58:37] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq [05:58:37] ═══════════════════════════════════════════════════════════ [05:58:37] Progress: 7/53 jobs | Elapsed: 1h58m | ETA: ~12h57m [05:58:37] [05:58:37] ╔══════════════════════════════════════════════════════════╗ [05:58:37] ║ Job 8/53: seq-read-qd32-nj16 [05:58:37] ║ Category: seq [05:58:37] ╚══════════════════════════════════════════════════════════╝ [05:58:37] ╔══════════════════════════════════════════════════════════╗ [05:58:37] ║ Benchmark: seq-read-qd32-nj16 [05:58:37] ║ Category: seq [05:58:37] ║ Runs: 3 × cooldown 30s [05:58:37] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [05:58:37] ╚══════════════════════════════════════════════════════════╝ [05:58:37] ──────────────────────────────────────────────────── [05:58:37] Run 1/3: seq-read-qd32-nj16_run1 [05:58:37] ──────────────────────────────────────────────────── [05:58:37] Cleaning fio test files from /tank-raidz2/bench … [05:58:38] Test files removed [05:58:38] Dropping Linux page cache + ZFS ARC … [05:58:38] Flushing ZFS ARC (was 1) … [05:58:43] ARC flushed — current size: 57982600128 bytes [05:58:43] NVMe volatile write caches flushed [05:58:44] pmcd healthy (core ✓ pmdazfs ✓) [05:58:44] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd32-nj16_run1.ndjson [05:58:45] Collector running (PID 58117), settling 5s … [05:58:50] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd32-nj16.fio [06:06:50] fio completed in 480s [06:06:50] Post-fio settle 5s … [06:06:55] Stopping collector [06:06:56] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd32-nj16_run1.manifest.json [06:06:56] Cooldown: 30s [06:07:26] ──────────────────────────────────────────────────── [06:07:26] Run 2/3: seq-read-qd32-nj16_run2 [06:07:26] ──────────────────────────────────────────────────── [06:07:26] Cleaning fio test files from /tank-raidz2/bench … [06:07:27] Test files removed [06:07:27] Dropping Linux page cache + ZFS ARC … [06:07:27] Flushing ZFS ARC (was 1) … [06:07:32] ARC flushed — current size: 32964804992 bytes [06:07:32] NVMe volatile write caches flushed [06:07:33] pmcd healthy (core ✓ pmdazfs ✓) [06:07:33] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd32-nj16_run2.ndjson [06:07:34] Collector running (PID 63475), settling 5s … [06:07:39] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd32-nj16.fio [06:15:39] fio completed in 480s [06:15:39] Post-fio settle 5s … [06:15:44] Stopping collector [06:15:45] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd32-nj16_run2.manifest.json [06:15:45] Cooldown: 30s [06:16:15] ──────────────────────────────────────────────────── [06:16:15] Run 3/3: seq-read-qd32-nj16_run3 [06:16:15] ──────────────────────────────────────────────────── [06:16:15] Cleaning fio test files from /tank-raidz2/bench … [06:16:15] Test files removed [06:16:15] Dropping Linux page cache + ZFS ARC … [06:16:15] Flushing ZFS ARC (was 1) … [06:16:20] ARC flushed — current size: 25008539944 bytes [06:16:20] NVMe volatile write caches flushed [06:16:22] pmcd healthy (core ✓ pmdazfs ✓) [06:16:22] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-read-qd32-nj16_run3.ndjson [06:16:23] Collector running (PID 68835), settling 5s … [06:16:28] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-read-qd32-nj16.fio [06:24:27] fio completed in 479s [06:24:27] Post-fio settle 5s … [06:24:32] Stopping collector [06:24:33] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-read-qd32-nj16_run3.manifest.json [06:24:33] ═══════════════════════════════════════════════════════════ [06:24:33] All 3 runs complete for: seq-read-qd32-nj16 [06:24:33] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq [06:24:33] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq [06:24:33] ═══════════════════════════════════════════════════════════ [06:24:33] Progress: 8/53 jobs | Elapsed: 2h24m | ETA: ~13h31m [06:24:33] [06:24:33] ╔══════════════════════════════════════════════════════════╗ [06:24:33] ║ Job 9/53: seq-write-qd1-nj1 [06:24:33] ║ Category: seq [06:24:33] ╚══════════════════════════════════════════════════════════╝ [06:24:33] ╔══════════════════════════════════════════════════════════╗ [06:24:33] ║ Benchmark: seq-write-qd1-nj1 [06:24:33] ║ Category: seq [06:24:33] ║ Runs: 3 × cooldown 30s [06:24:33] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [06:24:33] ╚══════════════════════════════════════════════════════════╝ [06:24:33] ──────────────────────────────────────────────────── [06:24:33] Run 1/3: seq-write-qd1-nj1_run1 [06:24:33] ──────────────────────────────────────────────────── [06:24:33] Cleaning fio test files from /tank-raidz2/bench … [06:24:34] Test files removed [06:24:34] Dropping Linux page cache + ZFS ARC … [06:24:34] Flushing ZFS ARC (was 1) … [06:24:39] ARC flushed — current size: 32254195664 bytes [06:24:39] NVMe volatile write caches flushed [06:24:40] pmcd healthy (core ✓ pmdazfs ✓) [06:24:40] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd1-nj1_run1.ndjson [06:24:41] Collector running (PID 74075), settling 5s … [06:24:46] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd1-nj1.fio [06:27:57] fio completed in 191s [06:27:57] Post-fio settle 5s … [06:28:02] Stopping collector [06:28:04] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd1-nj1_run1.manifest.json [06:28:04] Cooldown: 30s [06:28:34] ──────────────────────────────────────────────────── [06:28:34] Run 2/3: seq-write-qd1-nj1_run2 [06:28:34] ──────────────────────────────────────────────────── [06:28:34] Cleaning fio test files from /tank-raidz2/bench … [06:28:34] Test files removed [06:28:34] Dropping Linux page cache + ZFS ARC … [06:28:35] Flushing ZFS ARC (was 1) … [06:28:40] ARC flushed — current size: 12440296 bytes [06:28:40] NVMe volatile write caches flushed [06:28:41] pmcd healthy (core ✓ pmdazfs ✓) [06:28:41] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd1-nj1_run2.ndjson [06:28:42] Collector running (PID 77196), settling 5s … [06:28:47] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd1-nj1.fio [06:31:57] fio completed in 190s [06:31:57] Post-fio settle 5s … [06:32:02] Stopping collector [06:32:03] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd1-nj1_run2.manifest.json [06:32:03] Cooldown: 30s [06:32:33] ──────────────────────────────────────────────────── [06:32:33] Run 3/3: seq-write-qd1-nj1_run3 [06:32:33] ──────────────────────────────────────────────────── [06:32:33] Cleaning fio test files from /tank-raidz2/bench … [06:32:34] Test files removed [06:32:34] Dropping Linux page cache + ZFS ARC … [06:32:34] Flushing ZFS ARC (was 1) … [06:32:39] ARC flushed — current size: 45757252176 bytes [06:32:39] NVMe volatile write caches flushed [06:32:40] pmcd healthy (core ✓ pmdazfs ✓) [06:32:40] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd1-nj1_run3.ndjson [06:32:41] Collector running (PID 79653), settling 5s … [06:32:46] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd1-nj1.fio [06:35:57] fio completed in 191s [06:35:57] Post-fio settle 5s … [06:36:02] Stopping collector [06:36:04] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd1-nj1_run3.manifest.json [06:36:04] ═══════════════════════════════════════════════════════════ [06:36:04] All 3 runs complete for: seq-write-qd1-nj1 [06:36:04] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq [06:36:04] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq [06:36:04] ═══════════════════════════════════════════════════════════ [06:36:04] Progress: 9/53 jobs | Elapsed: 2h35m | ETA: ~12h41m [06:36:04] [06:36:04] ╔══════════════════════════════════════════════════════════╗ [06:36:04] ║ Job 10/53: seq-write-qd1-nj4 [06:36:04] ║ Category: seq [06:36:04] ╚══════════════════════════════════════════════════════════╝ [06:36:04] ╔══════════════════════════════════════════════════════════╗ [06:36:04] ║ Benchmark: seq-write-qd1-nj4 [06:36:04] ║ Category: seq [06:36:04] ║ Runs: 3 × cooldown 30s [06:36:04] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [06:36:04] ╚══════════════════════════════════════════════════════════╝ [06:36:04] ──────────────────────────────────────────────────── [06:36:04] Run 1/3: seq-write-qd1-nj4_run1 [06:36:04] ──────────────────────────────────────────────────── [06:36:04] Cleaning fio test files from /tank-raidz2/bench … [06:36:04] Test files removed [06:36:04] Dropping Linux page cache + ZFS ARC … [06:36:04] Flushing ZFS ARC (was 1) … [06:36:09] ARC flushed — current size: 12306288 bytes [06:36:09] NVMe volatile write caches flushed [06:36:11] pmcd healthy (core ✓ pmdazfs ✓) [06:36:11] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd1-nj4_run1.ndjson [06:36:12] Collector running (PID 82081), settling 5s … [06:36:17] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd1-nj4.fio [06:39:27] fio completed in 190s [06:39:27] Post-fio settle 5s … [06:39:32] Stopping collector [06:39:33] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd1-nj4_run1.manifest.json [06:39:33] Cooldown: 30s [06:40:03] ──────────────────────────────────────────────────── [06:40:03] Run 2/3: seq-write-qd1-nj4_run2 [06:40:03] ──────────────────────────────────────────────────── [06:40:03] Cleaning fio test files from /tank-raidz2/bench … [06:40:04] Test files removed [06:40:04] Dropping Linux page cache + ZFS ARC … [06:40:04] Flushing ZFS ARC (was 1) … [06:40:09] ARC flushed — current size: 61107816296 bytes [06:40:09] NVMe volatile write caches flushed [06:40:10] pmcd healthy (core ✓ pmdazfs ✓) [06:40:10] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd1-nj4_run2.ndjson [06:40:11] Collector running (PID 84503), settling 5s … [06:40:16] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd1-nj4.fio [06:43:27] fio completed in 191s [06:43:27] Post-fio settle 5s … [06:43:32] Stopping collector [06:43:33] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd1-nj4_run2.manifest.json [06:43:33] Cooldown: 30s [06:44:03] ──────────────────────────────────────────────────── [06:44:03] Run 3/3: seq-write-qd1-nj4_run3 [06:44:03] ──────────────────────────────────────────────────── [06:44:03] Cleaning fio test files from /tank-raidz2/bench … [06:44:03] Test files removed [06:44:03] Dropping Linux page cache + ZFS ARC … [06:44:03] Flushing ZFS ARC (was 1) … [06:44:08] ARC flushed — current size: 53010511224 bytes [06:44:08] NVMe volatile write caches flushed [06:44:10] pmcd healthy (core ✓ pmdazfs ✓) [06:44:10] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd1-nj4_run3.ndjson [06:44:11] Collector running (PID 86935), settling 5s … [06:44:16] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd1-nj4.fio [06:47:26] fio completed in 190s [06:47:26] Post-fio settle 5s … [06:47:31] Stopping collector [06:47:32] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd1-nj4_run3.manifest.json [06:47:32] ═══════════════════════════════════════════════════════════ [06:47:32] All 3 runs complete for: seq-write-qd1-nj4 [06:47:32] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq [06:47:32] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq [06:47:32] ═══════════════════════════════════════════════════════════ [06:47:32] Progress: 10/53 jobs | Elapsed: 2h47m | ETA: ~11h58m [06:47:32] [06:47:32] ╔══════════════════════════════════════════════════════════╗ [06:47:32] ║ Job 11/53: seq-write-qd1-nj8 [06:47:32] ║ Category: seq [06:47:32] ╚══════════════════════════════════════════════════════════╝ [06:47:32] ╔══════════════════════════════════════════════════════════╗ [06:47:32] ║ Benchmark: seq-write-qd1-nj8 [06:47:32] ║ Category: seq [06:47:32] ║ Runs: 3 × cooldown 30s [06:47:32] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [06:47:32] ╚══════════════════════════════════════════════════════════╝ [06:47:32] ──────────────────────────────────────────────────── [06:47:32] Run 1/3: seq-write-qd1-nj8_run1 [06:47:32] ──────────────────────────────────────────────────── [06:47:32] Cleaning fio test files from /tank-raidz2/bench … [06:47:33] Test files removed [06:47:33] Dropping Linux page cache + ZFS ARC … [06:47:33] Flushing ZFS ARC (was 1) … [06:47:38] ARC flushed — current size: 65500170768 bytes [06:47:38] NVMe volatile write caches flushed [06:47:39] pmcd healthy (core ✓ pmdazfs ✓) [06:47:39] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd1-nj8_run1.ndjson [06:47:40] Collector running (PID 89352), settling 5s … [06:47:45] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd1-nj8.fio [06:50:56] fio completed in 191s [06:50:56] Post-fio settle 5s … [06:51:01] Stopping collector [06:51:03] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd1-nj8_run1.manifest.json [06:51:03] Cooldown: 30s [06:51:33] ──────────────────────────────────────────────────── [06:51:33] Run 2/3: seq-write-qd1-nj8_run2 [06:51:33] ──────────────────────────────────────────────────── [06:51:33] Cleaning fio test files from /tank-raidz2/bench … [06:51:33] Test files removed [06:51:33] Dropping Linux page cache + ZFS ARC … [06:51:34] Flushing ZFS ARC (was 1) … [06:51:39] ARC flushed — current size: 129793296688 bytes [06:51:39] NVMe volatile write caches flushed [06:51:40] pmcd healthy (core ✓ pmdazfs ✓) [06:51:40] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd1-nj8_run2.ndjson [06:51:41] Collector running (PID 91790), settling 5s … [06:51:46] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd1-nj8.fio [06:54:56] fio completed in 190s [06:54:56] Post-fio settle 5s … [06:55:01] Stopping collector [06:55:02] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd1-nj8_run2.manifest.json [06:55:02] Cooldown: 30s [06:55:32] ──────────────────────────────────────────────────── [06:55:32] Run 3/3: seq-write-qd1-nj8_run3 [06:55:32] ──────────────────────────────────────────────────── [06:55:32] Cleaning fio test files from /tank-raidz2/bench … [06:55:33] Test files removed [06:55:33] Dropping Linux page cache + ZFS ARC … [06:55:33] Flushing ZFS ARC (was 1) … [06:55:38] ARC flushed — current size: 49426642240 bytes [06:55:38] NVMe volatile write caches flushed [06:55:40] pmcd healthy (core ✓ pmdazfs ✓) [06:55:40] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd1-nj8_run3.ndjson [06:55:41] Collector running (PID 94929), settling 5s … [06:55:46] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd1-nj8.fio [06:58:56] fio completed in 190s [06:58:56] Post-fio settle 5s … [06:59:01] Stopping collector [06:59:02] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd1-nj8_run3.manifest.json [06:59:02] ═══════════════════════════════════════════════════════════ [06:59:02] All 3 runs complete for: seq-write-qd1-nj8 [06:59:02] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq [06:59:02] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq [06:59:02] ═══════════════════════════════════════════════════════════ [06:59:02] Progress: 11/53 jobs | Elapsed: 2h58m | ETA: ~11h22m [06:59:02] [06:59:02] ╔══════════════════════════════════════════════════════════╗ [06:59:02] ║ Job 12/53: seq-write-qd1-nj16 [06:59:02] ║ Category: seq [06:59:02] ╚══════════════════════════════════════════════════════════╝ [06:59:02] ╔══════════════════════════════════════════════════════════╗ [06:59:02] ║ Benchmark: seq-write-qd1-nj16 [06:59:02] ║ Category: seq [06:59:02] ║ Runs: 3 × cooldown 30s [06:59:02] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [06:59:02] ╚══════════════════════════════════════════════════════════╝ [06:59:02] ──────────────────────────────────────────────────── [06:59:02] Run 1/3: seq-write-qd1-nj16_run1 [06:59:02] ──────────────────────────────────────────────────── [06:59:02] Cleaning fio test files from /tank-raidz2/bench … [06:59:03] Test files removed [06:59:03] Dropping Linux page cache + ZFS ARC … [06:59:03] Flushing ZFS ARC (was 1) … [06:59:08] ARC flushed — current size: 33692297312 bytes [06:59:08] NVMe volatile write caches flushed [06:59:09] pmcd healthy (core ✓ pmdazfs ✓) [06:59:09] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd1-nj16_run1.ndjson [06:59:10] Collector running (PID 97272), settling 5s … [06:59:15] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd1-nj16.fio [07:02:26] fio completed in 191s [07:02:26] Post-fio settle 5s … [07:02:31] Stopping collector [07:02:32] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd1-nj16_run1.manifest.json [07:02:32] Cooldown: 30s [07:03:02] ──────────────────────────────────────────────────── [07:03:02] Run 2/3: seq-write-qd1-nj16_run2 [07:03:02] ──────────────────────────────────────────────────── [07:03:02] Cleaning fio test files from /tank-raidz2/bench … [07:03:02] Test files removed [07:03:02] Dropping Linux page cache + ZFS ARC … [07:03:03] Flushing ZFS ARC (was 1) … [07:03:08] ARC flushed — current size: 32626763440 bytes [07:03:08] NVMe volatile write caches flushed [07:03:09] pmcd healthy (core ✓ pmdazfs ✓) [07:03:09] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd1-nj16_run2.ndjson [07:03:10] Collector running (PID 99749), settling 5s … [07:03:15] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd1-nj16.fio [07:06:26] fio completed in 191s [07:06:26] Post-fio settle 5s … [07:06:31] Stopping collector [07:06:32] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd1-nj16_run2.manifest.json [07:06:32] Cooldown: 30s [07:07:02] ──────────────────────────────────────────────────── [07:07:02] Run 3/3: seq-write-qd1-nj16_run3 [07:07:02] ──────────────────────────────────────────────────── [07:07:02] Cleaning fio test files from /tank-raidz2/bench … [07:07:02] Test files removed [07:07:02] Dropping Linux page cache + ZFS ARC … [07:07:02] Flushing ZFS ARC (was 1) … [07:07:07] ARC flushed — current size: 64966787096 bytes [07:07:07] NVMe volatile write caches flushed [07:07:09] pmcd healthy (core ✓ pmdazfs ✓) [07:07:09] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd1-nj16_run3.ndjson [07:07:10] Collector running (PID 102186), settling 5s … [07:07:15] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd1-nj16.fio [07:10:25] fio completed in 190s [07:10:25] Post-fio settle 5s … [07:10:30] Stopping collector [07:10:31] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd1-nj16_run3.manifest.json [07:10:31] ═══════════════════════════════════════════════════════════ [07:10:31] All 3 runs complete for: seq-write-qd1-nj16 [07:10:31] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq [07:10:31] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq [07:10:31] ═══════════════════════════════════════════════════════════ [07:10:31] Progress: 12/53 jobs | Elapsed: 3h10m | ETA: ~10h49m [07:10:31] [07:10:31] ╔══════════════════════════════════════════════════════════╗ [07:10:31] ║ Job 13/53: seq-write-qd32-nj1 [07:10:31] ║ Category: seq [07:10:31] ╚══════════════════════════════════════════════════════════╝ [07:10:31] ╔══════════════════════════════════════════════════════════╗ [07:10:31] ║ Benchmark: seq-write-qd32-nj1 [07:10:31] ║ Category: seq [07:10:31] ║ Runs: 3 × cooldown 30s [07:10:31] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [07:10:31] ╚══════════════════════════════════════════════════════════╝ [07:10:31] ──────────────────────────────────────────────────── [07:10:31] Run 1/3: seq-write-qd32-nj1_run1 [07:10:31] ──────────────────────────────────────────────────── [07:10:31] Cleaning fio test files from /tank-raidz2/bench … [07:10:32] Test files removed [07:10:32] Dropping Linux page cache + ZFS ARC … [07:10:32] Flushing ZFS ARC (was 1) … [07:10:37] ARC flushed — current size: 40145392216 bytes [07:10:37] NVMe volatile write caches flushed [07:10:39] pmcd healthy (core ✓ pmdazfs ✓) [07:10:39] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd32-nj1_run1.ndjson [07:10:40] Collector running (PID 104541), settling 5s … [07:10:45] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd32-nj1.fio [07:13:55] fio completed in 190s [07:13:55] Post-fio settle 5s … [07:14:00] Stopping collector [07:14:01] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd32-nj1_run1.manifest.json [07:14:01] Cooldown: 30s [07:14:31] ──────────────────────────────────────────────────── [07:14:31] Run 2/3: seq-write-qd32-nj1_run2 [07:14:31] ──────────────────────────────────────────────────── [07:14:31] Cleaning fio test files from /tank-raidz2/bench … [07:14:31] Test files removed [07:14:31] Dropping Linux page cache + ZFS ARC … [07:14:32] Flushing ZFS ARC (was 1) … [07:14:37] ARC flushed — current size: 33170421384 bytes [07:14:37] NVMe volatile write caches flushed [07:14:38] pmcd healthy (core ✓ pmdazfs ✓) [07:14:38] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd32-nj1_run2.ndjson [07:14:39] Collector running (PID 107040), settling 5s … [07:14:44] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd32-nj1.fio [07:17:54] fio completed in 190s [07:17:54] Post-fio settle 5s … [07:17:59] Stopping collector [07:18:01] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd32-nj1_run2.manifest.json [07:18:01] Cooldown: 30s [07:18:31] ──────────────────────────────────────────────────── [07:18:31] Run 3/3: seq-write-qd32-nj1_run3 [07:18:31] ──────────────────────────────────────────────────── [07:18:31] Cleaning fio test files from /tank-raidz2/bench … [07:18:31] Test files removed [07:18:31] Dropping Linux page cache + ZFS ARC … [07:18:31] Flushing ZFS ARC (was 1) … [07:18:36] ARC flushed — current size: 42515962720 bytes [07:18:36] NVMe volatile write caches flushed [07:18:37] pmcd healthy (core ✓ pmdazfs ✓) [07:18:37] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd32-nj1_run3.ndjson [07:18:38] Collector running (PID 109479), settling 5s … [07:18:43] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd32-nj1.fio [07:21:54] fio completed in 191s [07:21:54] Post-fio settle 5s … [07:21:59] Stopping collector [07:22:00] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd32-nj1_run3.manifest.json [07:22:00] ═══════════════════════════════════════════════════════════ [07:22:00] All 3 runs complete for: seq-write-qd32-nj1 [07:22:00] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq [07:22:00] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq [07:22:00] ═══════════════════════════════════════════════════════════ [07:22:00] Progress: 13/53 jobs | Elapsed: 3h21m | ETA: ~10h20m [07:22:00] [07:22:00] ╔══════════════════════════════════════════════════════════╗ [07:22:00] ║ Job 14/53: seq-write-qd32-nj4 [07:22:00] ║ Category: seq [07:22:00] ╚══════════════════════════════════════════════════════════╝ [07:22:00] ╔══════════════════════════════════════════════════════════╗ [07:22:00] ║ Benchmark: seq-write-qd32-nj4 [07:22:00] ║ Category: seq [07:22:00] ║ Runs: 3 × cooldown 30s [07:22:00] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [07:22:00] ╚══════════════════════════════════════════════════════════╝ [07:22:00] ──────────────────────────────────────────────────── [07:22:00] Run 1/3: seq-write-qd32-nj4_run1 [07:22:00] ──────────────────────────────────────────────────── [07:22:00] Cleaning fio test files from /tank-raidz2/bench … [07:22:00] Test files removed [07:22:00] Dropping Linux page cache + ZFS ARC … [07:22:00] Flushing ZFS ARC (was 1) … [07:22:05] ARC flushed — current size: 21316719064 bytes [07:22:05] NVMe volatile write caches flushed [07:22:07] pmcd healthy (core ✓ pmdazfs ✓) [07:22:07] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd32-nj4_run1.ndjson [07:22:08] Collector running (PID 111864), settling 5s … [07:22:13] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd32-nj4.fio [07:25:23] fio completed in 190s [07:25:23] Post-fio settle 5s … [07:25:28] Stopping collector [07:25:29] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd32-nj4_run1.manifest.json [07:25:29] Cooldown: 30s [07:25:59] ──────────────────────────────────────────────────── [07:25:59] Run 2/3: seq-write-qd32-nj4_run2 [07:25:59] ──────────────────────────────────────────────────── [07:25:59] Cleaning fio test files from /tank-raidz2/bench … [07:26:00] Test files removed [07:26:00] Dropping Linux page cache + ZFS ARC … [07:26:00] Flushing ZFS ARC (was 1) … [07:26:05] ARC flushed — current size: 78470123248 bytes [07:26:05] NVMe volatile write caches flushed [07:26:06] pmcd healthy (core ✓ pmdazfs ✓) [07:26:06] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd32-nj4_run2.ndjson [07:26:07] Collector running (PID 115011), settling 5s … [07:26:12] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd32-nj4.fio [07:29:23] fio completed in 191s [07:29:23] Post-fio settle 5s … [07:29:28] Stopping collector [07:29:30] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd32-nj4_run2.manifest.json [07:29:30] Cooldown: 30s [07:30:00] ──────────────────────────────────────────────────── [07:30:00] Run 3/3: seq-write-qd32-nj4_run3 [07:30:00] ──────────────────────────────────────────────────── [07:30:00] Cleaning fio test files from /tank-raidz2/bench … [07:30:00] Test files removed [07:30:00] Dropping Linux page cache + ZFS ARC … [07:30:01] Flushing ZFS ARC (was 1) … [07:30:06] ARC flushed — current size: 16120289808 bytes [07:30:06] NVMe volatile write caches flushed [07:30:07] pmcd healthy (core ✓ pmdazfs ✓) [07:30:07] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd32-nj4_run3.ndjson [07:30:08] Collector running (PID 117453), settling 5s … [07:30:13] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd32-nj4.fio [07:33:23] fio completed in 190s [07:33:23] Post-fio settle 5s … [07:33:28] Stopping collector [07:33:30] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd32-nj4_run3.manifest.json [07:33:30] ═══════════════════════════════════════════════════════════ [07:33:30] All 3 runs complete for: seq-write-qd32-nj4 [07:33:30] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq [07:33:30] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq [07:33:30] ═══════════════════════════════════════════════════════════ [07:33:30] Progress: 14/53 jobs | Elapsed: 3h33m | ETA: ~9h54m [07:33:30] [07:33:30] ╔══════════════════════════════════════════════════════════╗ [07:33:30] ║ Job 15/53: seq-write-qd32-nj8 [07:33:30] ║ Category: seq [07:33:30] ╚══════════════════════════════════════════════════════════╝ [07:33:31] ╔══════════════════════════════════════════════════════════╗ [07:33:31] ║ Benchmark: seq-write-qd32-nj8 [07:33:31] ║ Category: seq [07:33:31] ║ Runs: 3 × cooldown 30s [07:33:31] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [07:33:31] ╚══════════════════════════════════════════════════════════╝ [07:33:31] ──────────────────────────────────────────────────── [07:33:31] Run 1/3: seq-write-qd32-nj8_run1 [07:33:31] ──────────────────────────────────────────────────── [07:33:31] Cleaning fio test files from /tank-raidz2/bench … [07:33:31] Test files removed [07:33:31] Dropping Linux page cache + ZFS ARC … [07:33:31] Flushing ZFS ARC (was 1) … [07:33:36] ARC flushed — current size: 293836016 bytes [07:33:36] NVMe volatile write caches flushed [07:33:38] pmcd healthy (core ✓ pmdazfs ✓) [07:33:38] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd32-nj8_run1.ndjson [07:33:39] Collector running (PID 119873), settling 5s … [07:33:44] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd32-nj8.fio [07:36:54] fio completed in 190s [07:36:54] Post-fio settle 5s … [07:36:59] Stopping collector [07:37:00] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd32-nj8_run1.manifest.json [07:37:00] Cooldown: 30s [07:37:30] ──────────────────────────────────────────────────── [07:37:30] Run 2/3: seq-write-qd32-nj8_run2 [07:37:30] ──────────────────────────────────────────────────── [07:37:30] Cleaning fio test files from /tank-raidz2/bench … [07:37:31] Test files removed [07:37:31] Dropping Linux page cache + ZFS ARC … [07:37:31] Flushing ZFS ARC (was 1) … [07:37:36] ARC flushed — current size: 129721515208 bytes [07:37:36] NVMe volatile write caches flushed [07:37:37] pmcd healthy (core ✓ pmdazfs ✓) [07:37:37] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd32-nj8_run2.ndjson [07:37:38] Collector running (PID 122270), settling 5s … [07:37:43] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd32-nj8.fio [07:40:54] fio completed in 191s [07:40:54] Post-fio settle 5s … [07:40:59] Stopping collector [07:41:00] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd32-nj8_run2.manifest.json [07:41:00] Cooldown: 30s [07:41:30] ──────────────────────────────────────────────────── [07:41:30] Run 3/3: seq-write-qd32-nj8_run3 [07:41:30] ──────────────────────────────────────────────────── [07:41:30] Cleaning fio test files from /tank-raidz2/bench … [07:41:30] Test files removed [07:41:30] Dropping Linux page cache + ZFS ARC … [07:41:31] Flushing ZFS ARC (was 1) … [07:41:36] ARC flushed — current size: 129790693768 bytes [07:41:36] NVMe volatile write caches flushed [07:41:37] pmcd healthy (core ✓ pmdazfs ✓) [07:41:37] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd32-nj8_run3.ndjson [07:41:38] Collector running (PID 124728), settling 5s … [07:41:43] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd32-nj8.fio [07:44:53] fio completed in 190s [07:44:53] Post-fio settle 5s … [07:44:58] Stopping collector [07:45:00] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd32-nj8_run3.manifest.json [07:45:00] ═══════════════════════════════════════════════════════════ [07:45:00] All 3 runs complete for: seq-write-qd32-nj8 [07:45:00] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq [07:45:00] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq [07:45:00] ═══════════════════════════════════════════════════════════ [07:45:00] Progress: 15/53 jobs | Elapsed: 3h44m | ETA: ~9h29m [07:45:00] [07:45:00] ╔══════════════════════════════════════════════════════════╗ [07:45:00] ║ Job 16/53: seq-write-qd32-nj16 [07:45:00] ║ Category: seq [07:45:00] ╚══════════════════════════════════════════════════════════╝ [07:45:01] ╔══════════════════════════════════════════════════════════╗ [07:45:01] ║ Benchmark: seq-write-qd32-nj16 [07:45:01] ║ Category: seq [07:45:01] ║ Runs: 3 × cooldown 30s [07:45:01] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [07:45:01] ╚══════════════════════════════════════════════════════════╝ [07:45:01] ──────────────────────────────────────────────────── [07:45:01] Run 1/3: seq-write-qd32-nj16_run1 [07:45:01] ──────────────────────────────────────────────────── [07:45:01] Cleaning fio test files from /tank-raidz2/bench … [07:45:01] Test files removed [07:45:01] Dropping Linux page cache + ZFS ARC … [07:45:01] Flushing ZFS ARC (was 1) … [07:45:06] ARC flushed — current size: 747868672 bytes [07:45:06] NVMe volatile write caches flushed [07:45:08] pmcd healthy (core ✓ pmdazfs ✓) [07:45:08] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd32-nj16_run1.ndjson [07:45:09] Collector running (PID 127077), settling 5s … [07:45:14] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd32-nj16.fio [07:48:24] fio completed in 190s [07:48:24] Post-fio settle 5s … [07:48:29] Stopping collector [07:48:30] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd32-nj16_run1.manifest.json [07:48:30] Cooldown: 30s [07:49:00] ──────────────────────────────────────────────────── [07:49:00] Run 2/3: seq-write-qd32-nj16_run2 [07:49:00] ──────────────────────────────────────────────────── [07:49:00] Cleaning fio test files from /tank-raidz2/bench … [07:49:01] Test files removed [07:49:01] Dropping Linux page cache + ZFS ARC … [07:49:01] Flushing ZFS ARC (was 1) … [07:49:06] ARC flushed — current size: 32513953768 bytes [07:49:06] NVMe volatile write caches flushed [07:49:07] pmcd healthy (core ✓ pmdazfs ✓) [07:49:07] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd32-nj16_run2.ndjson [07:49:08] Collector running (PID 129559), settling 5s … [07:49:13] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd32-nj16.fio [07:52:24] fio completed in 191s [07:52:24] Post-fio settle 5s … [07:52:29] Stopping collector [07:52:31] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd32-nj16_run2.manifest.json [07:52:31] Cooldown: 30s [07:53:01] ──────────────────────────────────────────────────── [07:53:01] Run 3/3: seq-write-qd32-nj16_run3 [07:53:01] ──────────────────────────────────────────────────── [07:53:01] Cleaning fio test files from /tank-raidz2/bench … [07:53:02] Test files removed [07:53:02] Dropping Linux page cache + ZFS ARC … [07:53:02] Flushing ZFS ARC (was 1) … [07:53:07] ARC flushed — current size: 24325888528 bytes [07:53:07] NVMe volatile write caches flushed [07:53:08] pmcd healthy (core ✓ pmdazfs ✓) [07:53:08] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq/seq-write-qd32-nj16_run3.ndjson [07:53:09] Collector running (PID 132023), settling 5s … [07:53:14] Starting fio: /scripts_f16_with_data_deletion/jobs/seq-write-qd32-nj16.fio [07:56:25] fio completed in 191s [07:56:25] Post-fio settle 5s … [07:56:30] Stopping collector [07:56:31] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq/seq-write-qd32-nj16_run3.manifest.json [07:56:31] ═══════════════════════════════════════════════════════════ [07:56:31] All 3 runs complete for: seq-write-qd32-nj16 [07:56:31] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/seq [07:56:31] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/seq [07:56:31] ═══════════════════════════════════════════════════════════ [07:56:31] Progress: 16/53 jobs | Elapsed: 3h56m | ETA: ~9h6m [07:56:31] [07:56:31] ╔══════════════════════════════════════════════════════════╗ [07:56:31] ║ Job 17/53: rand-read-qd1-nj1 [07:56:31] ║ Category: rand [07:56:31] ╚══════════════════════════════════════════════════════════╝ [07:56:31] ╔══════════════════════════════════════════════════════════╗ [07:56:31] ║ Benchmark: rand-read-qd1-nj1 [07:56:31] ║ Category: rand [07:56:31] ║ Runs: 3 × cooldown 30s [07:56:31] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [07:56:31] ╚══════════════════════════════════════════════════════════╝ [07:56:31] ──────────────────────────────────────────────────── [07:56:31] Run 1/3: rand-read-qd1-nj1_run1 [07:56:31] ──────────────────────────────────────────────────── [07:56:31] Cleaning fio test files from /tank-raidz2/bench … [07:56:31] Test files removed [07:56:31] Dropping Linux page cache + ZFS ARC … [07:56:32] Flushing ZFS ARC (was 1) … [07:56:37] ARC flushed — current size: 56619264832 bytes [07:56:37] NVMe volatile write caches flushed [07:56:38] pmcd healthy (core ✓ pmdazfs ✓) [07:56:38] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd1-nj1_run1.ndjson [07:56:39] Collector running (PID 135109), settling 5s … [07:56:44] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd1-nj1.fio [08:02:22] fio completed in 338s [08:02:22] Post-fio settle 5s … [08:02:27] Stopping collector [08:02:28] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd1-nj1_run1.manifest.json [08:02:28] Cooldown: 30s [08:02:58] ──────────────────────────────────────────────────── [08:02:58] Run 2/3: rand-read-qd1-nj1_run2 [08:02:58] ──────────────────────────────────────────────────── [08:02:58] Cleaning fio test files from /tank-raidz2/bench … [08:02:58] Test files removed [08:02:58] Dropping Linux page cache + ZFS ARC … [08:02:58] Flushing ZFS ARC (was 1) … [08:03:03] ARC flushed — current size: 23330832 bytes [08:03:03] NVMe volatile write caches flushed [08:03:05] pmcd healthy (core ✓ pmdazfs ✓) [08:03:05] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd1-nj1_run2.ndjson [08:03:06] Collector running (PID 139227), settling 5s … [08:03:11] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd1-nj1.fio [08:08:47] fio completed in 336s [08:08:47] Post-fio settle 5s … [08:08:52] Stopping collector [08:08:53] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd1-nj1_run2.manifest.json [08:08:53] Cooldown: 30s [08:09:23] ──────────────────────────────────────────────────── [08:09:23] Run 3/3: rand-read-qd1-nj1_run3 [08:09:23] ──────────────────────────────────────────────────── [08:09:23] Cleaning fio test files from /tank-raidz2/bench … [08:09:23] Test files removed [08:09:23] Dropping Linux page cache + ZFS ARC … [08:09:23] Flushing ZFS ARC (was 1) … [08:09:28] ARC flushed — current size: 23306008 bytes [08:09:28] NVMe volatile write caches flushed [08:09:30] pmcd healthy (core ✓ pmdazfs ✓) [08:09:30] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd1-nj1_run3.ndjson [08:09:31] Collector running (PID 143348), settling 5s … [08:09:36] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd1-nj1.fio [08:15:13] fio completed in 337s [08:15:13] Post-fio settle 5s … [08:15:18] Stopping collector [08:15:20] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd1-nj1_run3.manifest.json [08:15:20] ═══════════════════════════════════════════════════════════ [08:15:20] All 3 runs complete for: rand-read-qd1-nj1 [08:15:20] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [08:15:20] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [08:15:20] ═══════════════════════════════════════════════════════════ [08:15:20] Progress: 17/53 jobs | Elapsed: 4h15m | ETA: ~9h0m [08:15:20] [08:15:20] ╔══════════════════════════════════════════════════════════╗ [08:15:20] ║ Job 18/53: rand-read-qd1-nj8 [08:15:20] ║ Category: rand [08:15:20] ╚══════════════════════════════════════════════════════════╝ [08:15:20] ╔══════════════════════════════════════════════════════════╗ [08:15:20] ║ Benchmark: rand-read-qd1-nj8 [08:15:20] ║ Category: rand [08:15:20] ║ Runs: 3 × cooldown 30s [08:15:20] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [08:15:20] ╚══════════════════════════════════════════════════════════╝ [08:15:20] ──────────────────────────────────────────────────── [08:15:20] Run 1/3: rand-read-qd1-nj8_run1 [08:15:20] ──────────────────────────────────────────────────── [08:15:20] Cleaning fio test files from /tank-raidz2/bench … [08:15:21] Test files removed [08:15:21] Dropping Linux page cache + ZFS ARC … [08:15:21] Flushing ZFS ARC (was 1) … [08:15:26] ARC flushed — current size: 23268816 bytes [08:15:26] NVMe volatile write caches flushed [08:15:27] pmcd healthy (core ✓ pmdazfs ✓) [08:15:27] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd1-nj8_run1.ndjson [08:15:28] Collector running (PID 147407), settling 5s … [08:15:33] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd1-nj8.fio [08:37:58] fio completed in 1345s [08:37:58] Post-fio settle 5s … [08:38:03] Stopping collector [08:38:04] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd1-nj8_run1.manifest.json [08:38:04] Cooldown: 30s [08:38:34] ──────────────────────────────────────────────────── [08:38:34] Run 2/3: rand-read-qd1-nj8_run2 [08:38:34] ──────────────────────────────────────────────────── [08:38:34] Cleaning fio test files from /tank-raidz2/bench … [08:38:34] Test files removed [08:38:34] Dropping Linux page cache + ZFS ARC … [08:38:35] Flushing ZFS ARC (was 1) … [08:38:40] ARC flushed — current size: 50735003040 bytes [08:38:40] NVMe volatile write caches flushed [08:38:41] pmcd healthy (core ✓ pmdazfs ✓) [08:38:41] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd1-nj8_run2.ndjson [08:38:42] Collector running (PID 163559), settling 5s … [08:38:47] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd1-nj8.fio [09:01:38] fio completed in 1371s [09:01:38] Post-fio settle 5s … [09:01:43] Stopping collector [09:01:44] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd1-nj8_run2.manifest.json [09:01:44] Cooldown: 30s [09:02:14] ──────────────────────────────────────────────────── [09:02:14] Run 3/3: rand-read-qd1-nj8_run3 [09:02:14] ──────────────────────────────────────────────────── [09:02:14] Cleaning fio test files from /tank-raidz2/bench … [09:02:14] Test files removed [09:02:14] Dropping Linux page cache + ZFS ARC … [09:02:14] Flushing ZFS ARC (was 1) … [09:02:19] ARC flushed — current size: 67896429224 bytes [09:02:19] NVMe volatile write caches flushed [09:02:20] pmcd healthy (core ✓ pmdazfs ✓) [09:02:20] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd1-nj8_run3.ndjson [09:02:21] Collector running (PID 179971), settling 5s … [09:02:26] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd1-nj8.fio [09:25:10] fio completed in 1364s [09:25:10] Post-fio settle 5s … [09:25:15] Stopping collector [09:25:16] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd1-nj8_run3.manifest.json [09:25:16] ═══════════════════════════════════════════════════════════ [09:25:16] All 3 runs complete for: rand-read-qd1-nj8 [09:25:16] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [09:25:16] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [09:25:16] ═══════════════════════════════════════════════════════════ [09:25:16] Progress: 18/53 jobs | Elapsed: 5h25m | ETA: ~10h31m [09:25:16] [09:25:16] ╔══════════════════════════════════════════════════════════╗ [09:25:16] ║ Job 19/53: rand-read-qd1-nj16 [09:25:16] ║ Category: rand [09:25:17] ╚══════════════════════════════════════════════════════════╝ [09:25:17] ╔══════════════════════════════════════════════════════════╗ [09:25:17] ║ Benchmark: rand-read-qd1-nj16 [09:25:17] ║ Category: rand [09:25:17] ║ Runs: 3 × cooldown 30s [09:25:17] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [09:25:17] ╚══════════════════════════════════════════════════════════╝ [09:25:17] ──────────────────────────────────────────────────── [09:25:17] Run 1/3: rand-read-qd1-nj16_run1 [09:25:17] ──────────────────────────────────────────────────── [09:25:17] Cleaning fio test files from /tank-raidz2/bench … [09:25:17] Test files removed [09:25:17] Dropping Linux page cache + ZFS ARC … [09:25:17] Flushing ZFS ARC (was 1) … [09:25:22] ARC flushed — current size: 26249824 bytes [09:25:22] NVMe volatile write caches flushed [09:25:23] pmcd healthy (core ✓ pmdazfs ✓) [09:25:23] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd1-nj16_run1.ndjson [09:25:24] Collector running (PID 196236), settling 5s … [09:25:29] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd1-nj16.fio [10:07:59] fio completed in 2550s [10:07:59] Post-fio settle 5s … [10:08:04] Stopping collector [10:08:05] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd1-nj16_run1.manifest.json [10:08:05] Cooldown: 30s [10:08:35] ──────────────────────────────────────────────────── [10:08:35] Run 2/3: rand-read-qd1-nj16_run2 [10:08:35] ──────────────────────────────────────────────────── [10:08:35] Cleaning fio test files from /tank-raidz2/bench … [10:08:36] Test files removed [10:08:36] Dropping Linux page cache + ZFS ARC … [10:08:36] Flushing ZFS ARC (was 1) … [10:08:41] ARC flushed — current size: 48199142464 bytes [10:08:41] NVMe volatile write caches flushed [10:08:42] pmcd healthy (core ✓ pmdazfs ✓) [10:08:42] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd1-nj16_run2.ndjson [10:08:43] Collector running (PID 225601), settling 5s … [10:08:48] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd1-nj16.fio [10:50:39] fio completed in 2511s [10:50:39] Post-fio settle 5s … [10:50:44] Stopping collector [10:50:46] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd1-nj16_run2.manifest.json [10:50:46] Cooldown: 30s [10:51:16] ──────────────────────────────────────────────────── [10:51:16] Run 3/3: rand-read-qd1-nj16_run3 [10:51:16] ──────────────────────────────────────────────────── [10:51:16] Cleaning fio test files from /tank-raidz2/bench … [10:51:16] Test files removed [10:51:16] Dropping Linux page cache + ZFS ARC … [10:51:16] Flushing ZFS ARC (was 1) … [10:51:21] ARC flushed — current size: 42198294040 bytes [10:51:21] NVMe volatile write caches flushed [10:51:23] pmcd healthy (core ✓ pmdazfs ✓) [10:51:23] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd1-nj16_run3.ndjson [10:51:24] Collector running (PID 254626), settling 5s … [10:51:29] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd1-nj16.fio [11:33:42] fio completed in 2533s [11:33:42] Post-fio settle 5s … [11:33:47] Stopping collector [11:33:49] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd1-nj16_run3.manifest.json [11:33:49] ═══════════════════════════════════════════════════════════ [11:33:49] All 3 runs complete for: rand-read-qd1-nj16 [11:33:49] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [11:33:49] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [11:33:49] ═══════════════════════════════════════════════════════════ [11:33:49] Progress: 19/53 jobs | Elapsed: 7h33m | ETA: ~13h31m [11:33:49] [11:33:49] ╔══════════════════════════════════════════════════════════╗ [11:33:49] ║ Job 20/53: rand-read-qd1-nj32 [11:33:49] ║ Category: rand [11:33:49] ╚══════════════════════════════════════════════════════════╝ [11:33:49] ╔══════════════════════════════════════════════════════════╗ [11:33:49] ║ Benchmark: rand-read-qd1-nj32 [11:33:49] ║ Category: rand [11:33:49] ║ Runs: 3 × cooldown 30s [11:33:49] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [11:33:49] ╚══════════════════════════════════════════════════════════╝ [11:33:49] ──────────────────────────────────────────────────── [11:33:49] Run 1/3: rand-read-qd1-nj32_run1 [11:33:49] ──────────────────────────────────────────────────── [11:33:49] Cleaning fio test files from /tank-raidz2/bench … [11:33:50] Test files removed [11:33:50] Dropping Linux page cache + ZFS ARC … [11:33:50] Flushing ZFS ARC (was 1) … [11:33:55] ARC flushed — current size: 44294372688 bytes [11:33:55] NVMe volatile write caches flushed [11:33:56] pmcd healthy (core ✓ pmdazfs ✓) [11:33:56] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd1-nj32_run1.ndjson [11:33:57] Collector running (PID 284448), settling 5s … [11:34:02] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd1-nj32.fio [12:55:53] fio completed in 4911s [12:55:53] Post-fio settle 5s … [12:55:58] Stopping collector [12:55:59] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd1-nj32_run1.manifest.json [12:55:59] Cooldown: 30s [12:56:29] ──────────────────────────────────────────────────── [12:56:29] Run 2/3: rand-read-qd1-nj32_run2 [12:56:29] ──────────────────────────────────────────────────── [12:56:29] Cleaning fio test files from /tank-raidz2/bench … [12:56:29] Test files removed [12:56:29] Dropping Linux page cache + ZFS ARC … [12:56:29] Flushing ZFS ARC (was 1) … [12:56:34] ARC flushed — current size: 86431609024 bytes [12:56:34] NVMe volatile write caches flushed [12:56:36] pmcd healthy (core ✓ pmdazfs ✓) [12:56:36] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd1-nj32_run2.ndjson [12:56:37] Collector running (PID 341203), settling 5s … [12:56:42] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd1-nj32.fio [14:18:10] fio completed in 4888s [14:18:10] Post-fio settle 5s … [14:18:15] Stopping collector [14:18:17] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd1-nj32_run2.manifest.json [14:18:17] Cooldown: 30s [14:18:47] ──────────────────────────────────────────────────── [14:18:47] Run 3/3: rand-read-qd1-nj32_run3 [14:18:47] ──────────────────────────────────────────────────── [14:18:47] Cleaning fio test files from /tank-raidz2/bench … [14:18:47] Test files removed [14:18:47] Dropping Linux page cache + ZFS ARC … [14:18:47] Flushing ZFS ARC (was 1) … [14:18:52] ARC flushed — current size: 86251671976 bytes [14:18:52] NVMe volatile write caches flushed [14:18:54] pmcd healthy (core ✓ pmdazfs ✓) [14:18:54] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd1-nj32_run3.ndjson [14:18:55] Collector running (PID 397773), settling 5s … [14:19:00] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd1-nj32.fio [15:40:48] fio completed in 4908s [15:40:48] Post-fio settle 5s … [15:40:53] Stopping collector [15:40:54] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd1-nj32_run3.manifest.json [15:40:54] ═══════════════════════════════════════════════════════════ [15:40:54] All 3 runs complete for: rand-read-qd1-nj32 [15:40:54] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [15:40:54] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [15:40:54] ═══════════════════════════════════════════════════════════ [15:40:54] Progress: 20/53 jobs | Elapsed: 11h40m | ETA: ~19h16m [15:40:54] [15:40:54] ╔══════════════════════════════════════════════════════════╗ [15:40:54] ║ Job 21/53: rand-read-qd4-nj1 [15:40:54] ║ Category: rand [15:40:54] ╚══════════════════════════════════════════════════════════╝ [15:40:54] ╔══════════════════════════════════════════════════════════╗ [15:40:54] ║ Benchmark: rand-read-qd4-nj1 [15:40:54] ║ Category: rand [15:40:54] ║ Runs: 3 × cooldown 30s [15:40:54] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [15:40:54] ╚══════════════════════════════════════════════════════════╝ [15:40:54] ──────────────────────────────────────────────────── [15:40:54] Run 1/3: rand-read-qd4-nj1_run1 [15:40:54] ──────────────────────────────────────────────────── [15:40:54] Cleaning fio test files from /tank-raidz2/bench … [15:40:54] Test files removed [15:40:54] Dropping Linux page cache + ZFS ARC … [15:40:55] Flushing ZFS ARC (was 1) … [15:41:00] ARC flushed — current size: 87910751184 bytes [15:41:00] NVMe volatile write caches flushed [15:41:01] pmcd healthy (core ✓ pmdazfs ✓) [15:41:01] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd4-nj1_run1.ndjson [15:41:02] Collector running (PID 454572), settling 5s … [15:41:07] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd4-nj1.fio [15:46:48] fio completed in 341s [15:46:48] Post-fio settle 5s … [15:46:53] Stopping collector [15:46:54] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd4-nj1_run1.manifest.json [15:46:54] Cooldown: 30s [15:47:24] ──────────────────────────────────────────────────── [15:47:24] Run 2/3: rand-read-qd4-nj1_run2 [15:47:24] ──────────────────────────────────────────────────── [15:47:24] Cleaning fio test files from /tank-raidz2/bench … [15:47:25] Test files removed [15:47:25] Dropping Linux page cache + ZFS ARC … [15:47:25] Flushing ZFS ARC (was 1) … [15:47:30] ARC flushed — current size: 22620376 bytes [15:47:30] NVMe volatile write caches flushed [15:47:31] pmcd healthy (core ✓ pmdazfs ✓) [15:47:31] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd4-nj1_run2.ndjson [15:47:32] Collector running (PID 458805), settling 5s … [15:47:37] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd4-nj1.fio [15:53:14] fio completed in 337s [15:53:14] Post-fio settle 5s … [15:53:19] Stopping collector [15:53:21] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd4-nj1_run2.manifest.json [15:53:21] Cooldown: 30s [15:53:51] ──────────────────────────────────────────────────── [15:53:51] Run 3/3: rand-read-qd4-nj1_run3 [15:53:51] ──────────────────────────────────────────────────── [15:53:51] Cleaning fio test files from /tank-raidz2/bench … [15:53:52] Test files removed [15:53:52] Dropping Linux page cache + ZFS ARC … [15:53:52] Flushing ZFS ARC (was 1) … [15:53:57] ARC flushed — current size: 23302008 bytes [15:53:57] NVMe volatile write caches flushed [15:53:58] pmcd healthy (core ✓ pmdazfs ✓) [15:53:58] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd4-nj1_run3.ndjson [15:53:59] Collector running (PID 462951), settling 5s … [15:54:04] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd4-nj1.fio [15:59:42] fio completed in 338s [15:59:42] Post-fio settle 5s … [15:59:47] Stopping collector [15:59:49] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd4-nj1_run3.manifest.json [15:59:49] ═══════════════════════════════════════════════════════════ [15:59:49] All 3 runs complete for: rand-read-qd4-nj1 [15:59:49] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [15:59:49] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [15:59:49] ═══════════════════════════════════════════════════════════ [15:59:49] Progress: 21/53 jobs | Elapsed: 11h59m | ETA: ~18h16m [15:59:49] [15:59:49] ╔══════════════════════════════════════════════════════════╗ [15:59:49] ║ Job 22/53: rand-read-qd4-nj8 [15:59:49] ║ Category: rand [15:59:49] ╚══════════════════════════════════════════════════════════╝ [15:59:49] ╔══════════════════════════════════════════════════════════╗ [15:59:49] ║ Benchmark: rand-read-qd4-nj8 [15:59:49] ║ Category: rand [15:59:49] ║ Runs: 3 × cooldown 30s [15:59:49] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [15:59:49] ╚══════════════════════════════════════════════════════════╝ [15:59:49] ──────────────────────────────────────────────────── [15:59:49] Run 1/3: rand-read-qd4-nj8_run1 [15:59:49] ──────────────────────────────────────────────────── [15:59:49] Cleaning fio test files from /tank-raidz2/bench … [15:59:49] Test files removed [15:59:49] Dropping Linux page cache + ZFS ARC … [15:59:49] Flushing ZFS ARC (was 1) … [15:59:54] ARC flushed — current size: 23523184 bytes [15:59:54] NVMe volatile write caches flushed [15:59:55] pmcd healthy (core ✓ pmdazfs ✓) [15:59:55] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd4-nj8_run1.ndjson [15:59:56] Collector running (PID 467652), settling 5s … [16:00:01] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd4-nj8.fio [16:22:41] fio completed in 1360s [16:22:41] Post-fio settle 5s … [16:22:46] Stopping collector [16:22:48] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd4-nj8_run1.manifest.json [16:22:48] Cooldown: 30s [16:23:18] ──────────────────────────────────────────────────── [16:23:18] Run 2/3: rand-read-qd4-nj8_run2 [16:23:18] ──────────────────────────────────────────────────── [16:23:18] Cleaning fio test files from /tank-raidz2/bench … [16:23:18] Test files removed [16:23:18] Dropping Linux page cache + ZFS ARC … [16:23:18] Flushing ZFS ARC (was 1) … [16:23:23] ARC flushed — current size: 14158482656 bytes [16:23:23] NVMe volatile write caches flushed [16:23:25] pmcd healthy (core ✓ pmdazfs ✓) [16:23:25] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd4-nj8_run2.ndjson [16:23:26] Collector running (PID 483349), settling 5s … [16:23:31] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd4-nj8.fio [16:46:02] fio completed in 1351s [16:46:02] Post-fio settle 5s … [16:46:07] Stopping collector [16:46:09] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd4-nj8_run2.manifest.json [16:46:09] Cooldown: 30s [16:46:39] ──────────────────────────────────────────────────── [16:46:39] Run 3/3: rand-read-qd4-nj8_run3 [16:46:39] ──────────────────────────────────────────────────── [16:46:39] Cleaning fio test files from /tank-raidz2/bench … [16:46:40] Test files removed [16:46:40] Dropping Linux page cache + ZFS ARC … [16:46:40] Flushing ZFS ARC (was 1) … [16:46:45] ARC flushed — current size: 23445191288 bytes [16:46:45] NVMe volatile write caches flushed [16:46:46] pmcd healthy (core ✓ pmdazfs ✓) [16:46:46] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd4-nj8_run3.ndjson [16:46:47] Collector running (PID 499620), settling 5s … [16:46:52] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd4-nj8.fio [17:09:42] fio completed in 1370s [17:09:42] Post-fio settle 5s … [17:09:48] Stopping collector [17:09:49] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd4-nj8_run3.manifest.json [17:09:49] ═══════════════════════════════════════════════════════════ [17:09:49] All 3 runs complete for: rand-read-qd4-nj8 [17:09:49] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [17:09:49] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [17:09:49] ═══════════════════════════════════════════════════════════ [17:09:49] Progress: 22/53 jobs | Elapsed: 13h9m | ETA: ~18h32m [17:09:49] [17:09:49] ╔══════════════════════════════════════════════════════════╗ [17:09:49] ║ Job 23/53: rand-read-qd4-nj16 [17:09:49] ║ Category: rand [17:09:49] ╚══════════════════════════════════════════════════════════╝ [17:09:49] ╔══════════════════════════════════════════════════════════╗ [17:09:49] ║ Benchmark: rand-read-qd4-nj16 [17:09:49] ║ Category: rand [17:09:49] ║ Runs: 3 × cooldown 30s [17:09:49] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [17:09:49] ╚══════════════════════════════════════════════════════════╝ [17:09:49] ──────────────────────────────────────────────────── [17:09:49] Run 1/3: rand-read-qd4-nj16_run1 [17:09:49] ──────────────────────────────────────────────────── [17:09:49] Cleaning fio test files from /tank-raidz2/bench … [17:09:49] Test files removed [17:09:49] Dropping Linux page cache + ZFS ARC … [17:09:49] Flushing ZFS ARC (was 1) … [17:09:54] ARC flushed — current size: 26436896552 bytes [17:09:54] NVMe volatile write caches flushed [17:09:55] pmcd healthy (core ✓ pmdazfs ✓) [17:09:55] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd4-nj16_run1.ndjson [17:09:56] Collector running (PID 515969), settling 5s … [17:10:01] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd4-nj16.fio [17:52:08] fio completed in 2527s [17:52:08] Post-fio settle 5s … [17:52:13] Stopping collector [17:52:14] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd4-nj16_run1.manifest.json [17:52:14] Cooldown: 30s [17:52:44] ──────────────────────────────────────────────────── [17:52:44] Run 2/3: rand-read-qd4-nj16_run2 [17:52:44] ──────────────────────────────────────────────────── [17:52:44] Cleaning fio test files from /tank-raidz2/bench … [17:52:44] Test files removed [17:52:44] Dropping Linux page cache + ZFS ARC … [17:52:45] Flushing ZFS ARC (was 1) … [17:52:50] ARC flushed — current size: 49160844240 bytes [17:52:50] NVMe volatile write caches flushed [17:52:51] pmcd healthy (core ✓ pmdazfs ✓) [17:52:51] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd4-nj16_run2.ndjson [17:52:52] Collector running (PID 544985), settling 5s … [17:52:57] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd4-nj16.fio [18:34:53] fio completed in 2516s [18:34:53] Post-fio settle 5s … [18:34:58] Stopping collector [18:35:00] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd4-nj16_run2.manifest.json [18:35:00] Cooldown: 30s [18:35:30] ──────────────────────────────────────────────────── [18:35:30] Run 3/3: rand-read-qd4-nj16_run3 [18:35:30] ──────────────────────────────────────────────────── [18:35:30] Cleaning fio test files from /tank-raidz2/bench … [18:35:31] Test files removed [18:35:31] Dropping Linux page cache + ZFS ARC … [18:35:31] Flushing ZFS ARC (was 1) … [18:35:36] ARC flushed — current size: 54668283112 bytes [18:35:36] NVMe volatile write caches flushed [18:35:37] pmcd healthy (core ✓ pmdazfs ✓) [18:35:37] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd4-nj16_run3.ndjson [18:35:38] Collector running (PID 574640), settling 5s … [18:35:43] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd4-nj16.fio [19:17:44] fio completed in 2521s [19:17:44] Post-fio settle 5s … [19:17:49] Stopping collector [19:17:51] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd4-nj16_run3.manifest.json [19:17:51] ═══════════════════════════════════════════════════════════ [19:17:51] All 3 runs complete for: rand-read-qd4-nj16 [19:17:51] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [19:17:51] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [19:17:51] ═══════════════════════════════════════════════════════════ [19:17:51] Progress: 23/53 jobs | Elapsed: 15h17m | ETA: ~19h56m [19:17:51] [19:17:51] ╔══════════════════════════════════════════════════════════╗ [19:17:51] ║ Job 24/53: rand-read-qd4-nj32 [19:17:51] ║ Category: rand [19:17:51] ╚══════════════════════════════════════════════════════════╝ [19:17:51] ╔══════════════════════════════════════════════════════════╗ [19:17:51] ║ Benchmark: rand-read-qd4-nj32 [19:17:51] ║ Category: rand [19:17:51] ║ Runs: 3 × cooldown 30s [19:17:51] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [19:17:51] ╚══════════════════════════════════════════════════════════╝ [19:17:51] ──────────────────────────────────────────────────── [19:17:51] Run 1/3: rand-read-qd4-nj32_run1 [19:17:51] ──────────────────────────────────────────────────── [19:17:51] Cleaning fio test files from /tank-raidz2/bench … [19:17:51] Test files removed [19:17:51] Dropping Linux page cache + ZFS ARC … [19:17:52] Flushing ZFS ARC (was 1) … [19:17:57] ARC flushed — current size: 48640509496 bytes [19:17:57] NVMe volatile write caches flushed [19:17:58] pmcd healthy (core ✓ pmdazfs ✓) [19:17:58] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd4-nj32_run1.ndjson [19:17:59] Collector running (PID 603647), settling 5s … [19:18:04] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd4-nj32.fio [20:39:27] fio completed in 4883s [20:39:27] Post-fio settle 5s … [20:39:32] Stopping collector [20:39:34] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd4-nj32_run1.manifest.json [20:39:34] Cooldown: 30s [20:40:04] ──────────────────────────────────────────────────── [20:40:04] Run 2/3: rand-read-qd4-nj32_run2 [20:40:04] ──────────────────────────────────────────────────── [20:40:04] Cleaning fio test files from /tank-raidz2/bench … [20:40:05] Test files removed [20:40:05] Dropping Linux page cache + ZFS ARC … [20:40:05] Flushing ZFS ARC (was 1) … [20:40:10] ARC flushed — current size: 86717209008 bytes [20:40:10] NVMe volatile write caches flushed [20:40:11] pmcd healthy (core ✓ pmdazfs ✓) [20:40:11] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd4-nj32_run2.ndjson [20:40:12] Collector running (PID 660249), settling 5s … [20:40:17] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd4-nj32.fio [22:01:55] fio completed in 4898s [22:01:55] Post-fio settle 5s … [22:02:00] Stopping collector [22:02:01] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd4-nj32_run2.manifest.json [22:02:01] Cooldown: 30s [22:02:31] ──────────────────────────────────────────────────── [22:02:31] Run 3/3: rand-read-qd4-nj32_run3 [22:02:31] ──────────────────────────────────────────────────── [22:02:31] Cleaning fio test files from /tank-raidz2/bench … [22:02:31] Test files removed [22:02:31] Dropping Linux page cache + ZFS ARC … [22:02:32] Flushing ZFS ARC (was 1) … [22:02:37] ARC flushed — current size: 87554818000 bytes [22:02:37] NVMe volatile write caches flushed [22:02:38] pmcd healthy (core ✓ pmdazfs ✓) [22:02:38] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd4-nj32_run3.ndjson [22:02:39] Collector running (PID 717022), settling 5s … [22:02:44] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd4-nj32.fio [23:24:17] fio completed in 4893s [23:24:17] Post-fio settle 5s … [23:24:22] Stopping collector [23:24:23] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd4-nj32_run3.manifest.json [23:24:23] ═══════════════════════════════════════════════════════════ [23:24:23] All 3 runs complete for: rand-read-qd4-nj32 [23:24:23] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [23:24:23] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [23:24:24] ═══════════════════════════════════════════════════════════ [23:24:24] Progress: 24/53 jobs | Elapsed: 19h24m | ETA: ~23h26m [23:24:24] [23:24:24] ╔══════════════════════════════════════════════════════════╗ [23:24:24] ║ Job 25/53: rand-read-qd16-nj1 [23:24:24] ║ Category: rand [23:24:24] ╚══════════════════════════════════════════════════════════╝ [23:24:24] ╔══════════════════════════════════════════════════════════╗ [23:24:24] ║ Benchmark: rand-read-qd16-nj1 [23:24:24] ║ Category: rand [23:24:24] ║ Runs: 3 × cooldown 30s [23:24:24] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [23:24:24] ╚══════════════════════════════════════════════════════════╝ [23:24:24] ──────────────────────────────────────────────────── [23:24:24] Run 1/3: rand-read-qd16-nj1_run1 [23:24:24] ──────────────────────────────────────────────────── [23:24:24] Cleaning fio test files from /tank-raidz2/bench … [23:24:24] Test files removed [23:24:24] Dropping Linux page cache + ZFS ARC … [23:24:24] Flushing ZFS ARC (was 1) … [23:24:29] ARC flushed — current size: 86522563608 bytes [23:24:29] NVMe volatile write caches flushed [23:24:30] pmcd healthy (core ✓ pmdazfs ✓) [23:24:30] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd16-nj1_run1.ndjson [23:24:31] Collector running (PID 772900), settling 5s … [23:24:36] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd16-nj1.fio [23:30:13] fio completed in 337s [23:30:13] Post-fio settle 5s … [23:30:18] Stopping collector [23:30:19] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd16-nj1_run1.manifest.json [23:30:19] Cooldown: 30s [23:30:49] ──────────────────────────────────────────────────── [23:30:49] Run 2/3: rand-read-qd16-nj1_run2 [23:30:49] ──────────────────────────────────────────────────── [23:30:49] Cleaning fio test files from /tank-raidz2/bench … [23:30:49] Test files removed [23:30:49] Dropping Linux page cache + ZFS ARC … [23:30:50] Flushing ZFS ARC (was 1) … [23:30:55] ARC flushed — current size: 23480328 bytes [23:30:55] NVMe volatile write caches flushed [23:30:56] pmcd healthy (core ✓ pmdazfs ✓) [23:30:56] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd16-nj1_run2.ndjson [23:30:57] Collector running (PID 777647), settling 5s … [23:31:02] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd16-nj1.fio [23:36:37] fio completed in 335s [23:36:37] Post-fio settle 5s … [23:36:42] Stopping collector [23:36:43] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd16-nj1_run2.manifest.json [23:36:43] Cooldown: 30s [23:37:13] ──────────────────────────────────────────────────── [23:37:13] Run 3/3: rand-read-qd16-nj1_run3 [23:37:13] ──────────────────────────────────────────────────── [23:37:13] Cleaning fio test files from /tank-raidz2/bench … [23:37:13] Test files removed [23:37:13] Dropping Linux page cache + ZFS ARC … [23:37:13] Flushing ZFS ARC (was 1) … [23:37:18] ARC flushed — current size: 23850104 bytes [23:37:18] NVMe volatile write caches flushed [23:37:20] pmcd healthy (core ✓ pmdazfs ✓) [23:37:20] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd16-nj1_run3.ndjson [23:37:21] Collector running (PID 781775), settling 5s … [23:37:26] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd16-nj1.fio [23:43:04] fio completed in 338s [23:43:04] Post-fio settle 5s … [23:43:09] Stopping collector [23:43:10] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd16-nj1_run3.manifest.json [23:43:10] ═══════════════════════════════════════════════════════════ [23:43:10] All 3 runs complete for: rand-read-qd16-nj1 [23:43:10] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [23:43:10] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [23:43:10] ═══════════════════════════════════════════════════════════ [23:43:10] Progress: 25/53 jobs | Elapsed: 19h42m | ETA: ~22h4m [23:43:10] [23:43:10] ╔══════════════════════════════════════════════════════════╗ [23:43:10] ║ Job 26/53: rand-read-qd16-nj8 [23:43:10] ║ Category: rand [23:43:10] ╚══════════════════════════════════════════════════════════╝ [23:43:10] ╔══════════════════════════════════════════════════════════╗ [23:43:10] ║ Benchmark: rand-read-qd16-nj8 [23:43:10] ║ Category: rand [23:43:10] ║ Runs: 3 × cooldown 30s [23:43:10] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [23:43:10] ╚══════════════════════════════════════════════════════════╝ [23:43:10] ──────────────────────────────────────────────────── [23:43:10] Run 1/3: rand-read-qd16-nj8_run1 [23:43:10] ──────────────────────────────────────────────────── [23:43:10] Cleaning fio test files from /tank-raidz2/bench … [23:43:10] Test files removed [23:43:10] Dropping Linux page cache + ZFS ARC … [23:43:10] Flushing ZFS ARC (was 1) … [23:43:15] ARC flushed — current size: 24210952 bytes [23:43:15] NVMe volatile write caches flushed [23:43:17] pmcd healthy (core ✓ pmdazfs ✓) [23:43:17] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd16-nj8_run1.ndjson [23:43:18] Collector running (PID 785849), settling 5s … [23:43:23] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd16-nj8.fio [00:06:14] fio completed in 1371s [00:06:14] Post-fio settle 5s … [00:06:19] Stopping collector [00:06:21] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd16-nj8_run1.manifest.json [00:06:21] Cooldown: 30s [00:06:51] ──────────────────────────────────────────────────── [00:06:51] Run 2/3: rand-read-qd16-nj8_run2 [00:06:51] ──────────────────────────────────────────────────── [00:06:51] Cleaning fio test files from /tank-raidz2/bench … [00:06:51] Test files removed [00:06:51] Dropping Linux page cache + ZFS ARC … [00:06:51] Flushing ZFS ARC (was 1) … [00:06:56] ARC flushed — current size: 14320224016 bytes [00:06:56] NVMe volatile write caches flushed [00:06:58] pmcd healthy (core ✓ pmdazfs ✓) [00:06:58] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd16-nj8_run2.ndjson [00:06:59] Collector running (PID 802304), settling 5s … [00:07:04] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd16-nj8.fio [00:29:55] fio completed in 1371s [00:29:55] Post-fio settle 5s … [00:30:00] Stopping collector [00:30:02] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd16-nj8_run2.manifest.json [00:30:02] Cooldown: 30s [00:30:32] ──────────────────────────────────────────────────── [00:30:32] Run 3/3: rand-read-qd16-nj8_run3 [00:30:32] ──────────────────────────────────────────────────── [00:30:32] Cleaning fio test files from /tank-raidz2/bench … [00:30:32] Test files removed [00:30:32] Dropping Linux page cache + ZFS ARC … [00:30:32] Flushing ZFS ARC (was 1) … [00:30:37] ARC flushed — current size: 25711521808 bytes [00:30:37] NVMe volatile write caches flushed [00:30:39] pmcd healthy (core ✓ pmdazfs ✓) [00:30:39] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd16-nj8_run3.ndjson [00:30:40] Collector running (PID 819155), settling 5s … [00:30:45] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd16-nj8.fio [00:53:34] fio completed in 1369s [00:53:34] Post-fio settle 5s … [00:53:39] Stopping collector [00:53:40] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd16-nj8_run3.manifest.json [00:53:40] ═══════════════════════════════════════════════════════════ [00:53:40] All 3 runs complete for: rand-read-qd16-nj8 [00:53:40] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [00:53:40] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [00:53:40] ═══════════════════════════════════════════════════════════ [00:53:40] Progress: 26/53 jobs | Elapsed: 20h53m | ETA: ~21h41m [00:53:40] [00:53:40] ╔══════════════════════════════════════════════════════════╗ [00:53:40] ║ Job 27/53: rand-read-qd16-nj16 [00:53:40] ║ Category: rand [00:53:40] ╚══════════════════════════════════════════════════════════╝ [00:53:40] ╔══════════════════════════════════════════════════════════╗ [00:53:40] ║ Benchmark: rand-read-qd16-nj16 [00:53:40] ║ Category: rand [00:53:40] ║ Runs: 3 × cooldown 30s [00:53:40] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [00:53:40] ╚══════════════════════════════════════════════════════════╝ [00:53:40] ──────────────────────────────────────────────────── [00:53:40] Run 1/3: rand-read-qd16-nj16_run1 [00:53:40] ──────────────────────────────────────────────────── [00:53:40] Cleaning fio test files from /tank-raidz2/bench … [00:53:40] Test files removed [00:53:40] Dropping Linux page cache + ZFS ARC … [00:53:40] Flushing ZFS ARC (was 1) … [00:53:45] ARC flushed — current size: 41177886584 bytes [00:53:45] NVMe volatile write caches flushed [00:53:47] pmcd healthy (core ✓ pmdazfs ✓) [00:53:47] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd16-nj16_run1.ndjson [00:53:48] Collector running (PID 834783), settling 5s … [00:53:53] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd16-nj16.fio [01:36:22] fio completed in 2549s [01:36:22] Post-fio settle 5s … [01:36:27] Stopping collector [01:36:28] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd16-nj16_run1.manifest.json [01:36:28] Cooldown: 30s [01:36:58] ──────────────────────────────────────────────────── [01:36:58] Run 2/3: rand-read-qd16-nj16_run2 [01:36:58] ──────────────────────────────────────────────────── [01:36:58] Cleaning fio test files from /tank-raidz2/bench … [01:36:58] Test files removed [01:36:58] Dropping Linux page cache + ZFS ARC … [01:36:59] Flushing ZFS ARC (was 1) … [01:37:04] ARC flushed — current size: 48578756256 bytes [01:37:04] NVMe volatile write caches flushed [01:37:05] pmcd healthy (core ✓ pmdazfs ✓) [01:37:05] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd16-nj16_run2.ndjson [01:37:06] Collector running (PID 864758), settling 5s … [01:37:11] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd16-nj16.fio [02:19:38] fio completed in 2547s [02:19:38] Post-fio settle 5s … [02:19:43] Stopping collector [02:19:45] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd16-nj16_run2.manifest.json [02:19:45] Cooldown: 30s [02:20:15] ──────────────────────────────────────────────────── [02:20:15] Run 3/3: rand-read-qd16-nj16_run3 [02:20:15] ──────────────────────────────────────────────────── [02:20:15] Cleaning fio test files from /tank-raidz2/bench … [02:20:15] Test files removed [02:20:15] Dropping Linux page cache + ZFS ARC … [02:20:15] Flushing ZFS ARC (was 1) … [02:20:20] ARC flushed — current size: 49297475088 bytes [02:20:20] NVMe volatile write caches flushed [02:20:21] pmcd healthy (core ✓ pmdazfs ✓) [02:20:21] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd16-nj16_run3.ndjson [02:20:22] Collector running (PID 894124), settling 5s … [02:20:27] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd16-nj16.fio [03:03:05] fio completed in 2558s [03:03:05] Post-fio settle 5s … [03:03:10] Stopping collector [03:03:11] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd16-nj16_run3.manifest.json [03:03:11] ═══════════════════════════════════════════════════════════ [03:03:11] All 3 runs complete for: rand-read-qd16-nj16 [03:03:11] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [03:03:11] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [03:03:11] ═══════════════════════════════════════════════════════════ [03:03:11] Progress: 27/53 jobs | Elapsed: 23h2m | ETA: ~22h11m [03:03:11] [03:03:11] ╔══════════════════════════════════════════════════════════╗ [03:03:11] ║ Job 28/53: rand-read-qd16-nj32 [03:03:11] ║ Category: rand [03:03:11] ╚══════════════════════════════════════════════════════════╝ [03:03:11] ╔══════════════════════════════════════════════════════════╗ [03:03:11] ║ Benchmark: rand-read-qd16-nj32 [03:03:11] ║ Category: rand [03:03:11] ║ Runs: 3 × cooldown 30s [03:03:11] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [03:03:11] ╚══════════════════════════════════════════════════════════╝ [03:03:11] ──────────────────────────────────────────────────── [03:03:11] Run 1/3: rand-read-qd16-nj32_run1 [03:03:11] ──────────────────────────────────────────────────── [03:03:11] Cleaning fio test files from /tank-raidz2/bench … [03:03:12] Test files removed [03:03:12] Dropping Linux page cache + ZFS ARC … [03:03:12] Flushing ZFS ARC (was 1) … [03:03:17] ARC flushed — current size: 48893574840 bytes [03:03:17] NVMe volatile write caches flushed [03:03:18] pmcd healthy (core ✓ pmdazfs ✓) [03:03:18] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd16-nj32_run1.ndjson [03:03:19] Collector running (PID 924233), settling 5s … [03:03:24] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd16-nj32.fio [04:25:15] fio completed in 4911s [04:25:15] Post-fio settle 5s … [04:25:20] Stopping collector [04:25:22] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd16-nj32_run1.manifest.json [04:25:22] Cooldown: 30s [04:25:52] ──────────────────────────────────────────────────── [04:25:52] Run 2/3: rand-read-qd16-nj32_run2 [04:25:52] ──────────────────────────────────────────────────── [04:25:52] Cleaning fio test files from /tank-raidz2/bench … [04:25:52] Test files removed [04:25:52] Dropping Linux page cache + ZFS ARC … [04:25:53] Flushing ZFS ARC (was 1) … [04:25:58] ARC flushed — current size: 92490505672 bytes [04:25:58] NVMe volatile write caches flushed [04:25:59] pmcd healthy (core ✓ pmdazfs ✓) [04:25:59] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd16-nj32_run2.ndjson [04:26:00] Collector running (PID 981187), settling 5s … [04:26:05] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd16-nj32.fio [05:48:06] fio completed in 4921s [05:48:06] Post-fio settle 5s … [05:48:11] Stopping collector [05:48:12] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd16-nj32_run2.manifest.json [05:48:12] Cooldown: 30s [05:48:42] ──────────────────────────────────────────────────── [05:48:42] Run 3/3: rand-read-qd16-nj32_run3 [05:48:42] ──────────────────────────────────────────────────── [05:48:42] Cleaning fio test files from /tank-raidz2/bench … [05:48:42] Test files removed [05:48:42] Dropping Linux page cache + ZFS ARC … [05:48:42] Flushing ZFS ARC (was 1) … [05:48:47] ARC flushed — current size: 86866717280 bytes [05:48:47] NVMe volatile write caches flushed [05:48:49] pmcd healthy (core ✓ pmdazfs ✓) [05:48:49] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd16-nj32_run3.ndjson [05:48:50] Collector running (PID 1037519), settling 5s … [05:48:55] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd16-nj32.fio [07:10:19] fio completed in 4884s [07:10:19] Post-fio settle 5s … [07:10:24] Stopping collector [07:10:26] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd16-nj32_run3.manifest.json [07:10:26] ═══════════════════════════════════════════════════════════ [07:10:26] All 3 runs complete for: rand-read-qd16-nj32 [07:10:26] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [07:10:26] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [07:10:26] ═══════════════════════════════════════════════════════════ [07:10:26] Progress: 28/53 jobs | Elapsed: 27h10m | ETA: ~24h15m [07:10:26] [07:10:26] ╔══════════════════════════════════════════════════════════╗ [07:10:26] ║ Job 29/53: rand-read-qd32-nj1 [07:10:26] ║ Category: rand [07:10:26] ╚══════════════════════════════════════════════════════════╝ [07:10:26] ╔══════════════════════════════════════════════════════════╗ [07:10:26] ║ Benchmark: rand-read-qd32-nj1 [07:10:26] ║ Category: rand [07:10:26] ║ Runs: 3 × cooldown 30s [07:10:26] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [07:10:26] ╚══════════════════════════════════════════════════════════╝ [07:10:26] ──────────────────────────────────────────────────── [07:10:26] Run 1/3: rand-read-qd32-nj1_run1 [07:10:26] ──────────────────────────────────────────────────── [07:10:26] Cleaning fio test files from /tank-raidz2/bench … [07:10:26] Test files removed [07:10:26] Dropping Linux page cache + ZFS ARC … [07:10:26] Flushing ZFS ARC (was 1) … [07:10:31] ARC flushed — current size: 87308023560 bytes [07:10:31] NVMe volatile write caches flushed [07:10:32] pmcd healthy (core ✓ pmdazfs ✓) [07:10:32] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd32-nj1_run1.ndjson [07:10:33] Collector running (PID 1094052), settling 5s … [07:10:38] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd32-nj1.fio [07:16:19] fio completed in 341s [07:16:19] Post-fio settle 5s … [07:16:24] Stopping collector [07:16:25] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd32-nj1_run1.manifest.json [07:16:25] Cooldown: 30s [07:16:55] ──────────────────────────────────────────────────── [07:16:55] Run 2/3: rand-read-qd32-nj1_run2 [07:16:55] ──────────────────────────────────────────────────── [07:16:55] Cleaning fio test files from /tank-raidz2/bench … [07:16:56] Test files removed [07:16:56] Dropping Linux page cache + ZFS ARC … [07:16:56] Flushing ZFS ARC (was 1) … [07:17:01] ARC flushed — current size: 24849440 bytes [07:17:01] NVMe volatile write caches flushed [07:17:02] pmcd healthy (core ✓ pmdazfs ✓) [07:17:02] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd32-nj1_run2.ndjson [07:17:03] Collector running (PID 1098209), settling 5s … [07:17:08] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd32-nj1.fio [07:22:43] fio completed in 335s [07:22:43] Post-fio settle 5s … [07:22:48] Stopping collector [07:22:50] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd32-nj1_run2.manifest.json [07:22:50] Cooldown: 30s [07:23:20] ──────────────────────────────────────────────────── [07:23:20] Run 3/3: rand-read-qd32-nj1_run3 [07:23:20] ──────────────────────────────────────────────────── [07:23:20] Cleaning fio test files from /tank-raidz2/bench … [07:23:20] Test files removed [07:23:20] Dropping Linux page cache + ZFS ARC … [07:23:20] Flushing ZFS ARC (was 1) … [07:23:25] ARC flushed — current size: 25430560 bytes [07:23:25] NVMe volatile write caches flushed [07:23:26] pmcd healthy (core ✓ pmdazfs ✓) [07:23:26] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd32-nj1_run3.ndjson [07:23:27] Collector running (PID 1102276), settling 5s … [07:23:32] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd32-nj1.fio [07:29:11] fio completed in 339s [07:29:11] Post-fio settle 5s … [07:29:16] Stopping collector [07:29:17] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd32-nj1_run3.manifest.json [07:29:17] ═══════════════════════════════════════════════════════════ [07:29:17] All 3 runs complete for: rand-read-qd32-nj1 [07:29:17] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [07:29:17] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [07:29:17] ═══════════════════════════════════════════════════════════ [07:29:17] Progress: 29/53 jobs | Elapsed: 27h29m | ETA: ~22h44m [07:29:17] [07:29:17] ╔══════════════════════════════════════════════════════════╗ [07:29:17] ║ Job 30/53: rand-read-qd32-nj8 [07:29:17] ║ Category: rand [07:29:17] ╚══════════════════════════════════════════════════════════╝ [07:29:17] ╔══════════════════════════════════════════════════════════╗ [07:29:17] ║ Benchmark: rand-read-qd32-nj8 [07:29:17] ║ Category: rand [07:29:17] ║ Runs: 3 × cooldown 30s [07:29:17] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [07:29:17] ╚══════════════════════════════════════════════════════════╝ [07:29:17] ──────────────────────────────────────────────────── [07:29:17] Run 1/3: rand-read-qd32-nj8_run1 [07:29:17] ──────────────────────────────────────────────────── [07:29:17] Cleaning fio test files from /tank-raidz2/bench … [07:29:17] Test files removed [07:29:17] Dropping Linux page cache + ZFS ARC … [07:29:17] Flushing ZFS ARC (was 1) … [07:29:22] ARC flushed — current size: 25836464 bytes [07:29:22] NVMe volatile write caches flushed [07:29:23] pmcd healthy (core ✓ pmdazfs ✓) [07:29:23] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd32-nj8_run1.ndjson [07:29:24] Collector running (PID 1107018), settling 5s … [07:29:29] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd32-nj8.fio [07:52:13] fio completed in 1364s [07:52:13] Post-fio settle 5s … [07:52:18] Stopping collector [07:52:19] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd32-nj8_run1.manifest.json [07:52:19] Cooldown: 30s [07:52:49] ──────────────────────────────────────────────────── [07:52:49] Run 2/3: rand-read-qd32-nj8_run2 [07:52:49] ──────────────────────────────────────────────────── [07:52:49] Cleaning fio test files from /tank-raidz2/bench … [07:52:49] Test files removed [07:52:49] Dropping Linux page cache + ZFS ARC … [07:52:49] Flushing ZFS ARC (was 1) … [07:52:54] ARC flushed — current size: 49302463504 bytes [07:52:54] NVMe volatile write caches flushed [07:52:56] pmcd healthy (core ✓ pmdazfs ✓) [07:52:56] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd32-nj8_run2.ndjson [07:52:57] Collector running (PID 1122718), settling 5s … [07:53:02] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd32-nj8.fio [08:15:36] fio completed in 1354s [08:15:36] Post-fio settle 5s … [08:15:41] Stopping collector [08:15:42] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd32-nj8_run2.manifest.json [08:15:42] Cooldown: 30s [08:16:12] ──────────────────────────────────────────────────── [08:16:12] Run 3/3: rand-read-qd32-nj8_run3 [08:16:12] ──────────────────────────────────────────────────── [08:16:12] Cleaning fio test files from /tank-raidz2/bench … [08:16:13] Test files removed [08:16:13] Dropping Linux page cache + ZFS ARC … [08:16:13] Flushing ZFS ARC (was 1) … [08:16:18] ARC flushed — current size: 60248592696 bytes [08:16:18] NVMe volatile write caches flushed [08:16:19] pmcd healthy (core ✓ pmdazfs ✓) [08:16:19] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd32-nj8_run3.ndjson [08:16:20] Collector running (PID 1139004), settling 5s … [08:16:25] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd32-nj8.fio [08:39:24] fio completed in 1379s [08:39:24] Post-fio settle 5s … [08:39:29] Stopping collector [08:39:30] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd32-nj8_run3.manifest.json [08:39:30] ═══════════════════════════════════════════════════════════ [08:39:30] All 3 runs complete for: rand-read-qd32-nj8 [08:39:30] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [08:39:30] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [08:39:30] ═══════════════════════════════════════════════════════════ [08:39:30] Progress: 30/53 jobs | Elapsed: 28h39m | ETA: ~21h57m [08:39:30] [08:39:30] ╔══════════════════════════════════════════════════════════╗ [08:39:30] ║ Job 31/53: rand-read-qd32-nj16 [08:39:30] ║ Category: rand [08:39:30] ╚══════════════════════════════════════════════════════════╝ [08:39:30] ╔══════════════════════════════════════════════════════════╗ [08:39:30] ║ Benchmark: rand-read-qd32-nj16 [08:39:30] ║ Category: rand [08:39:30] ║ Runs: 3 × cooldown 30s [08:39:30] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [08:39:30] ╚══════════════════════════════════════════════════════════╝ [08:39:30] ──────────────────────────────────────────────────── [08:39:30] Run 1/3: rand-read-qd32-nj16_run1 [08:39:30] ──────────────────────────────────────────────────── [08:39:30] Cleaning fio test files from /tank-raidz2/bench … [08:39:30] Test files removed [08:39:30] Dropping Linux page cache + ZFS ARC … [08:39:30] Flushing ZFS ARC (was 1) … [08:39:35] ARC flushed — current size: 29295560 bytes [08:39:35] NVMe volatile write caches flushed [08:39:37] pmcd healthy (core ✓ pmdazfs ✓) [08:39:37] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd32-nj16_run1.ndjson [08:39:38] Collector running (PID 1155536), settling 5s … [08:39:43] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd32-nj16.fio [09:22:17] fio completed in 2554s [09:22:17] Post-fio settle 5s … [09:22:22] Stopping collector [09:22:23] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd32-nj16_run1.manifest.json [09:22:23] Cooldown: 30s [09:22:53] ──────────────────────────────────────────────────── [09:22:53] Run 2/3: rand-read-qd32-nj16_run2 [09:22:53] ──────────────────────────────────────────────────── [09:22:53] Cleaning fio test files from /tank-raidz2/bench … [09:22:53] Test files removed [09:22:53] Dropping Linux page cache + ZFS ARC … [09:22:54] Flushing ZFS ARC (was 1) … [09:22:59] ARC flushed — current size: 54436293592 bytes [09:22:59] NVMe volatile write caches flushed [09:23:00] pmcd healthy (core ✓ pmdazfs ✓) [09:23:00] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd32-nj16_run2.ndjson [09:23:01] Collector running (PID 1184962), settling 5s … [09:23:06] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd32-nj16.fio [10:05:26] fio completed in 2540s [10:05:26] Post-fio settle 5s … [10:05:31] Stopping collector [10:05:32] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd32-nj16_run2.manifest.json [10:05:32] Cooldown: 30s [10:06:02] ──────────────────────────────────────────────────── [10:06:02] Run 3/3: rand-read-qd32-nj16_run3 [10:06:02] ──────────────────────────────────────────────────── [10:06:02] Cleaning fio test files from /tank-raidz2/bench … [10:06:02] Test files removed [10:06:02] Dropping Linux page cache + ZFS ARC … [10:06:02] Flushing ZFS ARC (was 1) … [10:06:07] ARC flushed — current size: 48566859528 bytes [10:06:07] NVMe volatile write caches flushed [10:06:08] pmcd healthy (core ✓ pmdazfs ✓) [10:06:08] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd32-nj16_run3.ndjson [10:06:09] Collector running (PID 1214849), settling 5s … [10:06:14] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd32-nj16.fio [10:48:33] fio completed in 2539s [10:48:33] Post-fio settle 5s … [10:48:38] Stopping collector [10:48:39] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd32-nj16_run3.manifest.json [10:48:39] ═══════════════════════════════════════════════════════════ [10:48:39] All 3 runs complete for: rand-read-qd32-nj16 [10:48:39] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [10:48:39] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [10:48:39] ═══════════════════════════════════════════════════════════ [10:48:39] Progress: 31/53 jobs | Elapsed: 30h48m | ETA: ~21h51m [10:48:39] [10:48:39] ╔══════════════════════════════════════════════════════════╗ [10:48:39] ║ Job 32/53: rand-read-qd32-nj32 [10:48:39] ║ Category: rand [10:48:39] ╚══════════════════════════════════════════════════════════╝ [10:48:39] ╔══════════════════════════════════════════════════════════╗ [10:48:39] ║ Benchmark: rand-read-qd32-nj32 [10:48:39] ║ Category: rand [10:48:39] ║ Runs: 3 × cooldown 30s [10:48:39] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [10:48:39] ╚══════════════════════════════════════════════════════════╝ [10:48:39] ──────────────────────────────────────────────────── [10:48:39] Run 1/3: rand-read-qd32-nj32_run1 [10:48:39] ──────────────────────────────────────────────────── [10:48:39] Cleaning fio test files from /tank-raidz2/bench … [10:48:39] Test files removed [10:48:39] Dropping Linux page cache + ZFS ARC … [10:48:40] Flushing ZFS ARC (was 1) … [10:48:45] ARC flushed — current size: 48932639184 bytes [10:48:45] NVMe volatile write caches flushed [10:48:46] pmcd healthy (core ✓ pmdazfs ✓) [10:48:46] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd32-nj32_run1.ndjson [10:48:47] Collector running (PID 1243984), settling 5s … [10:48:52] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd32-nj32.fio [12:10:22] fio completed in 4890s [12:10:22] Post-fio settle 5s … [12:10:27] Stopping collector [12:10:29] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd32-nj32_run1.manifest.json [12:10:29] Cooldown: 30s [12:10:59] ──────────────────────────────────────────────────── [12:10:59] Run 2/3: rand-read-qd32-nj32_run2 [12:10:59] ──────────────────────────────────────────────────── [12:10:59] Cleaning fio test files from /tank-raidz2/bench … [12:10:59] Test files removed [12:10:59] Dropping Linux page cache + ZFS ARC … [12:11:00] Flushing ZFS ARC (was 1) … [12:11:05] ARC flushed — current size: 91382271912 bytes [12:11:05] NVMe volatile write caches flushed [12:11:06] pmcd healthy (core ✓ pmdazfs ✓) [12:11:06] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd32-nj32_run2.ndjson [12:11:07] Collector running (PID 1300742), settling 5s … [12:11:12] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd32-nj32.fio [13:33:10] fio completed in 4918s [13:33:10] Post-fio settle 5s … [13:33:15] Stopping collector [13:33:16] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd32-nj32_run2.manifest.json [13:33:16] Cooldown: 30s [13:33:46] ──────────────────────────────────────────────────── [13:33:46] Run 3/3: rand-read-qd32-nj32_run3 [13:33:46] ──────────────────────────────────────────────────── [13:33:46] Cleaning fio test files from /tank-raidz2/bench … [13:33:47] Test files removed [13:33:47] Dropping Linux page cache + ZFS ARC … [13:33:47] Flushing ZFS ARC (was 1) … [13:33:52] ARC flushed — current size: 91054498688 bytes [13:33:52] NVMe volatile write caches flushed [13:33:53] pmcd healthy (core ✓ pmdazfs ✓) [13:33:53] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-read-qd32-nj32_run3.ndjson [13:33:54] Collector running (PID 1357765), settling 5s … [13:33:59] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-read-qd32-nj32.fio [14:56:00] fio completed in 4921s [14:56:00] Post-fio settle 5s … [14:56:05] Stopping collector [14:56:06] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-read-qd32-nj32_run3.manifest.json [14:56:06] ═══════════════════════════════════════════════════════════ [14:56:06] All 3 runs complete for: rand-read-qd32-nj32 [14:56:06] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [14:56:06] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [14:56:06] ═══════════════════════════════════════════════════════════ [14:56:06] Progress: 32/53 jobs | Elapsed: 34h55m | ETA: ~22h55m [14:56:06] [14:56:06] ╔══════════════════════════════════════════════════════════╗ [14:56:06] ║ Job 33/53: rand-write-qd1-nj1 [14:56:06] ║ Category: rand [14:56:06] ╚══════════════════════════════════════════════════════════╝ [14:56:06] ╔══════════════════════════════════════════════════════════╗ [14:56:06] ║ Benchmark: rand-write-qd1-nj1 [14:56:06] ║ Category: rand [14:56:06] ║ Runs: 3 × cooldown 30s [14:56:06] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [14:56:06] ╚══════════════════════════════════════════════════════════╝ [14:56:06] ──────────────────────────────────────────────────── [14:56:06] Run 1/3: rand-write-qd1-nj1_run1 [14:56:06] ──────────────────────────────────────────────────── [14:56:06] Cleaning fio test files from /tank-raidz2/bench … [14:56:06] Test files removed [14:56:06] Dropping Linux page cache + ZFS ARC … [14:56:07] Flushing ZFS ARC (was 1) … [14:56:12] ARC flushed — current size: 87280272264 bytes [14:56:12] NVMe volatile write caches flushed [14:56:13] pmcd healthy (core ✓ pmdazfs ✓) [14:56:13] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd1-nj1_run1.ndjson [14:56:14] Collector running (PID 1414711), settling 5s … [14:56:19] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd1-nj1.fio [14:59:29] fio completed in 190s [14:59:29] Post-fio settle 5s … [14:59:34] Stopping collector [14:59:35] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd1-nj1_run1.manifest.json [14:59:35] Cooldown: 30s [15:00:05] ──────────────────────────────────────────────────── [15:00:05] Run 2/3: rand-write-qd1-nj1_run2 [15:00:05] ──────────────────────────────────────────────────── [15:00:05] Cleaning fio test files from /tank-raidz2/bench … [15:00:06] Test files removed [15:00:06] Dropping Linux page cache + ZFS ARC … [15:00:06] Flushing ZFS ARC (was 1) … [15:00:11] ARC flushed — current size: 15450692304 bytes [15:00:11] NVMe volatile write caches flushed [15:00:12] pmcd healthy (core ✓ pmdazfs ✓) [15:00:12] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd1-nj1_run2.ndjson [15:00:13] Collector running (PID 1417209), settling 5s … [15:00:18] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd1-nj1.fio [15:03:29] fio completed in 191s [15:03:29] Post-fio settle 5s … [15:03:34] Stopping collector [15:03:35] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd1-nj1_run2.manifest.json [15:03:35] Cooldown: 30s [15:04:05] ──────────────────────────────────────────────────── [15:04:05] Run 3/3: rand-write-qd1-nj1_run3 [15:04:05] ──────────────────────────────────────────────────── [15:04:05] Cleaning fio test files from /tank-raidz2/bench … [15:04:05] Test files removed [15:04:05] Dropping Linux page cache + ZFS ARC … [15:04:05] Flushing ZFS ARC (was 1) … [15:04:10] ARC flushed — current size: 45680371104 bytes [15:04:10] NVMe volatile write caches flushed [15:04:12] pmcd healthy (core ✓ pmdazfs ✓) [15:04:12] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd1-nj1_run3.ndjson [15:04:13] Collector running (PID 1419672), settling 5s … [15:04:18] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd1-nj1.fio [15:07:28] fio completed in 190s [15:07:28] Post-fio settle 5s … [15:07:33] Stopping collector [15:07:35] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd1-nj1_run3.manifest.json [15:07:35] ═══════════════════════════════════════════════════════════ [15:07:35] All 3 runs complete for: rand-write-qd1-nj1 [15:07:35] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [15:07:35] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [15:07:35] ═══════════════════════════════════════════════════════════ [15:07:35] Progress: 33/53 jobs | Elapsed: 35h7m | ETA: ~21h17m [15:07:35] [15:07:35] ╔══════════════════════════════════════════════════════════╗ [15:07:35] ║ Job 34/53: rand-write-qd1-nj8 [15:07:35] ║ Category: rand [15:07:35] ╚══════════════════════════════════════════════════════════╝ [15:07:35] ╔══════════════════════════════════════════════════════════╗ [15:07:35] ║ Benchmark: rand-write-qd1-nj8 [15:07:35] ║ Category: rand [15:07:35] ║ Runs: 3 × cooldown 30s [15:07:35] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [15:07:35] ╚══════════════════════════════════════════════════════════╝ [15:07:35] ──────────────────────────────────────────────────── [15:07:35] Run 1/3: rand-write-qd1-nj8_run1 [15:07:35] ──────────────────────────────────────────────────── [15:07:35] Cleaning fio test files from /tank-raidz2/bench … [15:07:35] Test files removed [15:07:35] Dropping Linux page cache + ZFS ARC … [15:07:36] Flushing ZFS ARC (was 1) … [15:07:41] ARC flushed — current size: 56707360 bytes [15:07:41] NVMe volatile write caches flushed [15:07:42] pmcd healthy (core ✓ pmdazfs ✓) [15:07:42] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd1-nj8_run1.ndjson [15:07:43] Collector running (PID 1422076), settling 5s … [15:07:48] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd1-nj8.fio [15:10:58] fio completed in 190s [15:10:58] Post-fio settle 5s … [15:11:03] Stopping collector [15:11:04] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd1-nj8_run1.manifest.json [15:11:04] Cooldown: 30s [15:11:34] ──────────────────────────────────────────────────── [15:11:34] Run 2/3: rand-write-qd1-nj8_run2 [15:11:34] ──────────────────────────────────────────────────── [15:11:34] Cleaning fio test files from /tank-raidz2/bench … [15:11:35] Test files removed [15:11:35] Dropping Linux page cache + ZFS ARC … [15:11:35] Flushing ZFS ARC (was 1) … [15:11:40] ARC flushed — current size: 9829147408 bytes [15:11:40] NVMe volatile write caches flushed [15:11:41] pmcd healthy (core ✓ pmdazfs ✓) [15:11:41] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd1-nj8_run2.ndjson [15:11:42] Collector running (PID 1424712), settling 5s … [15:11:47] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd1-nj8.fio [15:14:58] fio completed in 191s [15:14:58] Post-fio settle 5s … [15:15:03] Stopping collector [15:15:05] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd1-nj8_run2.manifest.json [15:15:05] Cooldown: 30s [15:15:35] ──────────────────────────────────────────────────── [15:15:35] Run 3/3: rand-write-qd1-nj8_run3 [15:15:35] ──────────────────────────────────────────────────── [15:15:35] Cleaning fio test files from /tank-raidz2/bench … [15:15:35] Test files removed [15:15:35] Dropping Linux page cache + ZFS ARC … [15:15:35] Flushing ZFS ARC (was 1) … [15:15:40] ARC flushed — current size: 68407207184 bytes [15:15:40] NVMe volatile write caches flushed [15:15:42] pmcd healthy (core ✓ pmdazfs ✓) [15:15:42] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd1-nj8_run3.ndjson [15:15:43] Collector running (PID 1427367), settling 5s … [15:15:48] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd1-nj8.fio [15:18:58] fio completed in 190s [15:18:58] Post-fio settle 5s … [15:19:03] Stopping collector [15:19:04] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd1-nj8_run3.manifest.json [15:19:04] ═══════════════════════════════════════════════════════════ [15:19:04] All 3 runs complete for: rand-write-qd1-nj8 [15:19:04] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [15:19:04] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [15:19:04] ═══════════════════════════════════════════════════════════ [15:19:04] Progress: 34/53 jobs | Elapsed: 35h18m | ETA: ~19h44m [15:19:04] [15:19:04] ╔══════════════════════════════════════════════════════════╗ [15:19:04] ║ Job 35/53: rand-write-qd1-nj16 [15:19:04] ║ Category: rand [15:19:04] ╚══════════════════════════════════════════════════════════╝ [15:19:04] ╔══════════════════════════════════════════════════════════╗ [15:19:04] ║ Benchmark: rand-write-qd1-nj16 [15:19:04] ║ Category: rand [15:19:04] ║ Runs: 3 × cooldown 30s [15:19:04] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [15:19:04] ╚══════════════════════════════════════════════════════════╝ [15:19:04] ──────────────────────────────────────────────────── [15:19:04] Run 1/3: rand-write-qd1-nj16_run1 [15:19:04] ──────────────────────────────────────────────────── [15:19:04] Cleaning fio test files from /tank-raidz2/bench … [15:19:05] Test files removed [15:19:05] Dropping Linux page cache + ZFS ARC … [15:19:05] Flushing ZFS ARC (was 1) … [15:19:10] ARC flushed — current size: 33278326616 bytes [15:19:10] NVMe volatile write caches flushed [15:19:11] pmcd healthy (core ✓ pmdazfs ✓) [15:19:11] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd1-nj16_run1.ndjson [15:19:12] Collector running (PID 1429957), settling 5s … [15:19:17] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd1-nj16.fio [15:22:28] fio completed in 191s [15:22:28] Post-fio settle 5s … [15:22:33] Stopping collector [15:22:34] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd1-nj16_run1.manifest.json [15:22:34] Cooldown: 30s [15:23:04] ──────────────────────────────────────────────────── [15:23:04] Run 2/3: rand-write-qd1-nj16_run2 [15:23:04] ──────────────────────────────────────────────────── [15:23:04] Cleaning fio test files from /tank-raidz2/bench … [15:23:04] Test files removed [15:23:04] Dropping Linux page cache + ZFS ARC … [15:23:04] Flushing ZFS ARC (was 1) … [15:23:09] ARC flushed — current size: 37378006992 bytes [15:23:09] NVMe volatile write caches flushed [15:23:11] pmcd healthy (core ✓ pmdazfs ✓) [15:23:11] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd1-nj16_run2.ndjson [15:23:12] Collector running (PID 1432590), settling 5s … [15:23:17] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd1-nj16.fio [15:26:27] fio completed in 190s [15:26:27] Post-fio settle 5s … [15:26:32] Stopping collector [15:26:33] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd1-nj16_run2.manifest.json [15:26:33] Cooldown: 30s [15:27:03] ──────────────────────────────────────────────────── [15:27:03] Run 3/3: rand-write-qd1-nj16_run3 [15:27:03] ──────────────────────────────────────────────────── [15:27:03] Cleaning fio test files from /tank-raidz2/bench … [15:27:03] Test files removed [15:27:03] Dropping Linux page cache + ZFS ARC … [15:27:04] Flushing ZFS ARC (was 1) … [15:27:09] ARC flushed — current size: 13233080064 bytes [15:27:09] NVMe volatile write caches flushed [15:27:10] pmcd healthy (core ✓ pmdazfs ✓) [15:27:10] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd1-nj16_run3.ndjson [15:27:11] Collector running (PID 1435905), settling 5s … [15:27:16] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd1-nj16.fio [15:30:26] fio completed in 190s [15:30:26] Post-fio settle 5s … [15:30:31] Stopping collector [15:30:32] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd1-nj16_run3.manifest.json [15:30:32] ═══════════════════════════════════════════════════════════ [15:30:32] All 3 runs complete for: rand-write-qd1-nj16 [15:30:32] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [15:30:32] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [15:30:32] ═══════════════════════════════════════════════════════════ [15:30:32] Progress: 35/53 jobs | Elapsed: 35h30m | ETA: ~18h15m [15:30:32] [15:30:32] ╔══════════════════════════════════════════════════════════╗ [15:30:32] ║ Job 36/53: rand-write-qd1-nj32 [15:30:32] ║ Category: rand [15:30:32] ╚══════════════════════════════════════════════════════════╝ [15:30:32] ╔══════════════════════════════════════════════════════════╗ [15:30:32] ║ Benchmark: rand-write-qd1-nj32 [15:30:32] ║ Category: rand [15:30:32] ║ Runs: 3 × cooldown 30s [15:30:32] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [15:30:32] ╚══════════════════════════════════════════════════════════╝ [15:30:32] ──────────────────────────────────────────────────── [15:30:32] Run 1/3: rand-write-qd1-nj32_run1 [15:30:32] ──────────────────────────────────────────────────── [15:30:32] Cleaning fio test files from /tank-raidz2/bench … [15:30:33] Test files removed [15:30:33] Dropping Linux page cache + ZFS ARC … [15:30:33] Flushing ZFS ARC (was 1) … [15:30:38] ARC flushed — current size: 12938718208 bytes [15:30:38] NVMe volatile write caches flushed [15:30:39] pmcd healthy (core ✓ pmdazfs ✓) [15:30:39] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd1-nj32_run1.ndjson [15:30:40] Collector running (PID 1438442), settling 5s … [15:30:45] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd1-nj32.fio [15:33:56] fio completed in 191s [15:33:56] Post-fio settle 5s … [15:34:01] Stopping collector [15:34:03] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd1-nj32_run1.manifest.json [15:34:03] Cooldown: 30s [15:34:33] ──────────────────────────────────────────────────── [15:34:33] Run 2/3: rand-write-qd1-nj32_run2 [15:34:33] ──────────────────────────────────────────────────── [15:34:33] Cleaning fio test files from /tank-raidz2/bench … [15:34:33] Test files removed [15:34:33] Dropping Linux page cache + ZFS ARC … [15:34:33] Flushing ZFS ARC (was 1) … [15:34:38] ARC flushed — current size: 52244536 bytes [15:34:38] NVMe volatile write caches flushed [15:34:40] pmcd healthy (core ✓ pmdazfs ✓) [15:34:40] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd1-nj32_run2.ndjson [15:34:41] Collector running (PID 1440965), settling 5s … [15:34:46] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd1-nj32.fio [15:37:56] fio completed in 190s [15:37:56] Post-fio settle 5s … [15:38:01] Stopping collector [15:38:02] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd1-nj32_run2.manifest.json [15:38:02] Cooldown: 30s [15:38:32] ──────────────────────────────────────────────────── [15:38:32] Run 3/3: rand-write-qd1-nj32_run3 [15:38:32] ──────────────────────────────────────────────────── [15:38:32] Cleaning fio test files from /tank-raidz2/bench … [15:38:32] Test files removed [15:38:32] Dropping Linux page cache + ZFS ARC … [15:38:33] Flushing ZFS ARC (was 1) … [15:38:38] ARC flushed — current size: 50339744 bytes [15:38:38] NVMe volatile write caches flushed [15:38:39] pmcd healthy (core ✓ pmdazfs ✓) [15:38:39] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd1-nj32_run3.ndjson [15:38:40] Collector running (PID 1443516), settling 5s … [15:38:45] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd1-nj32.fio [15:41:55] fio completed in 190s [15:41:55] Post-fio settle 5s … [15:42:00] Stopping collector [15:42:01] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd1-nj32_run3.manifest.json [15:42:01] ═══════════════════════════════════════════════════════════ [15:42:01] All 3 runs complete for: rand-write-qd1-nj32 [15:42:01] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [15:42:01] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [15:42:01] ═══════════════════════════════════════════════════════════ [15:42:01] Progress: 36/53 jobs | Elapsed: 35h41m | ETA: ~16h51m [15:42:01] [15:42:01] ╔══════════════════════════════════════════════════════════╗ [15:42:01] ║ Job 37/53: rand-write-qd4-nj1 [15:42:01] ║ Category: rand [15:42:01] ╚══════════════════════════════════════════════════════════╝ [15:42:01] ╔══════════════════════════════════════════════════════════╗ [15:42:01] ║ Benchmark: rand-write-qd4-nj1 [15:42:01] ║ Category: rand [15:42:01] ║ Runs: 3 × cooldown 30s [15:42:01] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [15:42:01] ╚══════════════════════════════════════════════════════════╝ [15:42:01] ──────────────────────────────────────────────────── [15:42:01] Run 1/3: rand-write-qd4-nj1_run1 [15:42:01] ──────────────────────────────────────────────────── [15:42:01] Cleaning fio test files from /tank-raidz2/bench … [15:42:02] Test files removed [15:42:02] Dropping Linux page cache + ZFS ARC … [15:42:02] Flushing ZFS ARC (was 1) … [15:42:07] ARC flushed — current size: 49887200 bytes [15:42:07] NVMe volatile write caches flushed [15:42:08] pmcd healthy (core ✓ pmdazfs ✓) [15:42:08] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd4-nj1_run1.ndjson [15:42:09] Collector running (PID 1446020), settling 5s … [15:42:14] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd4-nj1.fio [15:45:25] fio completed in 191s [15:45:25] Post-fio settle 5s … [15:45:30] Stopping collector [15:45:31] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd4-nj1_run1.manifest.json [15:45:31] Cooldown: 30s [15:46:01] ──────────────────────────────────────────────────── [15:46:01] Run 2/3: rand-write-qd4-nj1_run2 [15:46:01] ──────────────────────────────────────────────────── [15:46:01] Cleaning fio test files from /tank-raidz2/bench … [15:46:01] Test files removed [15:46:01] Dropping Linux page cache + ZFS ARC … [15:46:01] Flushing ZFS ARC (was 1) … [15:46:06] ARC flushed — current size: 75646192 bytes [15:46:06] NVMe volatile write caches flushed [15:46:08] pmcd healthy (core ✓ pmdazfs ✓) [15:46:08] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd4-nj1_run2.ndjson [15:46:09] Collector running (PID 1448586), settling 5s … [15:46:14] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd4-nj1.fio [15:49:24] fio completed in 190s [15:49:24] Post-fio settle 5s … [15:49:29] Stopping collector [15:49:30] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd4-nj1_run2.manifest.json [15:49:30] Cooldown: 30s [15:50:00] ──────────────────────────────────────────────────── [15:50:00] Run 3/3: rand-write-qd4-nj1_run3 [15:50:00] ──────────────────────────────────────────────────── [15:50:00] Cleaning fio test files from /tank-raidz2/bench … [15:50:00] Test files removed [15:50:00] Dropping Linux page cache + ZFS ARC … [15:50:01] Flushing ZFS ARC (was 1) … [15:50:06] ARC flushed — current size: 19385323792 bytes [15:50:06] NVMe volatile write caches flushed [15:50:07] pmcd healthy (core ✓ pmdazfs ✓) [15:50:07] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd4-nj1_run3.ndjson [15:50:08] Collector running (PID 1451059), settling 5s … [15:50:13] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd4-nj1.fio [15:53:23] fio completed in 190s [15:53:23] Post-fio settle 5s … [15:53:28] Stopping collector [15:53:29] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd4-nj1_run3.manifest.json [15:53:29] ═══════════════════════════════════════════════════════════ [15:53:29] All 3 runs complete for: rand-write-qd4-nj1 [15:53:29] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [15:53:29] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [15:53:29] ═══════════════════════════════════════════════════════════ [15:53:29] Progress: 37/53 jobs | Elapsed: 35h53m | ETA: ~15h30m [15:53:29] [15:53:29] ╔══════════════════════════════════════════════════════════╗ [15:53:29] ║ Job 38/53: rand-write-qd4-nj8 [15:53:29] ║ Category: rand [15:53:29] ╚══════════════════════════════════════════════════════════╝ [15:53:29] ╔══════════════════════════════════════════════════════════╗ [15:53:29] ║ Benchmark: rand-write-qd4-nj8 [15:53:29] ║ Category: rand [15:53:29] ║ Runs: 3 × cooldown 30s [15:53:29] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [15:53:29] ╚══════════════════════════════════════════════════════════╝ [15:53:29] ──────────────────────────────────────────────────── [15:53:29] Run 1/3: rand-write-qd4-nj8_run1 [15:53:29] ──────────────────────────────────────────────────── [15:53:30] Cleaning fio test files from /tank-raidz2/bench … [15:53:30] Test files removed [15:53:30] Dropping Linux page cache + ZFS ARC … [15:53:30] Flushing ZFS ARC (was 1) … [15:53:35] ARC flushed — current size: 19893006832 bytes [15:53:35] NVMe volatile write caches flushed [15:53:36] pmcd healthy (core ✓ pmdazfs ✓) [15:53:36] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd4-nj8_run1.ndjson [15:53:37] Collector running (PID 1453490), settling 5s … [15:53:42] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd4-nj8.fio [15:56:53] fio completed in 191s [15:56:53] Post-fio settle 5s … [15:56:58] Stopping collector [15:56:59] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd4-nj8_run1.manifest.json [15:56:59] Cooldown: 30s [15:57:29] ──────────────────────────────────────────────────── [15:57:29] Run 2/3: rand-write-qd4-nj8_run2 [15:57:29] ──────────────────────────────────────────────────── [15:57:29] Cleaning fio test files from /tank-raidz2/bench … [15:57:29] Test files removed [15:57:29] Dropping Linux page cache + ZFS ARC … [15:57:29] Flushing ZFS ARC (was 1) … [15:57:34] ARC flushed — current size: 97982232 bytes [15:57:34] NVMe volatile write caches flushed [15:57:36] pmcd healthy (core ✓ pmdazfs ✓) [15:57:36] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd4-nj8_run2.ndjson [15:57:37] Collector running (PID 1456801), settling 5s … [15:57:42] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd4-nj8.fio [16:00:52] fio completed in 190s [16:00:52] Post-fio settle 5s … [16:00:57] Stopping collector [16:00:58] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd4-nj8_run2.manifest.json [16:00:58] Cooldown: 30s [16:01:28] ──────────────────────────────────────────────────── [16:01:28] Run 3/3: rand-write-qd4-nj8_run3 [16:01:28] ──────────────────────────────────────────────────── [16:01:28] Cleaning fio test files from /tank-raidz2/bench … [16:01:29] Test files removed [16:01:29] Dropping Linux page cache + ZFS ARC … [16:01:29] Flushing ZFS ARC (was 1) … [16:01:34] ARC flushed — current size: 97185032 bytes [16:01:34] NVMe volatile write caches flushed [16:01:35] pmcd healthy (core ✓ pmdazfs ✓) [16:01:35] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd4-nj8_run3.ndjson [16:01:36] Collector running (PID 1459452), settling 5s … [16:01:41] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd4-nj8.fio [16:04:52] fio completed in 191s [16:04:52] Post-fio settle 5s … [16:04:57] Stopping collector [16:04:59] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd4-nj8_run3.manifest.json [16:04:59] ═══════════════════════════════════════════════════════════ [16:04:59] All 3 runs complete for: rand-write-qd4-nj8 [16:04:59] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [16:04:59] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [16:04:59] ═══════════════════════════════════════════════════════════ [16:04:59] Progress: 38/53 jobs | Elapsed: 36h4m | ETA: ~14h14m [16:04:59] [16:04:59] ╔══════════════════════════════════════════════════════════╗ [16:04:59] ║ Job 39/53: rand-write-qd4-nj16 [16:04:59] ║ Category: rand [16:04:59] ╚══════════════════════════════════════════════════════════╝ [16:04:59] ╔══════════════════════════════════════════════════════════╗ [16:04:59] ║ Benchmark: rand-write-qd4-nj16 [16:04:59] ║ Category: rand [16:04:59] ║ Runs: 3 × cooldown 30s [16:04:59] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [16:04:59] ╚══════════════════════════════════════════════════════════╝ [16:04:59] ──────────────────────────────────────────────────── [16:04:59] Run 1/3: rand-write-qd4-nj16_run1 [16:04:59] ──────────────────────────────────────────────────── [16:04:59] Cleaning fio test files from /tank-raidz2/bench … [16:04:59] Test files removed [16:04:59] Dropping Linux page cache + ZFS ARC … [16:04:59] Flushing ZFS ARC (was 1) … [16:05:04] ARC flushed — current size: 9324232288 bytes [16:05:04] NVMe volatile write caches flushed [16:05:06] pmcd healthy (core ✓ pmdazfs ✓) [16:05:06] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd4-nj16_run1.ndjson [16:05:07] Collector running (PID 1462064), settling 5s … [16:05:12] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd4-nj16.fio [16:08:22] fio completed in 190s [16:08:22] Post-fio settle 5s … [16:08:27] Stopping collector [16:08:28] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd4-nj16_run1.manifest.json [16:08:28] Cooldown: 30s [16:08:58] ──────────────────────────────────────────────────── [16:08:58] Run 2/3: rand-write-qd4-nj16_run2 [16:08:58] ──────────────────────────────────────────────────── [16:08:58] Cleaning fio test files from /tank-raidz2/bench … [16:08:58] Test files removed [16:08:58] Dropping Linux page cache + ZFS ARC … [16:08:59] Flushing ZFS ARC (was 1) … [16:09:04] ARC flushed — current size: 13011901488 bytes [16:09:04] NVMe volatile write caches flushed [16:09:05] pmcd healthy (core ✓ pmdazfs ✓) [16:09:05] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd4-nj16_run2.ndjson [16:09:06] Collector running (PID 1464682), settling 5s … [16:09:11] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd4-nj16.fio [16:12:21] fio completed in 190s [16:12:21] Post-fio settle 5s … [16:12:26] Stopping collector [16:12:27] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd4-nj16_run2.manifest.json [16:12:27] Cooldown: 30s [16:12:57] ──────────────────────────────────────────────────── [16:12:57] Run 3/3: rand-write-qd4-nj16_run3 [16:12:57] ──────────────────────────────────────────────────── [16:12:57] Cleaning fio test files from /tank-raidz2/bench … [16:12:58] Test files removed [16:12:58] Dropping Linux page cache + ZFS ARC … [16:12:58] Flushing ZFS ARC (was 1) … [16:13:03] ARC flushed — current size: 13087542960 bytes [16:13:03] NVMe volatile write caches flushed [16:13:04] pmcd healthy (core ✓ pmdazfs ✓) [16:13:04] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd4-nj16_run3.ndjson [16:13:05] Collector running (PID 1467303), settling 5s … [16:13:10] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd4-nj16.fio [16:16:21] fio completed in 191s [16:16:21] Post-fio settle 5s … [16:16:26] Stopping collector [16:16:28] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd4-nj16_run3.manifest.json [16:16:28] ═══════════════════════════════════════════════════════════ [16:16:28] All 3 runs complete for: rand-write-qd4-nj16 [16:16:28] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [16:16:28] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [16:16:28] ═══════════════════════════════════════════════════════════ [16:16:28] Progress: 39/53 jobs | Elapsed: 36h16m | ETA: ~13h1m [16:16:28] [16:16:28] ╔══════════════════════════════════════════════════════════╗ [16:16:28] ║ Job 40/53: rand-write-qd4-nj32 [16:16:28] ║ Category: rand [16:16:28] ╚══════════════════════════════════════════════════════════╝ [16:16:28] ╔══════════════════════════════════════════════════════════╗ [16:16:28] ║ Benchmark: rand-write-qd4-nj32 [16:16:28] ║ Category: rand [16:16:28] ║ Runs: 3 × cooldown 30s [16:16:28] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [16:16:28] ╚══════════════════════════════════════════════════════════╝ [16:16:28] ──────────────────────────────────────────────────── [16:16:28] Run 1/3: rand-write-qd4-nj32_run1 [16:16:28] ──────────────────────────────────────────────────── [16:16:28] Cleaning fio test files from /tank-raidz2/bench … [16:16:28] Test files removed [16:16:28] Dropping Linux page cache + ZFS ARC … [16:16:28] Flushing ZFS ARC (was 1) … [16:16:33] ARC flushed — current size: 13536263656 bytes [16:16:33] NVMe volatile write caches flushed [16:16:35] pmcd healthy (core ✓ pmdazfs ✓) [16:16:35] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd4-nj32_run1.ndjson [16:16:36] Collector running (PID 1469893), settling 5s … [16:16:41] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd4-nj32.fio [16:19:51] fio completed in 190s [16:19:51] Post-fio settle 5s … [16:19:56] Stopping collector [16:19:57] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd4-nj32_run1.manifest.json [16:19:57] Cooldown: 30s [16:20:27] ──────────────────────────────────────────────────── [16:20:27] Run 2/3: rand-write-qd4-nj32_run2 [16:20:27] ──────────────────────────────────────────────────── [16:20:27] Cleaning fio test files from /tank-raidz2/bench … [16:20:27] Test files removed [16:20:27] Dropping Linux page cache + ZFS ARC … [16:20:28] Flushing ZFS ARC (was 1) … [16:20:33] ARC flushed — current size: 67906344 bytes [16:20:33] NVMe volatile write caches flushed [16:20:34] pmcd healthy (core ✓ pmdazfs ✓) [16:20:34] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd4-nj32_run2.ndjson [16:20:35] Collector running (PID 1472439), settling 5s … [16:20:40] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd4-nj32.fio [16:23:50] fio completed in 190s [16:23:50] Post-fio settle 5s … [16:23:55] Stopping collector [16:23:57] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd4-nj32_run2.manifest.json [16:23:57] Cooldown: 30s [16:24:27] ──────────────────────────────────────────────────── [16:24:27] Run 3/3: rand-write-qd4-nj32_run3 [16:24:27] ──────────────────────────────────────────────────── [16:24:27] Cleaning fio test files from /tank-raidz2/bench … [16:24:27] Test files removed [16:24:27] Dropping Linux page cache + ZFS ARC … [16:24:27] Flushing ZFS ARC (was 1) … [16:24:32] ARC flushed — current size: 71056072 bytes [16:24:32] NVMe volatile write caches flushed [16:24:33] pmcd healthy (core ✓ pmdazfs ✓) [16:24:33] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd4-nj32_run3.ndjson [16:24:34] Collector running (PID 1474959), settling 5s … [16:24:39] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd4-nj32.fio [16:27:50] fio completed in 191s [16:27:50] Post-fio settle 5s … [16:27:55] Stopping collector [16:27:57] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd4-nj32_run3.manifest.json [16:27:57] ═══════════════════════════════════════════════════════════ [16:27:57] All 3 runs complete for: rand-write-qd4-nj32 [16:27:57] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [16:27:57] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [16:27:57] ═══════════════════════════════════════════════════════════ [16:27:57] Progress: 40/53 jobs | Elapsed: 36h27m | ETA: ~11h50m [16:27:57] [16:27:57] ╔══════════════════════════════════════════════════════════╗ [16:27:57] ║ Job 41/53: rand-write-qd16-nj1 [16:27:57] ║ Category: rand [16:27:57] ╚══════════════════════════════════════════════════════════╝ [16:27:57] ╔══════════════════════════════════════════════════════════╗ [16:27:57] ║ Benchmark: rand-write-qd16-nj1 [16:27:57] ║ Category: rand [16:27:57] ║ Runs: 3 × cooldown 30s [16:27:57] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [16:27:57] ╚══════════════════════════════════════════════════════════╝ [16:27:57] ──────────────────────────────────────────────────── [16:27:57] Run 1/3: rand-write-qd16-nj1_run1 [16:27:57] ──────────────────────────────────────────────────── [16:27:57] Cleaning fio test files from /tank-raidz2/bench … [16:27:57] Test files removed [16:27:57] Dropping Linux page cache + ZFS ARC … [16:27:57] Flushing ZFS ARC (was 1) … [16:28:02] ARC flushed — current size: 75385336 bytes [16:28:02] NVMe volatile write caches flushed [16:28:04] pmcd healthy (core ✓ pmdazfs ✓) [16:28:04] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd16-nj1_run1.ndjson [16:28:05] Collector running (PID 1478087), settling 5s … [16:28:10] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd16-nj1.fio [16:31:20] fio completed in 190s [16:31:20] Post-fio settle 5s … [16:31:25] Stopping collector [16:31:26] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd16-nj1_run1.manifest.json [16:31:26] Cooldown: 30s [16:31:56] ──────────────────────────────────────────────────── [16:31:56] Run 2/3: rand-write-qd16-nj1_run2 [16:31:56] ──────────────────────────────────────────────────── [16:31:56] Cleaning fio test files from /tank-raidz2/bench … [16:31:57] Test files removed [16:31:57] Dropping Linux page cache + ZFS ARC … [16:31:57] Flushing ZFS ARC (was 1) … [16:32:02] ARC flushed — current size: 44678647176 bytes [16:32:02] NVMe volatile write caches flushed [16:32:03] pmcd healthy (core ✓ pmdazfs ✓) [16:32:03] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd16-nj1_run2.ndjson [16:32:04] Collector running (PID 1480660), settling 5s … [16:32:09] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd16-nj1.fio [16:35:20] fio completed in 191s [16:35:20] Post-fio settle 5s … [16:35:25] Stopping collector [16:35:26] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd16-nj1_run2.manifest.json [16:35:26] Cooldown: 30s [16:35:56] ──────────────────────────────────────────────────── [16:35:56] Run 3/3: rand-write-qd16-nj1_run3 [16:35:56] ──────────────────────────────────────────────────── [16:35:56] Cleaning fio test files from /tank-raidz2/bench … [16:35:56] Test files removed [16:35:56] Dropping Linux page cache + ZFS ARC … [16:35:56] Flushing ZFS ARC (was 1) … [16:36:01] ARC flushed — current size: 18104101360 bytes [16:36:01] NVMe volatile write caches flushed [16:36:03] pmcd healthy (core ✓ pmdazfs ✓) [16:36:03] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd16-nj1_run3.ndjson [16:36:04] Collector running (PID 1483148), settling 5s … [16:36:09] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd16-nj1.fio [16:39:19] fio completed in 190s [16:39:19] Post-fio settle 5s … [16:39:24] Stopping collector [16:39:25] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd16-nj1_run3.manifest.json [16:39:25] ═══════════════════════════════════════════════════════════ [16:39:25] All 3 runs complete for: rand-write-qd16-nj1 [16:39:25] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [16:39:25] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [16:39:25] ═══════════════════════════════════════════════════════════ [16:39:25] Progress: 41/53 jobs | Elapsed: 36h39m | ETA: ~10h43m [16:39:25] [16:39:25] ╔══════════════════════════════════════════════════════════╗ [16:39:25] ║ Job 42/53: rand-write-qd16-nj8 [16:39:25] ║ Category: rand [16:39:25] ╚══════════════════════════════════════════════════════════╝ [16:39:25] ╔══════════════════════════════════════════════════════════╗ [16:39:25] ║ Benchmark: rand-write-qd16-nj8 [16:39:25] ║ Category: rand [16:39:25] ║ Runs: 3 × cooldown 30s [16:39:25] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [16:39:25] ╚══════════════════════════════════════════════════════════╝ [16:39:25] ──────────────────────────────────────────────────── [16:39:25] Run 1/3: rand-write-qd16-nj8_run1 [16:39:25] ──────────────────────────────────────────────────── [16:39:25] Cleaning fio test files from /tank-raidz2/bench … [16:39:25] Test files removed [16:39:25] Dropping Linux page cache + ZFS ARC … [16:39:26] Flushing ZFS ARC (was 1) … [16:39:31] ARC flushed — current size: 36578057488 bytes [16:39:31] NVMe volatile write caches flushed [16:39:32] pmcd healthy (core ✓ pmdazfs ✓) [16:39:32] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd16-nj8_run1.ndjson [16:39:33] Collector running (PID 1485554), settling 5s … [16:39:38] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd16-nj8.fio [16:42:48] fio completed in 190s [16:42:48] Post-fio settle 5s … [16:42:53] Stopping collector [16:42:54] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd16-nj8_run1.manifest.json [16:42:54] Cooldown: 30s [16:43:24] ──────────────────────────────────────────────────── [16:43:24] Run 2/3: rand-write-qd16-nj8_run2 [16:43:24] ──────────────────────────────────────────────────── [16:43:24] Cleaning fio test files from /tank-raidz2/bench … [16:43:25] Test files removed [16:43:25] Dropping Linux page cache + ZFS ARC … [16:43:25] Flushing ZFS ARC (was 1) … [16:43:30] ARC flushed — current size: 121006776 bytes [16:43:30] NVMe volatile write caches flushed [16:43:31] pmcd healthy (core ✓ pmdazfs ✓) [16:43:31] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd16-nj8_run2.ndjson [16:43:32] Collector running (PID 1488237), settling 5s … [16:43:37] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd16-nj8.fio [16:46:48] fio completed in 191s [16:46:48] Post-fio settle 5s … [16:46:53] Stopping collector [16:46:54] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd16-nj8_run2.manifest.json [16:46:54] Cooldown: 30s [16:47:24] ──────────────────────────────────────────────────── [16:47:24] Run 3/3: rand-write-qd16-nj8_run3 [16:47:24] ──────────────────────────────────────────────────── [16:47:24] Cleaning fio test files from /tank-raidz2/bench … [16:47:24] Test files removed [16:47:24] Dropping Linux page cache + ZFS ARC … [16:47:24] Flushing ZFS ARC (was 1) … [16:47:29] ARC flushed — current size: 118437240 bytes [16:47:29] NVMe volatile write caches flushed [16:47:31] pmcd healthy (core ✓ pmdazfs ✓) [16:47:31] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd16-nj8_run3.ndjson [16:47:32] Collector running (PID 1490897), settling 5s … [16:47:37] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd16-nj8.fio [16:50:47] fio completed in 190s [16:50:47] Post-fio settle 5s … [16:50:52] Stopping collector [16:50:53] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd16-nj8_run3.manifest.json [16:50:53] ═══════════════════════════════════════════════════════════ [16:50:53] All 3 runs complete for: rand-write-qd16-nj8 [16:50:53] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [16:50:53] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [16:50:53] ═══════════════════════════════════════════════════════════ [16:50:53] Progress: 42/53 jobs | Elapsed: 36h50m | ETA: ~9h38m [16:50:53] [16:50:53] ╔══════════════════════════════════════════════════════════╗ [16:50:53] ║ Job 43/53: rand-write-qd16-nj16 [16:50:53] ║ Category: rand [16:50:53] ╚══════════════════════════════════════════════════════════╝ [16:50:53] ╔══════════════════════════════════════════════════════════╗ [16:50:53] ║ Benchmark: rand-write-qd16-nj16 [16:50:53] ║ Category: rand [16:50:53] ║ Runs: 3 × cooldown 30s [16:50:53] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [16:50:53] ╚══════════════════════════════════════════════════════════╝ [16:50:53] ──────────────────────────────────────────────────── [16:50:53] Run 1/3: rand-write-qd16-nj16_run1 [16:50:53] ──────────────────────────────────────────────────── [16:50:53] Cleaning fio test files from /tank-raidz2/bench … [16:50:54] Test files removed [16:50:54] Dropping Linux page cache + ZFS ARC … [16:50:54] Flushing ZFS ARC (was 1) … [16:50:59] ARC flushed — current size: 67036501528 bytes [16:50:59] NVMe volatile write caches flushed [16:51:00] pmcd healthy (core ✓ pmdazfs ✓) [16:51:00] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd16-nj16_run1.ndjson [16:51:01] Collector running (PID 1493462), settling 5s … [16:51:06] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd16-nj16.fio [16:54:17] fio completed in 191s [16:54:17] Post-fio settle 5s … [16:54:22] Stopping collector [16:54:23] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd16-nj16_run1.manifest.json [16:54:23] Cooldown: 30s [16:54:53] ──────────────────────────────────────────────────── [16:54:53] Run 2/3: rand-write-qd16-nj16_run2 [16:54:53] ──────────────────────────────────────────────────── [16:54:53] Cleaning fio test files from /tank-raidz2/bench … [16:54:53] Test files removed [16:54:53] Dropping Linux page cache + ZFS ARC … [16:54:53] Flushing ZFS ARC (was 1) … [16:54:58] ARC flushed — current size: 12655322352 bytes [16:54:58] NVMe volatile write caches flushed [16:55:00] pmcd healthy (core ✓ pmdazfs ✓) [16:55:00] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd16-nj16_run2.ndjson [16:55:01] Collector running (PID 1496126), settling 5s … [16:55:06] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd16-nj16.fio [16:58:16] fio completed in 190s [16:58:16] Post-fio settle 5s … [16:58:21] Stopping collector [16:58:22] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd16-nj16_run2.manifest.json [16:58:22] Cooldown: 30s [16:58:52] ──────────────────────────────────────────────────── [16:58:52] Run 3/3: rand-write-qd16-nj16_run3 [16:58:52] ──────────────────────────────────────────────────── [16:58:52] Cleaning fio test files from /tank-raidz2/bench … [16:58:52] Test files removed [16:58:52] Dropping Linux page cache + ZFS ARC … [16:58:53] Flushing ZFS ARC (was 1) … [16:58:58] ARC flushed — current size: 13468715000 bytes [16:58:58] NVMe volatile write caches flushed [16:58:59] pmcd healthy (core ✓ pmdazfs ✓) [16:58:59] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd16-nj16_run3.ndjson [16:59:00] Collector running (PID 1499389), settling 5s … [16:59:05] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd16-nj16.fio [17:02:15] fio completed in 190s [17:02:15] Post-fio settle 5s … [17:02:20] Stopping collector [17:02:21] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd16-nj16_run3.manifest.json [17:02:21] ═══════════════════════════════════════════════════════════ [17:02:21] All 3 runs complete for: rand-write-qd16-nj16 [17:02:21] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [17:02:21] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [17:02:21] ═══════════════════════════════════════════════════════════ [17:02:21] Progress: 43/53 jobs | Elapsed: 37h2m | ETA: ~8h36m [17:02:21] [17:02:21] ╔══════════════════════════════════════════════════════════╗ [17:02:21] ║ Job 44/53: rand-write-qd16-nj32 [17:02:21] ║ Category: rand [17:02:21] ╚══════════════════════════════════════════════════════════╝ [17:02:21] ╔══════════════════════════════════════════════════════════╗ [17:02:21] ║ Benchmark: rand-write-qd16-nj32 [17:02:21] ║ Category: rand [17:02:21] ║ Runs: 3 × cooldown 30s [17:02:21] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [17:02:21] ╚══════════════════════════════════════════════════════════╝ [17:02:21] ──────────────────────────────────────────────────── [17:02:21] Run 1/3: rand-write-qd16-nj32_run1 [17:02:21] ──────────────────────────────────────────────────── [17:02:21] Cleaning fio test files from /tank-raidz2/bench … [17:02:22] Test files removed [17:02:22] Dropping Linux page cache + ZFS ARC … [17:02:22] Flushing ZFS ARC (was 1) … [17:02:27] ARC flushed — current size: 14012134536 bytes [17:02:27] NVMe volatile write caches flushed [17:02:28] pmcd healthy (core ✓ pmdazfs ✓) [17:02:28] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd16-nj32_run1.ndjson [17:02:29] Collector running (PID 1501919), settling 5s … [17:02:34] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd16-nj32.fio [17:05:45] fio completed in 191s [17:05:45] Post-fio settle 5s … [17:05:50] Stopping collector [17:05:51] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd16-nj32_run1.manifest.json [17:05:51] Cooldown: 30s [17:06:21] ──────────────────────────────────────────────────── [17:06:21] Run 2/3: rand-write-qd16-nj32_run2 [17:06:21] ──────────────────────────────────────────────────── [17:06:21] Cleaning fio test files from /tank-raidz2/bench … [17:06:21] Test files removed [17:06:21] Dropping Linux page cache + ZFS ARC … [17:06:21] Flushing ZFS ARC (was 1) … [17:06:26] ARC flushed — current size: 84385144 bytes [17:06:26] NVMe volatile write caches flushed [17:06:28] pmcd healthy (core ✓ pmdazfs ✓) [17:06:28] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd16-nj32_run2.ndjson [17:06:29] Collector running (PID 1504465), settling 5s … [17:06:34] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd16-nj32.fio [17:09:44] fio completed in 190s [17:09:44] Post-fio settle 5s … [17:09:49] Stopping collector [17:09:50] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd16-nj32_run2.manifest.json [17:09:50] Cooldown: 30s [17:10:20] ──────────────────────────────────────────────────── [17:10:20] Run 3/3: rand-write-qd16-nj32_run3 [17:10:20] ──────────────────────────────────────────────────── [17:10:20] Cleaning fio test files from /tank-raidz2/bench … [17:10:20] Test files removed [17:10:20] Dropping Linux page cache + ZFS ARC … [17:10:21] Flushing ZFS ARC (was 1) … [17:10:26] ARC flushed — current size: 87508040 bytes [17:10:26] NVMe volatile write caches flushed [17:10:27] pmcd healthy (core ✓ pmdazfs ✓) [17:10:27] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd16-nj32_run3.ndjson [17:10:28] Collector running (PID 1506981), settling 5s … [17:10:33] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd16-nj32.fio [17:13:43] fio completed in 190s [17:13:43] Post-fio settle 5s … [17:13:48] Stopping collector [17:13:49] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd16-nj32_run3.manifest.json [17:13:49] ═══════════════════════════════════════════════════════════ [17:13:49] All 3 runs complete for: rand-write-qd16-nj32 [17:13:49] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [17:13:49] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [17:13:49] ═══════════════════════════════════════════════════════════ [17:13:49] Progress: 44/53 jobs | Elapsed: 37h13m | ETA: ~7h36m [17:13:49] [17:13:49] ╔══════════════════════════════════════════════════════════╗ [17:13:49] ║ Job 45/53: rand-write-qd32-nj1 [17:13:49] ║ Category: rand [17:13:49] ╚══════════════════════════════════════════════════════════╝ [17:13:49] ╔══════════════════════════════════════════════════════════╗ [17:13:49] ║ Benchmark: rand-write-qd32-nj1 [17:13:49] ║ Category: rand [17:13:49] ║ Runs: 3 × cooldown 30s [17:13:49] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [17:13:49] ╚══════════════════════════════════════════════════════════╝ [17:13:49] ──────────────────────────────────────────────────── [17:13:49] Run 1/3: rand-write-qd32-nj1_run1 [17:13:49] ──────────────────────────────────────────────────── [17:13:49] Cleaning fio test files from /tank-raidz2/bench … [17:13:50] Test files removed [17:13:50] Dropping Linux page cache + ZFS ARC … [17:13:50] Flushing ZFS ARC (was 1) … [17:13:55] ARC flushed — current size: 86064912 bytes [17:13:55] NVMe volatile write caches flushed [17:13:56] pmcd healthy (core ✓ pmdazfs ✓) [17:13:56] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd32-nj1_run1.ndjson [17:13:57] Collector running (PID 1509477), settling 5s … [17:14:02] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd32-nj1.fio [17:17:13] fio completed in 191s [17:17:13] Post-fio settle 5s … [17:17:18] Stopping collector [17:17:19] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd32-nj1_run1.manifest.json [17:17:19] Cooldown: 30s [17:17:49] ──────────────────────────────────────────────────── [17:17:49] Run 2/3: rand-write-qd32-nj1_run2 [17:17:49] ──────────────────────────────────────────────────── [17:17:49] Cleaning fio test files from /tank-raidz2/bench … [17:17:49] Test files removed [17:17:49] Dropping Linux page cache + ZFS ARC … [17:17:49] Flushing ZFS ARC (was 1) … [17:17:54] ARC flushed — current size: 49654877896 bytes [17:17:54] NVMe volatile write caches flushed [17:17:56] pmcd healthy (core ✓ pmdazfs ✓) [17:17:56] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd32-nj1_run2.ndjson [17:17:57] Collector running (PID 1511963), settling 5s … [17:18:02] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd32-nj1.fio [17:21:12] fio completed in 190s [17:21:12] Post-fio settle 5s … [17:21:17] Stopping collector [17:21:19] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd32-nj1_run2.manifest.json [17:21:19] Cooldown: 30s [17:21:49] ──────────────────────────────────────────────────── [17:21:49] Run 3/3: rand-write-qd32-nj1_run3 [17:21:49] ──────────────────────────────────────────────────── [17:21:49] Cleaning fio test files from /tank-raidz2/bench … [17:21:49] Test files removed [17:21:49] Dropping Linux page cache + ZFS ARC … [17:21:50] Flushing ZFS ARC (was 1) … [17:21:55] ARC flushed — current size: 24643955288 bytes [17:21:55] NVMe volatile write caches flushed [17:21:56] pmcd healthy (core ✓ pmdazfs ✓) [17:21:56] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd32-nj1_run3.ndjson [17:21:57] Collector running (PID 1514464), settling 5s … [17:22:02] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd32-nj1.fio [17:25:12] fio completed in 190s [17:25:12] Post-fio settle 5s … [17:25:17] Stopping collector [17:25:19] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd32-nj1_run3.manifest.json [17:25:19] ═══════════════════════════════════════════════════════════ [17:25:19] All 3 runs complete for: rand-write-qd32-nj1 [17:25:19] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [17:25:19] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [17:25:19] ═══════════════════════════════════════════════════════════ [17:25:19] Progress: 45/53 jobs | Elapsed: 37h25m | ETA: ~6h39m [17:25:19] [17:25:19] ╔══════════════════════════════════════════════════════════╗ [17:25:19] ║ Job 46/53: rand-write-qd32-nj8 [17:25:19] ║ Category: rand [17:25:19] ╚══════════════════════════════════════════════════════════╝ [17:25:19] ╔══════════════════════════════════════════════════════════╗ [17:25:19] ║ Benchmark: rand-write-qd32-nj8 [17:25:19] ║ Category: rand [17:25:19] ║ Runs: 3 × cooldown 30s [17:25:19] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [17:25:19] ╚══════════════════════════════════════════════════════════╝ [17:25:19] ──────────────────────────────────────────────────── [17:25:19] Run 1/3: rand-write-qd32-nj8_run1 [17:25:19] ──────────────────────────────────────────────────── [17:25:19] Cleaning fio test files from /tank-raidz2/bench … [17:25:20] Test files removed [17:25:20] Dropping Linux page cache + ZFS ARC … [17:25:20] Flushing ZFS ARC (was 1) … [17:25:25] ARC flushed — current size: 117783920 bytes [17:25:25] NVMe volatile write caches flushed [17:25:26] pmcd healthy (core ✓ pmdazfs ✓) [17:25:26] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd32-nj8_run1.ndjson [17:25:27] Collector running (PID 1517528), settling 5s … [17:25:32] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd32-nj8.fio [17:28:43] fio completed in 191s [17:28:43] Post-fio settle 5s … [17:28:48] Stopping collector [17:28:49] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd32-nj8_run1.manifest.json [17:28:49] Cooldown: 30s [17:29:19] ──────────────────────────────────────────────────── [17:29:19] Run 2/3: rand-write-qd32-nj8_run2 [17:29:19] ──────────────────────────────────────────────────── [17:29:19] Cleaning fio test files from /tank-raidz2/bench … [17:29:19] Test files removed [17:29:19] Dropping Linux page cache + ZFS ARC … [17:29:19] Flushing ZFS ARC (was 1) … [17:29:24] ARC flushed — current size: 118786480 bytes [17:29:24] NVMe volatile write caches flushed [17:29:26] pmcd healthy (core ✓ pmdazfs ✓) [17:29:26] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd32-nj8_run2.ndjson [17:29:27] Collector running (PID 1520170), settling 5s … [17:29:32] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd32-nj8.fio [17:32:42] fio completed in 190s [17:32:42] Post-fio settle 5s … [17:32:47] Stopping collector [17:32:48] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd32-nj8_run2.manifest.json [17:32:48] Cooldown: 30s [17:33:18] ──────────────────────────────────────────────────── [17:33:18] Run 3/3: rand-write-qd32-nj8_run3 [17:33:18] ──────────────────────────────────────────────────── [17:33:18] Cleaning fio test files from /tank-raidz2/bench … [17:33:19] Test files removed [17:33:19] Dropping Linux page cache + ZFS ARC … [17:33:19] Flushing ZFS ARC (was 1) … [17:33:24] ARC flushed — current size: 9633997184 bytes [17:33:24] NVMe volatile write caches flushed [17:33:25] pmcd healthy (core ✓ pmdazfs ✓) [17:33:25] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd32-nj8_run3.ndjson [17:33:26] Collector running (PID 1522855), settling 5s … [17:33:31] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd32-nj8.fio [17:36:42] fio completed in 191s [17:36:42] Post-fio settle 5s … [17:36:47] Stopping collector [17:36:49] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd32-nj8_run3.manifest.json [17:36:49] ═══════════════════════════════════════════════════════════ [17:36:49] All 3 runs complete for: rand-write-qd32-nj8 [17:36:49] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [17:36:49] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [17:36:49] ═══════════════════════════════════════════════════════════ [17:36:49] Progress: 46/53 jobs | Elapsed: 37h36m | ETA: ~5h43m [17:36:49] [17:36:49] ╔══════════════════════════════════════════════════════════╗ [17:36:49] ║ Job 47/53: rand-write-qd32-nj16 [17:36:49] ║ Category: rand [17:36:49] ╚══════════════════════════════════════════════════════════╝ [17:36:49] ╔══════════════════════════════════════════════════════════╗ [17:36:49] ║ Benchmark: rand-write-qd32-nj16 [17:36:49] ║ Category: rand [17:36:49] ║ Runs: 3 × cooldown 30s [17:36:49] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [17:36:49] ╚══════════════════════════════════════════════════════════╝ [17:36:49] ──────────────────────────────────────────────────── [17:36:49] Run 1/3: rand-write-qd32-nj16_run1 [17:36:49] ──────────────────────────────────────────────────── [17:36:49] Cleaning fio test files from /tank-raidz2/bench … [17:36:49] Test files removed [17:36:49] Dropping Linux page cache + ZFS ARC … [17:36:49] Flushing ZFS ARC (was 1) … [17:36:54] ARC flushed — current size: 27628429072 bytes [17:36:54] NVMe volatile write caches flushed [17:36:56] pmcd healthy (core ✓ pmdazfs ✓) [17:36:56] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd32-nj16_run1.ndjson [17:36:57] Collector running (PID 1525421), settling 5s … [17:37:02] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd32-nj16.fio [17:40:12] fio completed in 190s [17:40:12] Post-fio settle 5s … [17:40:17] Stopping collector [17:40:18] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd32-nj16_run1.manifest.json [17:40:18] Cooldown: 30s [17:40:48] ──────────────────────────────────────────────────── [17:40:48] Run 2/3: rand-write-qd32-nj16_run2 [17:40:48] ──────────────────────────────────────────────────── [17:40:48] Cleaning fio test files from /tank-raidz2/bench … [17:40:48] Test files removed [17:40:48] Dropping Linux page cache + ZFS ARC … [17:40:49] Flushing ZFS ARC (was 1) … [17:40:54] ARC flushed — current size: 12937003752 bytes [17:40:54] NVMe volatile write caches flushed [17:40:55] pmcd healthy (core ✓ pmdazfs ✓) [17:40:55] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd32-nj16_run2.ndjson [17:40:56] Collector running (PID 1528064), settling 5s … [17:41:01] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd32-nj16.fio [17:44:11] fio completed in 190s [17:44:11] Post-fio settle 5s … [17:44:16] Stopping collector [17:44:18] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd32-nj16_run2.manifest.json [17:44:18] Cooldown: 30s [17:44:48] ──────────────────────────────────────────────────── [17:44:48] Run 3/3: rand-write-qd32-nj16_run3 [17:44:48] ──────────────────────────────────────────────────── [17:44:48] Cleaning fio test files from /tank-raidz2/bench … [17:44:49] Test files removed [17:44:49] Dropping Linux page cache + ZFS ARC … [17:44:49] Flushing ZFS ARC (was 1) … [17:44:54] ARC flushed — current size: 12936465368 bytes [17:44:54] NVMe volatile write caches flushed [17:44:55] pmcd healthy (core ✓ pmdazfs ✓) [17:44:55] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd32-nj16_run3.ndjson [17:44:56] Collector running (PID 1530686), settling 5s … [17:45:01] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd32-nj16.fio [17:48:12] fio completed in 191s [17:48:12] Post-fio settle 5s … [17:48:17] Stopping collector [17:48:19] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd32-nj16_run3.manifest.json [17:48:19] ═══════════════════════════════════════════════════════════ [17:48:19] All 3 runs complete for: rand-write-qd32-nj16 [17:48:19] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [17:48:19] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [17:48:19] ═══════════════════════════════════════════════════════════ [17:48:19] Progress: 47/53 jobs | Elapsed: 37h48m | ETA: ~4h49m [17:48:19] [17:48:19] ╔══════════════════════════════════════════════════════════╗ [17:48:19] ║ Job 48/53: rand-write-qd32-nj32 [17:48:19] ║ Category: rand [17:48:19] ╚══════════════════════════════════════════════════════════╝ [17:48:19] ╔══════════════════════════════════════════════════════════╗ [17:48:19] ║ Benchmark: rand-write-qd32-nj32 [17:48:19] ║ Category: rand [17:48:19] ║ Runs: 3 × cooldown 30s [17:48:19] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [17:48:19] ╚══════════════════════════════════════════════════════════╝ [17:48:19] ──────────────────────────────────────────────────── [17:48:19] Run 1/3: rand-write-qd32-nj32_run1 [17:48:19] ──────────────────────────────────────────────────── [17:48:19] Cleaning fio test files from /tank-raidz2/bench … [17:48:19] Test files removed [17:48:19] Dropping Linux page cache + ZFS ARC … [17:48:19] Flushing ZFS ARC (was 1) … [17:48:24] ARC flushed — current size: 13657803584 bytes [17:48:24] NVMe volatile write caches flushed [17:48:26] pmcd healthy (core ✓ pmdazfs ✓) [17:48:26] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd32-nj32_run1.ndjson [17:48:27] Collector running (PID 1533198), settling 5s … [17:48:32] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd32-nj32.fio [17:51:42] fio completed in 190s [17:51:42] Post-fio settle 5s … [17:51:47] Stopping collector [17:51:48] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd32-nj32_run1.manifest.json [17:51:48] Cooldown: 30s [17:52:18] ──────────────────────────────────────────────────── [17:52:18] Run 2/3: rand-write-qd32-nj32_run2 [17:52:18] ──────────────────────────────────────────────────── [17:52:18] Cleaning fio test files from /tank-raidz2/bench … [17:52:18] Test files removed [17:52:18] Dropping Linux page cache + ZFS ARC … [17:52:19] Flushing ZFS ARC (was 1) … [17:52:24] ARC flushed — current size: 32500978608 bytes [17:52:24] NVMe volatile write caches flushed [17:52:25] pmcd healthy (core ✓ pmdazfs ✓) [17:52:25] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd32-nj32_run2.ndjson [17:52:26] Collector running (PID 1535674), settling 5s … [17:52:31] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd32-nj32.fio [17:55:41] fio completed in 190s [17:55:41] Post-fio settle 5s … [17:55:46] Stopping collector [17:55:47] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd32-nj32_run2.manifest.json [17:55:47] Cooldown: 30s [17:56:17] ──────────────────────────────────────────────────── [17:56:17] Run 3/3: rand-write-qd32-nj32_run3 [17:56:17] ──────────────────────────────────────────────────── [17:56:17] Cleaning fio test files from /tank-raidz2/bench … [17:56:18] Test files removed [17:56:18] Dropping Linux page cache + ZFS ARC … [17:56:18] Flushing ZFS ARC (was 1) … [17:56:23] ARC flushed — current size: 83257072 bytes [17:56:23] NVMe volatile write caches flushed [17:56:24] pmcd healthy (core ✓ pmdazfs ✓) [17:56:24] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand/rand-write-qd32-nj32_run3.ndjson [17:56:25] Collector running (PID 1538855), settling 5s … [17:56:30] Starting fio: /scripts_f16_with_data_deletion/jobs/rand-write-qd32-nj32.fio [17:59:41] fio completed in 191s [17:59:41] Post-fio settle 5s … [17:59:46] Stopping collector [17:59:47] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand/rand-write-qd32-nj32_run3.manifest.json [17:59:47] ═══════════════════════════════════════════════════════════ [17:59:47] All 3 runs complete for: rand-write-qd32-nj32 [17:59:47] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/rand [17:59:47] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/rand [17:59:47] ═══════════════════════════════════════════════════════════ [17:59:47] Progress: 48/53 jobs | Elapsed: 37h59m | ETA: ~3h57m [17:59:47] [17:59:47] ╔══════════════════════════════════════════════════════════╗ [17:59:47] ║ Job 49/53: lat-read-qd1-nj1 [17:59:47] ║ Category: latency [17:59:47] ╚══════════════════════════════════════════════════════════╝ [17:59:47] ╔══════════════════════════════════════════════════════════╗ [17:59:47] ║ Benchmark: lat-read-qd1-nj1 [17:59:47] ║ Category: latency [17:59:47] ║ Runs: 3 × cooldown 30s [17:59:47] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [17:59:47] ╚══════════════════════════════════════════════════════════╝ [17:59:47] ──────────────────────────────────────────────────── [17:59:47] Run 1/3: lat-read-qd1-nj1_run1 [17:59:47] ──────────────────────────────────────────────────── [17:59:47] Cleaning fio test files from /tank-raidz2/bench … [17:59:47] Test files removed [17:59:47] Dropping Linux page cache + ZFS ARC … [17:59:47] Flushing ZFS ARC (was 1) … [17:59:52] ARC flushed — current size: 86929504 bytes [17:59:52] NVMe volatile write caches flushed [17:59:54] pmcd healthy (core ✓ pmdazfs ✓) [17:59:54] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/latency/lat-read-qd1-nj1_run1.ndjson [17:59:55] Collector running (PID 1541325), settling 5s … [18:00:00] Starting fio: /scripts_f16_with_data_deletion/jobs/lat-read-qd1-nj1.fio [18:05:37] fio completed in 337s [18:05:37] Post-fio settle 5s … [18:05:42] Stopping collector [18:05:44] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/latency/lat-read-qd1-nj1_run1.manifest.json [18:05:44] Cooldown: 30s [18:06:14] ──────────────────────────────────────────────────── [18:06:14] Run 2/3: lat-read-qd1-nj1_run2 [18:06:14] ──────────────────────────────────────────────────── [18:06:14] Cleaning fio test files from /tank-raidz2/bench … [18:06:14] Test files removed [18:06:14] Dropping Linux page cache + ZFS ARC … [18:06:14] Flushing ZFS ARC (was 1) … [18:06:19] ARC flushed — current size: 77905808 bytes [18:06:19] NVMe volatile write caches flushed [18:06:20] pmcd healthy (core ✓ pmdazfs ✓) [18:06:20] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/latency/lat-read-qd1-nj1_run2.ndjson [18:06:21] Collector running (PID 1545442), settling 5s … [18:06:26] Starting fio: /scripts_f16_with_data_deletion/jobs/lat-read-qd1-nj1.fio [18:12:05] fio completed in 339s [18:12:05] Post-fio settle 5s … [18:12:10] Stopping collector [18:12:11] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/latency/lat-read-qd1-nj1_run2.manifest.json [18:12:11] Cooldown: 30s [18:12:41] ──────────────────────────────────────────────────── [18:12:41] Run 3/3: lat-read-qd1-nj1_run3 [18:12:41] ──────────────────────────────────────────────────── [18:12:41] Cleaning fio test files from /tank-raidz2/bench … [18:12:41] Test files removed [18:12:41] Dropping Linux page cache + ZFS ARC … [18:12:41] Flushing ZFS ARC (was 1) … [18:12:46] ARC flushed — current size: 83239848 bytes [18:12:46] NVMe volatile write caches flushed [18:12:47] pmcd healthy (core ✓ pmdazfs ✓) [18:12:47] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/latency/lat-read-qd1-nj1_run3.ndjson [18:12:48] Collector running (PID 1549586), settling 5s … [18:12:53] Starting fio: /scripts_f16_with_data_deletion/jobs/lat-read-qd1-nj1.fio [18:18:30] fio completed in 337s [18:18:30] Post-fio settle 5s … [18:18:35] Stopping collector [18:18:36] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/latency/lat-read-qd1-nj1_run3.manifest.json [18:18:36] ═══════════════════════════════════════════════════════════ [18:18:36] All 3 runs complete for: lat-read-qd1-nj1 [18:18:36] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/latency [18:18:36] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/latency [18:18:36] ═══════════════════════════════════════════════════════════ [18:18:36] Progress: 49/53 jobs | Elapsed: 38h18m | ETA: ~3h7m [18:18:36] [18:18:36] ╔══════════════════════════════════════════════════════════╗ [18:18:36] ║ Job 50/53: lat-write-qd1-nj1 [18:18:36] ║ Category: latency [18:18:36] ╚══════════════════════════════════════════════════════════╝ [18:18:36] ╔══════════════════════════════════════════════════════════╗ [18:18:36] ║ Benchmark: lat-write-qd1-nj1 [18:18:36] ║ Category: latency [18:18:36] ║ Runs: 3 × cooldown 30s [18:18:36] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [18:18:36] ╚══════════════════════════════════════════════════════════╝ [18:18:36] ──────────────────────────────────────────────────── [18:18:36] Run 1/3: lat-write-qd1-nj1_run1 [18:18:36] ──────────────────────────────────────────────────── [18:18:36] Cleaning fio test files from /tank-raidz2/bench … [18:18:36] Test files removed [18:18:36] Dropping Linux page cache + ZFS ARC … [18:18:36] Flushing ZFS ARC (was 1) … [18:18:41] ARC flushed — current size: 81146928 bytes [18:18:41] NVMe volatile write caches flushed [18:18:42] pmcd healthy (core ✓ pmdazfs ✓) [18:18:42] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/latency/lat-write-qd1-nj1_run1.ndjson [18:18:43] Collector running (PID 1553652), settling 5s … [18:18:48] Starting fio: /scripts_f16_with_data_deletion/jobs/lat-write-qd1-nj1.fio [18:21:59] fio completed in 191s [18:21:59] Post-fio settle 5s … [18:22:04] Stopping collector [18:22:05] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/latency/lat-write-qd1-nj1_run1.manifest.json [18:22:05] Cooldown: 30s [18:22:35] ──────────────────────────────────────────────────── [18:22:35] Run 2/3: lat-write-qd1-nj1_run2 [18:22:35] ──────────────────────────────────────────────────── [18:22:35] Cleaning fio test files from /tank-raidz2/bench … [18:22:35] Test files removed [18:22:35] Dropping Linux page cache + ZFS ARC … [18:22:35] Flushing ZFS ARC (was 1) … [18:22:40] ARC flushed — current size: 118094040 bytes [18:22:40] NVMe volatile write caches flushed [18:22:42] pmcd healthy (core ✓ pmdazfs ✓) [18:22:42] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/latency/lat-write-qd1-nj1_run2.ndjson [18:22:43] Collector running (PID 1556174), settling 5s … [18:22:48] Starting fio: /scripts_f16_with_data_deletion/jobs/lat-write-qd1-nj1.fio [18:25:58] fio completed in 190s [18:25:58] Post-fio settle 5s … [18:26:03] Stopping collector [18:26:05] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/latency/lat-write-qd1-nj1_run2.manifest.json [18:26:05] Cooldown: 30s [18:26:35] ──────────────────────────────────────────────────── [18:26:35] Run 3/3: lat-write-qd1-nj1_run3 [18:26:35] ──────────────────────────────────────────────────── [18:26:35] Cleaning fio test files from /tank-raidz2/bench … [18:26:36] Test files removed [18:26:36] Dropping Linux page cache + ZFS ARC … [18:26:36] Flushing ZFS ARC (was 1) … [18:26:41] ARC flushed — current size: 21907342640 bytes [18:26:41] NVMe volatile write caches flushed [18:26:42] pmcd healthy (core ✓ pmdazfs ✓) [18:26:42] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/latency/lat-write-qd1-nj1_run3.ndjson [18:26:43] Collector running (PID 1559363), settling 5s … [18:26:48] Starting fio: /scripts_f16_with_data_deletion/jobs/lat-write-qd1-nj1.fio [18:29:59] fio completed in 191s [18:29:59] Post-fio settle 5s … [18:30:04] Stopping collector [18:30:05] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/latency/lat-write-qd1-nj1_run3.manifest.json [18:30:05] ═══════════════════════════════════════════════════════════ [18:30:05] All 3 runs complete for: lat-write-qd1-nj1 [18:30:05] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/latency [18:30:05] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/latency [18:30:05] ═══════════════════════════════════════════════════════════ [18:30:05] Progress: 50/53 jobs | Elapsed: 38h29m | ETA: ~2h18m [18:30:05] [18:30:05] ╔══════════════════════════════════════════════════════════╗ [18:30:05] ║ Job 51/53: mixed-70r30w-qd16-nj1 [18:30:05] ║ Category: mixed [18:30:05] ╚══════════════════════════════════════════════════════════╝ [18:30:05] ╔══════════════════════════════════════════════════════════╗ [18:30:05] ║ Benchmark: mixed-70r30w-qd16-nj1 [18:30:05] ║ Category: mixed [18:30:05] ║ Runs: 3 × cooldown 30s [18:30:05] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [18:30:05] ╚══════════════════════════════════════════════════════════╝ [18:30:05] ──────────────────────────────────────────────────── [18:30:05] Run 1/3: mixed-70r30w-qd16-nj1_run1 [18:30:05] ──────────────────────────────────────────────────── [18:30:05] Cleaning fio test files from /tank-raidz2/bench … [18:30:05] Test files removed [18:30:05] Dropping Linux page cache + ZFS ARC … [18:30:05] Flushing ZFS ARC (was 1) … [18:30:10] ARC flushed — current size: 21344579600 bytes [18:30:10] NVMe volatile write caches flushed [18:30:12] pmcd healthy (core ✓ pmdazfs ✓) [18:30:12] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/mixed/mixed-70r30w-qd16-nj1_run1.ndjson [18:30:13] Collector running (PID 1561746), settling 5s … [18:30:18] Starting fio: /scripts_f16_with_data_deletion/jobs/mixed-70r30w-qd16-nj1.fio [18:35:55] fio completed in 337s [18:35:55] Post-fio settle 5s … [18:36:00] Stopping collector [18:36:02] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/mixed/mixed-70r30w-qd16-nj1_run1.manifest.json [18:36:02] Cooldown: 30s [18:36:32] ──────────────────────────────────────────────────── [18:36:32] Run 2/3: mixed-70r30w-qd16-nj1_run2 [18:36:32] ──────────────────────────────────────────────────── [18:36:32] Cleaning fio test files from /tank-raidz2/bench … [18:36:33] Test files removed [18:36:33] Dropping Linux page cache + ZFS ARC … [18:36:33] Flushing ZFS ARC (was 1) … [18:36:38] ARC flushed — current size: 3401006224 bytes [18:36:38] NVMe volatile write caches flushed [18:36:39] pmcd healthy (core ✓ pmdazfs ✓) [18:36:39] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/mixed/mixed-70r30w-qd16-nj1_run2.ndjson [18:36:40] Collector running (PID 1565890), settling 5s … [18:36:45] Starting fio: /scripts_f16_with_data_deletion/jobs/mixed-70r30w-qd16-nj1.fio [18:42:23] fio completed in 338s [18:42:23] Post-fio settle 5s … [18:42:28] Stopping collector [18:42:29] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/mixed/mixed-70r30w-qd16-nj1_run2.manifest.json [18:42:29] Cooldown: 30s [18:42:59] ──────────────────────────────────────────────────── [18:42:59] Run 3/3: mixed-70r30w-qd16-nj1_run3 [18:42:59] ──────────────────────────────────────────────────── [18:42:59] Cleaning fio test files from /tank-raidz2/bench … [18:42:59] Test files removed [18:42:59] Dropping Linux page cache + ZFS ARC … [18:43:00] Flushing ZFS ARC (was 1) … [18:43:05] ARC flushed — current size: 42648126624 bytes [18:43:05] NVMe volatile write caches flushed [18:43:06] pmcd healthy (core ✓ pmdazfs ✓) [18:43:06] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/mixed/mixed-70r30w-qd16-nj1_run3.ndjson [18:43:07] Collector running (PID 1570023), settling 5s … [18:43:12] Starting fio: /scripts_f16_with_data_deletion/jobs/mixed-70r30w-qd16-nj1.fio [18:48:50] fio completed in 338s [18:48:50] Post-fio settle 5s … [18:48:55] Stopping collector [18:48:57] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/mixed/mixed-70r30w-qd16-nj1_run3.manifest.json [18:48:57] ═══════════════════════════════════════════════════════════ [18:48:57] All 3 runs complete for: mixed-70r30w-qd16-nj1 [18:48:57] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/mixed [18:48:57] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/mixed [18:48:57] ═══════════════════════════════════════════════════════════ [18:48:57] Progress: 51/53 jobs | Elapsed: 38h48m | ETA: ~1h31m [18:48:57] [18:48:57] ╔══════════════════════════════════════════════════════════╗ [18:48:57] ║ Job 52/53: mixed-70r30w-qd16-nj4 [18:48:57] ║ Category: mixed [18:48:57] ╚══════════════════════════════════════════════════════════╝ [18:48:57] ╔══════════════════════════════════════════════════════════╗ [18:48:57] ║ Benchmark: mixed-70r30w-qd16-nj4 [18:48:57] ║ Category: mixed [18:48:57] ║ Runs: 3 × cooldown 30s [18:48:57] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [18:48:57] ╚══════════════════════════════════════════════════════════╝ [18:48:57] ──────────────────────────────────────────────────── [18:48:57] Run 1/3: mixed-70r30w-qd16-nj4_run1 [18:48:57] ──────────────────────────────────────────────────── [18:48:57] Cleaning fio test files from /tank-raidz2/bench … [18:48:57] Test files removed [18:48:57] Dropping Linux page cache + ZFS ARC … [18:48:57] Flushing ZFS ARC (was 1) … [18:49:02] ARC flushed — current size: 115271240 bytes [18:49:02] NVMe volatile write caches flushed [18:49:04] pmcd healthy (core ✓ pmdazfs ✓) [18:49:04] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/mixed/mixed-70r30w-qd16-nj4_run1.ndjson [18:49:05] Collector running (PID 1574072), settling 5s … [18:49:10] Starting fio: /scripts_f16_with_data_deletion/jobs/mixed-70r30w-qd16-nj4.fio [19:02:11] fio completed in 781s [19:02:11] Post-fio settle 5s … [19:02:16] Stopping collector [19:02:17] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/mixed/mixed-70r30w-qd16-nj4_run1.manifest.json [19:02:17] Cooldown: 30s [19:02:47] ──────────────────────────────────────────────────── [19:02:47] Run 2/3: mixed-70r30w-qd16-nj4_run2 [19:02:47] ──────────────────────────────────────────────────── [19:02:47] Cleaning fio test files from /tank-raidz2/bench … [19:02:47] Test files removed [19:02:47] Dropping Linux page cache + ZFS ARC … [19:02:48] Flushing ZFS ARC (was 1) … [19:02:53] ARC flushed — current size: 56214015896 bytes [19:02:53] NVMe volatile write caches flushed [19:02:54] pmcd healthy (core ✓ pmdazfs ✓) [19:02:54] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/mixed/mixed-70r30w-qd16-nj4_run2.ndjson [19:02:55] Collector running (PID 1584002), settling 5s … [19:03:00] Starting fio: /scripts_f16_with_data_deletion/jobs/mixed-70r30w-qd16-nj4.fio [19:16:03] fio completed in 783s [19:16:03] Post-fio settle 5s … [19:16:08] Stopping collector [19:16:10] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/mixed/mixed-70r30w-qd16-nj4_run2.manifest.json [19:16:10] Cooldown: 30s [19:16:40] ──────────────────────────────────────────────────── [19:16:40] Run 3/3: mixed-70r30w-qd16-nj4_run3 [19:16:40] ──────────────────────────────────────────────────── [19:16:40] Cleaning fio test files from /tank-raidz2/bench … [19:16:41] Test files removed [19:16:41] Dropping Linux page cache + ZFS ARC … [19:16:41] Flushing ZFS ARC (was 1) … [19:16:46] ARC flushed — current size: 19290404856 bytes [19:16:46] NVMe volatile write caches flushed [19:16:47] pmcd healthy (core ✓ pmdazfs ✓) [19:16:47] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/mixed/mixed-70r30w-qd16-nj4_run3.ndjson [19:16:48] Collector running (PID 1593309), settling 5s … [19:16:53] Starting fio: /scripts_f16_with_data_deletion/jobs/mixed-70r30w-qd16-nj4.fio [19:29:34] fio completed in 761s [19:29:34] Post-fio settle 5s … [19:29:39] Stopping collector [19:29:41] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/mixed/mixed-70r30w-qd16-nj4_run3.manifest.json [19:29:41] ═══════════════════════════════════════════════════════════ [19:29:41] All 3 runs complete for: mixed-70r30w-qd16-nj4 [19:29:41] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/mixed [19:29:41] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/mixed [19:29:41] ═══════════════════════════════════════════════════════════ [19:29:41] Progress: 52/53 jobs | Elapsed: 39h29m | ETA: ~0h45m [19:29:41] [19:29:41] ╔══════════════════════════════════════════════════════════╗ [19:29:41] ║ Job 53/53: mixed-70r30w-qd16-nj8 [19:29:41] ║ Category: mixed [19:29:41] ╚══════════════════════════════════════════════════════════╝ [19:29:41] ╔══════════════════════════════════════════════════════════╗ [19:29:41] ║ Benchmark: mixed-70r30w-qd16-nj8 [19:29:41] ║ Category: mixed [19:29:41] ║ Runs: 3 × cooldown 30s [19:29:41] ║ Output: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [19:29:41] ╚══════════════════════════════════════════════════════════╝ [19:29:41] ──────────────────────────────────────────────────── [19:29:41] Run 1/3: mixed-70r30w-qd16-nj8_run1 [19:29:41] ──────────────────────────────────────────────────── [19:29:41] Cleaning fio test files from /tank-raidz2/bench … [19:29:42] Test files removed [19:29:42] Dropping Linux page cache + ZFS ARC … [19:29:42] Flushing ZFS ARC (was 1) … [19:29:47] ARC flushed — current size: 122873584 bytes [19:29:47] NVMe volatile write caches flushed [19:29:48] pmcd healthy (core ✓ pmdazfs ✓) [19:29:48] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/mixed/mixed-70r30w-qd16-nj8_run1.ndjson [19:29:49] Collector running (PID 1602969), settling 5s … [19:29:54] Starting fio: /scripts_f16_with_data_deletion/jobs/mixed-70r30w-qd16-nj8.fio [19:52:47] fio completed in 1373s [19:52:47] Post-fio settle 5s … [19:52:52] Stopping collector [19:52:54] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/mixed/mixed-70r30w-qd16-nj8_run1.manifest.json [19:52:54] Cooldown: 30s [19:53:24] ──────────────────────────────────────────────────── [19:53:24] Run 2/3: mixed-70r30w-qd16-nj8_run2 [19:53:24] ──────────────────────────────────────────────────── [19:53:24] Cleaning fio test files from /tank-raidz2/bench … [19:53:24] Test files removed [19:53:24] Dropping Linux page cache + ZFS ARC … [19:53:24] Flushing ZFS ARC (was 1) … [19:53:29] ARC flushed — current size: 78128965984 bytes [19:53:29] NVMe volatile write caches flushed [19:53:31] pmcd healthy (core ✓ pmdazfs ✓) [19:53:31] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/mixed/mixed-70r30w-qd16-nj8_run2.ndjson [19:53:32] Collector running (PID 1618793), settling 5s … [19:53:37] Starting fio: /scripts_f16_with_data_deletion/jobs/mixed-70r30w-qd16-nj8.fio [20:16:34] fio completed in 1377s [20:16:34] Post-fio settle 5s … [20:16:39] Stopping collector [20:16:40] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/mixed/mixed-70r30w-qd16-nj8_run2.manifest.json [20:16:40] Cooldown: 30s [20:17:10] ──────────────────────────────────────────────────── [20:17:10] Run 3/3: mixed-70r30w-qd16-nj8_run3 [20:17:10] ──────────────────────────────────────────────────── [20:17:10] Cleaning fio test files from /tank-raidz2/bench … [20:17:10] Test files removed [20:17:10] Dropping Linux page cache + ZFS ARC … [20:17:11] Flushing ZFS ARC (was 1) … [20:17:16] ARC flushed — current size: 87005103536 bytes [20:17:16] NVMe volatile write caches flushed [20:17:17] pmcd healthy (core ✓ pmdazfs ✓) [20:17:17] Starting PCP collector → /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/mixed/mixed-70r30w-qd16-nj8_run3.ndjson [20:17:18] Collector running (PID 1635391), settling 5s … [20:17:23] Starting fio: /scripts_f16_with_data_deletion/jobs/mixed-70r30w-qd16-nj8.fio [20:40:00] fio completed in 1357s [20:40:00] Post-fio settle 5s … [20:40:05] Stopping collector [20:40:07] Manifest: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/mixed/mixed-70r30w-qd16-nj8_run3.manifest.json [20:40:07] ═══════════════════════════════════════════════════════════ [20:40:07] All 3 runs complete for: mixed-70r30w-qd16-nj8 [20:40:07] Benchmarks: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/benchmarks/mixed [20:40:07] Metrics: /scripts_f16_with_data_deletion/results/raidz2_20260320_040013/metrics/mixed [20:40:07] ═══════════════════════════════════════════════════════════ [20:40:07] Progress: 53/53 jobs | Elapsed: 40h39m | ETA: ~0h0m [20:40:07] [20:40:07] ╔══════════════════════════════════════════════════════════════╗ [20:40:07] ║ ALL BENCHMARKS COMPLETE ║ [20:40:07] ╠══════════════════════════════════════════════════════════════╣ [20:40:07] ║ Pool layout : raidz2 [20:40:07] ║ Total jobs : 53 [20:40:07] ║ Total runs : 159 [20:40:07] ║ Failed : 0 [20:40:07] ║ Elapsed : 40h 39m 54s [20:40:07] ║ Results : /scripts_f16_with_data_deletion/results/raidz2_20260320_040013 [20:40:07] ╚══════════════════════════════════════════════════════════════╝ [20:40:07] [20:40:07] Results tree: