Skip to content

Wire the AIE trace buffer through the fused full ELF flow - #151

Open
asyms wants to merge 4 commits into
amd:update-mlir-aie-latest-nightlyfrom
KULeuven-MICAS:swiglu-stream-tracing
Open

Wire the AIE trace buffer through the fused full ELF flow#151
asyms wants to merge 4 commits into
amd:update-mlir-aie-latest-nightlyfrom
KULeuven-MICAS:swiglu-stream-tracing

Conversation

@asyms

@asyms asyms commented Aug 21, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

stream-dse can now emit AIE tracing, but the trace buffer never reaches the device through the fused full ELF flow: lowering appends it to the operator's runtime sequence, and the address gets patched against the dispatched kernel instead, which is the wrapper. This wires the buffer through so a traced design produces real data, and leaves untraced builds exactly as they were.

  • Give the fused runtime sequence a trace buffer per operator, at the index that operator uses. That index is what lowering patches against, so the wrapper has to match it or the trace DMA writes nowhere and the buffer comes back empty.
  • Allocate one buffer per operator, bind them, and sync them back with the outputs.
  • Turn tracing on with IRON_TRACE_SIZE, and pick how many tiles with IRON_TRACE_NTILES. Off by default, since tracing changes the calling convention and its packet flows need routing a full design may not have spare.
  • Key the design cache on whether tracing is on, so traced and untraced builds do not share an entry.
  • Require stream-dse 1.13.14, the first release with the tracing codegen and the tile count argument. This is a floor for every build, not just traced ones.
  • Add unit tests for the slot layout.

Stacked on #150 for the mlir-aie 1.4.2 bump and the sequence.py rework.

Checked on Strix from a clean venv against the released stream-dse: untraced passes for k=1, 2 and 5, and a traced k=1 build gives a trace that decodes into per-core kernel spans and stalls.

asyms added 3 commits August 21, 2026 11:06
@asyms
require the stream-dse release that generates mlir-aie 1.4.0 buffer d…
85ed572 
…escriptors
@asyms
carry a hardware trace buffer through the fused sequence
72e8f22
@asyms
patch the trace buffer address against the dispatched kernel
9cb83e2 
Trace lowering records the buffer's index in the sequence it configures, but that
index is resolved against the kernel the host dispatches, which for a fused build
is the wrapper rather than the operator. The address was patched from an argument
the wrapper did not have, so the trace DMA wrote nowhere and the buffer came back
empty. Give the wrapper the buffer at the same index.
@asyms
asyms force-pushed the swiglu-stream-tracing branch from 436058f to 0d8e10b Compare August 21, 2026 09:47
@github-actions

github-actions Bot commented Aug 21, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

CI Test Results

92377dc (2026_08_21_17_08_36)

IRON - CI Summary

Small

iron/operators/axpy
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0] - - ✅ 304.94
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0] - - ✅ 697.02
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0] - - ✅ 294.88
iron/operators/dequant
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32] - - ✅ 340.12
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32] - - ✅ 281.58
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32] - - ✅ 240.26
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32] - - ✅ 323.00
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32] - - ✅ 315.74
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32] - - ✅ 416.38
iron/operators/elementwise_add
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048] - - ✅ 479.96
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024] - - ✅ 332.98
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512] - - ✅ 413.30
iron/operators/elementwise_mul
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048] - - ✅ 924.70
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024] - - ✅ 449.88
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512] - - ✅ 373.60
iron/operators/gelu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 544.98
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 383.76
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 425.36
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 392.54
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 476.94
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 521.54
iron/operators/gemm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1] - - ✅ 536.22
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1] - - ✅ 523.48
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1] - - ✅ 83808.84
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1] - - ✅ 25250.74
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1] - - ✅ 3840.62
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4] - - ✅ 5753.24
iron/operators/gemv
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128] - - ✅ 0.10
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048] - - ✅ 3.54
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024] - - ✅ 6.82
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512] - - ✅ 9.77
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024] - - ✅ 3.64
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024] - - ✅ 6.46
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024] - - ✅ 10.14
test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2] - - ✅ 1.81
test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2] - - ✅ 0.33
test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4] - - ✅ 0.42
test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8] - - ✅ 1.92
test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128] - - ❌ -
test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048] - - ❌ -
test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024] - - ❌ -
iron/operators/layer_norm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 356.40
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 427.08
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 931.64
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 438.70
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 652.70
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 394.64
iron/operators/leaky_relu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01] - - ✅ 431.98
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1] - - ✅ 371.58
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25] - - ✅ 322.04
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01] - - ✅ 267.16
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01] - - ✅ 314.70
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01] - - ✅ 483.86
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01] - - ✅ 475.88
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01] - - ✅ 673.98
iron/operators/mem_copy
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048] - - ✅ 373.30
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024] - - ✅ 358.42
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024] - - ✅ 439.14
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512] - - ✅ 853.58
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512] - - ✅ 477.66
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256] - - ✅ 511.10
iron/operators/relu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 348.58
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 323.10
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 341.18
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 585.18
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 352.58
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 777.18
iron/operators/rms_norm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False] - - ✅ 393.84
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True] - - ✅ 372.30
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False] - - ✅ 492.06
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True] - - ✅ 323.92
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False] - - ✅ 373.48
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True] - - ✅ 421.96
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False] - - ✅ 368.40
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True] - - ✅ 780.34
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False] - - ✅ 457.38
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True] - - ✅ 396.20
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False] - - ✅ 557.26
iron/operators/rope
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0] - - ✅ 401.98
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0] - - ✅ 389.72
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0] - - ✅ 422.80
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0] - - ✅ 473.10
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0] - - ✅ 415.74
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0] - - ✅ 414.04
iron/operators/sigmoid
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 296.28
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 558.72
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 401.36
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 371.44
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 414.02
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 353.52
iron/operators/silu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 574.96
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 418.86
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 402.38
iron/operators/softmax
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024] - - ✅ 451.36
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048] - - ✅ 418.34
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 391.24
iron/operators/swiglu_decode
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584] - - ✅ 12388.37
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048] - - ✅ 16673.09
iron/operators/swiglu_prefill
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False] - - ✅ 21625.21
iron/operators/tanh
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 362.78
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 442.68
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 412.00
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 400.30
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 535.00
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 488.36
iron/operators/transpose
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1] - - ✅ 549.76
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2] - - ✅ 780.88
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1] - - ✅ 724.78
Phoenix - Small

IRON

Tested on 2026_08_21_17_08_36 at commit 92377dc.

iron/operators/axpy
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]✅ 5/5304.940.04n/a
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]✅ 5/5697.020.03n/a
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]✅ 5/5294.880.04n/a
iron/operators/dequant
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]✅ 5/5340.120.02n/a
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]✅ 5/5281.580.02n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]✅ 5/5240.260.02n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]✅ 5/5323.000.02n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]✅ 5/5315.740.02n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]✅ 5/5416.380.01n/a
iron/operators/elementwise_add
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]✅ 5/5479.960.03n/a
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]✅ 5/5332.980.04n/a
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]✅ 5/5413.300.03n/a
iron/operators/elementwise_mul
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]✅ 5/5924.700.02n/a
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]✅ 5/5449.880.03n/a
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]✅ 5/5373.600.03n/a
iron/operators/gelu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5544.980.02n/a
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5383.760.02n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5425.360.02n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5392.540.02n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5476.940.02n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5521.540.02n/a
iron/operators/gemm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]✅ 5/5536.220.4619.69
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]✅ 5/5523.480.4318.55
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]✅ 5/583808.840.30205.14
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]✅ 5/525250.741.00681.27
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]✅ 5/53840.622.21580.27
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]✅ 5/55753.240.2211.77
iron/operators/gemv
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]✅ 5/5n/a0.100.10
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]✅ 5/5n/a3.543.54
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]✅ 5/5n/a6.826.81
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]✅ 5/5n/a9.779.76
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a3.643.64
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a6.466.46
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a10.1410.13
test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]✅ 5/5n/a1.811.81
test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]✅ 5/5n/a0.330.33
test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]✅ 5/5n/a0.420.41
test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]✅ 5/5n/a1.921.89
test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]❌ 0/5n/an/an/a
test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]❌ 0/5n/an/an/a
test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]❌ 0/5n/an/an/a
iron/operators/layer_norm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5356.400.03n/a
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5427.080.02n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5931.640.01n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5438.700.02n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5652.700.01n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5394.640.02n/a
iron/operators/leaky_relu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]✅ 5/5431.980.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]✅ 5/5371.580.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]✅ 5/5322.040.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]✅ 5/5267.160.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]✅ 5/5314.700.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]✅ 5/5483.860.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]✅ 5/5475.880.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]✅ 5/5673.980.02n/a
iron/operators/mem_copy
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]✅ 5/5373.300.02n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]✅ 5/5358.420.02n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]✅ 5/5439.140.02n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]✅ 5/5853.580.02n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]✅ 5/5477.660.02n/a
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]✅ 5/5511.100.02n/a
iron/operators/relu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5348.580.03n/a
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5323.100.03n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5341.180.03n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5585.180.02n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5352.580.02n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5777.180.02n/a
iron/operators/rms_norm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]✅ 5/5393.840.02n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]✅ 5/5372.300.04n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]✅ 5/5492.060.02n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]✅ 5/5323.920.03n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]✅ 5/5373.480.02n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]✅ 5/5421.960.03n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]✅ 5/5368.400.02n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]✅ 5/5780.340.02n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]✅ 5/5457.380.02n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]✅ 5/5396.200.02n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]✅ 5/5557.260.02n/a
iron/operators/rope
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]✅ 5/5401.980.26n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]✅ 5/5389.720.27n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]✅ 5/5422.800.26n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]✅ 5/5473.100.17n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]✅ 5/5415.740.20n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]✅ 5/5414.040.20n/a
iron/operators/sigmoid
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5296.280.03n/a
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5558.720.02n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5401.360.02n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5371.440.02n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5414.020.02n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5353.520.02n/a
iron/operators/silu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5574.960.02n/a
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5418.860.02n/a
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5402.380.02n/a
iron/operators/softmax
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]✅ 5/5451.360.31n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]✅ 5/5418.340.35n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5391.240.38n/a
iron/operators/swiglu_decode
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]✅ 5/512388.370.00n/a
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]✅ 5/516673.090.00n/a
iron/operators/swiglu_prefill
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]✅ 5/521625.210.11n/a
iron/operators/tanh
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5362.780.02n/a
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5442.680.02n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5412.000.02n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5400.300.02n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5535.000.02n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5488.360.02n/a
iron/operators/transpose
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]✅ 5/5549.761.10n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]✅ 5/5780.881.83n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]✅ 5/5724.781.11n/a

Trends:

IRON Trends

iron/operators/axpy

test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.05 (+15.85%)0.04 (+22.96%)0.04 (+4.41%)0.03 (+43.37%)0.01 (-27.81%)423.60 (-30.25%)304.94 (-25.13%)283.20 (-4.19%)234.60 (-13.65%)72.75 (-56.11%)
cdc48e9 — 2026-08-03 16:32:080.05 (n/a)0.03 (n/a)0.04 (n/a)0.02 (n/a)0.01 (n/a)607.30 (n/a)407.28 (n/a)295.60 (n/a)271.70 (n/a)165.76 (n/a)

test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.05 (+1.79%)0.03 (-32.67%)0.03 (-44.24%)0.01 (-68.79%)0.02 (+34.07%)1862.20 (+220.46%)697.02 (+111.92%)472.80 (+79.36%)231.50 (-1.78%)660.64 (+358.08%)
cdc48e9 — 2026-08-03 16:32:080.05 (n/a)0.04 (n/a)0.05 (n/a)0.02 (n/a)0.01 (n/a)581.10 (n/a)328.90 (n/a)263.60 (n/a)235.70 (n/a)144.22 (n/a)

test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.07 (+34.81%)0.04 (+41.92%)0.04 (+53.98%)0.03 (+73.90%)0.01 (+10.67%)371.80 (-42.50%)294.88 (-33.39%)303.20 (-35.05%)177.90 (-25.81%)71.26 (-54.84%)
cdc48e9 — 2026-08-03 16:32:080.05 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)646.60 (n/a)442.68 (n/a)466.80 (n/a)239.80 (n/a)157.79 (n/a)
iron/operators/dequant

test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.02 (-14.67%)0.02 (+11.03%)0.02 (+13.28%)0.01 (+53.51%)0.01 (-26.62%)527.70 (-34.86%)340.12 (-21.54%)261.00 (-11.71%)238.10 (+17.18%)131.57 (-47.55%)
cdc48e9 — 2026-08-03 16:32:080.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)810.10 (n/a)433.48 (n/a)295.60 (n/a)203.20 (n/a)250.85 (n/a)

test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (+9.64%)0.02 (+18.59%)0.02 (+24.83%)0.01 (+0.78%)0.01 (+3.70%)443.60 (-0.76%)281.58 (-15.85%)241.60 (-19.89%)206.40 (-8.79%)94.13 (-5.73%)
cdc48e9 — 2026-08-03 16:32:080.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)447.00 (n/a)334.62 (n/a)301.60 (n/a)226.30 (n/a)99.85 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.02 (-2.77%)0.02 (+28.69%)0.02 (+21.06%)0.02 (+91.51%)0.00 (-80.33%)259.00 (-47.78%)240.26 (-28.22%)240.10 (-17.41%)230.50 (+2.86%)11.48 (-89.61%)
cdc48e9 — 2026-08-03 16:32:080.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)496.00 (n/a)334.70 (n/a)290.70 (n/a)224.10 (n/a)110.49 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.02 (+15.36%)0.02 (+17.17%)0.02 (+4.34%)0.01 (+10.17%)0.00 (+15.44%)533.70 (-9.23%)323.00 (-14.12%)290.40 (-4.16%)248.00 (-13.32%)119.54 (-5.89%)
cdc48e9 — 2026-08-03 16:32:080.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)588.00 (n/a)376.12 (n/a)303.00 (n/a)286.10 (n/a)127.02 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.02 (+3.58%)0.02 (+2.74%)0.02 (+13.12%)0.01 (-12.99%)0.01 (+17.90%)536.60 (+14.93%)315.74 (+0.92%)271.90 (-11.61%)214.10 (-3.43%)128.33 (+35.71%)
cdc48e9 — 2026-08-03 16:32:080.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)466.90 (n/a)312.86 (n/a)307.60 (n/a)221.70 (n/a)94.56 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.02 (-15.93%)0.01 (-2.26%)0.01 (+15.05%)0.01 (-3.83%)0.00 (-24.82%)613.20 (+3.99%)416.38 (-0.68%)393.60 (-13.07%)290.90 (+18.98%)131.05 (-6.93%)
cdc48e9 — 2026-08-03 16:32:080.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)589.70 (n/a)419.24 (n/a)452.80 (n/a)244.50 (n/a)140.81 (n/a)
iron/operators/elementwise_add

test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.05 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)601.00 (n/a)479.96 (n/a)490.00 (n/a)265.70 (n/a)128.97 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.05 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)434.10 (n/a)332.98 (n/a)294.40 (n/a)231.30 (n/a)87.00 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.05 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)592.00 (n/a)413.30 (n/a)413.60 (n/a)259.80 (n/a)145.02 (n/a)
iron/operators/elementwise_mul

test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)0.01 (n/a)2464.90 (n/a)924.70 (n/a)500.50 (n/a)411.90 (n/a)871.48 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.05 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)603.20 (n/a)449.88 (n/a)547.40 (n/a)257.30 (n/a)172.45 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.05 (n/a)0.03 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)490.10 (n/a)373.60 (n/a)349.50 (n/a)259.70 (n/a)101.06 (n/a)
iron/operators/gelu

test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)1161.80 (n/a)544.98 (n/a)475.50 (n/a)257.90 (n/a)359.73 (n/a)

test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)561.30 (n/a)383.76 (n/a)344.50 (n/a)240.70 (n/a)150.06 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)626.90 (n/a)425.36 (n/a)442.30 (n/a)227.30 (n/a)184.95 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)524.30 (n/a)392.54 (n/a)416.30 (n/a)292.20 (n/a)96.23 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)724.10 (n/a)476.94 (n/a)462.80 (n/a)313.80 (n/a)167.72 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)590.50 (n/a)521.54 (n/a)540.50 (n/a)430.90 (n/a)60.04 (n/a)
iron/operators/gemm

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:170.76 (+42.81%)0.46 (+12.09%)0.36 (-12.67%)0.32 (+12.65%)0.19 (+97.57%)699.60 (-11.23%)536.22 (-4.80%)620.60 (+14.50%)292.50 (-29.97%)177.62 (+23.80%)32.27 (+42.81%)19.69 (+12.09%)15.21 (-12.67%)13.49 (+12.65%)8.05 (+97.57%)
cdc48e9 — 2026-08-03 16:32:080.53 (n/a)0.41 (n/a)0.41 (n/a)0.28 (n/a)0.10 (n/a)788.10 (n/a)563.26 (n/a)542.00 (n/a)417.70 (n/a)143.47 (n/a)22.60 (n/a)17.57 (n/a)17.41 (n/a)11.97 (n/a)4.07 (n/a)

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:170.54 (+12.70%)0.43 (+12.87%)0.42 (+18.20%)0.34 (+19.06%)0.08 (-4.12%)658.60 (-16.01%)523.48 (-12.42%)529.70 (-15.40%)410.00 (-11.27%)98.82 (-26.26%)23.02 (+12.70%)18.55 (+12.87%)17.82 (+18.20%)14.33 (+19.06%)3.49 (-4.12%)
cdc48e9 — 2026-08-03 16:32:080.48 (n/a)0.39 (n/a)0.35 (n/a)0.28 (n/a)0.09 (n/a)784.10 (n/a)597.72 (n/a)626.10 (n/a)462.10 (n/a)134.02 (n/a)20.42 (n/a)16.43 (n/a)15.07 (n/a)12.04 (n/a)3.64 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:170.31 (+1.21%)0.30 (-1.53%)0.30 (-0.86%)0.29 (-5.18%)0.01 (+391.55%)87901.50 (+5.46%)83808.84 (+1.63%)82994.00 (+0.86%)81136.50 (-1.19%)2576.15 (+413.74%)211.74 (+1.21%)205.14 (-1.53%)207.00 (-0.86%)195.44 (-5.18%)6.18 (+391.55%)
cdc48e9 — 2026-08-03 16:32:080.31 (n/a)0.31 (n/a)0.31 (n/a)0.30 (n/a)0.00 (n/a)83350.90 (n/a)82467.46 (n/a)82282.50 (n/a)82115.60 (n/a)501.45 (n/a)209.22 (n/a)208.33 (n/a)208.79 (n/a)206.12 (n/a)1.26 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:171.02 (+0.19%)1.00 (-0.25%)1.02 (+0.80%)0.93 (-2.94%)0.04 (+54.61%)27117.30 (+3.03%)25250.74 (+0.33%)24766.50 (-0.79%)24652.00 (-0.19%)1049.84 (+59.01%)696.90 (+0.19%)681.27 (-0.25%)693.67 (+0.80%)633.54 (-2.94%)26.87 (+54.61%)
cdc48e9 — 2026-08-03 16:32:081.02 (n/a)1.00 (n/a)1.01 (n/a)0.96 (n/a)0.03 (n/a)26319.80 (n/a)25168.86 (n/a)24964.50 (n/a)24697.80 (n/a)660.22 (n/a)695.60 (n/a)682.95 (n/a)688.17 (n/a)652.74 (n/a)17.38 (n/a)

test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:173.18 (-16.80%)2.21 (-6.80%)2.06 (+1.19%)1.64 (+8.00%)0.61 (-33.30%)4907.30 (-7.41%)3840.62 (+2.23%)3910.40 (-1.18%)2531.50 (+20.19%)920.11 (-24.93%)835.06 (-16.80%)580.27 (-6.80%)540.59 (+1.19%)430.77 (+8.00%)158.91 (-33.30%)
cdc48e9 — 2026-08-03 16:32:083.83 (n/a)2.37 (n/a)2.04 (n/a)1.52 (n/a)0.91 (n/a)5300.10 (n/a)3756.70 (n/a)3956.90 (n/a)2106.20 (n/a)1225.67 (n/a)1003.68 (n/a)622.60 (n/a)534.24 (n/a)398.85 (n/a)238.25 (n/a)

test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:170.25 (-17.04%)0.22 (+2.82%)0.22 (+13.21%)0.19 (+5.41%)0.02 (-52.05%)6606.90 (-5.13%)5753.24 (-5.06%)5602.80 (-11.67%)5039.70 (+20.54%)625.61 (-42.90%)13.32 (-17.04%)11.77 (+2.82%)11.98 (+13.21%)10.16 (+5.41%)1.26 (-52.05%)
cdc48e9 — 2026-08-03 16:32:080.30 (n/a)0.21 (n/a)0.20 (n/a)0.18 (n/a)0.05 (n/a)6964.20 (n/a)6059.96 (n/a)6342.80 (n/a)4180.90 (n/a)1095.64 (n/a)16.05 (n/a)11.45 (n/a)10.58 (n/a)9.64 (n/a)2.62 (n/a)
iron/operators/gemv

test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:170.12 (n/a)0.10 (n/a)0.10 (n/a)0.07 (n/a)0.02 (n/a)0.12 (n/a)0.10 (n/a)0.10 (n/a)0.07 (n/a)0.02 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:173.68 (n/a)3.54 (n/a)3.62 (n/a)3.36 (n/a)0.16 (n/a)3.68 (n/a)3.54 (n/a)3.62 (n/a)3.35 (n/a)0.16 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:177.42 (+30.91%)6.82 (+30.68%)6.87 (+30.15%)5.92 (+24.61%)0.55 (+24.60%)7.41 (+30.91%)6.81 (+30.68%)6.87 (+30.15%)5.92 (+24.61%)0.55 (+24.60%)
cdc48e9 — 2026-08-03 16:32:085.67 (n/a)5.22 (n/a)5.28 (n/a)4.75 (n/a)0.44 (n/a)5.66 (n/a)5.21 (n/a)5.28 (n/a)4.75 (n/a)0.44 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:1714.20 (+9.90%)9.77 (-1.34%)7.52 (-24.45%)6.51 (+1.50%)3.67 (+47.12%)14.19 (+9.90%)9.76 (-1.34%)7.51 (-24.45%)6.51 (+1.50%)3.67 (+47.12%)
cdc48e9 — 2026-08-03 16:32:0812.92 (n/a)9.90 (n/a)9.95 (n/a)6.41 (n/a)2.49 (n/a)12.91 (n/a)9.90 (n/a)9.95 (n/a)6.41 (n/a)2.49 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:173.76 (n/a)3.64 (n/a)3.69 (n/a)3.49 (n/a)0.13 (n/a)3.76 (n/a)3.64 (n/a)3.69 (n/a)3.49 (n/a)0.13 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:177.03 (-6.99%)6.46 (-6.50%)6.89 (+0.31%)4.92 (-18.46%)0.88 (+35.72%)7.02 (-6.99%)6.46 (-6.50%)6.89 (+0.31%)4.92 (-18.46%)0.88 (+35.72%)
cdc48e9 — 2026-08-03 16:32:087.56 (n/a)6.91 (n/a)6.87 (n/a)6.04 (n/a)0.65 (n/a)7.55 (n/a)6.90 (n/a)6.87 (n/a)6.03 (n/a)0.65 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:1713.09 (-5.82%)10.14 (-17.42%)9.82 (-21.62%)8.15 (-14.29%)1.80 (-0.99%)13.08 (-5.82%)10.13 (-17.42%)9.81 (-21.62%)8.15 (-14.29%)1.80 (-0.99%)
cdc48e9 — 2026-08-03 16:32:0813.89 (n/a)12.27 (n/a)12.52 (n/a)9.51 (n/a)1.82 (n/a)13.89 (n/a)12.27 (n/a)12.52 (n/a)9.50 (n/a)1.82 (n/a)

test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:172.41 (-12.74%)1.81 (+23.03%)1.93 (+53.70%)1.19 (+22.81%)0.47 (-35.24%)2.41 (-12.74%)1.81 (+23.03%)1.92 (+53.70%)1.19 (+22.81%)0.47 (-35.24%)
cdc48e9 — 2026-08-03 16:32:082.76 (n/a)1.47 (n/a)1.25 (n/a)0.97 (n/a)0.73 (n/a)2.76 (n/a)1.47 (n/a)1.25 (n/a)0.97 (n/a)0.73 (n/a)

test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:170.48 (+5.93%)0.33 (+44.90%)0.37 (+101.98%)0.08 (+2.68%)0.15 (-10.92%)0.47 (+5.93%)0.33 (+44.90%)0.36 (+101.98%)0.07 (+2.68%)0.15 (-10.92%)
cdc48e9 — 2026-08-03 16:32:080.45 (n/a)0.23 (n/a)0.18 (n/a)0.07 (n/a)0.17 (n/a)0.45 (n/a)0.22 (n/a)0.18 (n/a)0.07 (n/a)0.17 (n/a)

test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:170.72 (+65.30%)0.42 (+37.83%)0.40 (+40.13%)0.14 (+72.66%)0.23 (+54.01%)0.71 (+65.30%)0.41 (+37.83%)0.40 (+40.13%)0.14 (+72.66%)0.22 (+54.01%)
cdc48e9 — 2026-08-03 16:32:080.44 (n/a)0.30 (n/a)0.29 (n/a)0.08 (n/a)0.15 (n/a)0.43 (n/a)0.30 (n/a)0.28 (n/a)0.08 (n/a)0.14 (n/a)

test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
92377dc — 2026-08-21 17:04:172.71 (-10.56%)1.92 (+0.29%)2.26 (+22.93%)0.53 (-48.55%)0.87 (+21.83%)2.67 (-10.56%)1.89 (+0.29%)2.22 (+22.93%)0.52 (-48.55%)0.86 (+21.83%)
cdc48e9 — 2026-08-03 16:32:083.03 (n/a)1.91 (n/a)1.84 (n/a)1.03 (n/a)0.72 (n/a)2.98 (n/a)1.88 (n/a)1.81 (n/a)1.01 (n/a)0.71 (n/a)

test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

No metrics available.

test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

No metrics available.

test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

No metrics available.

iron/operators/layer_norm

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)644.40 (n/a)356.40 (n/a)302.20 (n/a)254.80 (n/a)162.28 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.04 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)511.20 (n/a)427.08 (n/a)467.20 (n/a)233.00 (n/a)113.68 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.02 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)0.01 (n/a)2461.20 (n/a)931.64 (n/a)597.40 (n/a)349.20 (n/a)863.43 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)621.40 (n/a)438.70 (n/a)458.50 (n/a)268.80 (n/a)163.94 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)1077.60 (n/a)652.70 (n/a)609.50 (n/a)435.80 (n/a)259.80 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)542.60 (n/a)394.64 (n/a)371.20 (n/a)236.30 (n/a)126.75 (n/a)
iron/operators/leaky_relu

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (+18.24%)0.02 (+18.15%)0.02 (+16.90%)0.01 (+3.50%)0.01 (+38.70%)611.60 (-3.38%)431.98 (-11.65%)459.40 (-14.45%)253.40 (-15.42%)168.60 (+6.61%)
cdc48e9 — 2026-08-03 16:32:080.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)633.00 (n/a)488.92 (n/a)537.00 (n/a)299.60 (n/a)158.15 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.04 (+4.19%)0.03 (-14.49%)0.03 (-13.83%)0.01 (-4.63%)0.01 (+13.23%)573.50 (+4.84%)371.58 (+20.09%)296.00 (+16.03%)206.40 (-4.04%)153.37 (+12.70%)
cdc48e9 — 2026-08-03 16:32:080.04 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)547.00 (n/a)309.42 (n/a)255.10 (n/a)215.10 (n/a)136.08 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.04 (+18.18%)0.03 (-2.16%)0.03 (-10.53%)0.02 (-9.53%)0.01 (+29.58%)442.50 (+10.51%)322.04 (+5.05%)293.10 (+11.78%)201.30 (-15.38%)98.64 (+22.43%)
cdc48e9 — 2026-08-03 16:32:080.03 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)400.40 (n/a)306.56 (n/a)262.20 (n/a)237.90 (n/a)80.57 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.04 (+16.50%)0.03 (+23.39%)0.03 (+6.31%)0.03 (+48.64%)0.01 (-16.83%)322.80 (-32.72%)267.16 (-23.15%)269.10 (-5.94%)194.00 (-14.16%)52.41 (-54.64%)
cdc48e9 — 2026-08-03 16:32:080.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)479.80 (n/a)347.66 (n/a)286.10 (n/a)226.00 (n/a)115.56 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (-7.36%)0.03 (+0.35%)0.03 (+2.26%)0.02 (+3.03%)0.01 (-37.38%)446.10 (-2.94%)314.70 (-5.55%)294.00 (-2.23%)241.10 (+7.97%)77.20 (-32.52%)
cdc48e9 — 2026-08-03 16:32:080.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)459.60 (n/a)333.20 (n/a)300.70 (n/a)223.30 (n/a)114.40 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.02 (-30.68%)0.02 (-11.05%)0.02 (+21.45%)0.01 (+45.07%)0.00 (-62.53%)690.20 (-31.07%)483.86 (-8.81%)463.70 (-17.65%)370.70 (+44.24%)126.12 (-58.41%)
cdc48e9 — 2026-08-03 16:32:080.03 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)1001.30 (n/a)530.62 (n/a)563.10 (n/a)257.00 (n/a)303.27 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (-1.72%)0.02 (-14.25%)0.02 (-25.48%)0.01 (+3.81%)0.01 (-14.61%)585.50 (-3.67%)475.88 (+13.84%)515.10 (+34.18%)291.40 (+1.75%)116.23 (-16.72%)
cdc48e9 — 2026-08-03 16:32:080.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)607.80 (n/a)418.02 (n/a)383.90 (n/a)286.40 (n/a)139.56 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (+0.55%)0.02 (+1.32%)0.02 (+42.59%)0.00 (-63.85%)0.01 (+43.59%)1868.20 (+176.61%)673.98 (+45.79%)339.40 (-29.88%)258.80 (-0.54%)678.13 (+338.95%)
cdc48e9 — 2026-08-03 16:32:080.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)675.40 (n/a)462.30 (n/a)484.00 (n/a)260.20 (n/a)154.49 (n/a)
iron/operators/mem_copy

test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (-23.40%)0.02 (-0.83%)0.03 (+36.75%)0.02 (+267.77%)0.01 (-48.16%)537.60 (-72.81%)373.30 (-42.65%)309.60 (-26.88%)242.90 (+30.52%)136.59 (-81.80%)
cdc48e9 — 2026-08-03 16:32:080.04 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)0.02 (n/a)1977.00 (n/a)650.86 (n/a)423.40 (n/a)186.10 (n/a)750.31 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (-10.18%)0.02 (+7.07%)0.03 (+41.49%)0.02 (+26.63%)0.01 (-36.32%)475.50 (-21.03%)358.42 (-15.01%)294.00 (-29.31%)268.50 (+11.32%)101.75 (-42.31%)
cdc48e9 — 2026-08-03 16:32:080.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)602.10 (n/a)421.72 (n/a)415.90 (n/a)241.20 (n/a)176.36 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (-0.18%)0.02 (-1.02%)0.02 (-7.68%)0.01 (-2.90%)0.01 (+0.89%)565.80 (+2.99%)439.14 (+1.26%)471.50 (+8.34%)252.20 (+0.16%)115.29 (+2.50%)
cdc48e9 — 2026-08-03 16:32:080.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)549.40 (n/a)433.68 (n/a)435.20 (n/a)251.80 (n/a)112.47 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (-26.31%)0.02 (-32.10%)0.02 (-13.11%)0.00 (-77.22%)0.01 (-16.77%)2433.00 (+339.01%)853.58 (+110.73%)536.30 (+15.09%)320.60 (+35.73%)888.95 (+479.23%)
cdc48e9 — 2026-08-03 16:32:080.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)554.20 (n/a)405.06 (n/a)466.00 (n/a)236.20 (n/a)153.47 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (+15.53%)0.02 (-16.74%)0.02 (-37.01%)0.01 (-0.26%)0.01 (+23.48%)595.80 (+0.27%)477.66 (+22.89%)515.40 (+58.78%)249.80 (-13.44%)139.68 (+6.55%)
cdc48e9 — 2026-08-03 16:32:080.03 (n/a)0.02 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)594.20 (n/a)388.70 (n/a)324.60 (n/a)288.60 (n/a)131.10 (n/a)

test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (-2.79%)0.02 (-9.55%)0.02 (+11.16%)0.01 (+16.47%)0.01 (-27.01%)618.90 (-14.14%)511.10 (+2.85%)522.30 (-10.04%)293.00 (+2.88%)132.05 (-32.55%)
cdc48e9 — 2026-08-03 16:32:080.03 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)720.80 (n/a)496.92 (n/a)580.60 (n/a)284.80 (n/a)195.77 (n/a)
iron/operators/rms_norm

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (+10.12%)0.02 (+3.75%)0.02 (-5.07%)0.02 (+7.25%)0.01 (+12.40%)543.90 (-6.77%)393.84 (-2.59%)413.90 (+5.34%)237.60 (-9.17%)141.50 (-2.02%)
cdc48e9 — 2026-08-03 16:32:080.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)583.40 (n/a)404.30 (n/a)392.90 (n/a)261.60 (n/a)144.43 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.05 (+3.50%)0.04 (+32.91%)0.04 (+51.12%)0.02 (+33.65%)0.01 (+3.60%)519.00 (-25.17%)372.30 (-25.74%)330.70 (-33.83%)260.40 (-3.38%)122.47 (-19.66%)
cdc48e9 — 2026-08-03 16:32:080.05 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)693.60 (n/a)501.36 (n/a)499.80 (n/a)269.50 (n/a)152.43 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (-2.08%)0.02 (-10.73%)0.02 (+1.56%)0.01 (-24.17%)0.01 (+5.17%)725.80 (+31.89%)492.06 (+16.36%)442.40 (-1.54%)277.90 (+2.13%)187.03 (+44.38%)
cdc48e9 — 2026-08-03 16:32:080.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)550.30 (n/a)422.88 (n/a)449.30 (n/a)272.10 (n/a)129.54 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.04 (+11.41%)0.03 (+26.47%)0.03 (+44.87%)0.02 (+23.18%)0.01 (-3.41%)464.80 (-18.81%)323.92 (-22.05%)300.20 (-30.97%)259.70 (-10.23%)80.89 (-25.28%)
cdc48e9 — 2026-08-03 16:32:080.04 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)572.50 (n/a)415.56 (n/a)434.90 (n/a)289.30 (n/a)108.25 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.04 (-5.26%)0.02 (-2.98%)0.03 (-5.38%)0.01 (+13.77%)0.01 (-13.92%)552.80 (-12.10%)373.48 (-0.97%)307.10 (+5.68%)231.30 (+5.57%)134.39 (-19.53%)
cdc48e9 — 2026-08-03 16:32:080.04 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)628.90 (n/a)377.14 (n/a)290.60 (n/a)219.10 (n/a)167.00 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.05 (+30.99%)0.03 (+42.81%)0.02 (+30.38%)0.02 (+278.30%)0.01 (+8.49%)533.40 (-73.57%)421.96 (-47.91%)465.50 (-23.30%)199.90 (-23.67%)130.76 (-81.07%)
cdc48e9 — 2026-08-03 16:32:080.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)2018.00 (n/a)810.12 (n/a)606.90 (n/a)261.90 (n/a)690.59 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.04 (-6.26%)0.02 (-13.46%)0.03 (-12.97%)0.02 (+5.00%)0.01 (-8.90%)510.70 (-4.76%)368.40 (+14.06%)315.00 (+14.88%)229.70 (+6.69%)120.59 (-5.85%)
cdc48e9 — 2026-08-03 16:32:080.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)536.20 (n/a)323.00 (n/a)274.20 (n/a)215.30 (n/a)128.08 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.02 (-48.27%)0.02 (-42.00%)0.02 (-44.03%)0.00 (-66.33%)0.01 (-41.59%)1859.60 (+197.01%)780.34 (+97.20%)566.30 (+78.64%)396.60 (+93.37%)612.01 (+237.61%)
cdc48e9 — 2026-08-03 16:32:080.04 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)626.10 (n/a)395.70 (n/a)317.00 (n/a)205.10 (n/a)181.28 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (-15.94%)0.02 (-0.12%)0.02 (+5.95%)0.01 (-7.01%)0.01 (-16.84%)661.00 (+7.53%)457.38 (-1.41%)495.30 (-5.62%)269.50 (+18.98%)165.51 (+4.33%)
cdc48e9 — 2026-08-03 16:32:080.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)614.70 (n/a)463.90 (n/a)524.80 (n/a)226.50 (n/a)158.65 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.03 (-9.59%)0.02 (-5.04%)0.02 (+0.02%)0.02 (+10.87%)0.01 (-23.72%)507.90 (-9.80%)396.20 (+1.47%)405.70 (-0.02%)272.20 (+10.61%)106.88 (-20.01%)
cdc48e9 — 2026-08-03 16:32:080.04 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)563.10 (n/a)390.46 (n/a)405.80 (n/a)246.10 (n/a)133.62 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.02 (-35.49%)0.02 (-6.79%)0.02 (+22.37%)0.01 (-17.06%)0.01 (-41.63%)1068.50 (+20.57%)557.26 (+3.09%)423.10 (-18.29%)365.00 (+55.06%)290.76 (+22.71%)
cdc48e9 — 2026-08-03 16:32:080.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)886.20 (n/a)540.54 (n/a)517.80 (n/a)235.40 (n/a)236.94 (n/a)
iron/operators/rope

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.37 (+3.42%)0.26 (-6.29%)0.24 (-29.92%)0.21 (+32.30%)0.07 (-36.87%)475.90 (-24.41%)401.98 (-3.93%)412.20 (+42.68%)265.30 (-3.32%)81.42 (-56.40%)
cdc48e9 — 2026-08-03 16:32:080.36 (n/a)0.27 (n/a)0.34 (n/a)0.16 (n/a)0.10 (n/a)629.60 (n/a)418.44 (n/a)288.90 (n/a)274.40 (n/a)186.73 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.36 (-23.80%)0.27 (-17.42%)0.26 (-26.11%)0.20 (+0.32%)0.08 (-37.21%)503.00 (-0.32%)389.72 (+14.20%)372.10 (+35.31%)271.60 (+31.21%)109.74 (-19.27%)
cdc48e9 — 2026-08-03 16:32:080.47 (n/a)0.33 (n/a)0.36 (n/a)0.19 (n/a)0.12 (n/a)504.60 (n/a)341.26 (n/a)275.00 (n/a)207.00 (n/a)135.94 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.39 (+8.53%)0.26 (+8.85%)0.21 (+8.57%)0.16 (-2.38%)0.11 (+17.43%)614.90 (+2.45%)422.80 (-6.10%)471.80 (-7.91%)254.30 (-7.86%)158.50 (+4.94%)
cdc48e9 — 2026-08-03 16:32:080.36 (n/a)0.24 (n/a)0.19 (n/a)0.16 (n/a)0.09 (n/a)600.20 (n/a)450.26 (n/a)512.30 (n/a)276.00 (n/a)151.05 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.30 (+3.67%)0.17 (-3.94%)0.16 (+6.21%)0.12 (+10.95%)0.07 (-12.61%)633.10 (-9.87%)473.10 (-2.03%)464.70 (-5.85%)246.90 (-3.55%)145.33 (-28.89%)
cdc48e9 — 2026-08-03 16:32:080.29 (n/a)0.18 (n/a)0.15 (n/a)0.10 (n/a)0.08 (n/a)702.40 (n/a)482.92 (n/a)493.60 (n/a)256.00 (n/a)204.36 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.30 (+2.96%)0.20 (+4.90%)0.15 (+6.42%)0.12 (-4.73%)0.08 (+8.60%)599.10 (+4.98%)415.74 (-3.39%)479.60 (-6.03%)249.40 (-2.88%)151.59 (+5.05%)
cdc48e9 — 2026-08-03 16:32:080.29 (n/a)0.19 (n/a)0.14 (n/a)0.13 (n/a)0.07 (n/a)570.70 (n/a)430.32 (n/a)510.40 (n/a)256.80 (n/a)144.31 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.30 (-2.23%)0.20 (-0.45%)0.21 (+21.61%)0.12 (-20.34%)0.07 (+24.93%)594.60 (+25.52%)414.04 (+6.91%)349.20 (-17.78%)249.00 (+2.26%)158.07 (+78.75%)
cdc48e9 — 2026-08-03 16:32:080.30 (n/a)0.20 (n/a)0.17 (n/a)0.16 (n/a)0.06 (n/a)473.70 (n/a)387.28 (n/a)424.70 (n/a)243.50 (n/a)88.43 (n/a)
iron/operators/softmax

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.45 (-12.11%)0.31 (-16.78%)0.27 (-29.62%)0.22 (-9.32%)0.10 (-22.63%)599.00 (+10.27%)451.36 (+17.17%)490.20 (+42.09%)289.40 (+13.80%)124.44 (-6.22%)
cdc48e9 — 2026-08-03 16:32:080.52 (n/a)0.37 (n/a)0.38 (n/a)0.24 (n/a)0.12 (n/a)543.20 (n/a)385.22 (n/a)345.00 (n/a)254.30 (n/a)132.70 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.48 (+90.56%)0.35 (+46.72%)0.29 (+16.91%)0.23 (+11.45%)0.12 (+556.78%)561.90 (-10.27%)418.34 (-25.16%)457.90 (-14.46%)270.40 (-47.53%)137.94 (+195.69%)
cdc48e9 — 2026-08-03 16:32:080.25 (n/a)0.24 (n/a)0.24 (n/a)0.21 (n/a)0.02 (n/a)626.20 (n/a)559.00 (n/a)535.30 (n/a)515.30 (n/a)46.65 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.51 (-0.40%)0.38 (+86.33%)0.45 (+154.62%)0.22 (+235.76%)0.14 (-26.57%)598.60 (-70.22%)391.24 (-65.14%)291.80 (-60.73%)254.70 (+0.43%)160.09 (-79.77%)
cdc48e9 — 2026-08-03 16:32:080.52 (n/a)0.20 (n/a)0.18 (n/a)0.07 (n/a)0.18 (n/a)2009.90 (n/a)1122.34 (n/a)743.10 (n/a)253.60 (n/a)791.49 (n/a)
iron/operators/swiglu_decode

test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.00 (+133.33%)0.00 (+72.73%)0.00 (+50.00%)0.00 (+0.00%)0.00 (+330.12%)17276.61 (-11.39%)12388.37 (-31.56%)13139.90 (-27.88%)5949.52 (-63.68%)4708.21 (+285.84%)
cdc48e9 — 2026-08-03 16:32:080.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)19497.20 (n/a)18101.11 (n/a)18219.31 (n/a)16380.05 (n/a)1220.24 (n/a)

test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.00 (+8.33%)0.00 (+6.90%)0.00 (+0.00%)0.00 (+0.00%)0.00 (+11.62%)22739.65 (-1.05%)16673.09 (-2.59%)18582.43 (-1.83%)6237.57 (-8.22%)6911.43 (+9.10%)
cdc48e9 — 2026-08-03 16:32:080.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)22980.49 (n/a)17117.16 (n/a)18929.10 (n/a)6796.32 (n/a)6335.01 (n/a)
iron/operators/swiglu_prefill

test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:170.15 (+15.16%)0.11 (+8.67%)0.08 (-9.85%)0.07 (-2.02%)0.04 (+53.63%)28779.62 (+2.09%)21625.21 (-3.23%)25741.29 (+10.90%)13810.22 (-13.15%)7181.54 (+29.07%)
cdc48e9 — 2026-08-03 16:32:080.13 (n/a)0.10 (n/a)0.09 (n/a)0.07 (n/a)0.03 (n/a)28189.10 (n/a)22347.59 (n/a)23211.24 (n/a)15901.35 (n/a)5564.14 (n/a)
iron/operators/transpose

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:171.57 (-10.55%)1.10 (-1.96%)1.00 (+6.61%)0.57 (-21.41%)0.43 (-5.38%)926.50 (+27.25%)549.76 (+3.97%)523.20 (-6.20%)334.20 (+11.77%)240.91 (+26.92%)
cdc48e9 — 2026-08-03 16:32:081.75 (n/a)1.12 (n/a)0.94 (n/a)0.72 (n/a)0.45 (n/a)728.10 (n/a)528.78 (n/a)557.80 (n/a)299.00 (n/a)189.82 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:172.35 (-14.53%)1.83 (-3.99%)2.28 (+47.87%)0.55 (-56.61%)0.78 (+16.97%)1911.20 (+130.49%)780.88 (+29.59%)459.60 (-32.38%)446.20 (+16.99%)637.08 (+230.44%)
cdc48e9 — 2026-08-03 16:32:082.75 (n/a)1.91 (n/a)1.54 (n/a)1.26 (n/a)0.66 (n/a)829.20 (n/a)602.60 (n/a)679.70 (n/a)381.40 (n/a)192.80 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
4bb8427 — 2026-06-25 20:01:371.58 (-2.67%)1.21 (+5.65%)1.29 (+41.89%)0.66 (-20.05%)0.38 (-2.53%)792.90 (+25.08%)479.12 (-3.80%)406.80 (-29.52%)331.10 (+2.76%)189.18 (+26.62%)
4bb8427 — 2026-06-23 22:46:491.63 (n/a)1.14 (n/a)0.91 (n/a)0.83 (n/a)0.38 (n/a)633.90 (n/a)498.02 (n/a)577.20 (n/a)322.20 (n/a)149.40 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
92377dc — 2026-08-21 17:04:171.83 (+3.38%)1.11 (+3.47%)0.99 (+6.35%)0.28 (-65.07%)0.60 (+51.23%)1894.10 (+186.33%)724.78 (+36.71%)528.10 (-5.98%)287.20 (-3.27%)664.69 (+372.24%)
cdc48e9 — 2026-08-03 16:32:081.77 (n/a)1.07 (n/a)0.93 (n/a)0.79 (n/a)0.40 (n/a)661.50 (n/a)530.14 (n/a)561.70 (n/a)296.90 (n/a)140.75 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
4bb8427 — 2026-06-25 20:01:371.75 (-15.44%)1.32 (-0.50%)1.36 (+22.47%)0.77 (-19.20%)0.36 (-21.75%)678.10 (+23.76%)430.02 (-0.09%)385.10 (-18.34%)300.10 (+18.29%)146.96 (+19.46%)
4bb8427 — 2026-06-23 22:46:492.07 (n/a)1.32 (n/a)1.11 (n/a)0.96 (n/a)0.46 (n/a)547.90 (n/a)430.40 (n/a)471.60 (n/a)253.70 (n/a)123.02 (n/a)
Phoenix - Examples

IRON

Tested on 2026_08_21_17_10_29 at commit 92377dc.

Trends:

IRON Trends

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@andrej andrej Awaiting requested review from andrej andrej is a code owner
@jgmelber jgmelber Awaiting requested review from jgmelber jgmelber is a code owner
@hunhoffe hunhoffe Awaiting requested review from hunhoffe hunhoffe is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@asyms