Skip to content

Allow use of MemCopy in an OperatorSequence - #170

Open
astrelsky wants to merge 3 commits into
amd:develfrom
astrelsky:MemCopy
Open

Allow use of MemCopy in an OperatorSequence#170
astrelsky wants to merge 3 commits into
amd:develfrom
astrelsky:MemCopy

Conversation

@astrelsky

@astrelsky astrelsky commented Aug 30, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Describe the intent of your PR here.

Added

  • Support for using the MemCopy operator in an OperatorSequence

Changed

  • my_mem_copy now has the func_prefix parameter which defaults to an empty string.

Removed

  • Nothing.

PR Merge Checklist

  1. The PR is rebased on the latest devel commit and pointing to devel.
  2. Your PR has been reviewed and approved.
  3. All checks are passing.

@andrej
andrej enabled auto-merge August 31, 2026 15:39
@andrej

andrej commented Aug 31, 2026

Copy link
Copy Markdown
Collaborator

Thanks!

@github-actions

github-actions Bot commented Aug 31, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

CI Test Results

f748905 (2026_08_31_16_02_48)

IRON - CI Summary

Small

iron/operators/axpy
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0] - - ✅ 368.56
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0] - - ✅ 297.72
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0] - - ✅ 312.32
iron/operators/dequant
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32] - - ✅ 638.66
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32] - - ✅ 291.98
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32] - - ✅ 224.06
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32] - - ✅ 282.02
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32] - - ✅ 307.76
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32] - - ✅ 795.02
iron/operators/elementwise_add
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048] - - ✅ 296.42
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024] - - ✅ 399.50
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512] - - ✅ 377.34
iron/operators/elementwise_mul
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048] - - ✅ 374.42
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024] - - ✅ 292.68
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512] - - ✅ 873.38
iron/operators/gelu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 390.52
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 358.82
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 381.00
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 465.22
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 325.18
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 490.60
iron/operators/gemm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1] - - ✅ 624.64
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1] - - ✅ 507.26
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1] - - ✅ 82843.98
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1] - - ✅ 25012.08
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1] - - ✅ 3913.88
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4] - - ✅ 5433.70
iron/operators/gemv
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128] - - ✅ 0.09
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048] - - ✅ 3.64
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024] - - ✅ 6.78
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512] - - ✅ 10.46
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024] - - ✅ 3.80
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024] - - ✅ 6.92
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024] - - ✅ 9.98
test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2] - - ✅ 2.17
test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2] - - ✅ 0.27
test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4] - - ✅ 0.52
test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8] - - ✅ 1.18
test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128] - - ❌ -
test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048] - - ❌ -
test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024] - - ❌ -
iron/operators/layer_norm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 376.82
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 864.44
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 358.24
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 399.26
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 388.04
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 421.80
iron/operators/leaky_relu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01] - - ✅ 312.22
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1] - - ✅ 334.36
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25] - - ✅ 316.12
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01] - - ✅ 290.88
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01] - - ✅ 339.28
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01] - - ✅ 412.06
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01] - - ✅ 838.66
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01] - - ✅ 385.02
iron/operators/mem_copy
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048] - - ✅ 439.84
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024] - - ✅ 388.00
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024] - - ✅ 354.72
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512] - - ✅ 421.56
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512] - - ✅ 466.84
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256] - - ✅ 497.84
iron/operators/relu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 434.18
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 321.22
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 508.26
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 537.92
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 353.88
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 423.92
iron/operators/repeat
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal] - - ✅ -
test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count] - - ✅ -
test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word] - - ✅ -
test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None] - - ✅ 326.46
test_repeat[rows_8-cols_512-repeat_4-transfer_size_64] - - ✅ 368.92
test_repeat[rows_8-cols_64-repeat_4-transfer_size_None] - - ✅ 341.72
iron/operators/rms_norm
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False] - - ✅ 363.24
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True] - - ✅ 385.84
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False] - - ✅ 434.70
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True] - - ✅ 416.18
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False] - - ✅ 383.30
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True] - - ✅ 467.28
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False] - - ✅ 442.96
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True] - - ✅ 341.34
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False] - - ✅ 463.00
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True] - - ✅ 491.46
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False] - - ✅ 545.68
iron/operators/rope
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0] - - ✅ 344.48
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0] - - ✅ 409.70
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0] - - ✅ 548.72
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0] - - ✅ 404.04
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0] - - ✅ 467.72
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0] - - ✅ 540.68
iron/operators/sigmoid
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 358.82
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 437.54
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 386.50
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 540.58
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 435.36
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 434.92
iron/operators/silu
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 365.70
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 452.52
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 430.16
iron/operators/softmax
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024] - - ✅ 425.76
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048] - - ✅ 429.16
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 429.42
iron/operators/strided_copy
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_strided_copy[chunked_transfer] - - ✅ 278.22
test_strided_copy[contiguous] - - ✅ 321.66
test_strided_copy[four_channels] - - ✅ 395.98
test_strided_copy[kv_slot0] - - ✅ 250.56
test_strided_copy[kv_slot5] - - ✅ 287.52
test_strided_copy[kv_slot5_four_channels] - - ✅ 396.06
test_strided_copy[kv_slot5_two_channels] - - ✅ 382.06
test_strided_copy[kv_slot_last] - - ✅ 388.62
test_strided_copy[two_channels] - - ✅ 272.36
test_strided_copy[two_channels_chunked] - - ✅ 362.30
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0] - - ✅ -
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1] - - ✅ -
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2] - - ✅ -
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3] - - ✅ -
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4] - - ✅ -
iron/operators/swiglu_decode
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584] - - ✅ 14882.94
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048] - - ✅ 9223.07
iron/operators/swiglu_prefill
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False] - - ✅ 23879.11
iron/operators/tanh
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048] - - ✅ 363.80
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024] - - ✅ 520.44
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024] - - ✅ 382.72
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512] - - ✅ 403.10
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512] - - ✅ 388.66
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256] - - ✅ 820.08
iron/operators/transpose
Test Krackan Status Krackan Phoenix Status Phoenix Latency (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1] - - ✅ 793.32
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2] - - ✅ 1168.96
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1] - - ✅ 432.20
Phoenix - Small

IRON

Tested on 2026_08_31_16_02_48 at commit f748905.

iron/operators/axpy
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]✅ 5/5368.560.04n/a
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]✅ 5/5297.720.04n/a
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]✅ 5/5312.320.04n/a
iron/operators/dequant
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]✅ 5/5638.660.01n/a
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]✅ 5/5291.980.02n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]✅ 5/5224.060.02n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]✅ 5/5282.020.02n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]✅ 5/5307.760.02n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]✅ 5/5795.020.01n/a
iron/operators/elementwise_add
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]✅ 5/5296.420.04n/a
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]✅ 5/5399.500.03n/a
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]✅ 5/5377.340.03n/a
iron/operators/elementwise_mul
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]✅ 5/5374.420.04n/a
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]✅ 5/5292.680.05n/a
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]✅ 5/5873.380.03n/a
iron/operators/gelu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5390.520.03n/a
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5358.820.03n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5381.000.02n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5465.220.02n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5325.180.03n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5490.600.02n/a
iron/operators/gemm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]✅ 5/5624.640.4117.42
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]✅ 5/5507.260.4619.47
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]✅ 5/582843.980.30207.39
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]✅ 5/525012.081.01687.04
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]✅ 5/53913.882.45642.95
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]✅ 5/55433.700.2513.40
iron/operators/gemv
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]✅ 5/5n/a0.090.09
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]✅ 5/5n/a3.643.64
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]✅ 5/5n/a6.786.77
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]✅ 5/5n/a10.4610.46
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a3.803.79
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a6.926.92
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]✅ 5/5n/a9.989.97
test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]✅ 5/5n/a2.172.17
test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]✅ 5/5n/a0.270.27
test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]✅ 5/5n/a0.520.51
test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]✅ 5/5n/a1.181.16
test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]❌ 0/5n/an/an/a
test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]❌ 0/5n/an/an/a
test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]❌ 0/5n/an/an/a
iron/operators/layer_norm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5376.820.02n/a
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5864.440.01n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5358.240.02n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5399.260.02n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5388.040.02n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5421.800.02n/a
iron/operators/leaky_relu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]✅ 5/5312.220.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]✅ 5/5334.360.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]✅ 5/5316.120.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]✅ 5/5290.880.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]✅ 5/5339.280.03n/a
test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]✅ 5/5412.060.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]✅ 5/5838.660.02n/a
test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]✅ 5/5385.020.02n/a
iron/operators/mem_copy
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]✅ 5/5439.840.02n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]✅ 5/5388.000.02n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]✅ 5/5354.720.03n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]✅ 5/5421.560.02n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]✅ 5/5466.840.02n/a
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]✅ 5/5497.840.02n/a
iron/operators/relu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5434.180.02n/a
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5321.220.03n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5508.260.02n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5537.920.02n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5353.880.02n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5423.920.02n/a
iron/operators/repeat
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal]✅ 5/5n/an/an/a
test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count]✅ 5/5n/an/an/a
test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word]✅ 5/5n/an/an/a
test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None]✅ 5/5326.460.08n/a
test_repeat[rows_8-cols_512-repeat_4-transfer_size_64]✅ 5/5368.920.13n/a
test_repeat[rows_8-cols_64-repeat_4-transfer_size_None]✅ 5/5341.720.02n/a
iron/operators/rms_norm
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]✅ 5/5363.240.03n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]✅ 5/5385.840.03n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]✅ 5/5434.700.02n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]✅ 5/5416.180.03n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]✅ 5/5383.300.02n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]✅ 5/5467.280.02n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]✅ 5/5442.960.02n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]✅ 5/5341.340.03n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]✅ 5/5463.000.02n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]✅ 5/5491.460.02n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]✅ 5/5545.680.02n/a
iron/operators/rope
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]✅ 5/5344.480.30n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]✅ 5/5409.700.25n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]✅ 5/5548.720.20n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]✅ 5/5404.040.20n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]✅ 5/5467.720.17n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]✅ 5/5540.680.14n/a
iron/operators/sigmoid
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5358.820.02n/a
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5437.540.02n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5386.500.02n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5540.580.02n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5435.360.02n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5434.920.02n/a
iron/operators/silu
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5365.700.03n/a
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5452.520.02n/a
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5430.160.02n/a
iron/operators/softmax
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]✅ 5/5425.760.33n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]✅ 5/5429.160.34n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5429.420.34n/a
iron/operators/strided_copy
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_strided_copy[chunked_transfer]✅ 5/5278.220.02n/a
test_strided_copy[contiguous]✅ 5/5321.660.01n/a
test_strided_copy[four_channels]✅ 5/5395.980.01n/a
test_strided_copy[kv_slot0]✅ 5/5250.560.53n/a
test_strided_copy[kv_slot5]✅ 5/5287.520.49n/a
test_strided_copy[kv_slot5_four_channels]✅ 5/5396.060.37n/a
test_strided_copy[kv_slot5_two_channels]✅ 5/5382.060.37n/a
test_strided_copy[kv_slot_last]✅ 5/5388.620.39n/a
test_strided_copy[two_channels]✅ 5/5272.360.02n/a
test_strided_copy[two_channels_chunked]✅ 5/5362.300.01n/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0]✅ 1/1n/an/an/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1]✅ 1/1n/an/an/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2]✅ 1/1n/an/an/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3]✅ 1/1n/an/an/a
test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4]✅ 1/1n/an/an/a
iron/operators/swiglu_decode
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]✅ 5/514882.940.00n/a
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]✅ 5/59223.070.00n/a
iron/operators/swiglu_prefill
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]✅ 5/523879.110.09n/a
iron/operators/tanh
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]✅ 5/5363.800.02n/a
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]✅ 5/5520.440.02n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]✅ 5/5382.720.02n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]✅ 5/5403.100.02n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]✅ 5/5388.660.02n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]✅ 5/5820.080.01n/a
iron/operators/transpose
TestChecksLatency (mean)Bandwidth (mean)Throughput (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]✅ 5/5793.320.97n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]✅ 5/51168.961.55n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]✅ 5/5432.201.34n/a

Trends:

IRON Trends

iron/operators/axpy

test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.05 (-2.02%)0.04 (+9.15%)0.03 (+31.06%)0.02 (+14.31%)0.01 (-16.32%)537.80 (-12.52%)368.56 (-15.00%)414.70 (-23.70%)229.70 (+2.04%)135.19 (-28.38%)
d9e4ec5 — 2026-08-29 05:11:110.05 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)614.80 (n/a)433.62 (n/a)543.50 (n/a)225.10 (n/a)188.75 (n/a)

test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.06 (+41.00%)0.04 (+59.41%)0.04 (+80.99%)0.03 (+30.24%)0.01 (+36.66%)438.90 (-23.23%)297.72 (-37.05%)288.90 (-44.76%)206.60 (-29.08%)87.15 (-20.53%)
d9e4ec5 — 2026-08-29 05:11:110.04 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)571.70 (n/a)472.94 (n/a)523.00 (n/a)291.30 (n/a)109.67 (n/a)

test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.06 (+82.82%)0.04 (+90.25%)0.05 (+123.97%)0.02 (+20.00%)0.01 (+131.93%)552.20 (-16.67%)312.32 (-43.50%)265.00 (-55.36%)196.40 (-45.31%)139.15 (+17.89%)
d9e4ec5 — 2026-08-29 05:11:110.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)662.70 (n/a)552.74 (n/a)593.60 (n/a)359.10 (n/a)118.03 (n/a)
iron/operators/dequant

test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.02 (-30.42%)0.01 (-18.02%)0.02 (-16.52%)0.00 (-61.71%)0.01 (-16.49%)1999.10 (+161.18%)638.66 (+70.70%)296.60 (+19.79%)272.20 (+43.72%)760.86 (+223.22%)
d9e4ec5 — 2026-08-29 05:11:110.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)765.40 (n/a)374.14 (n/a)247.60 (n/a)189.40 (n/a)235.40 (n/a)

test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (+80.43%)0.02 (+75.59%)0.02 (+82.08%)0.01 (+9.75%)0.01 (+173.48%)600.60 (-8.88%)291.98 (-35.45%)217.20 (-45.08%)198.80 (-44.56%)172.98 (+42.11%)
d9e4ec5 — 2026-08-29 05:11:110.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)659.10 (n/a)452.30 (n/a)395.50 (n/a)358.60 (n/a)121.72 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (+56.63%)0.02 (+42.99%)0.02 (+18.59%)0.02 (+82.85%)0.01 (+34.75%)264.40 (-45.32%)224.06 (-31.69%)239.60 (-15.66%)153.10 (-36.16%)43.16 (-55.53%)
d9e4ec5 — 2026-08-29 05:11:110.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)483.50 (n/a)328.00 (n/a)284.10 (n/a)239.80 (n/a)97.05 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.02 (+1.05%)0.02 (+21.55%)0.02 (+19.43%)0.02 (+89.54%)0.00 (-54.15%)318.40 (-47.24%)282.02 (-25.19%)292.10 (-16.26%)243.40 (-1.06%)35.38 (-75.77%)
d9e4ec5 — 2026-08-29 05:11:110.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)603.50 (n/a)376.98 (n/a)348.80 (n/a)246.00 (n/a)146.04 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (+21.95%)0.02 (+14.69%)0.02 (-0.47%)0.01 (+18.29%)0.01 (+0.92%)490.00 (-15.46%)307.76 (-15.78%)290.90 (+0.48%)195.10 (-17.99%)112.12 (-26.80%)
d9e4ec5 — 2026-08-29 05:11:110.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)579.60 (n/a)365.44 (n/a)289.50 (n/a)237.90 (n/a)153.18 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.02 (+10.94%)0.01 (-0.89%)0.01 (+10.09%)0.00 (-71.50%)0.01 (+89.56%)2421.80 (+250.88%)795.02 (+65.90%)377.40 (-9.17%)321.20 (-9.85%)911.83 (+552.67%)
d9e4ec5 — 2026-08-29 05:11:110.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)690.20 (n/a)479.22 (n/a)415.50 (n/a)356.30 (n/a)139.71 (n/a)
iron/operators/elementwise_add

test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.06 (n/a)0.04 (n/a)0.04 (n/a)0.03 (n/a)0.01 (n/a)450.10 (n/a)296.42 (n/a)285.10 (n/a)205.60 (n/a)92.21 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.05 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)531.20 (n/a)399.50 (n/a)459.40 (n/a)260.50 (n/a)129.33 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.05 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)525.80 (n/a)377.34 (n/a)377.50 (n/a)248.50 (n/a)110.89 (n/a)
iron/operators/elementwise_mul

test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.06 (n/a)0.04 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)535.50 (n/a)374.42 (n/a)409.60 (n/a)194.50 (n/a)139.77 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.07 (n/a)0.05 (n/a)0.05 (n/a)0.03 (n/a)0.01 (n/a)479.90 (n/a)292.68 (n/a)270.60 (n/a)187.60 (n/a)110.44 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.05 (n/a)0.03 (n/a)0.02 (n/a)0.00 (n/a)0.02 (n/a)2536.80 (n/a)873.38 (n/a)540.50 (n/a)232.60 (n/a)942.26 (n/a)
iron/operators/gelu

test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.04 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)610.00 (n/a)390.52 (n/a)286.60 (n/a)223.70 (n/a)187.68 (n/a)

test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.04 (n/a)0.03 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)600.50 (n/a)358.82 (n/a)244.20 (n/a)204.10 (n/a)179.99 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)460.10 (n/a)381.00 (n/a)385.90 (n/a)244.00 (n/a)88.90 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)554.20 (n/a)465.22 (n/a)451.90 (n/a)380.70 (n/a)66.83 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)441.70 (n/a)325.18 (n/a)281.30 (n/a)219.00 (n/a)96.96 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)640.40 (n/a)490.60 (n/a)594.90 (n/a)242.60 (n/a)176.24 (n/a)
iron/operators/gemm

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:060.64 (-0.71%)0.41 (-19.37%)0.38 (-26.11%)0.20 (-41.91%)0.16 (+47.54%)1100.70 (+72.15%)624.64 (+37.15%)580.00 (+35.32%)344.30 (+0.73%)285.95 (+156.61%)27.41 (-0.71%)17.42 (-19.37%)16.27 (-26.11%)8.57 (-41.91%)6.85 (+47.54%)
d9e4ec5 — 2026-08-29 05:11:110.65 (n/a)0.51 (n/a)0.52 (n/a)0.35 (n/a)0.11 (n/a)639.40 (n/a)455.44 (n/a)428.60 (n/a)341.80 (n/a)111.43 (n/a)27.61 (n/a)21.61 (n/a)22.02 (n/a)14.76 (n/a)4.65 (n/a)

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:060.59 (+17.18%)0.46 (+18.70%)0.40 (+6.82%)0.35 (+71.35%)0.11 (-8.26%)628.80 (-41.64%)507.26 (-20.57%)555.10 (-6.39%)377.00 (-14.65%)116.11 (-55.31%)25.03 (+17.18%)19.47 (+18.70%)17.00 (+6.82%)15.01 (+71.35%)4.76 (-8.26%)
d9e4ec5 — 2026-08-29 05:11:110.50 (n/a)0.38 (n/a)0.37 (n/a)0.21 (n/a)0.12 (n/a)1077.40 (n/a)638.66 (n/a)593.00 (n/a)441.70 (n/a)259.83 (n/a)21.36 (n/a)16.41 (n/a)15.92 (n/a)8.76 (n/a)5.19 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:060.31 (-1.84%)0.30 (-1.06%)0.30 (-1.51%)0.30 (-0.17%)0.00 (-46.90%)83926.30 (+0.17%)82843.98 (+1.05%)82860.70 (+1.53%)81809.20 (+1.87%)771.63 (-45.87%)210.00 (-1.84%)207.39 (-1.06%)207.33 (-1.51%)204.70 (-0.17%)1.93 (-46.90%)
d9e4ec5 — 2026-08-29 05:11:110.31 (n/a)0.31 (n/a)0.31 (n/a)0.30 (n/a)0.01 (n/a)83783.80 (n/a)81983.54 (n/a)81611.20 (n/a)80305.80 (n/a)1425.64 (n/a)213.93 (n/a)209.60 (n/a)210.51 (n/a)205.05 (n/a)3.64 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:061.03 (-0.55%)1.01 (-0.65%)1.00 (-0.83%)0.98 (-1.85%)0.02 (+48.77%)25629.10 (+1.88%)25012.08 (+0.67%)25066.20 (+0.83%)24504.60 (+0.55%)453.45 (+52.44%)701.09 (-0.55%)687.04 (-0.65%)685.38 (-0.83%)670.33 (-1.85%)12.42 (+48.77%)
d9e4ec5 — 2026-08-29 05:11:111.03 (n/a)1.01 (n/a)1.01 (n/a)1.00 (n/a)0.01 (n/a)25155.80 (n/a)24846.00 (n/a)24858.90 (n/a)24369.90 (n/a)297.47 (n/a)704.96 (n/a)691.53 (n/a)691.09 (n/a)682.94 (n/a)8.35 (n/a)

test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:063.74 (-1.06%)2.45 (+13.51%)1.80 (-2.84%)1.33 (-12.45%)1.16 (+25.56%)6063.50 (+14.22%)3913.88 (-5.34%)4478.60 (+2.93%)2155.70 (+1.08%)1698.79 (+40.88%)980.64 (-1.06%)642.95 (+13.51%)472.01 (-2.84%)348.63 (-12.45%)303.02 (+25.56%)
d9e4ec5 — 2026-08-29 05:11:113.78 (n/a)2.16 (n/a)1.85 (n/a)1.52 (n/a)0.92 (n/a)5308.70 (n/a)4134.84 (n/a)4351.30 (n/a)2132.70 (n/a)1205.81 (n/a)991.18 (n/a)566.40 (n/a)485.82 (n/a)398.20 (n/a)241.34 (n/a)

test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:060.32 (+18.10%)0.25 (+16.50%)0.28 (+31.03%)0.14 (-15.55%)0.07 (+70.32%)8629.70 (+18.42%)5433.70 (-9.47%)4525.70 (-23.68%)3836.70 (-15.33%)1927.86 (+74.80%)17.49 (+18.10%)13.40 (+16.50%)14.83 (+31.03%)7.78 (-15.55%)3.80 (+70.32%)
d9e4ec5 — 2026-08-29 05:11:110.27 (n/a)0.21 (n/a)0.21 (n/a)0.17 (n/a)0.04 (n/a)7287.50 (n/a)6002.22 (n/a)5930.00 (n/a)4531.10 (n/a)1102.87 (n/a)14.81 (n/a)11.51 (n/a)11.32 (n/a)9.21 (n/a)2.23 (n/a)
iron/operators/gemv

test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:060.16 (n/a)0.09 (n/a)0.07 (n/a)0.06 (n/a)0.04 (n/a)0.16 (n/a)0.09 (n/a)0.07 (n/a)0.06 (n/a)0.04 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:063.71 (n/a)3.64 (n/a)3.68 (n/a)3.48 (n/a)0.09 (n/a)3.70 (n/a)3.64 (n/a)3.68 (n/a)3.48 (n/a)0.09 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:067.55 (+5.26%)6.78 (+8.67%)6.95 (+17.62%)5.36 (-2.21%)0.89 (+23.06%)7.54 (+5.26%)6.77 (+8.67%)6.95 (+17.62%)5.35 (-2.21%)0.89 (+23.06%)
d9e4ec5 — 2026-08-29 05:11:117.17 (n/a)6.24 (n/a)5.91 (n/a)5.48 (n/a)0.72 (n/a)7.17 (n/a)6.23 (n/a)5.91 (n/a)5.47 (n/a)0.72 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:0613.77 (+39.43%)10.46 (+30.12%)9.97 (+23.94%)7.86 (+15.30%)2.46 (+112.32%)13.76 (+39.43%)10.46 (+30.12%)9.96 (+23.94%)7.85 (+15.30%)2.46 (+112.32%)
d9e4ec5 — 2026-08-29 05:11:119.88 (n/a)8.04 (n/a)8.04 (n/a)6.81 (n/a)1.16 (n/a)9.87 (n/a)8.04 (n/a)8.04 (n/a)6.81 (n/a)1.16 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:063.94 (n/a)3.80 (n/a)3.84 (n/a)3.66 (n/a)0.13 (n/a)3.94 (n/a)3.79 (n/a)3.84 (n/a)3.66 (n/a)0.13 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:067.75 (+2.19%)6.92 (+13.90%)7.54 (+29.77%)5.72 (+18.94%)0.96 (-20.85%)7.75 (+2.19%)6.92 (+13.90%)7.53 (+29.77%)5.71 (+18.94%)0.96 (-20.85%)
d9e4ec5 — 2026-08-29 05:11:117.58 (n/a)6.07 (n/a)5.81 (n/a)4.80 (n/a)1.21 (n/a)7.58 (n/a)6.07 (n/a)5.81 (n/a)4.80 (n/a)1.21 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:0613.89 (+3.75%)9.98 (+0.37%)8.38 (-13.41%)6.89 (-17.28%)3.36 (+63.05%)13.89 (+3.75%)9.97 (+0.37%)8.37 (-13.41%)6.88 (-17.28%)3.36 (+63.05%)
d9e4ec5 — 2026-08-29 05:11:1113.39 (n/a)9.94 (n/a)9.67 (n/a)8.33 (n/a)2.06 (n/a)13.38 (n/a)9.94 (n/a)9.67 (n/a)8.32 (n/a)2.06 (n/a)

test_gemv_batched[M_1024-K_1024-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:063.20 (+12.40%)2.17 (+3.72%)2.59 (+16.59%)1.01 (+0.42%)1.04 (+35.39%)3.19 (+12.40%)2.17 (+3.72%)2.59 (+16.59%)1.01 (+0.42%)1.04 (+35.39%)
d9e4ec5 — 2026-08-29 05:11:112.84 (n/a)2.10 (n/a)2.22 (n/a)1.01 (n/a)0.77 (n/a)2.84 (n/a)2.09 (n/a)2.22 (n/a)1.01 (n/a)0.77 (n/a)

test_gemv_batched[M_1026-K_64-num_aie_columns_1-tile_size_input_1-tile_size_output_2-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:060.41 (-13.07%)0.27 (-32.26%)0.26 (-36.25%)0.08 (-76.62%)0.13 (+133.59%)0.41 (-13.07%)0.27 (-32.26%)0.26 (-36.25%)0.07 (-76.62%)0.13 (+133.59%)
d9e4ec5 — 2026-08-29 05:11:110.47 (n/a)0.40 (n/a)0.41 (n/a)0.32 (n/a)0.06 (n/a)0.47 (n/a)0.40 (n/a)0.40 (n/a)0.32 (n/a)0.06 (n/a)

test_gemv_batched[M_256-K_128-num_aie_columns_1-tile_size_input_1-tile_size_output_256-num_batches_4]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:060.77 (-1.51%)0.52 (-8.80%)0.37 (-40.55%)0.35 (-6.80%)0.22 (+34.46%)0.76 (-1.51%)0.51 (-8.80%)0.36 (-40.55%)0.35 (-6.80%)0.22 (+34.46%)
d9e4ec5 — 2026-08-29 05:11:110.78 (n/a)0.57 (n/a)0.61 (n/a)0.38 (n/a)0.16 (n/a)0.77 (n/a)0.56 (n/a)0.61 (n/a)0.37 (n/a)0.16 (n/a)

test_gemv_batched[M_64-K_1536-num_aie_columns_1-tile_size_input_1-tile_size_output_64-num_batches_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Throughput (max)Throughput (mean)Throughput (median)Throughput (min)Throughput (stddev)
f748905 — 2026-08-31 15:58:062.58 (+28.61%)1.18 (-8.44%)0.64 (-57.95%)0.44 (-0.21%)0.96 (+21.14%)2.54 (+28.61%)1.16 (-8.44%)0.63 (-57.95%)0.43 (-0.21%)0.94 (+21.14%)
d9e4ec5 — 2026-08-29 05:11:112.01 (n/a)1.29 (n/a)1.52 (n/a)0.44 (n/a)0.79 (n/a)1.97 (n/a)1.26 (n/a)1.50 (n/a)0.44 (n/a)0.78 (n/a)

test_gemv_gelu[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

No metrics available.

test_gemv_gelu[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

No metrics available.

test_gemv_gelu[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

No metrics available.

iron/operators/layer_norm

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (n/a)0.02 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)512.40 (n/a)376.82 (n/a)300.70 (n/a)273.20 (n/a)117.82 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.02 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)0.00 (n/a)2016.40 (n/a)864.44 (n/a)623.70 (n/a)496.50 (n/a)648.23 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (n/a)0.02 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)497.40 (n/a)358.24 (n/a)317.30 (n/a)257.50 (n/a)111.82 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)510.90 (n/a)399.26 (n/a)460.40 (n/a)235.90 (n/a)123.88 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (n/a)0.02 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)617.20 (n/a)388.04 (n/a)302.60 (n/a)248.70 (n/a)153.87 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)549.20 (n/a)421.80 (n/a)449.40 (n/a)204.70 (n/a)136.70 (n/a)
iron/operators/leaky_relu

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (+6.47%)0.03 (+23.27%)0.03 (+23.92%)0.02 (+17.86%)0.01 (-17.08%)446.30 (-15.17%)312.22 (-21.30%)287.80 (-19.32%)265.50 (-6.08%)76.00 (-34.70%)
d9e4ec5 — 2026-08-29 05:11:110.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)526.10 (n/a)396.72 (n/a)356.70 (n/a)282.70 (n/a)116.38 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (-1.17%)0.03 (+5.83%)0.03 (+12.96%)0.02 (+36.35%)0.00 (-36.72%)394.10 (-26.65%)334.36 (-9.62%)309.10 (-11.48%)272.00 (+1.19%)55.54 (-49.95%)
d9e4ec5 — 2026-08-29 05:11:110.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)537.30 (n/a)369.94 (n/a)349.20 (n/a)268.80 (n/a)110.96 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-alpha_0.25]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (+21.88%)0.03 (+9.01%)0.03 (-1.86%)0.02 (+16.54%)0.01 (+9.74%)393.80 (-14.20%)316.12 (-8.66%)297.50 (+1.88%)236.80 (-17.95%)64.32 (-18.69%)
d9e4ec5 — 2026-08-29 05:11:110.03 (n/a)0.02 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)459.00 (n/a)346.08 (n/a)292.00 (n/a)288.60 (n/a)79.11 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.04 (+31.74%)0.03 (+24.86%)0.03 (+19.58%)0.02 (+19.36%)0.01 (+22.20%)436.90 (-16.21%)290.88 (-20.14%)287.80 (-16.39%)191.20 (-24.07%)94.35 (-19.58%)
d9e4ec5 — 2026-08-29 05:11:110.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)521.40 (n/a)364.24 (n/a)344.20 (n/a)251.80 (n/a)117.31 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.04 (+13.94%)0.03 (+18.36%)0.03 (+72.50%)0.01 (+7.44%)0.01 (+8.95%)553.20 (-6.92%)339.28 (-15.07%)259.20 (-42.04%)202.50 (-12.22%)147.84 (-3.78%)
d9e4ec5 — 2026-08-29 05:11:110.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)594.30 (n/a)399.50 (n/a)447.20 (n/a)230.70 (n/a)153.65 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (-5.90%)0.02 (-3.64%)0.02 (-1.89%)0.01 (+4.39%)0.01 (-13.27%)574.20 (-4.19%)412.06 (+0.79%)451.30 (+1.92%)251.10 (+6.26%)146.01 (-9.89%)
d9e4ec5 — 2026-08-29 05:11:110.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)599.30 (n/a)408.82 (n/a)442.80 (n/a)236.30 (n/a)162.04 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (-31.14%)0.02 (-15.25%)0.02 (-7.29%)0.00 (-76.86%)0.01 (-6.24%)2441.00 (+332.11%)838.66 (+79.39%)544.20 (+7.87%)310.40 (+45.25%)904.65 (+525.28%)
d9e4ec5 — 2026-08-29 05:11:110.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)564.90 (n/a)467.50 (n/a)504.50 (n/a)213.70 (n/a)144.68 (n/a)

test_leaky_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-alpha_0.01]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (+61.11%)0.02 (+45.46%)0.02 (+35.71%)0.01 (+6.28%)0.01 (+179.64%)566.40 (-5.91%)385.02 (-24.86%)388.10 (-26.31%)237.10 (-37.93%)143.16 (+54.47%)
d9e4ec5 — 2026-08-29 05:11:110.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.00 (n/a)602.00 (n/a)512.42 (n/a)526.70 (n/a)382.00 (n/a)92.68 (n/a)
iron/operators/mem_copy

test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (-24.55%)0.02 (-31.88%)0.02 (-25.29%)0.01 (-52.85%)0.01 (+80.07%)632.70 (+112.10%)439.84 (+62.72%)361.30 (+33.86%)288.40 (+32.54%)170.87 (+426.25%)
d9e4ec5 — 2026-08-29 05:11:110.04 (n/a)0.03 (n/a)0.03 (n/a)0.03 (n/a)0.00 (n/a)298.30 (n/a)270.30 (n/a)269.90 (n/a)217.60 (n/a)32.47 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (-23.57%)0.02 (-2.01%)0.02 (+8.27%)0.02 (+54.32%)0.00 (-55.82%)476.20 (-35.20%)388.00 (-10.60%)391.30 (-7.65%)292.20 (+30.80%)74.41 (-62.21%)
d9e4ec5 — 2026-08-29 05:11:110.04 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)734.90 (n/a)434.00 (n/a)423.70 (n/a)223.40 (n/a)196.88 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (-2.18%)0.03 (+12.63%)0.03 (+52.60%)0.01 (-28.56%)0.01 (+15.27%)638.30 (+39.98%)354.72 (-6.64%)287.50 (-34.48%)266.50 (+2.22%)159.40 (+66.79%)
d9e4ec5 — 2026-08-29 05:11:110.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)456.00 (n/a)379.96 (n/a)438.80 (n/a)260.70 (n/a)95.57 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (-6.70%)0.02 (+29.37%)0.02 (+17.83%)0.01 (+78.71%)0.01 (-18.43%)556.90 (-44.04%)421.56 (-30.86%)506.10 (-15.13%)245.20 (+7.17%)147.55 (-45.99%)
d9e4ec5 — 2026-08-29 05:11:110.04 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)995.20 (n/a)609.72 (n/a)596.30 (n/a)228.80 (n/a)273.19 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (+18.71%)0.02 (+23.79%)0.02 (+9.51%)0.01 (+209.34%)0.01 (-3.34%)592.90 (-67.67%)466.84 (-37.68%)496.60 (-8.70%)239.70 (-15.75%)137.32 (-77.74%)
d9e4ec5 — 2026-08-29 05:11:110.03 (n/a)0.02 (n/a)0.02 (n/a)0.00 (n/a)0.01 (n/a)1833.90 (n/a)749.06 (n/a)543.90 (n/a)284.50 (n/a)617.00 (n/a)

test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (+44.84%)0.02 (+23.30%)0.02 (+6.33%)0.01 (+54.05%)0.01 (+52.12%)811.10 (-35.09%)497.84 (-18.93%)503.10 (-5.95%)248.80 (-30.97%)235.13 (-35.75%)
d9e4ec5 — 2026-08-29 05:11:110.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)1249.50 (n/a)614.10 (n/a)534.90 (n/a)360.40 (n/a)365.95 (n/a)
iron/operators/repeat

test_cols_without_a_legal_split_is_rejected[cols_1031-why_prime > 1023: the only divisors are 1 and cols, neither legal]

No metrics available.

test_cols_without_a_legal_split_is_rejected[cols_2062-why_2 x 1031: the only word-aligned chunk leaves a 1031-wide chunk count]

No metrics available.

test_cols_without_a_legal_split_is_rejected[cols_513-why_odd: every divisor is odd, so no chunk is a whole 32-bit word]

No metrics available.

test_repeat[rows_4-cols_1024-repeat_2-transfer_size_None]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.10 (+8.48%)0.08 (+13.40%)0.09 (+7.90%)0.04 (-3.72%)0.02 (+3.16%)554.80 (+3.88%)326.46 (-11.14%)274.70 (-7.32%)252.90 (-7.84%)128.07 (+6.78%)
d9e4ec5 — 2026-08-29 05:11:110.09 (n/a)0.07 (n/a)0.08 (n/a)0.05 (n/a)0.02 (n/a)534.10 (n/a)367.38 (n/a)296.40 (n/a)274.40 (n/a)119.94 (n/a)

test_repeat[rows_8-cols_512-repeat_4-transfer_size_64]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.17 (-5.61%)0.13 (-4.20%)0.15 (-7.24%)0.07 (-4.48%)0.04 (-15.82%)596.80 (+4.68%)368.92 (+0.43%)277.70 (+7.80%)238.00 (+5.92%)155.59 (-9.77%)
d9e4ec5 — 2026-08-29 05:11:110.18 (n/a)0.13 (n/a)0.16 (n/a)0.07 (n/a)0.05 (n/a)570.10 (n/a)367.34 (n/a)257.60 (n/a)224.70 (n/a)172.43 (n/a)

test_repeat[rows_8-cols_64-repeat_4-transfer_size_None]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.02 (+17.51%)0.02 (+23.51%)0.02 (+45.67%)0.01 (+1.43%)0.01 (+32.98%)565.80 (-1.41%)341.72 (-16.29%)269.80 (-31.35%)232.20 (-14.88%)135.87 (+14.13%)
d9e4ec5 — 2026-08-29 05:11:110.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)573.90 (n/a)408.20 (n/a)393.00 (n/a)272.80 (n/a)119.05 (n/a)
iron/operators/rms_norm

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (+2.92%)0.03 (+8.41%)0.03 (+5.85%)0.01 (-6.06%)0.01 (+7.00%)661.00 (+6.46%)363.24 (-6.23%)273.10 (-5.53%)243.20 (-2.84%)177.84 (+8.15%)
d9e4ec5 — 2026-08-29 05:11:110.03 (n/a)0.02 (n/a)0.03 (n/a)0.01 (n/a)0.01 (n/a)620.90 (n/a)387.38 (n/a)289.10 (n/a)250.30 (n/a)164.44 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.05 (-17.82%)0.03 (-6.47%)0.03 (-1.48%)0.02 (+13.55%)0.01 (-35.53%)514.20 (-11.92%)385.84 (-0.83%)382.10 (+1.49%)272.40 (+21.66%)109.18 (-30.98%)
d9e4ec5 — 2026-08-29 05:11:110.05 (n/a)0.04 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)583.80 (n/a)389.08 (n/a)376.50 (n/a)223.90 (n/a)158.18 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.04 (+17.02%)0.02 (+4.15%)0.02 (-2.23%)0.01 (-9.01%)0.01 (+31.38%)603.00 (+9.90%)434.70 (+0.03%)493.90 (+2.30%)218.80 (-14.53%)150.80 (+16.26%)
d9e4ec5 — 2026-08-29 05:11:110.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)548.70 (n/a)434.58 (n/a)482.80 (n/a)256.00 (n/a)129.70 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.04 (+8.43%)0.03 (-4.41%)0.02 (+1.20%)0.02 (-2.29%)0.01 (+9.03%)525.00 (+2.34%)416.18 (+4.93%)440.40 (-1.19%)231.40 (-7.77%)110.56 (-3.95%)
d9e4ec5 — 2026-08-29 05:11:110.04 (n/a)0.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)513.00 (n/a)396.62 (n/a)445.70 (n/a)250.90 (n/a)115.10 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.04 (+12.20%)0.02 (-16.10%)0.02 (-32.20%)0.02 (-5.07%)0.01 (+40.81%)502.00 (+5.33%)383.30 (+24.57%)415.40 (+47.51%)206.90 (-10.90%)122.32 (+25.72%)
d9e4ec5 — 2026-08-29 05:11:110.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)476.60 (n/a)307.70 (n/a)281.60 (n/a)232.20 (n/a)97.30 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.04 (-36.91%)0.02 (-14.70%)0.02 (-2.26%)0.02 (+190.37%)0.01 (-61.91%)646.50 (-65.56%)467.28 (-32.15%)453.70 (+2.32%)281.00 (+58.49%)131.89 (-80.88%)
d9e4ec5 — 2026-08-29 05:11:110.06 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)0.02 (n/a)1877.40 (n/a)688.66 (n/a)443.40 (n/a)177.30 (n/a)689.65 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (-18.27%)0.02 (-12.71%)0.02 (-6.53%)0.02 (+24.92%)0.00 (-45.01%)502.60 (-19.94%)442.96 (+5.80%)490.20 (+6.98%)299.20 (+22.32%)85.18 (-44.82%)
d9e4ec5 — 2026-08-29 05:11:110.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)627.80 (n/a)418.66 (n/a)458.20 (n/a)244.60 (n/a)154.35 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.05 (+18.78%)0.03 (+14.36%)0.03 (+13.44%)0.02 (+10.11%)0.01 (+21.15%)512.20 (-9.18%)341.34 (-11.54%)277.30 (-11.86%)195.30 (-15.78%)137.41 (-8.10%)
d9e4ec5 — 2026-08-29 05:11:110.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)564.00 (n/a)385.86 (n/a)314.60 (n/a)231.90 (n/a)149.52 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (-12.62%)0.02 (-13.19%)0.02 (+12.94%)0.01 (-26.40%)0.01 (-6.05%)739.70 (+35.85%)463.00 (+19.44%)372.50 (-11.46%)271.10 (+14.44%)190.93 (+53.47%)
d9e4ec5 — 2026-08-29 05:11:110.03 (n/a)0.02 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)544.50 (n/a)387.64 (n/a)420.70 (n/a)236.90 (n/a)124.41 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (-15.75%)0.02 (-24.62%)0.02 (-40.09%)0.01 (-7.12%)0.01 (-26.68%)617.70 (+7.67%)491.46 (+26.65%)513.70 (+66.95%)279.30 (+18.70%)126.64 (-17.63%)
d9e4ec5 — 2026-08-29 05:11:110.04 (n/a)0.03 (n/a)0.03 (n/a)0.02 (n/a)0.01 (n/a)573.70 (n/a)388.06 (n/a)307.70 (n/a)235.30 (n/a)153.76 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.03 (+3.81%)0.02 (-15.36%)0.01 (-28.51%)0.01 (-12.54%)0.01 (+17.38%)772.60 (+14.32%)545.68 (+24.14%)602.30 (+39.87%)237.00 (-3.66%)205.37 (+23.24%)
d9e4ec5 — 2026-08-29 05:11:110.03 (n/a)0.02 (n/a)0.02 (n/a)0.01 (n/a)0.01 (n/a)675.80 (n/a)439.58 (n/a)430.60 (n/a)246.00 (n/a)166.65 (n/a)
iron/operators/rope

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.40 (+7.66%)0.30 (+24.96%)0.32 (+77.44%)0.22 (+43.37%)0.07 (-29.84%)443.30 (-30.24%)344.48 (-27.15%)311.70 (-43.64%)247.90 (-7.12%)86.57 (-52.31%)
d9e4ec5 — 2026-08-29 05:11:110.37 (n/a)0.24 (n/a)0.18 (n/a)0.15 (n/a)0.11 (n/a)635.50 (n/a)472.88 (n/a)553.10 (n/a)266.90 (n/a)181.52 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.33 (-12.66%)0.25 (-19.15%)0.22 (-32.38%)0.19 (-16.61%)0.07 (+4.70%)524.80 (+19.93%)409.70 (+25.74%)449.60 (+47.89%)294.20 (+14.52%)101.08 (+38.76%)
d9e4ec5 — 2026-08-29 05:11:110.38 (n/a)0.31 (n/a)0.32 (n/a)0.22 (n/a)0.06 (n/a)437.60 (n/a)325.82 (n/a)304.00 (n/a)256.90 (n/a)72.84 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.32 (-19.81%)0.20 (-37.98%)0.18 (-52.05%)0.12 (-43.09%)0.08 (-19.94%)832.80 (+75.73%)548.72 (+65.53%)533.30 (+108.56%)304.50 (+24.69%)197.19 (+75.16%)
d9e4ec5 — 2026-08-29 05:11:110.40 (n/a)0.32 (n/a)0.38 (n/a)0.21 (n/a)0.10 (n/a)473.90 (n/a)331.50 (n/a)255.70 (n/a)244.20 (n/a)112.58 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.32 (-11.42%)0.20 (-17.00%)0.18 (-29.53%)0.12 (-20.16%)0.08 (-11.20%)595.00 (+25.24%)404.04 (+20.72%)404.30 (+41.91%)231.40 (+12.88%)146.08 (+16.58%)
d9e4ec5 — 2026-08-29 05:11:110.36 (n/a)0.25 (n/a)0.26 (n/a)0.16 (n/a)0.09 (n/a)475.10 (n/a)334.68 (n/a)284.90 (n/a)205.00 (n/a)125.30 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.25 (-14.02%)0.17 (-22.58%)0.15 (-36.73%)0.13 (-6.23%)0.05 (-32.29%)581.40 (+6.64%)467.72 (+23.10%)505.20 (+58.02%)292.70 (+16.34%)111.44 (-20.89%)
d9e4ec5 — 2026-08-29 05:11:110.29 (n/a)0.22 (n/a)0.23 (n/a)0.14 (n/a)0.07 (n/a)545.20 (n/a)379.96 (n/a)319.70 (n/a)251.60 (n/a)140.86 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.15 (-52.27%)0.14 (-42.66%)0.14 (-49.08%)0.12 (-26.99%)0.01 (-84.42%)604.30 (+36.97%)540.68 (+65.09%)534.00 (+96.40%)507.40 (+109.50%)39.74 (-56.54%)
d9e4ec5 — 2026-08-29 05:11:110.30 (n/a)0.24 (n/a)0.27 (n/a)0.17 (n/a)0.06 (n/a)441.20 (n/a)327.50 (n/a)271.90 (n/a)242.20 (n/a)91.43 (n/a)
iron/operators/softmax

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.49 (+2.53%)0.33 (-10.44%)0.27 (-28.57%)0.24 (+22.93%)0.11 (+2.20%)550.70 (-18.66%)425.76 (+9.32%)481.80 (+40.02%)266.60 (-2.45%)123.35 (-24.53%)
d9e4ec5 — 2026-08-29 05:11:110.48 (n/a)0.37 (n/a)0.38 (n/a)0.19 (n/a)0.11 (n/a)677.00 (n/a)389.46 (n/a)344.10 (n/a)273.30 (n/a)163.46 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.48 (-3.42%)0.34 (-2.62%)0.33 (+0.76%)0.22 (+4.35%)0.12 (-7.21%)607.70 (-4.16%)429.16 (+1.53%)396.20 (-0.75%)272.80 (+3.53%)154.63 (-3.87%)
d9e4ec5 — 2026-08-29 05:11:110.50 (n/a)0.35 (n/a)0.33 (n/a)0.21 (n/a)0.13 (n/a)634.10 (n/a)422.70 (n/a)399.20 (n/a)263.50 (n/a)160.85 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.49 (-3.72%)0.34 (+15.80%)0.39 (+29.71%)0.20 (+193.16%)0.12 (-27.22%)640.30 (-65.89%)429.42 (-39.19%)335.60 (-22.89%)267.10 (+3.85%)166.86 (-75.05%)
d9e4ec5 — 2026-08-29 05:11:110.51 (n/a)0.30 (n/a)0.30 (n/a)0.07 (n/a)0.17 (n/a)1877.10 (n/a)706.14 (n/a)435.20 (n/a)257.20 (n/a)668.74 (n/a)
iron/operators/strided_copy

test_strided_copy[chunked_transfer]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.02 (+18.05%)0.02 (+43.40%)0.02 (+66.89%)0.01 (+59.22%)0.00 (-27.58%)358.40 (-37.20%)278.22 (-34.11%)260.10 (-40.08%)228.50 (-15.31%)50.25 (-60.70%)
d9e4ec5 — 2026-08-29 05:11:110.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)570.70 (n/a)422.28 (n/a)434.10 (n/a)269.80 (n/a)127.88 (n/a)

test_strided_copy[contiguous]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.02 (+0.16%)0.01 (+7.84%)0.02 (+10.06%)0.01 (-14.18%)0.00 (-3.47%)541.60 (+16.52%)321.66 (-6.56%)270.50 (-9.14%)245.40 (-0.16%)124.00 (+14.60%)
d9e4ec5 — 2026-08-29 05:11:110.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)464.80 (n/a)344.24 (n/a)297.70 (n/a)245.80 (n/a)108.20 (n/a)

test_strided_copy[four_channels]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.02 (-15.64%)0.01 (+7.84%)0.01 (+14.52%)0.01 (+7.46%)0.00 (-31.67%)549.90 (-6.94%)395.98 (-13.51%)424.30 (-12.68%)242.50 (+18.52%)119.58 (-24.07%)
d9e4ec5 — 2026-08-29 05:11:110.02 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)590.90 (n/a)457.84 (n/a)485.90 (n/a)204.60 (n/a)157.50 (n/a)

test_strided_copy[kv_slot0]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.58 (-13.76%)0.53 (+23.47%)0.55 (+30.45%)0.48 (+102.14%)0.04 (-77.61%)276.30 (-50.52%)250.56 (-31.68%)240.20 (-23.36%)227.80 (+15.93%)20.78 (-87.70%)
d9e4ec5 — 2026-08-29 05:11:110.67 (n/a)0.43 (n/a)0.42 (n/a)0.24 (n/a)0.19 (n/a)558.40 (n/a)366.76 (n/a)313.40 (n/a)196.50 (n/a)168.98 (n/a)

test_strided_copy[kv_slot5]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.59 (+21.08%)0.49 (+47.84%)0.49 (+23.09%)0.30 (+347.34%)0.12 (-32.99%)433.60 (-77.65%)287.52 (-57.49%)267.90 (-18.77%)222.20 (-17.40%)85.93 (-87.98%)
d9e4ec5 — 2026-08-29 05:11:110.49 (n/a)0.33 (n/a)0.40 (n/a)0.07 (n/a)0.17 (n/a)1939.80 (n/a)676.28 (n/a)329.80 (n/a)269.00 (n/a)714.69 (n/a)

test_strided_copy[kv_slot5_four_channels]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.48 (-12.69%)0.37 (-2.83%)0.42 (+29.35%)0.23 (-6.08%)0.12 (-11.76%)570.00 (+6.46%)396.06 (+2.85%)311.70 (-22.67%)277.40 (+14.53%)144.94 (+11.35%)
d9e4ec5 — 2026-08-29 05:11:110.55 (n/a)0.38 (n/a)0.33 (n/a)0.25 (n/a)0.14 (n/a)535.40 (n/a)385.10 (n/a)403.10 (n/a)242.20 (n/a)130.16 (n/a)

test_strided_copy[kv_slot5_two_channels]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.55 (-4.81%)0.37 (-12.71%)0.35 (-29.72%)0.24 (-4.43%)0.12 (-13.73%)541.60 (+4.64%)382.06 (+12.33%)379.70 (+42.26%)241.10 (+5.05%)115.99 (-6.87%)
d9e4ec5 — 2026-08-29 05:11:110.58 (n/a)0.43 (n/a)0.49 (n/a)0.26 (n/a)0.14 (n/a)517.60 (n/a)340.12 (n/a)266.90 (n/a)229.50 (n/a)124.54 (n/a)

test_strided_copy[kv_slot_last]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.58 (-33.17%)0.39 (-21.09%)0.43 (-8.26%)0.22 (-10.25%)0.15 (-36.70%)596.00 (+11.42%)388.62 (+21.31%)304.70 (+9.02%)226.80 (+49.60%)164.03 (+10.72%)
d9e4ec5 — 2026-08-29 05:11:110.87 (n/a)0.49 (n/a)0.47 (n/a)0.25 (n/a)0.24 (n/a)534.90 (n/a)320.34 (n/a)279.50 (n/a)151.60 (n/a)148.14 (n/a)

test_strided_copy[two_channels]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.02 (+3.74%)0.02 (+27.07%)0.01 (-0.05%)0.01 (+249.78%)0.00 (-65.90%)299.70 (-71.41%)272.36 (-41.73%)292.80 (+0.07%)229.80 (-3.61%)33.90 (-90.15%)
d9e4ec5 — 2026-08-29 05:11:110.02 (n/a)0.01 (n/a)0.01 (n/a)0.00 (n/a)0.01 (n/a)1048.30 (n/a)467.44 (n/a)292.60 (n/a)238.40 (n/a)344.11 (n/a)

test_strided_copy[two_channels_chunked]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.02 (-34.08%)0.01 (-8.17%)0.01 (-6.65%)0.01 (+17.90%)0.00 (-52.39%)547.70 (-15.18%)362.30 (-8.40%)317.10 (+7.13%)242.50 (+51.75%)121.70 (-41.64%)
d9e4ec5 — 2026-08-29 05:11:110.03 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)0.01 (n/a)645.70 (n/a)395.52 (n/a)296.00 (n/a)159.80 (n/a)208.52 (n/a)

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter0]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter1]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter2]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter3]

No metrics available.

test_transfer_size_not_dividing_per_channel_share_is_rejected[iter4]

No metrics available.

iron/operators/swiglu_decode

test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.00 (+200.00%)0.00 (+50.00%)0.00 (+0.00%)0.00 (+0.00%)0.00 (n/a)18176.47 (-15.17%)14882.94 (-25.16%)16599.11 (-20.08%)6945.09 (-58.71%)4603.55 (+141.99%)
d9e4ec5 — 2026-08-29 05:11:110.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)21427.35 (n/a)19885.82 (n/a)20769.78 (n/a)16821.89 (n/a)1902.35 (n/a)

test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.00 (+133.33%)0.00 (+108.00%)0.00 (+140.00%)0.00 (+0.00%)0.00 (+470.96%)18215.51 (-3.57%)9223.07 (-45.08%)6678.25 (-59.87%)5974.46 (-58.34%)5151.66 (+195.44%)
d9e4ec5 — 2026-08-29 05:11:110.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)0.00 (n/a)18890.03 (n/a)16792.67 (n/a)16640.05 (n/a)14342.14 (n/a)1743.73 (n/a)
iron/operators/swiglu_prefill

test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:060.14 (+29.35%)0.09 (+3.23%)0.09 (-3.85%)0.07 (-1.96%)0.03 (+88.69%)29870.38 (+2.03%)23879.11 (+0.64%)24658.03 (+3.93%)14460.37 (-22.73%)5776.50 (+41.29%)
d9e4ec5 — 2026-08-29 05:11:110.11 (n/a)0.09 (n/a)0.09 (n/a)0.07 (n/a)0.02 (n/a)29274.86 (n/a)23727.88 (n/a)23726.25 (n/a)18714.51 (n/a)4088.38 (n/a)
iron/operators/transpose

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:061.78 (+16.42%)0.97 (-21.90%)0.97 (-33.97%)0.27 (-63.55%)0.55 (+53.28%)1939.50 (+174.37%)793.32 (+72.47%)538.70 (+51.45%)294.80 (-14.10%)656.94 (+310.30%)
d9e4ec5 — 2026-08-29 05:11:111.53 (n/a)1.24 (n/a)1.47 (n/a)0.74 (n/a)0.36 (n/a)706.90 (n/a)459.98 (n/a)355.70 (n/a)343.20 (n/a)160.11 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8-num_batches_2]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:062.49 (+47.71%)1.55 (+63.01%)1.69 (+49.56%)0.30 (-5.65%)0.80 (+30.80%)3511.20 (+5.98%)1168.96 (-34.12%)620.20 (-33.14%)421.00 (-32.29%)1313.55 (-3.35%)
d9e4ec5 — 2026-08-29 05:11:111.69 (n/a)0.95 (n/a)1.13 (n/a)0.32 (n/a)0.61 (n/a)3313.00 (n/a)1774.42 (n/a)927.60 (n/a)621.80 (n/a)1359.02 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
4bb8427 — 2026-06-25 20:01:371.58 (-2.67%)1.21 (+5.65%)1.29 (+41.89%)0.66 (-20.05%)0.38 (-2.53%)792.90 (+25.08%)479.12 (-3.80%)406.80 (-29.52%)331.10 (+2.76%)189.18 (+26.62%)
4bb8427 — 2026-06-23 22:46:491.63 (n/a)1.14 (n/a)0.91 (n/a)0.83 (n/a)0.38 (n/a)633.90 (n/a)498.02 (n/a)577.20 (n/a)322.20 (n/a)149.40 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8-num_batches_1]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
f748905 — 2026-08-31 15:58:061.76 (+40.19%)1.34 (+46.00%)1.56 (+45.74%)0.80 (+425.16%)0.44 (-0.18%)651.90 (-80.96%)432.20 (-59.40%)337.00 (-31.39%)298.20 (-28.68%)160.70 (-87.82%)
d9e4ec5 — 2026-08-29 05:11:111.25 (n/a)0.92 (n/a)1.07 (n/a)0.15 (n/a)0.44 (n/a)3423.30 (n/a)1064.42 (n/a)491.20 (n/a)418.10 (n/a)1319.07 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8]

Commit/Date Bandwidth (max)Bandwidth (mean)Bandwidth (median)Bandwidth (min)Bandwidth (stddev)Latency (max)Latency (mean)Latency (median)Latency (min)Latency (stddev)
4bb8427 — 2026-06-25 20:01:371.75 (-15.44%)1.32 (-0.50%)1.36 (+22.47%)0.77 (-19.20%)0.36 (-21.75%)678.10 (+23.76%)430.02 (-0.09%)385.10 (-18.34%)300.10 (+18.29%)146.96 (+19.46%)
4bb8427 — 2026-06-23 22:46:492.07 (n/a)1.32 (n/a)1.11 (n/a)0.96 (n/a)0.46 (n/a)547.90 (n/a)430.40 (n/a)471.60 (n/a)253.70 (n/a)123.02 (n/a)
Phoenix - Examples

IRON

Tested on 2026_08_31_16_04_51 at commit f748905.

Trends:

IRON Trends

auto-merge was automatically disabled August 31, 2026 19:50

Head branch was pushed to by a user without write access

@astrelsky

astrelsky commented Sep 1, 2026

Copy link
Copy Markdown
Contributor Author

@andrej I fixed the formatting problem. I didn't originally run black because I assumed everything was already following the formatting rules. It should be good now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@andrej andrej andrej approved these changes
@jgmelber jgmelber Awaiting requested review from jgmelber jgmelber is a code owner
@hunhoffe hunhoffe Awaiting requested review from hunhoffe hunhoffe is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@astrelsky @andrej