Skip to content

[Autoloop: perf-comparison] - #435

Draft
github-actions[bot] wants to merge 54 commits into
mainfrom
autoloop/perf-comparison
Draft

[Autoloop: perf-comparison]#435
github-actions[bot] wants to merge 54 commits into
mainfrom
autoloop/perf-comparison

Conversation

@github-actions

Copy link
Copy Markdown
Contributor

🤖 This PR is maintained by Autoloop. Each accepted iteration adds a commit to this branch.

Autoloop: perf-comparison

Goal: Benchmark every tsb function vs pandas equivalent.

Current Best Metric: 756 benchmarked function pairs

Program Issue: #221


Latest Iteration (418)

Added firstValidIndex / lastValidIndex benchmarks:

  • TypeScript: benchmarks/tsb/bench_first_last_valid_index.ts — 100k-row Series with NaN at start, end, and scattered; 500 measured iterations
  • Python: benchmarks/pandas/bench_first_last_valid_index.py — matching dataset and loop structure using Series.first_valid_index() / Series.last_valid_index()

Metric: 755 → 756 (+1)

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • releaseassets.githubusercontent.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "releaseassets.githubusercontent.com"

See Network Configuration for more information.

Generated by Autoloop · 1.4K AIC · ⌖ 12.1 AIC · ⊞ 51.8K ·
Comment /autoloop to run again

…ndex benchmark

Run: https://github.com/githubnext/tsb/actions/runs/30010910150

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
github-actions Bot and others added 2 commits July 23, 2026 13:33
Benchmark BooleanArray extension array (100k elements, ~10% nulls, 50 iters):
from/any/all/sum/and/or/not/fillna. TS: arrays.BooleanArray from tsb;
Python: pd.array(dtype='boolean').

Run: https://github.com/githubnext/tsb/actions/runs/30058807058

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 402ebd6

Generated by Autoloop · 983.4 AIC · ⌖ 11.9 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 8d70dac

Generated by Autoloop · 1.2K AIC · ⌖ 12 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

🤖 Iteration 420✅ Accepted

  • Change: Added StringArray extension array benchmarks (bench_string_array.ts / bench_string_array.py)
  • Metric: 758 (best: 758, delta: +1)
  • Commit: 8d70dac
  • Result: Benchmarks cover from/upper/lower/strip/contains/len/fillna on 100k-element arrays with ~10% nulls (50 measured iterations). Python uses pd.array(dtype="string") with equivalent .str accessor methods.

Generated by Autoloop · 1.2K AIC · ⌖ 12 AIC · ⊞ 51.8K ·
Comment /autoloop to run again

Add bench_datetime_array.ts and bench_datetime_array.py benchmarking
nullable datetime extension array: from/year/month/day/isna/notna/fillna.
100k elements with ~10% nulls, 50 iterations.

Run: https://github.com/githubnext/tsb/actions/runs/30138360760

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 7500ea9

Generated by Autoloop · 669.6 AIC · ⌖ 11.8 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits July 25, 2026 01:30
Add bench_timedelta_array.ts and bench_timedelta_array.py benchmarks for
TimedeltaArray (100k elements, ~10% nulls, 50 iters): from/days/hours/
totalSeconds/isna/notna/sum/min/max/fillna.

Run: https://github.com/githubnext/tsb/actions/runs/30159549081

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 744e7b2

Generated by Autoloop · 845.1 AIC · ⌖ 11.9 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits July 25, 2026 13:32
Add matched TypeScript + Python benchmarks for Gaussian KDE (evaluate + integrate)
on a bimodal 10k-point dataset with 200 evaluation points, 20 iterations.

Run: https://github.com/githubnext/tsb/actions/runs/30182788398

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: dfda6b1

Generated by Autoloop · 1.8K AIC · ⌖ 12 AIC · ⊞ 51.8K

@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 66c5b82

Generated by Autoloop · 678.6 AIC · ⌖ 11.6 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits July 26, 2026 13:29
…tropy/jsDivergence/jsDistance/crossEntropy benchmark

Run: https://github.com/githubnext/tsb/actions/runs/30248425219

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 6fdb111

Generated by Autoloop · 1.1K AIC · ⌖ 12.1 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits July 27, 2026 08:17
…alEntropy/variationOfInformation benchmark

1000-element paired observations, 10 categories, 50 iters each.
Python: pure-numpy implementations matching tsb semantics.

Run: https://github.com/githubnext/tsb/actions/runs/30297867311

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown
Contributor Author

Commit pushed: 320e47d

Generated by Autoloop · 1.2K AIC · ⌖ 12 AIC · ⊞ 51.8K

…(split/replace/extract/join, 100k strings, 15 iters)

Run: https://github.com/githubnext/tsb/actions/runs/30701520139

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

github-actions Bot commented Aug 1, 2026

Copy link
Copy Markdown
Contributor Author

Commit pushed: 26400e7

Generated by Autoloop · 1.3K AIC · ⌖ 11.9 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 1, 2026 13:38
Add TypeScript and Python benchmarks for clipSeriesWithBounds / clipDataFrameWithBounds,
benchmarking per-element clipping with Series/array bounds (100k rows, 4-col DataFrame).

Run: https://github.com/githubnext/tsb/actions/runs/30726948175

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

github-actions Bot commented Aug 2, 2026

Copy link
Copy Markdown
Contributor Author

Commit pushed: 032397e

Generated by Autoloop · 1.6K AIC · ⌖ 12 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 2, 2026 01:42
Add bench_swaplevel_dataframe.ts and bench_swaplevel_dataframe.py benchmarking
swapLevelDataFrame and reorderLevelsDataFrame on a 50k-row × 3-column DataFrame
with a 3-level MultiIndex row index (30 iterations, warm-up 5).

Run: https://github.com/githubnext/tsb/actions/runs/30749712022

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

github-actions Bot commented Aug 2, 2026

Copy link
Copy Markdown
Contributor Author

Commit pushed: 9fdcff1

Generated by Autoloop · 2.7K AIC · ⌖ 12.3 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 2, 2026 13:36
…mark

Add bench_information_advanced.ts and bench_information_advanced.py covering
9 advanced information-theory functions: jsDivergence, jsDistance, crossEntropy,
renyiEntropy, tsallisEntropy, jointEntropy, conditionalEntropy, normalizedMI,
variationOfInformation. Dataset: N=200 PMF + 1000 paired observations, 50 iters.

Run: https://github.com/githubnext/tsb/actions/runs/30776731199

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

github-actions Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor Author

Commit pushed: 646ec8f

Generated by Autoloop · 2.3K AIC · ⌖ 12.5 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 3, 2026 01:37
…Markdown/toLaTeX/seriesToMarkdown, 1000-row DataFrame, 20 iters)

Run: https://github.com/githubnext/tsb/actions/runs/30819531253

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

github-actions Bot commented Aug 3, 2026

Copy link
Copy Markdown
Contributor Author

Commit pushed: bd73477

Generated by Autoloop · 1.6K AIC · ⌖ 11.9 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 3, 2026 14:06
@github-actions

github-actions Bot commented Aug 4, 2026

Copy link
Copy Markdown
Contributor Author

Commit pushed: 2863f1f

Generated by Autoloop · 909.9 AIC · ⌖ 12.2 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 4, 2026 01:36
…stest_jarquebera benchmarks

Run: https://github.com/githubnext/tsb/actions/runs/30913778633

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

github-actions Bot commented Aug 4, 2026

Copy link
Copy Markdown
Contributor Author

Commit pushed: 1923387

Generated by Autoloop · 5.1K AIC · ⌖ 12.5 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 4, 2026 13:56
…marks

Add TypeScript and Python benchmarks for digitize, histogram, linspace,
arange, zscore, minMaxNormalize, and percentileOfScore from numeric_extended.

Run: https://github.com/githubnext/tsb/actions/runs/30966192541

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor Author

Commit pushed: 0e5f374

Generated by Autoloop · 1.3K AIC · ⌖ 12.1 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 5, 2026 01:37
…chmark (sortIndexDataFrame axis=1, 50-col DataFrame, 30 iters)

Run: https://github.com/githubnext/tsb/actions/runs/31010097715

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor Author

Commit pushed: 806b80b

Generated by Autoloop · 4.2K AIC · ⌖ 12 AIC · ⊞ 51.8K

github-actions Bot and others added 2 commits August 5, 2026 13:46
@github-actions

github-actions Bot commented Aug 6, 2026

Copy link
Copy Markdown
Contributor Author

Commit pushed: 3fd006a

Generated by Autoloop · 759.2 AIC · ⌖ 11.9 AIC · ⊞ 51.8K

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants