Skip to content

Osrs 5.0 pr - #644

Open
valtterivalo wants to merge 46 commits into
PufferAI:5.0from
valtterivalo:osrs-5.0-pr
Open

Osrs 5.0 pr#644
valtterivalo wants to merge 46 commits into
PufferAI:5.0from
valtterivalo:osrs-5.0-pr

Conversation

@valtterivalo

Copy link
Copy Markdown

going back to basics here, we're down from 3k+ to 905 and 530 in colo and inferno respectively. we're no longer running sim in the obs and there's nothing in place you could call scaffolding, you could argue current setup is even a bit unfair to RL on.

on a 4090 colo gets 401k SPS, reaching wave 9.7 on avg and a win rate of ~5%.
inferno is sitting at 424k SPS, currently only reaching wave 47. gonna focus on that for the next couple days.

both envs now use puffer's Encoder interface and inventory, equipped gear, and NPCs go through a small shared per record encoder followed by max pooling. i add pooled features to flat projection before entering the net.

replaces the stale mid-july PR 613 payload with the post-recut tree:
item-table inventory obs, fused entity encoders in env .cu files,
macos openmp and arm simd build fixes, and no python package.
persist denormalized sweep_observations.csv, replay via resume_from, and
skip the random phase so a warm surrogate does not re-draw Sobol.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant