Skip to content

[Crazy RoboTaxi] Add HDmap view, optionally show prompt in HUD - #616

Merged
aidanfnv merged 4 commits into
mainfrom
dev/aidanf/game/crazy-robotaxi/debug-views
Sep 18, 2026
Merged

aidanfnv merged 4 commits into
mainfrom
dev/aidanf/game/crazy-robotaxi/debug-views

Conversation

@aidanfnv

@aidanfnv aidanfnv commented Sep 11, 2026

Copy link
Copy Markdown
Collaborator

Closes #553

Split off from #553, this change adds a key to show the HDmap like the pre-API-port demo had. It also adds an option to have the HUD show the current prompt being used.

@aidanfnv
aidanfnv added this pull request to stack #610 September 11, 2026 00:53
@copy-pr-bot

copy-pr-bot Bot commented Sep 11, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@greptile-apps

greptile-apps Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

RetriggerConfidence Score: 5/5

The PR appears safe to merge; no new actionable issues were introduced since the previous review, and both prior HUD-layout findings are resolved.

Summary

Adds an optional HD-map conditioning view and configurable current-prompt HUD display to Crazy Robotaxi.

  • Publishes frame-aligned HD-map tensors alongside generated video and BEV output.
  • Adds keyboard and gamepad bindings for toggling the HD-map view during gameplay.
  • Propagates the active generation prompt into HUD frames and renders it within a height-capped panel.
  • Updates settings handling and tests for controls, rendering, prompt layout, and live-edit integration.

Diagram

%%{init: {'theme': 'neutral'}}%%
flowchart LR
  Model[Model generation step] --> Video[Generated video]
  Model --> HDMap[HD-map conditioning]
  Model --> Prompt[Active prompt]
  Video --> Presentation[Presentation manager]
  HDMap --> Presentation
  Prompt --> HUD[Frame-aligned HUD state]
  Input[HD-map toggle input] --> HUD
  Presentation --> Select{HD-map view enabled?}
  HUD --> Select
  Select -->|No| VideoOutput[Display generated video]
  Select -->|Yes| HDMapOutput[Display HD-map conditioning]
Loading

Reviews (13) · Last reviewed commit: "[crazy-robotaxi] Offset live-edit HUD be..."

Comment thread apps/crazy_robotaxi/crazy_robotaxi/ui.py Outdated
@aidanfnv
aidanfnv force-pushed the dev/aidanf/game/crazy-robotaxi/debug-views branch from dac9f20 to 7590297 Compare September 11, 2026 02:30
@aidanfnv
aidanfnv force-pushed the dev/aidanf/game/crazy-robotaxi/debug-views branch from 439c172 to 42bf297 Compare September 11, 2026 23:45
Comment thread apps/crazy_robotaxi/crazy_robotaxi/ui.py Outdated
@aidanfnv

Copy link
Copy Markdown
Collaborator Author

/ok to test c3206c6

@aidanfnv
aidanfnv force-pushed the dev/aidanf/game/crazy-robotaxi/debug-views branch from c3206c6 to f4d605c Compare September 12, 2026 00:26
@aidanfnv
aidanfnv force-pushed the dev/aidanf/game/crazy-robotaxi/debug-views branch 2 times, most recently from a55bba2 to ef7a4d7 Compare September 14, 2026 16:40
@aidanfnv

Copy link
Copy Markdown
Collaborator Author

/ok to test ef7a4d7

@aidanfnv
aidanfnv force-pushed the dev/aidanf/game/crazy-robotaxi/debug-views branch from ef7a4d7 to f5fbfd5 Compare September 14, 2026 22:52
@aidanfnv
aidanfnv force-pushed the dev/aidanf/game/crazy-robotaxi/debug-views branch from f5fbfd5 to 50cc3f7 Compare September 16, 2026 16:56
@jmccaffrey-nv
jmccaffrey-nv force-pushed the dev/aidanf/game/crazy-robotaxi/debug-views branch from 50cc3f7 to 06b99fd Compare September 16, 2026 20:55
@aidanfnv
aidanfnv force-pushed the dev/aidanf/game/crazy-robotaxi/debug-views branch from 06b99fd to 3816371 Compare September 18, 2026 17:54
@spaingnv

Copy link
Copy Markdown
Collaborator

/ok to test 3816371

Base automatically changed from dev/aidanf/game/crazy-robotaxi/leaderboards to main September 18, 2026 19:36
Signed-off-by: Aidan Foster <aidanf@nvidia.com>
Signed-off-by: Aidan Foster <aidanf@nvidia.com>
Signed-off-by: Aidan Foster <aidanf@nvidia.com>
Signed-off-by: Aidan Foster <aidanf@nvidia.com>
@aidanfnv
aidanfnv force-pushed the dev/aidanf/game/crazy-robotaxi/debug-views branch from 3816371 to 861b318 Compare September 18, 2026 19:36
@aidanfnv

Copy link
Copy Markdown
Collaborator Author

/ok to test 861b318

@spaingnv spaingnv left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. New tests cover the HD-map toggle, exact conditioning presentation, and the current-prompt overlay.

@aidanfnv
aidanfnv added this pull request to the merge queue Sep 18, 2026
@aidanfnv

Copy link
Copy Markdown
Collaborator Author

Thank you for the reviews @spaingnv !

Merged via the queue into main with commit bc711d6 Sep 18, 2026
7 checks passed
@aidanfnv
aidanfnv deleted the dev/aidanf/game/crazy-robotaxi/debug-views branch September 18, 2026 23:31
@aidanfnv
aidanfnv restored the dev/aidanf/game/crazy-robotaxi/debug-views branch September 18, 2026 23:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants