Beanstalk Longshot test farm
Menu

#2081 fix(vk): host-visible buffers stay within their heap's budget, and a submit refused for want of memory is made again

by HumanBean closed Open on Forgejo

Commit

Head
038d85c
Base
main 9dd4132
Run
2
Approval
approved HumanBean, · reviewed

Plan (gpt-6.1-terra)

Compare the Castle and Deku Tree memory tour on Windows AMD iGPUs and Steam Deck

⚠️ Note: The farm cannot compare the two numbers in each heap log line, so it cannot enforce the requested per-device-heap budget limit.

⚠️ Note: Pictures are compared at two sampled moments; this can catch a black-screen regression against main but cannot guarantee detection throughout the tour or when main is also black.

⚠️ Note: Camera turns occur before each 30-second measurement, not during it; the shared submit rule also rejects device-lost submits on Windows.

In plain words

Windows AMD iGPUs and Steam Decks will load kokiri-start and visit Hyrule Castle and the Deku Tree, with camera turns and 30-second measurements at each stop. The roughly 13-minute run per tester compares load time, frame-time p99, peak VRAM and pictures with main. Crashes, failed memory or device-lost submits, substantial performance or VRAM regressions, and sufficiently different pictures fail the plan. No tester online now matches windows+amd+igpu: that target waits for one.

Asked for

test Windows AMD iGPUs (windows+amd+igpu): from the save kokiri-start, load the save, teleport to Hyrule Castle and then Inside the Deku Tree, 30 s in each with the camera turning. Fail on any "vk: submit" or "batched submit" line with "failed (-2)", a black screen, or a "memory heaps" line where a device heap's "used" is over its budget. Compare load times and peak VRAM with main. --- and another request --- test Steam Deck (steamdeck): from the save kokiri-start, load the save, teleport to Hyrule Castle and Inside the Deku Tree, 30 s each. Compare load time, frame time p99 and peak VRAM with main. Fail on any "failed (-2)" or "failed (-4)" submit line, or a crash.

Raw plan 156 lines Download plan.json

  "pass" 
    "crash" false
    "screenshot" 
      "max_diff" 0.05
    
    "vram_peak_mb" 
      "max_delta_pct" 10
    
    "load_time_max_s" 
      "max_delta_pct" 20
    
    "frametime_p99_ms" 
      "max_delta_pct" 15
    
    "log_forbidden_hits" 
      "max" 0
    
  
  "probe" 
    
      "kind" "crash"
    
    
      "kind" "load_time"
    
    
      "kind" "frametime"
    
    
      "kind" "vram"
    
    
      "kind" "log_match"
      "expected" 
      "forbidden" 
        "vk: (batched )?submit[^\\n]*failed \\(-(2|4)\\)"
      
    
  
  "matrix" 
  "schema" 3
  "target" 
    
      "name" "windows+amd+igpu"
      "tags" 
        "windows"
        "amd"
        "igpu"
      
      "max_reports" 2
      "min_reports" 1
    
    
      "name" "steamdeck"
      "tags" 
        "steamdeck"
      
      "max_reports" 2
      "min_reports" 1
    
  
  "summary" "Compare the Castle and Deku Tree memory tour on Windows AMD iGPUs and Steam Deck"
  "baseline" 
    "ref" "main"
  
  "scenario" 
    
      "env" 
      "name" "castle-deku-tour"
      "runs" 1
      "step" 
        
          "do" "wait"
          "event" "in_play"
          "timeout_s" 120
        
        
          "do" "teleport"
          "to" "HyruleCastle"
        
        
          "do" "wait"
          "map" "HyruleCastle"
          "event" "map"
          "timeout_s" 120
        
        
          "x" 1.0
          "y" 0.0
          "do" "stick"
          "stick" "R"
          "frames" 600
        
        
          "x" 1.0
          "y" 0.0
          "do" "stick"
          "stick" "R"
          "frames" 300
        
        
          "do" "shot"
          "name" "castle"
          "upload" false
          "compare" "baseline"
        
        
          "do" "measure"
          "name" "castle"
          "warmup_s" 0
          "duration_s" 30
        
        
          "do" "teleport"
          "to" "InsideTheDekuTree"
        
        
          "do" "wait"
          "map" "InsideTheDekuTree"
          "event" "map"
          "timeout_s" 120
        
        
          "x" 1.0
          "y" 0.0
          "do" "stick"
          "stick" "R"
          "frames" 600
        
        
          "x" 1.0
          "y" 0.0
          "do" "stick"
          "stick" "R"
          "frames" 300
        
        
          "do" "shot"
          "name" "deku"
          "upload" false
          "compare" "baseline"
        
        
          "do" "measure"
          "name" "deku"
          "warmup_s" 0
          "duration_s" 30
        
      
      "start" "save:kokiri-start"
      "matrix" true
      "settings" 
    
  

Targets

TargetTierReportsStatus
windows+amd+igpureviewed HumanBean none yet 0/1 pass, 0 running, 0 queued
steamdeckreviewed HumanBean 1 2 2/1 fail

Reports

ReportCommitTargetTesterResultWhen
rp_01e0fef21f03c9ae038d85c run 2steamdeck manasuazo/agent-ebaed6fail outlier
rp_249da7a74fa6dd41038d85c run 2steamdeck Wrath/agent-0e17b1fail outlier

Jobs

JobCommitTargetStateTesterStartedAttemptsEstimateNote
jb_7b7fba970e6350d3 log038d85cwindows+amd+igpu off target cancelled build-baseHidden tester1 the PR was closed
jb_806dc2d7e291afb0 log038d85cwindows+amd+igpu cancelled—0 the PR was closed
jb_5677aee055f2454e log038d85cwindows+amd+igpu cancelled—0 the PR was closed
jb_e4f7c3db60e790b9 log038d85csteamdeck done reportmanasuazo/agent-ebaed61
jb_629cbfc55152c145 log038d85csteamdeck done reportWrath/agent-0e17b11