Beanstalk Longshot test farm
Menu

#1813 perf(vk): RX_VK_TEX_AHEAD=2 prepares every block-compressed texture the game makes, not only those an earlier load drew

by GummiNaomi open Open on Forgejo

Commit

Head
3af1d15
Base
main 6548881
Approval
approved GummiNaomi, · reviewed

Plan (gpt-6.1-terra)

Compare texture-ahead modes on a five-location teleport tour

In plain words

The plan runs the requested teleport tour from Kokiri Forest through Market, Kakariko and Hyrule Field and back on Windows 8 GB, Windows 12 GB and Steam Deck targets. It compares texture-ahead modes 0, 1 and 2 on main and the PR, measuring post-arrival frame tails, memory, load times and eviction counts if the available logs match the supplied pattern. The plan cannot set the requested frame-trace switch, so individual loading-frame maxima may require follow-up. Each target takes roughly 35 minutes; crashes, device loss, out-of-memory errors, visual mismatches or specified regressions fail the PR.

Asked for

windows+vram8gb, windows+vram12gb and steamdeck: the teleport walk from kokiri-start (Kokiri Forest, Castle Town market, Kakariko, Hyrule Field, back to Kokiri) with `RX_VK_TEX_AHEAD` 0, 1 and 2, `RX_VK_FRAME_TRACE=1`. Measure each arrival's longest frame and the eviction counts. Expecting on 8 GB and the Steam Deck `=2` to evict more and its second arrivals no better than `=1` (that is the question for the default); on 12 GB about what the description's Measurements shows. (Earlier runs on #1846 and #1847 today ended in `error` before building: the farm's checkout of main failed `git rev-parse --verify HEAD^{commit}` in packs.py's cmd_base, so nothing was measured there.)

Raw plan 244 lines Download plan.json

  "pass" 
    "crash" false
    "screenshot" 
      "max_diff" 0.05
    
    "vram_peak_mb" 
      "max_delta_pct" 15
    
    "load_time_max_s" 
      "max_delta_pct" 30
    
    "frametime_p99_ms" 
      "max_delta_pct" 30
    
    "log_forbidden_hits" 
      "max" 0
    
  
  "probe" 
    
      "kind" "crash"
    
    
      "kind" "frametime"
    
    
      "kind" "load_time"
    
    
      "kind" "vram"
    
    
      "kind" "process"
    
    
      "kind" "log_match"
      "expected" 
      "forbidden" 
        "vk: device lost"
        "[Oo]ut of [Mm]emory"
      
    
    
      "kind" "log_value"
      "value" 
        
          "name" "textures_retired"
          "take" "last"
          "pattern" "textures retired[^0-9]*([0-9]+)"
        
      
    
  
  "matrix" 
    "RX_VK_TEX_AHEAD" 
      "0"
      "1"
      "2"
    
  
  "schema" 7
  "target" 
    
      "name" "windows+vram8gb"
      "tags" 
        "windows"
      
      "vram_gb" 8
      "max_reports" 2
      "min_reports" 1
    
    
      "name" "windows+vram12gb"
      "tags" 
        "windows"
      
      "vram_gb" 12
      "max_reports" 2
      "min_reports" 1
    
    
      "name" "steamdeck"
      "tags" 
        "steamdeck"
      
      "max_reports" 2
      "min_reports" 1
    
  
  "summary" "Compare texture-ahead modes on a five-location teleport tour"
  "baseline" 
    "ref" "main"
  
  "scenario" 
    
      "env" 
      "name" "teleport-tour"
      "runs" 1
      "step" 
        
          "do" "wait"
          "event" "in_play"
          "timeout_s" 120
        
        
          "do" "teleport"
          "to" "KokiriForest_Child"
        
        
          "do" "wait"
          "map" "KokiriForest_Child"
          "event" "map"
          "timeout_s" 120
        
        
          "do" "measure"
          "name" "kokiri-first"
          "warmup_s" 0
          "duration_s" 5
        
        
          "x" 0
          "y" 1
          "do" "stick"
          "stick" "L"
          "frames" 600
        
        
          "do" "teleport"
          "to" "Market_Child"
        
        
          "do" "wait"
          "map" "Market_Child"
          "event" "map"
          "timeout_s" 120
        
        
          "do" "measure"
          "name" "market"
          "warmup_s" 0
          "duration_s" 5
        
        
          "do" "shot"
          "name" "market"
          "upload" false
          "compare" "baseline"
        
        
          "x" 0
          "y" 1
          "do" "stick"
          "stick" "L"
          "frames" 600
        
        
          "do" "teleport"
          "to" "KakarikoVillage_Child"
        
        
          "do" "wait"
          "map" "KakarikoVillage_Child"
          "event" "map"
          "timeout_s" 120
        
        
          "do" "measure"
          "name" "kakariko"
          "warmup_s" 0
          "duration_s" 5
        
        
          "do" "shot"
          "name" "kakariko"
          "upload" false
          "compare" "baseline"
        
        
          "x" 0
          "y" 1
          "do" "stick"
          "stick" "L"
          "frames" 600
        
        
          "do" "teleport"
          "to" "HyruleField_Child"
        
        
          "do" "wait"
          "map" "HyruleField_Child"
          "event" "map"
          "timeout_s" 120
        
        
          "do" "measure"
          "name" "field"
          "warmup_s" 0
          "duration_s" 5
        
        
          "do" "shot"
          "name" "field"
          "upload" false
          "compare" "baseline"
        
        
          "x" 0
          "y" 1
          "do" "stick"
          "stick" "L"
          "frames" 600
        
        
          "do" "teleport"
          "to" "KokiriForest_Child"
        
        
          "do" "wait"
          "map" "KokiriForest_Child"
          "event" "map"
          "timeout_s" 120
        
        
          "do" "measure"
          "name" "kokiri-return"
          "warmup_s" 0
          "duration_s" 5
        
        
          "do" "shot"
          "name" "kokiri-return"
          "upload" false
          "compare" "baseline"
        
      
      "start" "save:kokiri-start"
      "matrix" true
      "settings" 
    
  

Targets

TargetTierReportsStatus
windows+vram8gb 8 GB VRAMreviewed GummiNaomi 1 2 2/1 fail
windows+vram12gb 12 GB VRAMreviewed GummiNaomi 1 2 1/1 fail
steamdeckreviewed GummiNaomi 1 1/1 fail

Reports

ReportCommitTargetTesterResultWhen
rp_0d035cd77068c69c3af1d15steamdeck Wrath/agent-0e17b1fail
rp_bface65d371268f23af1d15windows+vram8gb Smilingcorpse/agent-54e7cffail outlier
rp_b85980f0865152bd3af1d15windows+vram12gb Samsheperd/agent-a9f512fail
rp_521666ea63125b4b3af1d15windows+vram8gb thebasedpisces/agent-8d2999fail outlier
rp_746e0328efc1233e3af1d15windows+vram12gb akkusativ/agent-0a71fcerror

Jobs

Estimate: done in about 45 min, from the queue and the testers online now; some jobs can't start yet.

JobCommitTargetStateTesterStartedAttemptsEstimateNote
jb_13766ff4684ba086 log3af1d15steamdeck off target runningbuild-base10%10%Wrath/agent-03e8901 done in about 45 min
jb_f5f8f446d3e54b7f log3af1d15windows+vram12gb done reportakkusativ/agent-0a71fc1
jb_5a43bc443880f4d2 log3af1d15windows+vram8gb done runthebasedpisces/agent-8d29992 report: the farm refused the report: the coordinator answered HTTP 400 (BadRequest): {"error":"report.rules[8].status must be one of pass, fail, unsupported, skipped, mismatch"}
jb_0bf4059126c56afa log3af1d15windows+vram8gb done reportSmilingcorpse/agent-54e7cf2 report: the farm refused the report: the coordinator answered HTTP 400 (BadRequest): {"error":"report.rules[8].status must be one of pass, fail, unsupported, skipped, mismatch"}
jb_b4de653fa47c5441 log3af1d15steamdeck done reportWrath/agent-0e17b12 lease expired, tried again: the tester missed its heartbeats
jb_2ad35f9bacbafc12 log3af1d15windows+vram12gb done reportSamsheperd/agent-a9f5121
jb_7c21d80ae8849ac23af1d15steamdeck queued—1 No tester online can take it now.1 tester matches `steamdeck` online, but 1 ran or skipped this job already.
jb_2670c7e17545bf36 loge9d6b5dwindows+vram8gb cancelled build-basethebasedpisces/agent-8d29991 superseded by a new push
jb_cdf639f9013bee4d loge9d6b5dwindows+vram8gb cancelled—0 superseded by a new push
jb_738d0a85f56ec9f4 loge9d6b5dwindows+vram12gb cancelled—0 superseded by a new push
jb_14a2bd888f7a1178 loge9d6b5dwindows+vram12gb cancelled—0 superseded by a new push
jb_87e8c804291c40e6 loge9d6b5dsteamdeck cancelled—0 superseded by a new push
jb_261b42b26c2a450b loge9d6b5dsteamdeck cancelled—0 superseded by a new push