Beanstalk Longshot test farm
Menu

#1847 perf(vk): textures prepared on worker threads as the game makes them (RX_VK_TEX_PREP, off by default)

by GummiNaomi closed Open on Forgejo

Commit

Head
ebd6c08
Base
main 89c3d21
Approval
approved GummiNaomi, · reviewed

Plan (gpt-6.1-terra)

Tour six destinations with texture preparation enabled versus main, recording frame times, resident memory and pictures

In plain words

On Steam Deck and Windows, two runs per side will tour six destinations from Kokiri Forest, spending 3.5 minutes in measured segments per tour. The PR with texture preparation enabled is compared with main unset; arrival-segment longest frames, whole-run hitches, peak resident memory and screenshots are recorded. Crashes or material screenshot differences fail the plan, while smoothness and memory are reported without requiring a gain. The farm cannot select Windows PCs by core count, enable the requested frame trace, or measure peak private memory; resident memory is a proxy and arrival-segment maxima exclude the preceding load.

Asked for

steamdeck, and windows with 6 to 8 cores: a 4-minute teleport tour from kokiri-start (Castle Town's market, Hyrule Field, Kakariko, Kokiri Forest, the Lost Woods, Zora's River), `RX_VK_TEX_PREP=1` against unset, ABBA, `RX_VK_FRAME_TRACE=1`, with each arrival's longest frame and the peak private memory. The question is whether `=1` makes arrivals smoother anywhere; expecting about 1 GB more memory with it. (This replaces today's run, which ended in `error` before building: the farm's checkout of main failed `git rev-parse --verify HEAD^{commit}` in packs.py's cmd_base.)

Raw plan 203 lines Download plan.json

  "pass" 
    "crash" false
    "screenshot" 
      "max_diff" 0.05
    
    "log_forbidden_hits" 
      "max" 0
    
  
  "probe" 
    
      "kind" "crash"
    
    
      "kind" "frametime"
    
    
      "kind" "process"
    
    
      "kind" "log_match"
      "expected" 
      "forbidden" 
        "vk: device lost"
      
    
  
  "matrix" 
    "pr_only" 
      "RX_VK_TEX_PREP" 
        "1"
      
    
  
  "schema" 3
  "target" 
    
      "name" "steamdeck"
      "tags" 
        "steamdeck"
      
      "max_reports" 2
      "min_reports" 1
    
    
      "name" "windows"
      "tags" 
        "windows"
      
      "max_reports" 2
      "min_reports" 1
    
  
  "summary" "Tour six destinations with texture preparation enabled versus main, recording frame times, resident memory and pictures"
  "baseline" 
    "ref" "main"
  
  "scenario" 
    
      "env" 
      "name" "teleport-tour"
      "runs" 2
      "step" 
        
          "do" "teleport"
          "to" "Market_Child"
        
        
          "do" "wait"
          "map" "Market_Child"
          "event" "map"
          "timeout_s" 60
        
        
          "do" "shot"
          "name" "market"
          "upload" false
          "compare" "baseline"
        
        
          "do" "measure"
          "name" "market"
          "warmup_s" 0
          "duration_s" 35
        
        
          "do" "teleport"
          "to" "HyruleField_Child"
        
        
          "do" "wait"
          "map" "HyruleField_Child"
          "event" "map"
          "timeout_s" 60
        
        
          "do" "shot"
          "name" "field"
          "upload" false
          "compare" "baseline"
        
        
          "do" "measure"
          "name" "field"
          "warmup_s" 0
          "duration_s" 35
        
        
          "do" "teleport"
          "to" "KakarikoVillage_Child"
        
        
          "do" "wait"
          "map" "KakarikoVillage_Child"
          "event" "map"
          "timeout_s" 60
        
        
          "do" "shot"
          "name" "kakariko"
          "upload" false
          "compare" "baseline"
        
        
          "do" "measure"
          "name" "kakariko"
          "warmup_s" 0
          "duration_s" 35
        
        
          "do" "teleport"
          "to" "KokiriForest_Child"
        
        
          "do" "wait"
          "map" "KokiriForest_Child"
          "event" "map"
          "timeout_s" 60
        
        
          "do" "shot"
          "name" "kokiri"
          "upload" false
          "compare" "baseline"
        
        
          "do" "measure"
          "name" "kokiri"
          "warmup_s" 0
          "duration_s" 35
        
        
          "do" "teleport"
          "to" "LostWood_Child"
        
        
          "do" "wait"
          "map" "LostWood_Child"
          "event" "map"
          "timeout_s" 60
        
        
          "do" "shot"
          "name" "woods"
          "upload" false
          "compare" "baseline"
        
        
          "do" "measure"
          "name" "woods"
          "warmup_s" 0
          "duration_s" 35
        
        
          "do" "teleport"
          "to" "ZoraRiver_Child"
        
        
          "do" "wait"
          "map" "ZoraRiver_Child"
          "event" "map"
          "timeout_s" 60
        
        
          "do" "shot"
          "name" "river"
          "upload" false
          "compare" "baseline"
        
        
          "do" "measure"
          "name" "river"
          "warmup_s" 0
          "duration_s" 35
        
      
      "start" "save:kokiri-start"
      "matrix" true
      "settings" 
    
  

Targets

TargetTierReportsStatus
steamdeckreviewed GummiNaomi none yet 0/1 pass, 0 running, 0 queued
windowsreviewed GummiNaomi 1 2 0/1 pass, 2 error

Reports

ReportCommitTargetTesterResultWhen
rp_49c4339386c908ccebd6c08windows Flashman4/agent-de36c5error
rp_f9718d2bb0553cadebd6c08windows Hidden testererror
rp_91e1da1b838809efa35e5edany CubanLegend/agent-341924error
rp_d5c7a3a00cdc8cf9a35e5edany Hidden testererror

Jobs

JobCommitTargetStateTesterStartedAttemptsEstimateNote
jb_2c0292d1ce7bb9e3 logebd6c08steamdeck cancelled—0 the PR was closed
jb_2f0d6c6baf21d4bf logebd6c08windows done reportFlashman4/agent-de36c51
jb_201d11663c1616df logebd6c08steamdeck cancelled—0 the PR was closed
jb_3c76b952fc1bb597 logebd6c08windows done build-baseHidden tester1
jb_ee2ee82dc9272e7d loga35e5edany done build-baseCubanLegend/agent-3419242 report: the farm refused the report: the coordinator answered HTTP 400 (BadRequest): {"error":"report.rules[4].status must be one of pass, fail, unsupported, skipped, mismatch"}
jb_b08075b1bd1e2ae5 loga35e5edany done build-baseHidden tester1