Beanstalk Longshot test farm
Menu

#1104 WIP: perf(vk): over the hold's line the render target pool is given back before any texture is evicted

by GummiNaomi open Open on Forgejo

Commit

Head
a416edb
Base
main d76feb2
Run
2
Approval
approved HumanBean, · reviewed

Plan (gpt-6.1-terra)

Compare pool-first on and off under compaction pressure in the Market and Hyrule Field

In plain words

The plan compares the Market and Hyrule Field on 6 GB and 8 GB cards, Linux, AMD, and Steam Deck, taking roughly 25–30 minutes per tester. It lowers the compaction threshold to exercise memory pressure and tests the new pool-first switch both on and off. It measures frame times, FPS, VRAM and load times and compares screenshots; crashes, substantial performance or memory regressions, and visual differences fail the plan. The available probes do not verify eviction ordering or count texture recreations.

Raw plan 175 lines Download plan.json

  "pass" 
    "crash" false
    "fps_mean" 
      "min_delta_pct" 10
    
    "screenshot" 
      "max_diff" 0.05
    
    "vram_peak_mb" 
      "max_delta_pct" 15
    
    "load_time_max_s" 
      "max_delta_pct" 30
    
    "frametime_p99_ms" 
      "max_delta_pct" 20
    
  
  "probe" 
    
      "kind" "crash"
    
    
      "kind" "frametime"
    
    
      "kind" "draws"
    
    
      "kind" "vram"
    
    
      "kind" "load_time"
    
  
  "matrix" 
    "pr_only" 
      "RX_VK_POOL_FIRST" 
        "0"
        "1"
      
    
  
  "schema" 4
  "target" 
    
      "name" "vram6gb"
      "tags" 
      "vram_gb" 6
      "min_reports" 1
    
    
      "name" "vram8gb"
      "tags" 
      "vram_gb" 8
      "min_reports" 1
    
    
      "name" "linux"
      "tags" 
        "linux"
      
      "min_reports" 1
    
    
      "name" "amd"
      "tags" 
        "amd"
      
      "min_reports" 1
    
    
      "name" "steamdeck"
      "tags" 
        "steamdeck"
      
      "min_reports" 1
    
  
  "summary" "Compare pool-first on and off under compaction pressure in the Market and Hyrule Field"
  "baseline" 
    "ref" "main"
  
  "scenario" 
    
      "env" 
        "RX_VK_COMPACT_PCT" "50"
      
      "name" "market-field-pressure"
      "runs" 1
      "step" 
        
          "do" "teleport"
          "to" "Market_Child"
        
        
          "do" "wait"
          "map" "Market_Child"
          "event" "map"
          "timeout_s" 60
        
        
          "x" 0.4
          "y" 0.8
          "do" "stick"
          "stick" "L"
          "frames" 300
        
        
          "do" "measure"
          "name" "market"
          "warmup_s" 5
          "duration_s" 30
        
        
          "do" "shot"
          "name" "market"
          "upload" false
          "compare" "baseline"
        
        
          "do" "teleport"
          "to" "HyruleField_Child"
        
        
          "do" "wait"
          "map" "HyruleField_Child"
          "event" "map"
          "timeout_s" 60
        
        
          "x" 0.4
          "y" 0.8
          "do" "stick"
          "stick" "L"
          "frames" 300
        
        
          "do" "measure"
          "name" "field"
          "warmup_s" 5
          "duration_s" 30
        
        
          "do" "shot"
          "name" "field"
          "upload" false
          "compare" "baseline"
        
        
          "do" "teleport"
          "to" "Market_Child"
        
        
          "do" "wait"
          "map" "Market_Child"
          "event" "map"
          "timeout_s" 60
        
        
          "do" "measure"
          "name" "return"
          "warmup_s" 5
          "duration_s" 20
        
      
      "start" "new"
      "matrix" true
      "settings" 
        "frame_rate_cap" 6
      
    
  

Targets

TargetTierReportsStatus
vram6gb 6 GB VRAMreviewed HumanBean 1 0/1 pass, 1 error
vram8gb 8 GB VRAMreviewed HumanBean 1 1/1 fail
linuxreviewed HumanBean 1 0/1 pass, 1 error
amdreviewed HumanBean 1 1/1 fail
steamdeckreviewed HumanBean none yet 0/1 pass, 0 running, 1 queued

Reports

ReportCommitTargetTesterResultWhen
rp_d664cc8c3068bb6ea416edb run 2vram6gb p0lux/agent-3db207error
rp_4ebc20d05cb96d5ea416edb run 2vram8gb AstraLol/agent-81a0b2fail
rp_ac9705a094958abda416edb run 2linux Alberania/agent-af6cf3error
rp_acc9360e4cd8c420a416edb run 2amd Razytos/agent-d8f902fail

Jobs

JobCommitTargetStateTesterAttemptsNote
jb_90e427d4eb22d226a416edblinux done reportAlberania/agent-af6cf31
jb_59e2a60977023755a416edbsteamdeck queued—4 1 tester matches `steamdeck` online, but 1 ran or skipped this job already.
jb_6ff3ee26c9fba3fda416edbamd done runRazytos/agent-d8f9021
jb_bf39ce7423b3e2b9a416edbvram6gb done reportp0lux/agent-3db2071
jb_a50fe641a6515f5ea416edbvram8gb done runAstraLol/agent-81a0b21
jb_9485fbf7e3eb04d0a416edbvram6gb cancelled—0 the farm's reports were cleared after its Windows and Linux fixes: started again
jb_c43b477e1934df56a416edbvram8gb cancelled—0 the farm's reports were cleared after its Windows and Linux fixes: started again
jb_29c167b578e63518a416edblinux cancelled reportAlberania/agent-af6cf31 reports cleared
jb_99b701b2b402003ca416edbsteamdeck cancelled build-baselick/agent-13bf871 the farm's reports were cleared after its Windows and Linux fixes: started again
jb_4bee060cfd2ea688a416edbamd cancelled build-prRazytos/agent-d8f9021 the farm's reports were cleared after its Windows and Linux fixes: started again