Beanstalk Longshot test farm
Menu

#1574 perf(vk): RX_VK_ACQUIRE_AHEAD=1 asks for the window's next image right after a present, so the render thread no longer waits for it (off by default)

by klimovich008 open Open on Forgejo

Commit

Head
2f24a49
Base
main 430eef4
Approval
approved futondestroyer, · reviewed

Plan (gpt-6.1-terra)

Compare Hyrule Field presentation with acquire-ahead off and on

In plain words

On NVIDIA, Intel, Linux and Steam Deck PCs, the plan compares main and the PR in Hyrule Field for three minutes per run, with acquire-ahead off and on. It measures FPS, frame times and hitches, compares still images, and fails on lower FPS, crashes, device-loss or fatal GPU-hang logs. Intel and Steam Deck targets will wait for matching testers. The headless farm cannot cover and uncover a desktop window, verify repeated frames throughout a run, or enforce the requested per-present wait and threaded-rendering log details. No tester online now matches intel, steamdeck: those targets wait for one.

Asked for

nvidia, intel, linux, steamdeck: in Hyrule Field, in a window, with V-Sync Off and frame generation off, play 3 minutes without the switch, then 3 minutes with `RX_VK_ACQUIRE_AHEAD=1` in `longshot_env.txt`, and post both runs' fps, your Threaded rendering setting, the switch run's `vk: the window's image (600 presents)` lines, and with Threaded rendering on both runs' `vk: the render thread (600 presents ...)` lines. Expect with the switch: `acquire ahead: on` in the log, the window's image waited for near 0 ms a present, fps not lower. On Linux, also cover the window with another one for 40 s, then uncover it: frames must come back. Fail on a hang, a crash, a lost device, flashing or repeated frames, lower fps, or error lines in the log.

Raw plan 154 lines Download plan.json

  "pass" 
    "crash" false
    "fps_mean" 
      "min_delta_pct" 0
    
    "screenshot" 
      "max_diff" 0.05
    
    "log_forbidden_hits" 
      "max" 0
    
  
  "probe" 
    
      "kind" "crash"
    
    
      "kind" "draws"
    
    
      "kind" "frametime"
    
    
      "kind" "log_match"
      "expected" 
      "forbidden" 
        "vk: device lost"
        "vk: FATAL"
        "VK_ERROR_DEVICE_LOST"
      
    
  
  "matrix" 
    "pr_only" 
      "RX_VK_ACQUIRE_AHEAD" 
        "1"
      
    
  
  "schema" 3
  "target" 
    
      "name" "nvidia"
      "tags" 
        "nvidia"
      
      "max_reports" 2
      "min_reports" 1
    
    
      "name" "intel"
      "tags" 
        "intel"
      
      "max_reports" 2
      "min_reports" 1
    
    
      "name" "linux"
      "tags" 
        "linux"
      
      "max_reports" 2
      "min_reports" 1
    
    
      "name" "steamdeck"
      "tags" 
        "steamdeck"
      
      "max_reports" 2
      "min_reports" 1
    
  
  "summary" "Compare Hyrule Field presentation with acquire-ahead off and on"
  "baseline" 
    "ref" "main"
  
  "scenario" 
    
      "env" 
      "name" "field-default"
      "runs" 1
      "step" 
        
          "do" "teleport"
          "to" "HyruleField_Child"
        
        
          "do" "wait"
          "map" "HyruleField_Child"
          "event" "map"
          "timeout_s" 60
        
        
          "do" "shot"
          "name" "field-default"
          "upload" false
          "compare" "baseline"
        
        
          "do" "measure"
          "name" "field"
          "warmup_s" 10
          "duration_s" 180
        
      
      "start" "new"
      "matrix" false
      "settings" 
        "vsync" 2
        "fullscreen" 0
        "frame_generation" 0
      
    
    
      "env" 
      "name" "field-acquire-ahead"
      "runs" 1
      "step" 
        
          "do" "teleport"
          "to" "HyruleField_Child"
        
        
          "do" "wait"
          "map" "HyruleField_Child"
          "event" "map"
          "timeout_s" 60
        
        
          "do" "shot"
          "name" "field-ahead"
          "upload" false
          "compare" "baseline"
        
        
          "do" "measure"
          "name" "field"
          "warmup_s" 10
          "duration_s" 180
        
      
      "start" "new"
      "matrix" true
      "settings" 
        "vsync" 2
        "fullscreen" 0
        "frame_generation" 0
      
    
  

Targets

TargetTierReportsStatus
nvidiareviewed futondestroyer 1 2 1/1 fail
intelreviewed futondestroyer none yet 0/1 pass, 0 running, 2 queued
linuxreviewed futondestroyer 1 2 1/1 pass
steamdeckreviewed futondestroyer none yet 0/1 pass, 0 running, 2 queued

Reports

ReportCommitTargetTesterResultWhen
rp_b854f1dd81aaa1432f24a49nvidia jabbaxipil/Blainepass outlier
rp_903bc676955bce4a2f24a49linux DuckNintendo/linux-4090error
rp_8db0f25f3bc6c7402f24a49nvidia Flashman4/agent-de36c5fail outlier
rp_bb166040791326c52f24a49linux jabbaxipil/Blainepass

Jobs

Estimate: done in about 1 h 15 min, from the queue and the testers online now; some jobs can't start yet.

JobCommitTargetStateTesterStartedAttemptsEstimateNote
jb_5fa46ca7a3e8df31 log2f24a49linux done runDuckNintendo/linux-40901
jb_74a33c7cad23ddca log2f24a49nvidia done reportjabbaxipil/Blaine7 fetch: git fetch --no-tags --quiet failed in the agent's Longshot clone (exit 128): error: insufficient permission for adding an object to repository database .git/objects fatal: failed to write object fatal: unpack-objects failed (tried 4 times)
jb_c72ea971eafc0140 log2f24a49linux done runjabbaxipil/Blaine1
jb_c5a793bbfa1a7046 log2f24a49nvidia done reportFlashman4/agent-de36c51
jb_a4fecd6d69591f672f24a49steamdeck queued—0 No tester online can take it now.1 tester matches `steamdeck` online, but 1 running another test.
jb_a41da0186ab413ce2f24a49steamdeck queued—0 starts now, done in about 1 h 15 min1 tester matches `steamdeck` online, but 1 running another test.
jb_5869b4513741ccd12f24a49intel queued—0 No tester online can take it now.No tester online matches `intel`.
jb_9ee12b2f210b0b992f24a49intel queued—0 No tester online can take it now.No tester online matches `intel`.