Beanstalk Longshot test farm
Menu

#1702 perf(vk): the presenter thread on by default with NVIDIA on Linux and AMD on Windows, with NVIDIA Reflex; after #1121

by HumanBean closed Open on Forgejo

Commit

Head
28f5fb2
Base
main d5794c8
Approval
approved HumanBean, · reviewed

Plan (gpt-6.1-terra)

Windows AMD and NVIDIA presenter defaults and uncapped FPS in Kokiri Forest and Market

In plain words

Compare the PR with main on Windows AMD and NVIDIA PCs, with V-Sync off and the frame rate uncapped. Each of two starts per side visits Kokiri Forest and Castle Town Market, measuring 15 seconds standing and 10 seconds after moving at each location; the run takes about 22 minutes per tester. The PR fails on a crash, device loss, a sampled picture difference, or FPS below main in any segment. The log check accepts either requested presenter-thread message, but cannot enforce the AMD and NVIDIA expectations separately in one shared plan.

Asked for

run 5, again for the new head 28f5fb2 (the same code: #1121 now sits under it as its own PR; run 4 failed because main did not build on Windows, fixed by #1729). The last commit turns the presenter thread on by default with AMD's Windows driver on a discrete card. Please test this PR against main on windows+amd and windows+nvidia, settings vsync=2 (Off) and frame_rate_cap=6 (Uncapped), no switches: Kokiri Forest and Castle Town Market, standing 15 s and 10 s after moving, two game starts a side. Expect `vk: presenter thread: each present made on a thread` in the log on AMD and `off (RX_VK_PRESENT_THREAD=1: on)` on NVIDIA, and fps at least main's on both.

Raw plan 148 lines Download plan.json

  "pass" 
    "crash" false
    "fps_mean" 
      "min_delta_pct" 0
    
    "screenshot" 
      "max_diff" 0.2
    
    "log_forbidden_hits" 
      "max" 0
    
    "log_expected_missing" 
      "max" 0
    
  
  "probe" 
    
      "kind" "crash"
    
    
      "kind" "draws"
    
    
      "kind" "frametime"
    
    
      "kind" "log_match"
      "expected" 
        "vk: presenter thread: each present made on a thread|off \\(RX_VK_PRESENT_THREAD=1: on\\)"
      
      "forbidden" 
        "vk: device lost"
      
    
  
  "matrix" 
  "schema" 3
  "target" 
    
      "name" "windows+amd"
      "tags" 
        "windows"
        "amd"
      
      "max_reports" 2
      "min_reports" 1
    
    
      "name" "windows+nvidia"
      "tags" 
        "windows"
        "nvidia"
      
      "max_reports" 2
      "min_reports" 1
    
  
  "summary" "Windows AMD and NVIDIA presenter defaults and uncapped FPS in Kokiri Forest and Market"
  "baseline" 
    "ref" "main"
  
  "scenario" 
    
      "env" 
      "name" "forest-and-market"
      "runs" 2
      "step" 
        
          "do" "teleport"
          "to" "KokiriForest_Child"
        
        
          "do" "wait"
          "map" "KokiriForest_Child"
          "event" "map"
          "timeout_s" 60
        
        
          "do" "measure"
          "name" "forest-standing"
          "warmup_s" 5
          "duration_s" 15
        
        
          "do" "shot"
          "name" "forest"
          "upload" false
          "compare" "baseline"
        
        
          "x" 0
          "y" 1
          "do" "stick"
          "stick" "L"
          "frames" 150
        
        
          "do" "measure"
          "name" "forest-after-moving"
          "warmup_s" 0
          "duration_s" 10
        
        
          "do" "teleport"
          "to" "Market_Child"
        
        
          "do" "wait"
          "map" "Market_Child"
          "event" "map"
          "timeout_s" 60
        
        
          "do" "measure"
          "name" "market-standing"
          "warmup_s" 5
          "duration_s" 15
        
        
          "do" "shot"
          "name" "market"
          "upload" false
          "compare" "baseline"
        
        
          "x" 0
          "y" 1
          "do" "stick"
          "stick" "L"
          "frames" 150
        
        
          "do" "measure"
          "name" "market-after-moving"
          "warmup_s" 0
          "duration_s" 10
        
      
      "start" "save:kokiri-start"
      "matrix" true
      "settings" 
        "vsync" 2
        "frame_rate_cap" 6
      
    
  

Targets

TargetTierReportsStatus
windows+amdreviewed HumanBean 1 2 0/1 pass, 2 error
windows+nvidiareviewed HumanBean 1 2 1/1 fail

Reports

ReportCommitTargetTesterResultWhen
rp_5708eb072282d27528f5fb2windows+amd Hidden testererror
rp_2eacdc0f799b5a3f28f5fb2windows+nvidia Flashman4/agent-de36c5fail
rp_62086cc2465d0a5228f5fb2windows+amd KellDraygo/agent-eb6ce1error
rp_a48e5b8e6cc573a328f5fb2windows+nvidia Hidden testererror
rp_a9eacb65ac1b432d0c38084windows+amd Razytos/agent-d8f902error
rp_4bc7ec755cfe900b0c38084windows+amd Hidden testererror
rp_ac9de19fc07f21980c38084windows+nvidia Flashman4/agent-de36c5error
rp_2481870588f0935e0c38084windows+nvidia Hidden testererror
rp_531e9a2b3e65ed163569b8d run 3linux+amd Flashman4/agent-0e17b1fail outlier
rp_d5204a53a6df66573569b8d run 3steamdeck Flashman4/agent-0e17b1fail
rp_6f75df0f318b29e53569b8d run 3windows+nvidia Flashman4/agent-de36c5fail
rp_01c20b8226d7940d3569b8d run 3windows+amd Hidden testerfail outlier
rp_4af36d408d9304cf3569b8d run 3windows+amd Razytos/agent-d8f902fail outlier
rp_8fdadaaac118fe303569b8d run 3linux+amd Alberania/agent-af6cf3fail outlier
rp_89160c60ed6b579c3569b8d run 3windows+nvidia Hidden testererror
rp_dabcf9c0a1af52643569b8d run 2windows+nvidia thebasedpisces/agent-8d2999fail
rp_c45a1107923a365f3569b8d run 2windows+amd Razytos/agent-d8f902fail
rp_446ffb6b133f1a623569b8d run 2linux+amd Alberania/agent-af6cf3fail
rp_5009f0f6831439553569b8d run 2windows+amd Hidden testerfail
rp_3bdfd674e0a160093569b8d run 2windows+nvidia Hidden testererror
rp_a65df7e54289f5a33569b8dwindows+amd Hidden testerfail

Jobs

JobCommitTargetStateTesterStartedAttemptsEstimateNote
jb_718419a9177a120e log28f5fb2windows+amd done build-baseHidden tester4 setup: Could not access your .nup file: it is not where it was. Check that the file is still there, reconnect its drive if needed, or choose it again in Settings.
jb_6f071b862296e2d8 log28f5fb2windows+nvidia done reportFlashman4/agent-de36c51
jb_a872aab13df2d891 log28f5fb2windows+amd done build-baseKellDraygo/agent-eb6ce12 prefetch: less than 30.0 GB free on the work folder's disk
jb_9a8b98e7f4e07b45 log28f5fb2windows+nvidia done build-baseHidden tester1
jb_1bbe2605ec57dfc6 log0c38084linux+intel off target cancelled runHidden tester1 superseded by a new push
jb_292a7ee1aa3485ff log0c38084windows+amd done build-baseHidden tester1
jb_a6591fcec6a32a2b log0c38084windows+amd done build-baseRazytos/agent-d8f9021
jb_1c49bec199482b42 log0c38084windows+nvidia done reportHidden tester1
jb_58e60feb3e2f04bb log0c38084windows+intel cancelled—0 superseded by a new push
jb_73e630c0f5a45433 log0c38084windows+intel cancelled—0 superseded by a new push
jb_ba3830f6fd125b75 log0c38084linux+intel cancelled—0 superseded by a new push
jb_fdd6cda28075b59f log0c38084linux+intel cancelled—0 superseded by a new push
jb_0acb1454c1536934 log0c38084windows+nvidia done build-baseFlashman4/agent-de36c51
jb_bc8d4519913a502e log3569b8dlinux+intel off target cancelled runHidden tester1 superseded by a new push
jb_851f27ea93d33d4c log3569b8dwindows+intel cancelled—0 superseded by a new push
jb_11821ba923ef1fe4 log3569b8dwindows+intel cancelled—0 superseded by a new push
jb_766e98034e59f0eb log3569b8dlinux+intel cancelled—0 superseded by a new push
jb_834d0ef914da105f log3569b8dsteamdeck cancelled—0 superseded by a new push
jb_7baf6cb3498b8021 log3569b8dlinux+intel cancelled—0 superseded by a new push
jb_4d3201ae8b3f88e6 log3569b8dwindows+nvidia done build-baseHidden tester1
jb_23d863037c761b45 log3569b8dwindows+nvidia done reportFlashman4/agent-de36c51
jb_9b21cc79f76459e4 log3569b8dlinux+amd done reportAlberania/agent-af6cf31
jb_e9152b3953bb4fdf log3569b8dwindows+amd done reportHidden tester2 passing, tried again: prefetch: the agent failed: WinError: SetNamedSecurityInfoW (the low integrity label on <data>\game-home): error 5 (0x5, Access is denied)
jb_101a46b59d131cc3 log3569b8dsteamdeck done reportFlashman4/agent-0e17b11
jb_61e3e57de4276cbf log3569b8dlinux+amd done reportFlashman4/agent-0e17b11
jb_cad9d677c60f0b82 log3569b8dwindows+amd done reportRazytos/agent-d8f9021
jb_61d1ebddb5d78ce8 log3569b8dlinux+amd done reportAlberania/agent-af6cf31
jb_95407821d646906a log3569b8dlinux+amd cancelled—0 re-planned by HumanBean
jb_c0cc1fb54b4fc1ac log3569b8dwindows+nvidia done reportthebasedpisces/agent-8d29991
jb_b769d6a826659138 log3569b8dwindows+nvidia done build-baseHidden tester1
jb_c16c2b9cff0394b5 log3569b8dwindows+amd done reportHidden tester1
jb_9465ac03f6c5dcbb log3569b8dwindows+amd done reportRazytos/agent-d8f9021
jb_6786ebf40de892b0 log3569b8dwindows+amd cancelled—0 re-planned by HumanBean
jb_0a8dd1d22c9c6446 log3569b8dwindows+amd done reportHidden tester1