Beanstalk Longshot test farm
Menu

#1815 fix(menu): the Scan row's help lines end, so a Linux window starts and the menu opens again

by mooki closed Open on Forgejo

Commit

Head
7e4cf25
Base
main 0de25c3
Approval
approved mooki, · reviewed

Plan (gpt-6.1-terra)

Check menu opening, tab changes and continued presentation on Linux and Windows

In plain words

On Linux and Windows, this plan opens the menu windowlessly from the Kokiri starting save, changes tabs, closes it, and checks that presentation continues. Each tester runs one start per build, taking roughly 12 minutes; menu screenshots and frame times are compared with main. A crash, stalled presentation, menu image difference, or substantial frame-time regression fails the test; main may itself stall on Linux. The automated sequence does not press the NFC Scan row or test a physical reader.

Raw plan 98 lines Download plan.json

  "pass" 
    "crash" false
    "screenshot" 
      "max_diff" 0.05
    
    "frametime_p99_ms" 
      "max_delta_pct" 20
    
  
  "probe" 
    
      "kind" "crash"
    
    
      "kind" "frametime"
    
  
  "matrix" 
  "schema" 3
  "target" 
    
      "name" "linux"
      "tags" 
        "linux"
      
      "max_reports" 2
      "min_reports" 1
    
    
      "name" "windows"
      "tags" 
        "windows"
      
      "max_reports" 2
      "min_reports" 1
    
  
  "summary" "Check menu opening, tab changes and continued presentation on Linux and Windows"
  "baseline" 
    "ref" "main"
  
  "scenario" 
    
      "env" 
        "RX_VK_SHOT_MENU" "1"
        "RX_VK_MENU_SCRIPT" "5:INS,8:TABR,9:TABR,12:ESC"
      
      "name" "menu-presentation"
      "runs" 1
      "step" 
        
          "do" "wait"
          "event" "present"
          "timeout_s" 60
        
        
          "do" "wait_s"
          "seconds" 7
        
        
          "do" "shot"
          "name" "menu-open"
          "upload" false
          "compare" "baseline"
        
        
          "do" "wait_s"
          "seconds" 4
        
        
          "do" "shot"
          "name" "menu-tabs"
          "upload" false
          "compare" "baseline"
        
        
          "do" "wait_s"
          "seconds" 3
        
        
          "do" "wait"
          "event" "present"
          "timeout_s" 30
        
        
          "do" "measure"
          "name" "after-menu"
          "warmup_s" 0
          "duration_s" 10
        
      
      "start" "save:kokiri-start"
      "matrix" true
      "settings" 
    
  

Targets

TargetTierReportsStatus
linuxreviewed mooki 1 2 0/1 pass, 2 error
windowsreviewed mooki 1 2 1/1 pass

Reports

ReportCommitTargetTesterResultWhen
rp_4e09296d061a65d97e4cf25windows Hidden testerpass
rp_e73d0a3bbbf360cb7e4cf25windows Hidden testererror
rp_4448733bc5b849207e4cf25linux Alberania/agent-af6cf3error
rp_03ffe8b5239d06917e4cf25linux SweatyEggs69/agent-cf0be7error

Jobs

JobCommitTargetStateTesterStartedAttemptsEstimateNote
jb_7fa697c0d4055f0f log7e4cf25windows done runHidden tester1
jb_a885f9fb64bb689b log7e4cf25linux done build-baseSweatyEggs69/agent-cf0be71
jb_50aa0def21b9a56c log7e4cf25linux done build-baseAlberania/agent-af6cf31
jb_7dcf33d03a6e9ce2 log7e4cf25windows done build-baseHidden tester2 passing, tried again: fetch: git clone failed: Cloning into '<data>\longshot'... fatal: unable to access 'https://git.magicbean.dev/MagicBeanDev/Longshot.git/': schannel: next InitializeSecurityContext failed: CRYPT_E_REVOCATION_OFFLINE (0x80092013) - The revocation function was unable to check revocation because the revocation server was offline. (tried 4 times)