Beanstalk Longshot test farm
Menu

#1775 docs(perf): the player guide says the game sends the performance batches, not the launcher

by mooki open Open on Forgejo

Commit

Head
8be546f
Base
main 068fb8e
Approval
approved mooki, · reviewed

Plan (gpt-6.1-terra)

Title-screen smoke test for a documentation-only change

In plain words

This documentation-only change cannot be verified by a gameplay test. A short title-screen smoke test compares startup time and appearance with main, taking about 10 minutes per tester. A crash, a startup-time increase over 20%, or a substantial screenshot difference fails the plan; it does not check the corrected documentation or telemetry behavior.

Raw plan 60 lines Download plan.json

  "pass" 
    "crash" false
    "screenshot" 
      "max_diff" 0.1
    
    "boot_time_s" 
      "max_delta_pct" 20
    
  
  "probe" 
    
      "kind" "crash"
    
    
      "kind" "boot_time"
    
  
  "matrix" 
  "schema" 3
  "target" 
    
      "name" "any"
      "tags" 
      "max_reports" 2
      "min_reports" 1
    
  
  "summary" "Title-screen smoke test for a documentation-only change"
  "baseline" 
    "ref" "main"
  
  "scenario" 
    
      "env" 
      "name" "title-smoke"
      "runs" 1
      "step" 
        
          "do" "wait"
          "event" "present"
          "timeout_s" 600
        
        
          "do" "wait_s"
          "seconds" 5
        
        
          "do" "shot"
          "name" "title"
          "upload" false
          "compare" "baseline"
        
      
      "start" "title"
      "matrix" true
      "settings" 
    
  

Targets

TargetTierReportsStatus
anyreviewed mooki 1 2 1/1 pass

Reports

ReportCommitTargetTesterResultWhen
rp_a8f77d6509134d238be546fany Samsheperd/agent-a9f512pass
rp_423cf4bbaee6336f8be546fany Hidden testererror
rp_d1543c424533e708e0a69cbany thebasedpisces/agent-8d2999pass
rp_4cf0df4af73ad5ade0a69cbany Hidden testererror

Jobs

JobCommitTargetStateTesterStartedAttemptsEstimateNote
jb_163864e2c25ecfff log8be546fany done build-baseHidden tester1
jb_ebd933f1a9f65adc log8be546fany done reportSamsheperd/agent-a9f5122 prefetch: less than 30.0 GB free on the work folder's disk
jb_cb70f5ecbe37c4bf loge0a69cbany done build-baseHidden tester2 passing, tried again: fetch: git clone failed: Cloning into '<data>\longshot'... fatal: unable to access 'https://git.magicbean.dev/MagicBeanDev/Longshot.git/': schannel: next InitializeSecurityContext failed: CRYPT_E_REVOCATION_OFFLINE (0x80092013) - The revocation function was unable to check revocation because the revocation server was offline. (tried 4 times)
jb_1ac7e0651e0676dc loge0a69cbany done runthebasedpisces/agent-8d29992 prefetch: less than 30.0 GB free on the work folder's disk