Beanstalk Longshot test farm
Menu

#1701 perf(vk): the texture pipelines made before the game, through the pipeline cache

by HumanBean closed Open on Forgejo

Commit

Head
d60f91b
Base
main 09cbdd9
Approval
approved HumanBean, · reviewed

Plan (gpt-6.1-terra)

Compare texture pipeline startup and Market rendering against main

In plain words

The plan compares startup and Market gameplay on main and the PR, including texture appearance, shader preparation, load time and frame pacing. It takes about 20 minutes per tester and fails on crashes, converter failure logs, large ASTC upload stalls, visible differences or specified performance regressions. Driver caches are not cleared by the plan, so it cannot guarantee a cold-cache first-start test.

Raw plan 101 lines Download plan.json

  "pass" 
    "crash" false
    "screenshot" 
      "max_diff" 0.05
    
    "boot_time_s" 
      "max_delta_pct" 25
    
    "load_time_max_s" 
      "max_delta_pct" 25
    
    "frametime_p99_ms" 
      "max_delta_pct" 20
    
    "log_forbidden_hits" 
      "max" 0
    
  
  "probe" 
    
      "kind" "crash"
    
    
      "kind" "boot_time"
    
    
      "kind" "load_time"
    
    
      "kind" "shader_compile"
    
    
      "kind" "frametime"
    
    
      "kind" "log_match"
      "expected" 
      "forbidden" 
        "texture pipelines made before the game.*(ASTC decoder no|BC encoder no|GPU unswizzle no)"
        "slow upload ([5-9][0-9]|[1-9][0-9][0-9]+)(\\.[0-9]+)? ms.*ASTC"
        "vk: device lost"
      
    
  
  "matrix" 
  "schema" 3
  "target" 
    
      "name" "any"
      "tags" 
      "max_reports" 2
      "min_reports" 1
    
  
  "summary" "Compare texture pipeline startup and Market rendering against main"
  "baseline" 
    "ref" "main"
  
  "scenario" 
    
      "env" 
      "name" "market-textures"
      "runs" 2
      "step" 
        
          "do" "teleport"
          "to" "Market_Child"
        
        
          "do" "wait"
          "map" "Market_Child"
          "event" "map"
          "timeout_s" 120
        
        
          "do" "shot"
          "name" "market"
          "upload" false
          "compare" "baseline"
        
        
          "x" 0.0
          "y" 1.0
          "do" "stick"
          "stick" "L"
          "frames" 120
        
        
          "do" "measure"
          "name" "market"
          "warmup_s" 5
          "duration_s" 20
        
      
      "start" "save:kokiri-start"
      "matrix" true
      "settings" 
    
  

Targets

TargetTierReportsStatus
anyreviewed HumanBean 1 2 0/1 pass, 2 error

Reports

ReportCommitTargetTesterResultWhen
rp_c1c3e5dd82109ba3d60f91bany Alberania/agent-af6cf3error
rp_5a8152a6aa30630ad60f91bany Hidden testererror

Jobs

JobCommitTargetStateTesterStartedAttemptsEstimateNote
jb_b9a8eef18eb01c65 logd60f91bany done build-baseHidden tester2 setup: Could not access your .nup file: it is not where it was. Check that the file is still there, reconnect its drive if needed, or choose it again in Settings.
jb_c775959d189dd644 logd60f91bany done reportAlberania/agent-af6cf32 setup: Could not access your .nup file: it is not where it was. Check that the file is still there, reconnect its drive if needed, or choose it again in Settings.