Skip to content

Instantly share code, notes, and snippets.

@jwmatthews
Last active May 28, 2026 19:36
Show Gist options
  • Select an option

  • Save jwmatthews/610c7ad2a69f17fc85f37b41fbaca1b4 to your computer and use it in GitHub Desktop.

Select an option

Save jwmatthews/610c7ad2a69f17fc85f37b41fbaca1b4 to your computer and use it in GitHub Desktop.

Testing Zip File with quipucords-ui


git@github.com:jwmatthews/quipucords-ui.git
cd quipucords-ui
git checkout original_2.1.0

$ time ./run.sh --migrate ./quipucords-ui --base-branch original_2.1.0 --non-interactive
[INFO]  Using pre-packaged rules
[INFO]  Base branch: original_2.1.0
[INFO]  Creating migration branch: semver/goose/052826-1545
Already on 'original_2.1.0'
Your branch is up to date with 'origin/original_2.1.0'.
Switched to a new branch 'semver/goose/052826-1545'
[INFO]  Project:   /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/quipucords-ui
[INFO]  Branch:    semver/goose/052826-1545
[INFO]  Rules:     /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/rules
[INFO]  Agent:     goose
[INFO]  Temp dir:  /var/folders/4c/970lt3wx2kj653cfmt7xxrpc0000gn/T//pf-migrate.Wx4LOQ

[STEP 1/8] Generating provider settings

[STEP 2/8] Starting frontend-analyzer-provider
[INFO]  Running '/Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/bin/frontend-analyzer-provider serve -p 9002'
[INFO]  frontend-analyzer-provider started (PID 44970, port 9002)

[STEP 3/8] Running kantra analysis
[INFO]  Running '/Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/.kantra/kantra analyze --input /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/quipucords-ui --output /var/folders/4c/970lt3wx2kj653cfmt7xxrpc0000gn/T//pf-migrate.Wx4LOQ/kantra --rules /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/rules --override-provider-settings /var/folders/4c/970lt3wx2kj653cfmt7xxrpc0000gn/T//pf-migrate.Wx4LOQ/provider_settings.json --enable-default-rulesets=false --run-local --overwrite'
[INFO]  Follow logs: tail -f /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/logs/20260528T154552/kantra.log
[INFO]  Kantra analysis complete (0m08s)

[STEP 4/8] Stopping frontend-analyzer-provider
[INFO]  frontend-analyzer-provider stopped

[STEP 5/8] Converting kantra output to JSON
[INFO]  Converted: /var/folders/4c/970lt3wx2kj653cfmt7xxrpc0000gn/T//pf-migrate.Wx4LOQ/kantra/output.json

[STEP 6/8] Applying pattern-based fixes
[INFO]  Running 'unbuffer /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/bin/fix-engine-cli fix /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/quipucords-ui --input /var/folders/4c/970lt3wx2kj653cfmt7xxrpc0000gn/T//pf-migrate.Wx4LOQ/kantra/output.json --log-dir /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/logs/20260528T154552/fix-debug --strategies /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/rules/topology/fix-guidance/fix-strategies.json --strategies /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/rules/patternfly/fix-guidance/fix-strategies.json --strategies /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/rules/rcg/fix-guidance/fix-strategies.json --strategies /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/rules/sdk/fix-guidance/fix-strategies.json --strategies /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/rules/react-types/fix-guidance/fix-strategies.json'
[INFO]  Follow logs: tail -f /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/logs/20260528T154552/fix-pattern.log
[INFO]  Pattern-based fixes complete (0m01s)

[STEP 7/8] Applying LLM-based fixes
[INFO]  Running 'unbuffer /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/bin/fix-engine-cli fix /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/quipucords-ui --input /var/folders/4c/970lt3wx2kj653cfmt7xxrpc0000gn/T//pf-migrate.Wx4LOQ/kantra/output.json --llm-provider goose --goose-timeout 300 --log-dir /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/logs/20260528T154552/fix-debug --strategies /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/rules/topology/fix-guidance/fix-strategies.json --strategies /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/rules/patternfly/fix-guidance/fix-strategies.json --strategies /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/rules/rcg/fix-guidance/fix-strategies.json --strategies /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/rules/sdk/fix-guidance/fix-strategies.json --strategies /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/rules/react-types/fix-guidance/fix-strategies.json'
[INFO]  Follow logs: tail -f /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/logs/20260528T154552/fix-llm.log
[INFO]  LLM-based fixes complete (49m37s)
[INFO]  Committed automated fixes

[STEP 8/8] Running goose for remaining fixes
[INFO]  Running 'env GOOSE_MODE=auto goose run -i /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/prompt.md'
[INFO]  Follow logs: tail -f /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/logs/20260528T154552/agent-goose.log
[INFO]  Goose agent complete (9m32s)
[INFO]  Committed AI agent fixes
[INFO]  Stats written to: /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/quipucords-ui/.pf-migration/stats.json

[INFO]  Migration complete!
[INFO]  Project: /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/quipucords-ui
[INFO]  Kantra output: /var/folders/4c/970lt3wx2kj653cfmt7xxrpc0000gn/T//pf-migrate.Wx4LOQ/kantra/
[INFO]  Logs: /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/logs/20260528T154552/
[INFO]  Total runtime: 59m21s

real    59m20.335s
user    13m37.385s
sys     5m43.146s

Run eval


 $ time ./eval.sh --migrate ./quipucords-ui --base-branch original_2.1.0 --branch semver/goose/052826-1545 --non-interactive
[INFO]  Project:    /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/quipucords-ui
[INFO]  Base:       original_2.1.0
[INFO]  Branch:     semver/goose/052826-1545
[INFO]  Agent:      goose
[INFO]  Logs:       /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/logs/20260528T165430/

[STEP 1/3] Running pf-codemods
[INFO]  Creating pf-codemods branch: pf-codemods-052826-1654
Switched to branch 'original_2.1.0'
Your branch is up to date with 'origin/original_2.1.0'.
Switched to a new branch 'pf-codemods-052826-1654'
[INFO]  Running 'npx @patternfly/pf-codemods@latest /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/quipucords-ui --v6 --fix'
[WARN]  pf-codemods exited with non-zero status. Check /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/logs/20260528T165430/pf-codemods.log
[INFO]  Committed pf-codemods changes on pf-codemods-052826-1654
Switched to branch 'semver/goose/052826-1545'

[STEP 2/3] Running evaluation agent
[INFO]  Evaluating: original_2.1.0 → pf-codemods-052826-1654 vs semver/goose/052826-1545
[INFO]  Follow logs: tail -f /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/logs/20260528T165430/eval-agent.log
[INFO]  Running 'GOOSE_MODE=auto goose run -i /var/folders/4c/970lt3wx2kj653cfmt7xxrpc0000gn/T//pf-eval.qZ4WtX/eval_prompt.md'
[INFO]  Injecting migration stats into report
[INFO]  Evaluation report: /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/logs/20260528T165430/pf-migration-comparison-report.html

[STEP 3/3] Cleaning up
[INFO]  Deleted pf-codemods branch: pf-codemods-052826-1654

[INFO]  Evaluation complete!
[INFO]  Project: /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/quipucords-ui
[INFO]  Logs: /Users/jmatthews/synced/semver_example_runs/2026_05_28_updates_rebased/patternfly-tools/logs/20260528T165430/
[INFO]  Total eval runtime: 16m45s
./eval.sh --migrate ./quipucords-ui --base-branch original_2.1.0 --branch    506.27s user 149.84s system 65% cpu 16:44.27 total

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment