Created
November 15, 2023 19:19
-
-
Save erfanium/61c3f282a0996d8f41459a34b4a5d225 to your computer and use it in GitHub Desktop.
Simple benchmark script for tabby
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| npx autocannon \ | |
| -m POST \ | |
| --header 'Content-Type: application/json' \ | |
| -c 5 \ | |
| --duration 60 \ | |
| --body '{"language":"python","segments":{"prefix":"def binarySearch(arr, left, right, x):\\n mid = (left +", "suffix": ""}}' \ | |
| http://localhost:8080/v1/completions |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment