Created
October 14, 2025 21:38
-
-
Save sozercan/2a1f241889f0d33833a1c37889b07c66 to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| oss-gpt120b-bench-j9b29 Collecting ruamel-yaml~=0.18.12 (from aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading ruamel.yaml-0.18.15-py3-none-any.whl.metadata (25 kB) | |
| oss-gpt120b-bench-j9b29 Collecting setproctitle~=1.3.6 (from aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading setproctitle-1.3.7-cp312-cp312-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl.metadata (10 kB) | |
| oss-gpt120b-bench-j9b29 Collecting soundfile~=0.13.1 (from aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading soundfile-0.13.1-py2.py3-none-manylinux_2_28_x86_64.whl.metadata (16 kB) | |
| oss-gpt120b-bench-j9b29 Collecting textual~=5.3.0 (from aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading textual-5.3.0-py3-none-any.whl.metadata (9.1 kB) | |
| oss-gpt120b-bench-j9b29 Collecting tqdm>=4.67.1 (from aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading tqdm-4.67.1-py3-none-any.whl.metadata (57 kB) | |
| oss-gpt120b-bench-j9b29 Collecting transformers>=4.52.0 (from aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading transformers-4.57.1-py3-none-any.whl.metadata (43 kB) | |
| oss-gpt120b-bench-j9b29 Collecting uvloop~=0.21.0 (from aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading uvloop-0.21.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.9 kB) | |
| oss-gpt120b-bench-j9b29 Collecting aiohappyeyeballs>=2.5.0 (from aiohttp~=3.12.14->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading aiohappyeyeballs-2.6.1-py3-none-any.whl.metadata (5.9 kB) | |
| oss-gpt120b-bench-j9b29 Collecting aiosignal>=1.4.0 (from aiohttp~=3.12.14->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading aiosignal-1.4.0-py3-none-any.whl.metadata (3.7 kB) | |
| oss-gpt120b-bench-j9b29 Collecting attrs>=17.3.0 (from aiohttp~=3.12.14->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading attrs-25.4.0-py3-none-any.whl.metadata (10 kB) | |
| oss-gpt120b-bench-j9b29 Collecting frozenlist>=1.1.1 (from aiohttp~=3.12.14->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading frozenlist-1.8.0-cp312-cp312-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl.metadata (20 kB) | |
| oss-gpt120b-bench-j9b29 Collecting multidict<7.0,>=4.5 (from aiohttp~=3.12.14->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading multidict-6.7.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (5.3 kB) | |
| oss-gpt120b-bench-j9b29 Collecting propcache>=0.2.0 (from aiohttp~=3.12.14->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading propcache-0.4.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (13 kB) | |
| oss-gpt120b-bench-j9b29 Collecting yarl<2.0,>=1.17.0 (from aiohttp~=3.12.14->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading yarl-1.22.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (75 kB) | |
| oss-gpt120b-bench-j9b29 Collecting docstring-parser>=0.15 (from cyclopts<4,>=3->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading docstring_parser-0.17.0-py3-none-any.whl.metadata (3.5 kB) | |
| oss-gpt120b-bench-j9b29 Collecting rich-rst<2.0.0,>=1.3.1 (from cyclopts<4,>=3->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading rich_rst-1.3.2-py3-none-any.whl.metadata (6.1 kB) | |
| oss-gpt120b-bench-j9b29 Collecting anyio<5,>=3.5.0 (from openai~=1.92.2->openai[aiohttp[]~=1.92.2->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading anyio-4.11.0-py3-none-any.whl.metadata (4.1 kB) | |
| oss-gpt120b-bench-j9b29 Collecting distro<2,>=1.7.0 (from openai~=1.92.2->openai[aiohttp[]~=1.92.2->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading distro-1.9.0-py3-none-any.whl.metadata (6.8 kB) | |
| oss-gpt120b-bench-j9b29 Collecting httpx<1,>=0.23.0 (from openai~=1.92.2->openai[aiohttp[]~=1.92.2->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading httpx-0.28.1-py3-none-any.whl.metadata (7.1 kB) | |
| oss-gpt120b-bench-j9b29 Collecting jiter<1,>=0.4.0 (from openai~=1.92.2->openai[aiohttp[]~=1.92.2->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading jiter-0.11.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (5.2 kB) | |
| oss-gpt120b-bench-j9b29 Collecting sniffio (from openai~=1.92.2->openai[aiohttp[]~=1.92.2->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading sniffio-1.3.1-py3-none-any.whl.metadata (3.9 kB) | |
| oss-gpt120b-bench-j9b29 Collecting typing-extensions<5,>=4.11 (from openai~=1.92.2->openai[aiohttp[]~=1.92.2->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading typing_extensions-4.15.0-py3-none-any.whl.metadata (3.3 kB) | |
| oss-gpt120b-bench-j9b29 Collecting httpx-aiohttp>=0.1.6 (from openai[aiohttp[]~=1.92.2->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading httpx_aiohttp-0.1.8-py3-none-any.whl.metadata (2.8 kB) | |
| oss-gpt120b-bench-j9b29 Collecting python-dateutil>=2.8.2 (from pandas~=2.3.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) | |
| oss-gpt120b-bench-j9b29 Collecting pytz>=2020.1 (from pandas~=2.3.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading pytz-2025.2-py2.py3-none-any.whl.metadata (22 kB) | |
| oss-gpt120b-bench-j9b29 Collecting tzdata>=2022.7 (from pandas~=2.3.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading tzdata-2025.2-py2.py3-none-any.whl.metadata (1.4 kB) | |
| oss-gpt120b-bench-j9b29 Collecting annotated-types>=0.6.0 (from pydantic~=2.11.4->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading annotated_types-0.7.0-py3-none-any.whl.metadata (15 kB) | |
| oss-gpt120b-bench-j9b29 Collecting pydantic-core==2.33.2 (from pydantic~=2.11.4->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading pydantic_core-2.33.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.8 kB) | |
| oss-gpt120b-bench-j9b29 Collecting typing-inspection>=0.4.0 (from pydantic~=2.11.4->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading typing_inspection-0.4.2-py3-none-any.whl.metadata (2.6 kB) | |
| oss-gpt120b-bench-j9b29 Collecting python-dotenv>=0.21.0 (from pydantic-settings~=2.10.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading python_dotenv-1.1.1-py3-none-any.whl.metadata (24 kB) | |
| oss-gpt120b-bench-j9b29 Collecting markdown-it-py>=2.2.0 (from rich~=14.1.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading markdown_it_py-4.0.0-py3-none-any.whl.metadata (7.3 kB) | |
| oss-gpt120b-bench-j9b29 Collecting pygments<3.0.0,>=2.13.0 (from rich~=14.1.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading pygments-2.19.2-py3-none-any.whl.metadata (2.5 kB) | |
| oss-gpt120b-bench-j9b29 Collecting ruamel.yaml.clib>=0.2.7 (from ruamel-yaml~=0.18.12->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading ruamel.yaml.clib-0.2.14-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (3.0 kB) | |
| oss-gpt120b-bench-j9b29 Collecting cffi>=1.0 (from soundfile~=0.13.1->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading cffi-2.0.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl.metadata (2.6 kB) | |
| oss-gpt120b-bench-j9b29 Collecting platformdirs<5,>=3.6.0 (from textual~=5.3.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading platformdirs-4.5.0-py3-none-any.whl.metadata (12 kB) | |
| oss-gpt120b-bench-j9b29 Collecting filelock (from transformers>=4.52.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading filelock-3.20.0-py3-none-any.whl.metadata (2.1 kB) | |
| oss-gpt120b-bench-j9b29 Collecting huggingface-hub<1.0,>=0.34.0 (from transformers>=4.52.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading huggingface_hub-0.35.3-py3-none-any.whl.metadata (14 kB) | |
| oss-gpt120b-bench-j9b29 Collecting packaging>=20.0 (from transformers>=4.52.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Using cached packaging-25.0-py3-none-any.whl.metadata (3.3 kB) | |
| oss-gpt120b-bench-j9b29 Collecting pyyaml>=5.1 (from transformers>=4.52.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading pyyaml-6.0.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (2.4 kB) | |
| oss-gpt120b-bench-j9b29 Collecting regex!=2019.12.17 (from transformers>=4.52.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading regex-2025.9.18-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (40 kB) | |
| oss-gpt120b-bench-j9b29 Collecting requests (from transformers>=4.52.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading requests-2.32.5-py3-none-any.whl.metadata (4.9 kB) | |
| oss-gpt120b-bench-j9b29 Collecting tokenizers<=0.23.0,>=0.22.0 (from transformers>=4.52.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading tokenizers-0.22.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.8 kB) | |
| oss-gpt120b-bench-j9b29 Collecting safetensors>=0.4.3 (from transformers>=4.52.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading safetensors-0.6.2-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.1 kB) | |
| oss-gpt120b-bench-j9b29 Collecting idna>=2.8 (from anyio<5,>=3.5.0->openai~=1.92.2->openai[aiohttp[]~=1.92.2->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading idna-3.11-py3-none-any.whl.metadata (8.4 kB) | |
| oss-gpt120b-bench-j9b29 Collecting pycparser (from cffi>=1.0->soundfile~=0.13.1->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading pycparser-2.23-py3-none-any.whl.metadata (993 bytes) | |
| oss-gpt120b-bench-j9b29 Collecting certifi (from httpx<1,>=0.23.0->openai~=1.92.2->openai[aiohttp[]~=1.92.2->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading certifi-2025.10.5-py3-none-any.whl.metadata (2.5 kB) | |
| oss-gpt120b-bench-j9b29 Collecting httpcore==1.* (from httpx<1,>=0.23.0->openai~=1.92.2->openai[aiohttp[]~=1.92.2->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading httpcore-1.0.9-py3-none-any.whl.metadata (21 kB) | |
| oss-gpt120b-bench-j9b29 Collecting h11>=0.16 (from httpcore==1.*->httpx<1,>=0.23.0->openai~=1.92.2->openai[aiohttp[]~=1.92.2->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading h11-0.16.0-py3-none-any.whl.metadata (8.3 kB) | |
| oss-gpt120b-bench-j9b29 Collecting fsspec>=2023.5.0 (from huggingface-hub<1.0,>=0.34.0->transformers>=4.52.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading fsspec-2025.9.0-py3-none-any.whl.metadata (10 kB) | |
| oss-gpt120b-bench-j9b29 Collecting hf-xet<2.0.0,>=1.1.3 (from huggingface-hub<1.0,>=0.34.0->transformers>=4.52.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading hf_xet-1.1.10-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.7 kB) | |
| oss-gpt120b-bench-j9b29 Collecting mdurl~=0.1 (from markdown-it-py>=2.2.0->rich~=14.1.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading mdurl-0.1.2-py3-none-any.whl.metadata (1.6 kB) | |
| oss-gpt120b-bench-j9b29 Collecting linkify-it-py<3,>=1 (from markdown-it-py[linkify,plugins[]>=2.1.0->textual~=5.3.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading linkify_it_py-2.0.3-py3-none-any.whl.metadata (8.5 kB) | |
| oss-gpt120b-bench-j9b29 Collecting mdit-py-plugins>=0.5.0 (from markdown-it-py[linkify,plugins[]>=2.1.0->textual~=5.3.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading mdit_py_plugins-0.5.0-py3-none-any.whl.metadata (2.8 kB) | |
| oss-gpt120b-bench-j9b29 Collecting six>=1.5 (from python-dateutil>=2.8.2->pandas~=2.3.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading six-1.17.0-py2.py3-none-any.whl.metadata (1.7 kB) | |
| oss-gpt120b-bench-j9b29 Collecting docutils (from rich-rst<2.0.0,>=1.3.1->cyclopts<4,>=3->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading docutils-0.22.2-py3-none-any.whl.metadata (15 kB) | |
| oss-gpt120b-bench-j9b29 Collecting charset_normalizer<4,>=2 (from requests->transformers>=4.52.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading charset_normalizer-3.4.4-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl.metadata (37 kB) | |
| oss-gpt120b-bench-j9b29 Collecting urllib3<3,>=1.21.1 (from requests->transformers>=4.52.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading urllib3-2.5.0-py3-none-any.whl.metadata (6.5 kB) | |
| oss-gpt120b-bench-j9b29 Collecting uc-micro-py (from linkify-it-py<3,>=1->markdown-it-py[linkify,plugins[]>=2.1.0->textual~=5.3.0->aiperf==0.1.1) | |
| oss-gpt120b-bench-j9b29 Downloading uc_micro_py-1.0.3-py3-none-any.whl.metadata (2.0 kB) | |
| oss-gpt120b-bench-j9b29 Downloading aiofiles-24.1.0-py3-none-any.whl (15 kB) | |
| oss-gpt120b-bench-j9b29 Downloading aiohttp-3.12.15-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.7 MB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 23.8 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading cyclopts-3.24.0-py3-none-any.whl (86 kB) | |
| oss-gpt120b-bench-j9b29 Downloading numpy-2.2.6-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.5 MB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16.5/16.5 MB 88.2 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading openai-1.92.3-py3-none-any.whl (753 kB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 753.4/753.4 kB 74.4 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading orjson-3.10.18-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (133 kB) | |
| oss-gpt120b-bench-j9b29 Downloading pandas-2.3.3-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl (12.4 MB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.4/12.4 MB 92.4 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading pillow-11.1.0-cp312-cp312-manylinux_2_28_x86_64.whl (4.5 MB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.5/4.5 MB 101.3 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading psutil-7.0.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (277 kB) | |
| oss-gpt120b-bench-j9b29 Downloading pydantic-2.11.10-py3-none-any.whl (444 kB) | |
| oss-gpt120b-bench-j9b29 Downloading pydantic_core-2.33.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.0 MB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 139.0 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading pydantic_settings-2.10.1-py3-none-any.whl (45 kB) | |
| oss-gpt120b-bench-j9b29 Downloading pyzmq-26.4.0-cp312-cp312-manylinux_2_28_x86_64.whl (855 kB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 855.9/855.9 kB 80.7 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading rich-14.1.0-py3-none-any.whl (243 kB) | |
| oss-gpt120b-bench-j9b29 Downloading ruamel.yaml-0.18.15-py3-none-any.whl (119 kB) | |
| oss-gpt120b-bench-j9b29 Downloading setproctitle-1.3.7-cp312-cp312-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl (32 kB) | |
| oss-gpt120b-bench-j9b29 Downloading soundfile-0.13.1-py2.py3-none-manylinux_2_28_x86_64.whl (1.3 MB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 106.9 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading textual-5.3.0-py3-none-any.whl (702 kB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 702.7/702.7 kB 68.8 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading tqdm-4.67.1-py3-none-any.whl (78 kB) | |
| oss-gpt120b-bench-j9b29 Downloading transformers-4.57.1-py3-none-any.whl (12.0 MB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.0/12.0 MB 86.7 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading uvloop-0.21.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.7/4.7 MB 103.8 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading aiohappyeyeballs-2.6.1-py3-none-any.whl (15 kB) | |
| oss-gpt120b-bench-j9b29 Downloading aiosignal-1.4.0-py3-none-any.whl (7.5 kB) | |
| oss-gpt120b-bench-j9b29 Downloading annotated_types-0.7.0-py3-none-any.whl (13 kB) | |
| oss-gpt120b-bench-j9b29 Downloading anyio-4.11.0-py3-none-any.whl (109 kB) | |
| oss-gpt120b-bench-j9b29 Downloading attrs-25.4.0-py3-none-any.whl (67 kB) | |
| oss-gpt120b-bench-j9b29 Downloading cffi-2.0.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.whl (219 kB) | |
| oss-gpt120b-bench-j9b29 Downloading distro-1.9.0-py3-none-any.whl (20 kB) | |
| oss-gpt120b-bench-j9b29 Downloading docstring_parser-0.17.0-py3-none-any.whl (36 kB) | |
| oss-gpt120b-bench-j9b29 Downloading frozenlist-1.8.0-cp312-cp312-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl (242 kB) | |
| oss-gpt120b-bench-j9b29 Downloading httpx-0.28.1-py3-none-any.whl (73 kB) | |
| oss-gpt120b-bench-j9b29 Downloading httpcore-1.0.9-py3-none-any.whl (78 kB) | |
| oss-gpt120b-bench-j9b29 Downloading httpx_aiohttp-0.1.8-py3-none-any.whl (6.2 kB) | |
| oss-gpt120b-bench-j9b29 Downloading huggingface_hub-0.35.3-py3-none-any.whl (564 kB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 564.3/564.3 kB 51.1 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading jiter-0.11.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (347 kB) | |
| oss-gpt120b-bench-j9b29 Downloading markdown_it_py-4.0.0-py3-none-any.whl (87 kB) | |
| oss-gpt120b-bench-j9b29 Downloading multidict-6.7.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (256 kB) | |
| oss-gpt120b-bench-j9b29 Using cached packaging-25.0-py3-none-any.whl (66 kB) | |
| oss-gpt120b-bench-j9b29 Downloading platformdirs-4.5.0-py3-none-any.whl (18 kB) | |
| oss-gpt120b-bench-j9b29 Downloading propcache-0.4.1-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (221 kB) | |
| oss-gpt120b-bench-j9b29 Downloading pygments-2.19.2-py3-none-any.whl (1.2 MB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 110.0 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) | |
| oss-gpt120b-bench-j9b29 Downloading python_dotenv-1.1.1-py3-none-any.whl (20 kB) | |
| oss-gpt120b-bench-j9b29 Downloading pytz-2025.2-py2.py3-none-any.whl (509 kB) | |
| oss-gpt120b-bench-j9b29 Downloading pyyaml-6.0.3-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (807 kB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 807.9/807.9 kB 80.1 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading regex-2025.9.18-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (802 kB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 802.0/802.0 kB 65.3 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading rich_rst-1.3.2-py3-none-any.whl (12 kB) | |
| oss-gpt120b-bench-j9b29 Downloading ruamel.yaml.clib-0.2.14-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (753 kB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 753.1/753.1 kB 77.7 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading safetensors-0.6.2-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (485 kB) | |
| oss-gpt120b-bench-j9b29 Downloading sniffio-1.3.1-py3-none-any.whl (10 kB) | |
| oss-gpt120b-bench-j9b29 Downloading tokenizers-0.22.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.3 MB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.3/3.3 MB 84.5 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading typing_extensions-4.15.0-py3-none-any.whl (44 kB) | |
| oss-gpt120b-bench-j9b29 Downloading typing_inspection-0.4.2-py3-none-any.whl (14 kB) | |
| oss-gpt120b-bench-j9b29 Downloading tzdata-2025.2-py2.py3-none-any.whl (347 kB) | |
| oss-gpt120b-bench-j9b29 Downloading yarl-1.22.0-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (377 kB) | |
| oss-gpt120b-bench-j9b29 Downloading filelock-3.20.0-py3-none-any.whl (16 kB) | |
| oss-gpt120b-bench-j9b29 Downloading requests-2.32.5-py3-none-any.whl (64 kB) | |
| oss-gpt120b-bench-j9b29 Downloading certifi-2025.10.5-py3-none-any.whl (163 kB) | |
| oss-gpt120b-bench-j9b29 Downloading charset_normalizer-3.4.4-cp312-cp312-manylinux2014_x86_64.manylinux_2_17_x86_64.manylinux_2_28_x86_64.whl (153 kB) | |
| oss-gpt120b-bench-j9b29 Downloading fsspec-2025.9.0-py3-none-any.whl (199 kB) | |
| oss-gpt120b-bench-j9b29 Downloading hf_xet-1.1.10-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.2 MB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.2/3.2 MB 83.3 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading idna-3.11-py3-none-any.whl (71 kB) | |
| oss-gpt120b-bench-j9b29 Downloading linkify_it_py-2.0.3-py3-none-any.whl (19 kB) | |
| oss-gpt120b-bench-j9b29 Downloading mdit_py_plugins-0.5.0-py3-none-any.whl (57 kB) | |
| oss-gpt120b-bench-j9b29 Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB) | |
| oss-gpt120b-bench-j9b29 Downloading six-1.17.0-py2.py3-none-any.whl (11 kB) | |
| oss-gpt120b-bench-j9b29 Downloading urllib3-2.5.0-py3-none-any.whl (129 kB) | |
| oss-gpt120b-bench-j9b29 Downloading docutils-0.22.2-py3-none-any.whl (632 kB) | |
| oss-gpt120b-bench-j9b29 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 632.7/632.7 kB 58.0 MB/s eta 0:00:00 | |
| oss-gpt120b-bench-j9b29 Downloading pycparser-2.23-py3-none-any.whl (118 kB) | |
| oss-gpt120b-bench-j9b29 Downloading h11-0.16.0-py3-none-any.whl (37 kB) | |
| oss-gpt120b-bench-j9b29 Downloading uc_micro_py-1.0.3-py3-none-any.whl (6.2 kB) | |
| oss-gpt120b-bench-j9b29 Building wheels for collected packages: aiperf | |
| oss-gpt120b-bench-j9b29 Building wheel for aiperf (pyproject.toml): started | |
| oss-gpt120b-bench-j9b29 Building wheel for aiperf (pyproject.toml): finished with status 'done' | |
| oss-gpt120b-bench-j9b29 Created wheel for aiperf: filename=aiperf-0.1.1-py3-none-any.whl size=2801033 sha256=f2f7af06bfb8c51d116627256e7dbc59e54e1e8c2c00a47474d2447935ffa1be | |
| oss-gpt120b-bench-j9b29 Stored in directory: /root/.cache/pip/wheels/d7/a5/95/2d19f6967192cc77d1f77e497d7246d1b41c9decfb0c756dc6 | |
| oss-gpt120b-bench-j9b29 Successfully built aiperf | |
| oss-gpt120b-bench-j9b29 Installing collected packages: pytz, uvloop, urllib3, uc-micro-py, tzdata, typing-extensions, tqdm, sniffio, six, setproctitle, safetensors, ruamel.yaml.clib, regex, pyzmq, pyyaml, python-dotenv, pygments, pycparser, psutil, propcache, platformdirs, pillow, packaging, orjson, numpy, multidict, mdurl, jiter, idna, hf-xet, h11, fsspec, frozenlist, filelock, docutils, docstring-parser, distro, charset_normalizer, certifi, attrs, annotated-types, aiohappyeyeballs, aiofiles, yarl, typing-inspection, ruamel-yaml, requests, python-dateutil, pydantic-core, markdown-it-py, linkify-it-py, httpcore, cffi, anyio, aiosignal, soundfile, rich, pydantic, pandas, mdit-py-plugins, huggingface-hub, httpx, aiohttp, tokenizers, rich-rst, pydantic-settings, openai, httpx-aiohttp, transformers, textual, cyclopts, aiperf | |
| oss-gpt120b-bench-j9b29 Successfully installed aiofiles-24.1.0 aiohappyeyeballs-2.6.1 aiohttp-3.12.15 aiosignal-1.4.0 aiperf-0.1.1 annotated-types-0.7.0 anyio-4.11.0 attrs-25.4.0 certifi-2025.10.5 cffi-2.0.0 charset_normalizer-3.4.4 cyclopts-3.24.0 distro-1.9.0 docstring-parser-0.17.0 docutils-0.22.2 filelock-3.20.0 frozenlist-1.8.0 fsspec-2025.9.0 h11-0.16.0 hf-xet-1.1.10 httpcore-1.0.9 httpx-0.28.1 httpx-aiohttp-0.1.8 huggingface-hub-0.35.3 idna-3.11 jiter-0.11.0 linkify-it-py-2.0.3 markdown-it-py-4.0.0 mdit-py-plugins-0.5.0 mdurl-0.1.2 multidict-6.7.0 numpy-2.2.6 openai-1.92.3 orjson-3.10.18 packaging-25.0 pandas-2.3.3 pillow-11.1.0 platformdirs-4.5.0 propcache-0.4.1 psutil-7.0.0 pycparser-2.23 pydantic-2.11.10 pydantic-core-2.33.2 pydantic-settings-2.10.1 pygments-2.19.2 python-dateutil-2.9.0.post0 python-dotenv-1.1.1 pytz-2025.2 pyyaml-6.0.3 pyzmq-26.4.0 regex-2025.9.18 requests-2.32.5 rich-14.1.0 rich-rst-1.3.2 ruamel-yaml-0.18.15 ruamel.yaml.clib-0.2.14 safetensors-0.6.2 setproctitle-1.3.7 six-1.17.0 sniffio-1.3.1 soundfile-0.13.1 textual-5.3.0 tokenizers-0.22.1 tqdm-4.67.1 transformers-4.57.1 typing-extensions-4.15.0 typing-inspection-0.4.2 tzdata-2025.2 uc-micro-py-1.0.3 urllib3-2.5.0 uvloop-0.21.0 yarl-1.22.0 | |
| oss-gpt120b-bench-j9b29 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning. | |
| oss-gpt120b-bench-j9b29 | |
| oss-gpt120b-bench-j9b29 [notice[] A new release of pip is available: 25.0.1 -> 25.2 | |
| oss-gpt120b-bench-j9b29 [notice[] To update, run: pip install --upgrade pip | |
| oss-gpt120b-bench-j9b29 Collecting protobuf | |
| oss-gpt120b-bench-j9b29 Downloading protobuf-6.32.1-cp39-abi3-manylinux2014_x86_64.whl.metadata (593 bytes) | |
| oss-gpt120b-bench-j9b29 Downloading protobuf-6.32.1-cp39-abi3-manylinux2014_x86_64.whl (322 kB) | |
| oss-gpt120b-bench-j9b29 Installing collected packages: protobuf | |
| oss-gpt120b-bench-j9b29 Successfully installed protobuf-6.32.1 | |
| oss-gpt120b-bench-j9b29 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning. | |
| oss-gpt120b-bench-j9b29 | |
| oss-gpt120b-bench-j9b29 [notice[] A new release of pip is available: 25.0.1 -> 25.2 | |
| oss-gpt120b-bench-j9b29 [notice[] To update, run: pip install --upgrade pip | |
| oss-gpt120b-bench-j9b29 aiperf installation completed | |
| oss-gpt120b-bench-j9b29 net.ipv4.ip_local_port_range = 1024 65000 | |
| oss-gpt120b-bench-j9b29 1024 65000 | |
| oss-gpt120b-bench-j9b29 Waiting for model 'openai/gpt-oss-120b' at gpt-oss-agg-frontend:8000/v1/models (checking every 5s)... | |
| oss-gpt120b-bench-j9b29 ✅ Model 'openai/gpt-oss-120b' is now available! | |
| oss-gpt120b-bench-j9b29 Model 'openai/gpt-oss-120b' is now available! | |
| oss-gpt120b-bench-j9b29 { | |
| oss-gpt120b-bench-j9b29 "object": "list", | |
| oss-gpt120b-bench-j9b29 "data": [ | |
| oss-gpt120b-bench-j9b29 { | |
| oss-gpt120b-bench-j9b29 "id": "openai/gpt-oss-120b", | |
| oss-gpt120b-bench-j9b29 "object": "object", | |
| oss-gpt120b-bench-j9b29 "created": 1760477801, | |
| oss-gpt120b-bench-j9b29 "owned_by": "nvidia" | |
| oss-gpt120b-bench-j9b29 } | |
| oss-gpt120b-bench-j9b29 ] | |
| oss-gpt120b-bench-j9b29 } | |
| oss-gpt120b-bench-j9b29 Calculated total concurrency: 3600 (900 per GPU × 4 GPUs) | |
| oss-gpt120b-bench-j9b29 ARTIFACT_DIR: /model-cache/perf/1760477801_oss-gpt120b-bench/concurrency_3600 | |
| oss-gpt120b-bench-j9b29 21:36:42.960532 INFO Starting AIPerf System cli_runner.py:32 | |
| oss-gpt120b-bench-j9b29 21:36:45.214731 INFO Registered Record Processor (id: 'record_processor_ee828bc7') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.224772 INFO Registered Record Processor (id: 'record_processor_c4627926') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.227582 INFO Registered Worker Manager (id: 'worker_manager_86a1b435') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.230229 INFO Registered Timing Manager (id: 'timing_manager_c0555027') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.232806 INFO Registered Records Manager (id: 'records_manager_c919aef3') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.234949 INFO Registered Record Processor (id: 'record_processor_6b41cdb6') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.236936 INFO Registered Record Processor (id: 'record_processor_3d86e888') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.238868 INFO Registered Record Processor (id: 'record_processor_c91aaff1') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.240760 INFO Registered Record Processor (id: 'record_processor_79a8e0f9') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.242623 INFO Registered Record Processor (id: 'record_processor_fc9adef6') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.244740 INFO Registered Record Processor (id: 'record_processor_d2fdb839') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.246660 INFO Registered Record Processor (id: 'record_processor_b4ae8afa') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.248821 INFO Registered Record Processor (id: 'record_processor_7b5e326f') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.250949 INFO Registered Record Processor (id: 'record_processor_88e26628') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.252894 INFO Registered Record Processor (id: 'record_processor_1399eeee') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.255378 INFO Registered Record Processor (id: 'record_processor_a9672934') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.257360 INFO Registered Record Processor (id: 'record_processor_af2dd14a') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.259204 INFO Registered Record Processor (id: 'record_processor_7e43cc0e') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.261356 INFO Registered Record Processor (id: 'record_processor_b937271c') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.265059 INFO Registered Record Processor (id: 'record_processor_3cc3f4d6') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.266809 INFO Registered Record Processor (id: 'record_processor_f9bab9ec') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:45.268977 INFO Registered Record Processor (id: 'record_processor_a4b8e371') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 'GPT2Tokenizer', 'HerbertTokenizer', 'LayoutLMTokenizer', 'LayoutLMv2Tokenizer', 'LayoutLMv3Tokenizer', 'LayoutXLMTokenizer', | |
| oss-gpt120b-bench-j9b29 'LongformerTokenizer', 'LEDTokenizer', 'LxmertTokenizer', 'MarkupLMTokenizer', 'MBartTokenizer', 'MBart50Tokenizer', 'MPNetTokenizer', | |
| oss-gpt120b-bench-j9b29 'MobileBertTokenizer', 'MvpTokenizer', 'NllbTokenizer', 'OpenAIGPTTokenizer', 'PegasusTokenizer', 'Qwen2Tokenizer', 'RealmTokenizer', | |
| oss-gpt120b-bench-j9b29 'ReformerTokenizer', 'RemBertTokenizer', 'RetriBertTokenizer', 'RobertaTokenizer', 'RoFormerTokenizer', 'SeamlessM4TTokenizer', | |
| oss-gpt120b-bench-j9b29 'SqueezeBertTokenizer', 'T5Tokenizer', 'UdopTokenizer', 'WhisperTokenizer', 'XLMRobertaTokenizer', 'XLNetTokenizer', 'SplinterTokenizer', | |
| oss-gpt120b-bench-j9b29 'XGLMTokenizer', 'LlamaTokenizer', 'CodeLlamaTokenizer', 'GemmaTokenizer', 'Phi3Tokenizer'] | |
| oss-gpt120b-bench-j9b29 21:36:48.464534 INFO Registered Worker (id: 'worker_038655e0') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.466401 INFO Registered Worker (id: 'worker_22a42a6e') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.471510 INFO Registered Worker (id: 'worker_b1ae5be5') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.473892 INFO Registered Worker (id: 'worker_561ff721') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.476352 INFO Registered Worker (id: 'worker_577d1056') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.478795 INFO Registered Worker (id: 'worker_b0ea8141') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.480861 INFO Registered Worker (id: 'worker_a1c68543') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.482542 INFO Registered Worker (id: 'worker_9e967e8b') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.484349 INFO Registered Worker (id: 'worker_7ea56698') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.486995 INFO Registered Worker (id: 'worker_f51dc6bc') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.489505 INFO Registered Worker (id: 'worker_25cf8932') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.491810 INFO Registered Worker (id: 'worker_358812f5') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.494618 INFO Registered Worker (id: 'worker_e1a63e8d') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.496259 INFO Registered Worker (id: 'worker_3cc7e187') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.497970 INFO Registered Worker (id: 'worker_2db15849') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.510870 INFO Registered Worker (id: 'worker_9b9e41d8') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.512850 INFO Registered Worker (id: 'worker_413bea6f') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.515177 INFO Registered Worker (id: 'worker_a6d8f664') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.517192 INFO Registered Worker (id: 'worker_b0eb8b7b') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.519138 INFO Registered Worker (id: 'worker_f5c764d2') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.520935 INFO Registered Worker (id: 'worker_0b3e8aa2') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.523012 INFO Registered Worker (id: 'worker_551d77f7') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.524868 INFO Registered Worker (id: 'worker_52c29806') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.526865 INFO Registered Worker (id: 'worker_f33fc5bd') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.528697 INFO Registered Worker (id: 'worker_3e7d4dc2') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.530496 INFO Registered Worker (id: 'worker_9d35293d') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.532738 INFO Registered Worker (id: 'worker_c23db60e') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.534934 INFO Registered Worker (id: 'worker_15e2267d') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.536840 INFO Registered Worker (id: 'worker_28339a3f') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.539082 INFO Registered Worker (id: 'worker_251c74ab') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.541834 INFO Registered Worker (id: 'worker_2cbffa86') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.543494 INFO Registered Worker (id: 'worker_72bff953') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.545948 INFO Registered Worker (id: 'worker_2337483b') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.547742 INFO Registered Worker (id: 'worker_1a82b498') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.549854 INFO Registered Worker (id: 'worker_1e099fff') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.551504 INFO Registered Worker (id: 'worker_92d7890a') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.553632 INFO Registered Worker (id: 'worker_4de78b13') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.555799 INFO Registered Worker (id: 'worker_076c42c4') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.557558 INFO Registered Worker (id: 'worker_88865ea3') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.559161 INFO Registered Worker (id: 'worker_a33b9021') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.561078 INFO Registered Worker (id: 'worker_b86a48b2') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.562768 INFO Registered Worker (id: 'worker_c91bf65a') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.564407 INFO Registered Worker (id: 'worker_4c93605e') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.566198 INFO Registered Worker (id: 'worker_f3d816e8') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.569091 INFO Registered Worker (id: 'worker_86b6531f') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.571115 INFO Registered Worker (id: 'worker_0a60c485') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.573347 INFO Registered Worker (id: 'worker_ba0fc7c9') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.575191 INFO Registered Worker (id: 'worker_061f477a') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.577563 INFO Registered Worker (id: 'worker_139312a5') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.579528 INFO Registered Worker (id: 'worker_95908ebe') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.581511 INFO Registered Worker (id: 'worker_d7fc92cc') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.583241 INFO Registered Worker (id: 'worker_b29fc18b') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.585163 INFO Registered Worker (id: 'worker_ab79b156') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.586884 INFO Registered Worker (id: 'worker_ac56f80a') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.589476 INFO Registered Worker (id: 'worker_19e2f769') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.591590 INFO Registered Worker (id: 'worker_7939e57d') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.593425 INFO Registered Worker (id: 'worker_07799e7e') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.595237 INFO Registered Worker (id: 'worker_75ed1f8c') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.598015 INFO Registered Worker (id: 'worker_8471e324') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.599523 INFO Registered Worker (id: 'worker_8100fe15') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.601407 INFO Registered Worker (id: 'worker_9e12b8f4') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.603543 INFO Registered Worker (id: 'worker_daec656f') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.605686 INFO Registered Worker (id: 'worker_646a7ae9') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.607689 INFO Registered Worker (id: 'worker_f253e140') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.609424 INFO Registered Worker (id: 'worker_4e67fc7a') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.611574 INFO Registered Worker (id: 'worker_f7c56654') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.613550 INFO Registered Worker (id: 'worker_e2535ffa') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.615477 INFO Registered Worker (id: 'worker_4bdb658d') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.617387 INFO Registered Worker (id: 'worker_3f3adade') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.619277 INFO Registered Worker (id: 'worker_2d492253') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.621554 INFO Registered Worker (id: 'worker_7c2c12f7') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.623246 INFO Registered Worker (id: 'worker_d0a845f1') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.625237 INFO Registered Worker (id: 'worker_c2923b81') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.627273 INFO Registered Worker (id: 'worker_8ed99390') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.629423 INFO Registered Worker (id: 'worker_f02be283') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.631101 INFO Registered Worker (id: 'worker_4586cd89') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.632996 INFO Registered Worker (id: 'worker_51167974') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.634914 INFO Registered Worker (id: 'worker_fcafadc8') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.636793 INFO Registered Worker (id: 'worker_a2c7a473') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.639254 INFO Registered Worker (id: 'worker_8e56aacf') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.641359 INFO Registered Worker (id: 'worker_85ce8c5f') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.643533 INFO Registered Worker (id: 'worker_ff400da8') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.645624 INFO Registered Worker (id: 'worker_619446c3') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.647374 INFO Registered Worker (id: 'worker_0d96dc75') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.649441 INFO Registered Worker (id: 'worker_d16630aa') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.651526 INFO Registered Worker (id: 'worker_b2060695') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.653675 INFO Registered Worker (id: 'worker_28d57936') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.655722 INFO Registered Worker (id: 'worker_c8bcc344') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.657682 INFO Registered Worker (id: 'worker_03906a90') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.665317 INFO Registered Worker (id: 'worker_64a6e106') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.667129 INFO Registered Worker (id: 'worker_3505cd0a') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.669347 INFO Registered Worker (id: 'worker_ac797b47') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.671419 INFO Registered Worker (id: 'worker_f3bc1163') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:36:48.673646 INFO Registered Worker (id: 'worker_68857a15') system_controller.py:231 | |
| oss-gpt120b-bench-j9b29 21:37:15.213237 ERROR Service dataset_manager failed to register within timeout multiprocess_service_manager.py:190 | |
| oss-gpt120b-bench-j9b29 │ /usr/local/lib/python3.12/site-packages/aiperf/controller/multiprocess_service_manager.py:178 in wait_for_all_services_registration │ | |
| oss-gpt120b-bench-j9b29 │ │ | |
| oss-gpt120b-bench-j9b29 │ 175 │ │ │ │ await asyncio.sleep(0.5) │ | |
| oss-gpt120b-bench-j9b29 │ 176 │ │ │ | |
| oss-gpt120b-bench-j9b29 │ 177 │ │ try: │ | |
| oss-gpt120b-bench-j9b29 │ ❱ 178 │ │ │ await asyncio.wait_for(_wait_for_registration(), timeout=timeout_seconds) │ | |
| oss-gpt120b-bench-j9b29 │ 179 │ │ except asyncio.TimeoutError as e: │ | |
| oss-gpt120b-bench-j9b29 │ 180 │ │ │ # Log which services didn't register in time │ | |
| oss-gpt120b-bench-j9b29 │ 181 │ │ │ registered_types_set = set( │ | |
| oss-gpt120b-bench-j9b29 │ │ | |
| oss-gpt120b-bench-j9b29 │ /usr/local/lib/python3.12/asyncio/tasks.py:519 in wait_for │ | |
| oss-gpt120b-bench-j9b29 │ │ | |
| oss-gpt120b-bench-j9b29 │ 516 │ │ except exceptions.CancelledError as exc: │ | |
| oss-gpt120b-bench-j9b29 │ 517 │ │ │ raise TimeoutError from exc │ | |
| oss-gpt120b-bench-j9b29 │ 518 │ │ | |
| oss-gpt120b-bench-j9b29 │ ❱ 519 │ async with timeouts.timeout(timeout): │ | |
| oss-gpt120b-bench-j9b29 │ 520 │ │ return await fut │ | |
| oss-gpt120b-bench-j9b29 │ 521 │ | |
| oss-gpt120b-bench-j9b29 │ 522 async def _wait(fs, timeout, return_when, loop): │ | |
| oss-gpt120b-bench-j9b29 │ │ | |
| oss-gpt120b-bench-j9b29 │ /usr/local/lib/python3.12/asyncio/timeouts.py:115 in __aexit__ │ | |
| oss-gpt120b-bench-j9b29 │ │ | |
| oss-gpt120b-bench-j9b29 │ 112 │ │ │ if self._task.uncancel() <= self._cancelling and exc_type is │ | |
| oss-gpt120b-bench-j9b29 │ exceptions.CancelledError: │ | |
| oss-gpt120b-bench-j9b29 │ 113 │ │ │ │ # Since there are no new cancel requests, we're │ | |
| oss-gpt120b-bench-j9b29 │ 114 │ │ │ │ # handling this. │ | |
| oss-gpt120b-bench-j9b29 │ ❱ 115 │ │ │ │ raise TimeoutError from exc_val │ | |
| oss-gpt120b-bench-j9b29 │ 116 │ │ elif self._state is _State.ENTERED: │ | |
| oss-gpt120b-bench-j9b29 │ 117 │ │ │ self._state = _State.EXITED │ | |
| oss-gpt120b-bench-j9b29 │ 118 │ | |
| oss-gpt120b-bench-j9b29 ╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯ | |
| oss-gpt120b-bench-j9b29 TimeoutError | |
| oss-gpt120b-bench-j9b29 | |
| oss-gpt120b-bench-j9b29 The above exception was the direct cause of the following exception: | |
| oss-gpt120b-bench-j9b29 | |
| oss-gpt120b-bench-j9b29 ╭────────────────────────────────────────────────────── Traceback (most recent call last) ──────────────────────────────────────────────────────╮ | |
| oss-gpt120b-bench-j9b29 │ /usr/local/lib/python3.12/site-packages/aiperf/common/mixins/hooks_mixin.py:185 in run_hooks │ | |
| oss-gpt120b-bench-j9b29 │ │ | |
| oss-gpt120b-bench-j9b29 │ 182 │ │ for hook in self.get_hooks(*hook_types, reverse=reverse): │ | |
| oss-gpt120b-bench-j9b29 │ 183 │ │ │ self.debug(lambda hook=hook: f"Running hook: {hook!r}") │ | |
| oss-gpt120b-bench-j9b29 │ 184 │ │ │ try: │ | |
| oss-gpt120b-bench-j9b29 │ ❱ 185 │ │ │ │ await hook(**kwargs) │ | |
| oss-gpt120b-bench-j9b29 │ 186 │ │ │ except Exception as e: │ | |
| oss-gpt120b-bench-j9b29 │ 187 │ │ │ │ exceptions.append(e) │ | |
| oss-gpt120b-bench-j9b29 │ 188 │ │ │ │ self.exception( │ | |
| oss-gpt120b-bench-j9b29 │ │ | |
| oss-gpt120b-bench-j9b29 │ /usr/local/lib/python3.12/site-packages/aiperf/common/hooks.py:114 in __call__ │ | |
| oss-gpt120b-bench-j9b29 │ │ | |
| oss-gpt120b-bench-j9b29 │ 111 │ │ | |
| oss-gpt120b-bench-j9b29 │ 112 │ async def __call__(self, **kwargs) -> None: │ | |
| oss-gpt120b-bench-j9b29 │ 113 │ │ if asyncio.iscoroutinefunction(self.func): │ | |
| oss-gpt120b-bench-j9b29 │ ❱ 114 │ │ │ await self.func(**kwargs) │ | |
| oss-gpt120b-bench-j9b29 │ 115 │ │ else: │ | |
| oss-gpt120b-bench-j9b29 │ 116 │ │ │ await asyncio.to_thread(self.func, **kwargs) │ | |
| oss-gpt120b-bench-j9b29 │ 117 │ | |
| oss-gpt120b-bench-j9b29 │ │ | |
| oss-gpt120b-bench-j9b29 │ /usr/local/lib/python3.12/site-packages/aiperf/controller/system_controller.py:156 in _start_services │ | |
| oss-gpt120b-bench-j9b29 │ │ | |
| oss-gpt120b-bench-j9b29 │ 153 │ │ self.debug("System Controller is bootstrapping services") │ | |
| oss-gpt120b-bench-j9b29 │ 154 │ │ # Start all required services │ | |
| oss-gpt120b-bench-j9b29 │ 155 │ │ await self.service_manager.start() │ | |
| oss-gpt120b-bench-j9b29 │ ❱ 156 │ │ await self.service_manager.wait_for_all_services_registration( │ | |
| oss-gpt120b-bench-j9b29 │ 157 │ │ │ stop_event=self._stop_requested_event, │ | |
| oss-gpt120b-bench-j9b29 │ 158 │ │ ) │ | |
| oss-gpt120b-bench-j9b29 │ 159 │ | |
| oss-gpt120b-bench-j9b29 │ │ | |
| oss-gpt120b-bench-j9b29 │ /usr/local/lib/python3.12/site-packages/aiperf/controller/multiprocess_service_manager.py:194 in wait_for_all_services_registration │ | |
| oss-gpt120b-bench-j9b29 │ │ | |
| oss-gpt120b-bench-j9b29 │ 191 │ │ │ │ │ │ f"Service {service_type} failed to register within timeout" │ | |
| oss-gpt120b-bench-j9b29 │ 192 │ │ │ │ │ ) │ | |
| oss-gpt120b-bench-j9b29 │ 195 │ │ | |
| oss-gpt120b-bench-j9b29 │ 196 │ async def _wait_for_process(self, info: MultiProcessRunInfo) -> None: │ | |
| oss-gpt120b-bench-j9b29 │ 197 │ │ """Wait for a process to terminate with timeout handling.""" │ | |
| oss-gpt120b-bench-j9b29 ╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯ | |
| oss-gpt120b-bench-j9b29 AIPerfError: AIPerfError: Some services failed to register within timeout | |
| oss-gpt120b-bench-j9b29 21:37:15.581544 ERROR Failed for SystemController (id=system_controller): AIPerfMultiError: Errors running (AIPerfHook.ON_START,) hooks for SystemController: Some aiperf_lifecycle_mixin.py:236 | |
| oss-gpt120b-bench-j9b29 services failed to register within timeout | |
| oss-gpt120b-bench-j9b29 ╭────────────────────────────────────────────────────── Traceback (most recent call last) ──────────────────────────────────────────────────────╮ | |
| oss-gpt120b-bench-j9b29 │ /usr/local/lib/python3.12/site-packages/aiperf/common/mixins/aiperf_lifecycle_mixin.py:121 in _execute_state_transition │ | |
| oss-gpt120b-bench-j9b29 │ │ | |
| oss-gpt120b-bench-j9b29 │ 118 │ │ await self._set_state(transient_state) │ | |
| oss-gpt120b-bench-j9b29 │ 119 │ │ self.debug(lambda: f"{transient_state.title()} {self}") │ | |
| oss-gpt120b-bench-j9b29 │ 120 │ │ try: │ | |
| oss-gpt120b-bench-j9b29 │ ❱ 121 │ │ │ await self.run_hooks(hook_type, reverse=reverse) │ | |
| oss-gpt120b-bench-j9b29 │ 122 │ │ │ await self._set_state(final_state) │ | |
| oss-gpt120b-bench-j9b29 │ 123 │ │ │ self.debug(lambda: f"{self} is now {final_state.title()}") │ | |
| oss-gpt120b-bench-j9b29 │ 124 │ │ │ event.set() │ | |
| oss-gpt120b-bench-j9b29 │ │ | |
| oss-gpt120b-bench-j9b29 │ /usr/local/lib/python3.12/site-packages/aiperf/common/mixins/hooks_mixin.py:192 in run_hooks │ | |
| oss-gpt120b-bench-j9b29 │ │ | |
| oss-gpt120b-bench-j9b29 │ 189 │ │ │ │ │ f"Error running {hook!r} hook for {self.__class__.__name__}: {e}" │ | |
| oss-gpt120b-bench-j9b29 │ 190 │ │ │ │ ) │ | |
| oss-gpt120b-bench-j9b29 │ 191 │ │ if exceptions: │ | |
| oss-gpt120b-bench-j9b29 │ ❱ 192 │ │ │ raise AIPerfMultiError( │ | |
| oss-gpt120b-bench-j9b29 │ 193 │ │ │ │ f"Errors running {hook_types} hooks for {self.__class__.__name__}", │ | |
| oss-gpt120b-bench-j9b29 │ 194 │ │ │ │ exceptions, │ | |
| oss-gpt120b-bench-j9b29 │ 195 │ │ │ ) │ | |
| oss-gpt120b-bench-j9b29 ╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯ | |
| oss-gpt120b-bench-j9b29 AIPerfMultiError: AIPerfMultiError: Errors running (AIPerfHook.ON_START,) hooks for SystemController: Some services failed to register within | |
| oss-gpt120b-bench-j9b29 timeout |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment