Skip to content

Instantly share code, notes, and snippets.

View sozercan's full-sized avatar
:shipit:
I may be slow to respond.

Sertaç Özercan sozercan

:shipit:
I may be slow to respond.
View GitHub Profile
oss-gpt120b-bench-j9b29 Collecting ruamel-yaml~=0.18.12 (from aiperf==0.1.1)
oss-gpt120b-bench-j9b29 Downloading ruamel.yaml-0.18.15-py3-none-any.whl.metadata (25 kB)
oss-gpt120b-bench-j9b29 Collecting setproctitle~=1.3.6 (from aiperf==0.1.1)
oss-gpt120b-bench-j9b29 Downloading setproctitle-1.3.7-cp312-cp312-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl.metadata (10 kB)
oss-gpt120b-bench-j9b29 Collecting soundfile~=0.13.1 (from aiperf==0.1.1)
oss-gpt120b-bench-j9b29 Downloading soundfile-0.13.1-py2.py3-none-manylinux_2_28_x86_64.whl.metadata (16 kB)
oss-gpt120b-bench-j9b29 Collecting textual~=5.3.0 (from aiperf==0.1.1)
oss-gpt120b-bench-j9b29 Downloading textual-5.3.0-py3-none-any.whl.metadata (9.1 kB)
oss-gpt120b-bench-j9b29 Collecting tqdm>=4.67.1 (from aiperf==0.1.1)
oss-gpt120b-bench-j9b29 Downloading tqdm-4.67.1-py3-none-any.whl.metadata (57 kB)
oss-gpt120b-bench-94ldh Downloading setproctitle-1.3.7-cp312-cp312-manylinux1_x86_64.manylinux_2_28_x86_64.manylinux_2_5_x86_64.whl (32 kB)
oss-gpt120b-bench-94ldh Downloading soundfile-0.13.1-py2.py3-none-manylinux_2_28_x86_64.whl (1.3 MB)
oss-gpt120b-bench-94ldh ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.3/1.3 MB 115.8 MB/s eta 0:00:00
oss-gpt120b-bench-94ldh Downloading textual-5.3.0-py3-none-any.whl (702 kB)
oss-gpt120b-bench-94ldh ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 702.7/702.7 kB 71.6 MB/s eta 0:00:00
oss-gpt120b-bench-94ldh Downloading tqdm-4.67.1-py3-none-any.whl (78 kB)
oss-gpt120b-bench-94ldh Downloading transformers-4.57.1-py3-none-any.whl (12.0 MB)
oss-gpt120b-bench-94ldh ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.0/12.0 MB 141.6 MB/s eta 0:00:00
oss-gpt120b-bench-94ldh Downloading uvloop-0.21.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
oss-gpt120b-bench-94ldh ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.7/4.7 MB 146.3 MB/s eta 0:00:00
│ 175 │ │ │ │ await asyncio.sleep(0.5) │
│ 176 │ │ │
│ 177 │ │ try: │
│ ❱ 178 │ │ │ await asyncio.wait_for(_wait_for_registration(), timeout=timeout_seconds) │
│ 179 │ │ except asyncio.TimeoutError as e: │
{
"@context": "https://openvex.dev/ns/v0.2.0",
"@id": "govulncheck/vex:e47eb4a0ed7d490a5a94dfb6f85150e2244773b6977de80e8dc620dbd3d30a72",
"author": "Unknown Author",
"timestamp": "2025-09-26T20:54:41.812737311Z",
"version": 1,
"tooling": "https://pkg.go.dev/golang.org/x/vuln/cmd/govulncheck",
"statements": [
{
"vulnerability": {
package types
import (
"time"
)
// Options contains common copacetic options.
type Options struct {
// Core image configuration
Image string
2025-03-07 09:54:52,381 INFO usage_lib.py:467 -- Usage stats collection is enabled by default without user confirmation because this terminal is detected to be non-interactive. To disable this, add `--disable-usage-stats` to the command that starts the cluster, or run the following command: `ray disable-usage-stats` before starting the cluster. See https://docs.ray.io/en/master/cluster/usage-stats.html for more details.
2025-03-07 09:54:52,381 INFO scripts.py:865 -- Local node IP: 10.244.2.105
2025-03-07 09:54:54,440 SUCC scripts.py:902 -- --------------------
2025-03-07 09:54:54,440 SUCC scripts.py:903 -- Ray runtime started.
2025-03-07 09:54:54,440 SUCC scripts.py:904 -- --------------------
2025-03-07 09:54:54,440 INFO scripts.py:906 -- Next steps
2025-03-07 09:54:54,440 INFO scripts.py:909 -- To add another node to this Ray cluster, run
2025-03-07 09:54:54,440 INFO scripts.py:912 -- ray start --address='10.244.2.105:6379'
2025-03-07 09:54:54,440 INFO scripts.py:921 -- To connect to this Ray cluster:
202
Defaulted container "ray-worker" out of: ray-worker, wait-gcs-ready (init)
INFO 03-07 09:56:00 __init__.py:183] Automatically detected platform cuda.
INFO 03-07 09:56:01 api_server.py:838] vLLM API server version 0.7.1
INFO 03-07 09:56:01 api_server.py:839] args: Namespace(host=None, port=8000, uvicorn_log_level='info', allow_credentials=False, allowed_origins=['*'], allowed_methods=['*'], allowed_headers=['*'], api_key=None, lora_modules=None, prompt_adapters=None, chat_template=None, chat_template_content_format='auto', response_role='assistant', ssl_keyfile=None, ssl_certfile=None, ssl_ca_certs=None, ssl_cert_reqs=0, root_path=None, middleware=[], return_tokens_as_token_ids=False, disable_frontend_multiprocessing=False, enable_request_id_headers=False, enable_auto_tool_choice=False, enable_reasoning=False, reasoning_parser=None, tool_call_parser=None, tool_parser_plugin='', model='facebook/opt-125m', task='auto', tokenizer=None, skip_tokenizer_init=False, revision=None, code_revision=None, tokenizer_revisi
k describe po qwen-coder-7b-instruct-7f74c4446-q5r94-small-group-worker-ncw9w ⎈ sertac-aks-gpu sozercan@sertac-vm
Name: qwen-coder-7b-instruct-7f74c4446-q5r94-small-group-worker-ncw9w
Namespace: default
Priority: 0
Service Account: default
Node: aks-gpu-13753585-vmss000002/10.224.0.5
Start Time: Thu, 06 Mar 2025 06:46:19 +0000
Labels: app.kubernetes.io/created-by=kuberay-operator
app.kubernetes.io/name=kuberay
ray.io/cluster=qwen-coder-7b-instruct-7f74c4446-q5r94
@sozercan
sozercan / dalec-windows.yaml
Created February 21, 2025 00:21
Dalec Windows Example
# syntax=ghcr.io/azure/dalec/frontend:0.12
args:
VERSION: 1.0.0
COMMIT: 32022caedd6a177a7717aa8680cbe179e1045935
REVISION: 1
TARGETOS:
name: fake-test-project
packager: Azure Container Upstream
# syntax=ghcr.io/azure/dalec/frontend:latest
name: kubectl-bash
version: 0.1.0
license: MIT
description: A minimal distroless image with only kubectl and bash
revision: 1
dependencies:
runtime:
kubectl: