sozercan

2025-03-07 09:54:52,381	INFO usage_lib.py:467 -- Usage stats collection is enabled by default without user confirmation because this terminal is detected to be non-interactive. To disable this, add `--disable-usage-stats` to the command that starts the cluster, or run the following command: `ray disable-usage-stats` before starting the cluster. See https://docs.ray.io/en/master/cluster/usage-stats.html for more details.
2025-03-07 09:54:52,381	INFO scripts.py:865 -- Local node IP: 10.244.2.105
2025-03-07 09:54:54,440	SUCC scripts.py:902 -- --------------------
2025-03-07 09:54:54,440	SUCC scripts.py:903 -- Ray runtime started.
2025-03-07 09:54:54,440	SUCC scripts.py:904 -- --------------------
2025-03-07 09:54:54,440	INFO scripts.py:906 -- Next steps
2025-03-07 09:54:54,440	INFO scripts.py:909 -- To add another node to this Ray cluster, run
2025-03-07 09:54:54,440	INFO scripts.py:912 --   ray start --address='10.244.2.105:6379'
2025-03-07 09:54:54,440	INFO scripts.py:921 -- To connect to this Ray cluster:
202

sozercan

Defaulted container "ray-worker" out of: ray-worker, wait-gcs-ready (init)
INFO 03-07 09:56:00 __init__.py:183] Automatically detected platform cuda.
INFO 03-07 09:56:01 api_server.py:838] vLLM API server version 0.7.1
INFO 03-07 09:56:01 api_server.py:839] args: Namespace(host=None, port=8000, uvicorn_log_level='info', allow_credentials=False, allowed_origins=['*'], allowed_methods=['*'], allowed_headers=['*'], api_key=None, lora_modules=None, prompt_adapters=None, chat_template=None, chat_template_content_format='auto', response_role='assistant', ssl_keyfile=None, ssl_certfile=None, ssl_ca_certs=None, ssl_cert_reqs=0, root_path=None, middleware=[], return_tokens_as_token_ids=False, disable_frontend_multiprocessing=False, enable_request_id_headers=False, enable_auto_tool_choice=False, enable_reasoning=False, reasoning_parser=None, tool_call_parser=None, tool_parser_plugin='', model='facebook/opt-125m', task='auto', tokenizer=None, skip_tokenizer_init=False, revision=None, code_revision=None, tokenizer_revisi

sozercan

k describe po  qwen-coder-7b-instruct-7f74c4446-q5r94-small-group-worker-ncw9w                                                ⎈ sertac-aks-gpu sozercan@sertac-vm
Name:             qwen-coder-7b-instruct-7f74c4446-q5r94-small-group-worker-ncw9w
Namespace:        default
Priority:         0
Service Account:  default
Node:             aks-gpu-13753585-vmss000002/10.224.0.5
Start Time:       Thu, 06 Mar 2025 06:46:19 +0000
Labels:           app.kubernetes.io/created-by=kuberay-operator
                  app.kubernetes.io/name=kuberay
                  ray.io/cluster=qwen-coder-7b-instruct-7f74c4446-q5r94

sozercan

# syntax=ghcr.io/azure/dalec/frontend:0.12

args:
  VERSION: 1.0.0
  COMMIT: 32022caedd6a177a7717aa8680cbe179e1045935
  REVISION: 1
  TARGETOS:

name: fake-test-project
packager: Azure Container Upstream

sozercan

# syntax=ghcr.io/azure/dalec/frontend:latest
name: kubectl-bash
version: 0.1.0
license: MIT
description: A minimal distroless image with only kubectl and bash
revision: 1

dependencies:
    runtime:
        kubectl:

sozercan

{
    "jsonwall": "1.0",
    "schema": "1.0",
    "count": 140
}
{
    "kind": "content",
    "slice": "base-files_bin",
    "path": "/bin/"
}

sozercan

#!/bin/bash

subscription_id="<insert subscription id>"

resource_group="<insert resource group>"

endpoints=("<insert endpoint1>" "<insert endpoint2>" "...")

# Define the base URI for the Azure Management API
base_uri="https://management.azure.com/subscriptions/$subscription_id/resourceGroups/$resource_group/providers/Microsoft.CognitiveServices/accounts"

sozercan

#syntax=ghcr.io/sozercan/aikit:latest
apiVersion: v1alpha1
baseModel: unsloth/llama-3-8b-bnb-4bit
datasets:
  - source: "yahma/alpaca-cleaned"
    type: alpaca
config:
  unsloth:
    packing: false
    maxSeqLength: 2048

sozercan

{"spdxVersion":"SPDX-2.3","dataLicense":"CC0-1.0","SPDXID":"SPDXRef-DOCUMENT","name":"k8supstream.azurecr.io/public/oss/kubernetes/kube-proxy","documentNamespace":"https://anchore.com/syft/image/k8supstream.azurecr.io/public/oss/kubernetes/kube-proxy-a0af9d58-72fb-4030-b1eb-9f179c05d93a","creationInfo":{"licenseListVersion":"3.22","creators":["Organization: Anchore, Inc","Tool: syft-0.98.0"],"created":"2024-04-04T20:28:20Z"},"packages":[{"name":"./staging/src/k8s.io/api","SPDXID":"SPDXRef-Package-go-module-.-staging-src-k8s.io-api-fae416354729a482","versionInfo":"(devel)","supplier":"NOASSERTION","downloadLocation":"NOASSERTION","filesAnalyzed":false,"sourceInfo":"acquired package info from go module information: /usr/local/bin/kube-proxy","licenseConcluded":"NOASSERTION","licenseDeclared":"NOASSERTION","copyrightText":"NOASSERTION","externalRefs":[{"referenceCategory":"SECURITY","referenceType":"cpe23Type","referenceLocator":"cpe:2.3:a:staging:src\\/k8s.io\\/api:\\(devel\\):*:*:*:*:*:*:*"},{"referenceCategor

sozercan

goos: linux
goarch: amd64
pkg: github.com/open-policy-agent/gatekeeper/v3/pkg/mutation
cpu: AMD EPYC 7763 64-Core Processor
                │  old2.txt   │              new2.txt              │
                │   sec/op    │   sec/op     vs base               │
System_Mutate-8   925.8n ± 0%   935.2n ± 0%  +1.02% (p=0.000 n=20)

pkg: github.com/open-policy-agent/gatekeeper/v3/pkg/mutation/mutators/assign
                                              │  old2.txt   │              new2.txt              │