Olaf Geibig olafgeibig

tutaona
Berlin
http://www.tutaona.com

Recently created

Least recently created

Recently updated

Least recently updated

olafgeibig / cc-proxy.sh

Last active August 4, 2025 19:49

A LiteLLM proxy solution to use Claude Code with models from the Weights and Biases inference service. You need to have LiteLLM installed or use the docker container. Easiest is to install it with `uv tool install "litellm[proxy]"` Don't worry about the fallback warnings. Either LiteLLM, W&B or the combo of both are not handling streaming respon…

	#!/bin/bash
	export WANDB_API_KEY=<your key>
	export WANDB_PROJECT=<org/project>

	litellm --port 4000 --debug --config cc-proxy.yaml

olafgeibig / gist:47a5a2f364902c56361fd16e36080af9

Created June 27, 2025 07:59

mlx-vlm install failiure

	```
	uv run --with mlx-vlm mlx_vlm.generate --model gg-hf-gm/gemma-3n-E4B-it --max-tokens 100 --temperature 0.7 --prompt "Transcribe the following speech segment in English:"
	× Failed to build `llvmlite==0.36.0`
	├─▶ The build backend returned an error
	╰─▶ Call to `setuptools.build_meta:__legacy__.build_wheel` failed (exit status: 1)

	[stderr]
	Traceback (most recent call last):
	File "<string>", line 14, in <module>
	File "/Users/olaf/.cache/uv/builds-v0/.tmpPmfozJ/lib/python3.12/site-packages/setuptools/build_meta.py", line 331, in

olafgeibig / review_tool.py

Last active June 1, 2024 13:46

A review tool for CrewAI that uses a LLM to review a work result if it matches a given task or topic. I posted this here because it demonstrates how to use Joao's way to do multi-argument calls for calling multi-argument tools. The tool is actually not really very useful, since I don't manage that the agents are passing on their full work result…

	from langchain.tools import Tool
	from langchain_core.language_models.chat_models import BaseChatModel
	from langchain_core.messages import HumanMessage, SystemMessage

	class ReviewToolFactory():

	@staticmethod
	def get_review_tool(llm: BaseChatModel) -> Tool:
	"""
	Returns a Tool object that can be used for reviewing a result from working on a task and giving constructive

olafgeibig / nous-hermes-2-solar.ollama

Created January 3, 2024 09:35

Ollama modelfile for nous-hermes-2-solar-10.7b

	FROM ./nous-hermes-2-solar-10.7b.Q5_K_M.gguf
	PARAMETER num_ctx 4096
	TEMPLATE """<\|im_start\|>system
	{{ .System }}<\|im_end\|>
	<\|im_start\|>user
	{{ .Prompt }}<\|im_end\|>
	<\|im_start\|>assistant
	"""
	PARAMETER stop "<\|im_start\|>"
	PARAMETER stop "<\|im_end\|>"

olafgeibig / effizienz

Created January 17, 2013 09:59

	Java:
	String getDescription() {
	StringBuilder stringBuilder = new StringBuilder();

	if(titel != null && titel.length() > 0){
	stringBuilder.append(titel).append(',')
	}

	if(vorname != null && vorname.length() > 0){
	stringBuilder.append(vorname).append(',')

	FROM ./nous-hermes-2-solar-10.7b.Q5_K_M.gguf
	PARAMETER num_ctx 4096
	TEMPLATE """<\|im_start\|>system
	{{ .System }}<\|im_end\|>
	<\|im_start\|>user
	{{ .Prompt }}<\|im_end\|>
	<\|im_start\|>assistant
	"""
	PARAMETER stop "<\|im_start\|>"
	PARAMETER stop "<\|im_end\|>"