Talismanic

Step 01: Download the Model from HF

First clone or download the huggingface repository. Change the model name as per need.

from huggingface_hub import snapshot_download
model_name = "Qwen/Qwen2.5-0.5B-Instruct"
snapshot_download(repo_id=model_name, local_dir="./hf_model")

Save the above code in model_downloader.py. Then run the above code with

python model_downloader.py

Talismanic

Install Framework Dependencies

!pip install "camel-ai[all]==0.2.8"

!pip install 'camel-ai[tools]'

Define Behavior

sys_msg = `You are an avid searcher who can search and find anything on internet. You present the data in concise manner from your search result. At the end of your presentation, you add your life philosophy with the answer.`

Talismanic

Run Ollama Docker

docker run -d -v /my/ollama/local/directory:/root/.ollama -p 11434:11434 --name my-ollama ollama/ollama

Run Open-WebUI for Ollama

docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main

Download and run llama3.2

Talismanic

#generating certificate and private key

from cryptography import x509
from cryptography.hazmat.backends import default_backend
from cryptography.hazmat.primitives import serialization, hashes
from cryptography.hazmat.primitives.asymmetric import rsa
from cryptography.x509.oid import NameOID
import datetime

# Generate Private Key