Hans Elias J. hansihe

Enthusiastic developer who likes working with both electronics and software, including everything in between. Has a weak spot for Rust and Elixir.

xenova / tiktoken-to-hf.ipynb

Last active April 7, 2025 20:13

Convert tiktoken tokenizers to the Hugging Face tokenizers format

Sorry, something went wrong. Reload?

Sorry, we cannot display this file.

Sorry, this file is invalid so it cannot be displayed.

yurydelendik / !wasmllvm.md

Last active December 7, 2024 18:08

Using WebAssembly in LLVM

NOTE: the content is out-of-date. All development is moved to the https://github.com/yurydelendik/wasmception

Using WebAssembly in LLVM

# locations, e.g.
export WORKDIR=~/llvmwasm; mkdir -p $WORKDIR
export INSTALLDIR=$WORKDIR