ravwojdyla

Anti-hype LLM reading list

Goals: Add links that are reasonable and good explanations of how stuff works. No hype and no vendor content if possible. Practical first-hand accounts and experience preferred (super rare at this point).

My own notes from a few months back.

Background

• Survey of LLMS
• Self-attention and transformer networks

ravwojdyla

{"$schema":"https://www.speedscope.app/file-format-schema.json","profiles":[{"type":"sampled","name":"Thread 0x1FF62E500 \"MainThread\"","unit":"seconds","startValue":0.0,"endValue":0.239,"samples":[[1,0],[1,3,2],[1,4],[1,4],[1,4],[1,4],[1,4,12,11,10,9,8,7,6,5],[1,4,12,11,10,9,8,7,6,5],[1,4,12,11,10,9,8,7,6,13],[1,4,12,11,10,9,8,7,6,13],[1,4,12,11,10,9,8,7,6,13],[1,4,27,26,25,24,23,22,21,20,19,18,17,16,15,14],[1,4,27,26,25,24,23,22,21,20,19,18,17,16,15,14],[1,4,27,26,25,24,23,22,21,20,19,18,31,30,29,28,7,6,5],[1,4,27,26,25,24,23,39,38,37,36,35,34,33,32],[1,4,27,26,25,24,23,43,42,41,40],[1,4,27,26,25,24,23,43,42,41,40],[1,4,27,26,25,24,23,43,42,41,40],[1,4,27,26,25,24,23,43,42,41,40],[1,4,27,26,25,24,23,43,42,46,45,15,44],[1,4,27,26,25,24,23,43,42,46,45,15,44],[1,4,27,26,25,24,23,43,42,46,45,15,44],[1,4,27,26,25,24,23,43,42,46,45,15,44],[1,4,27,26,25,24,23,43,47],[1,4,27,26,25,24,23,43,47],[1,4,27,26,25,24,23,43,48],[1,4,27,26,25,24,23,43,47],[1,4,27,26,25,24,23,43,47],[1,4,27,26,25,24,23,43,48],[1,4,27,26,25,

ravwojdyla

# FILE: /etc/systemd/system/auto-suspend.service
[Unit]
Description=Auto-suspend VM
After=network-online.target

[Service]
# NOTE: adjust this to whatever you need
ExecStart=/usr/bin/auto_suspend_vm 1.0 60 60

[Install]

ravwojdyla

" zip.vim version v27
" Browsing zipfile /Users/rav/.m2/repository/com/esotericsoftware/kryo-shaded/4.0.0/kryo-shaded-4.0.0.jar
" Select a file with cursor and press ENTER

META-INF/
META-INF/MANIFEST.MF
META-INF/maven/
META-INF/maven/com.esotericsoftware/
META-INF/maven/com.esotericsoftware/kryo-shaded/
META-INF/maven/com.esotericsoftware/kryo-shaded/pom.properties

ravwojdyla

Keybase proof

I hereby claim:

• I am ravwojdyla on github.
• I am ravwojdyla (https://keybase.io/ravwojdyla) on keybase.
• I have a public key whose fingerprint is 51ED 4795 3717 8EDB 7447 CE1D 2895 2E96 30D5 341F

To claim this, I am signing this object:

ravwojdyla

(snakebite_dev)➜  snakebite git:(master) ✗ python setup.py sdist
running sdist
warning: sdist: manifest template 'MANIFEST.in' does not exist (using default file list)
warning: sdist: standard file not found: should have one of README, README.txt
writing manifest file 'MANIFEST'
creating snakebite-2.4.5                                                                                                       
creating snakebite-2.4.5/bin
creating snakebite-2.4.5/snakebite
creating snakebite-2.4.5/snakebite/protobuf
creating snakebite-2.4.5/test