Skip to content

Instantly share code, notes, and snippets.

View tokenbender's full-sized avatar

tokenbender tokenbender

View GitHub Profile
@tokenbender
tokenbender / RL_Pretraining_Comprehensive_Plan.md
Last active July 14, 2025 09:30
avataRL RL-Based Pretraining Plan

The Gentle Art of Teaching Machines to Speak

A Journey Through Semantic Reinforcement Learning

For the curious mind who has just discovered that language models can learn, and wonders if there might be a kinder way to teach them.

In the hushed moments before dawn, ten thousand starlings lift from a field as one—not because any single bird commands them, but because each learns from its neighbors' subtle shifts, creating a collective intelligence far greater than the sum of its parts.

      >         >
>      >    >        >
@tokenbender
tokenbender / train_modal_standalone.py
Last active July 18, 2025 13:33
standalone serverless simple character level transformer
import os
import sys
import time
import math
import pickle
from contextlib import nullcontext
from pathlib import Path
import subprocess
from dataclasses import dataclass
import inspect
You have to assign tasks to a junior engineer to solve a user problem. The user problem could be of various forms:
- Adding a feature
- Debugging a failing test case
- Understanding a feature in the codebase
- A GitHub issue raised on the codebase
## Instructions
### Repository status
Repository Name: astropy (update if different)
@tokenbender
tokenbender / normcore-llm.md
Created February 11, 2024 14:36 — forked from veekaybee/normcore-llm.md
Normcore LLM Reads

Anti-hype LLM reading list

Goals: Add links that are reasonable and good explanations of how stuff works. No hype and no vendor content if possible. Practical first-hand accounts of models in prod eagerly sought.

Foundational Concepts

Screenshot 2023-12-18 at 10 40 27 PM

Pre-Transformer Models

@tokenbender
tokenbender / graph_101.cpp
Created November 22, 2017 15:08 — forked from abrarShariar/graph_101.cpp
Graph implementation using C++
/*
Graph implementation following tutorial http://www.geeksforgeeks.org/graph-and-its-representations/
*/
#include<iostream>
#include<cstdlib>
using namespace std;
//struct for an adjacency list node
struct AdjListNode{
int data;
@tokenbender
tokenbender / AVL Tree.cpp
Created November 22, 2017 15:08 — forked from harish-r/AVL Tree.cpp
AVL Tree Implementation in C++. Self Balancing Tree
/* AVL Tree Implementation in C++ */
/* Harish R */
#include<iostream>
using namespace std;
class BST
{
@tokenbender
tokenbender / binary-search-tree.cpp
Last active November 24, 2017 21:01 — forked from mgechev/binary-search-tree-cpp.cpp
Simple implementation of binary search tree in C++.
#include <iostream>
#include <math.h>
using namespace std;
template <class T>
struct Node {
T value;
Node *left;
Node *right;
@tokenbender
tokenbender / btree.cpp
Created November 22, 2017 15:01 — forked from toboqus/btree.cpp
Binary tree implementation in c++
#include <iostream>
using namespace std;
struct node{
int value;
node *left;
node *right;
};
@tokenbender
tokenbender / disjoint_set_union.h
Created November 22, 2017 15:01 — forked from fyquah/disjoint_set_union.h
Disjoint Set Union Implementation in C++
#include <cstring>
class Disjoint_Union
{
public:
Disjoint_Union(const int & n);
int create();
void merge(int i , int j);
int find(const int & i);
int size(){