dsdanielpark / HuggingfaceBigModelSequentialDownloader.md

Created April 21, 2025 13:07

Rate‑Limit‑Safe Sequential Download of Large HuggingFace Models

"""
Sequentially download all files from a Hugging Face model repository
while preserving default cache behavior and robust retry logic.
"""
import os
import time
import argparse
import logging

dsdanielpark / ubuntu2204_ruby_gem_jekyll_for_gitblog.md

Last active June 18, 2024 02:53

Installing Ruby GEM Jekyll on Ubuntu 22.04 with RVM (GitBlog)

Installing command Ruby + GEM + Jekyll on Ubuntu 22.04 with RVM

Q: Why did you build it manually when GitHub builds automatically?
GitHub builds take a long time depending on the number of posts, and debugging is very difficult as changes are not reflected in real-time.

Check Jekyll installation, RubyGems.org

Command summary

dsdanielpark / Ubuntu+Nginx+SSL(acme.sh)+CloudflareDNS+Flask.md

Last active April 23, 2025 01:47

Ubuntu 22.04 + Nginx + SSL (acme.sh) + Cloudflare DNS Setup + Flask + tumx

Step-by-Step Guide to Setting Up SSL with Nginx on Ubuntu 22.04

This guide provides a detailed walkthrough on setting up SSL (Secure Sockets Layer) with Nginx using OpenSSL and acme.sh on Ubuntu 22.04. Each step is explained with key concepts and commands for a clear understanding.

Most errors occur due to incorrect paths. Know your path and create files and directories correctly before passing them as arguments.

dsdanielpark / LLM.md

Created October 4, 2023 08:24 — forked from rain-1/LLM.md

LLM Introduction: Learn Language Models

Purpose

Bootstrap knowledge of LLMs ASAP. With a bias/focus to GPT.

Avoid being a link dump. Try to provide only valuable well tuned information.

Prelude

Neural network links before starting with transformers.

dsdanielpark / RLHF.md

Created August 10, 2023 07:55 — forked from JoaoLages/RLHF.md

Reinforcement Learning from Human Feedback (RLHF) - a simplified explanation

Maybe you've heard about this technique but you haven't completely understood it, especially the PPO part. This explanation might help.

We will focus on text-to-text language models 📝, such as GPT-3, BLOOM, and T5. Models like BERT, which are encoder-only, are not addressed.

Reinforcement Learning from Human Feedback (RLHF) has been successfully applied in ChatGPT, hence its major increase in popularity. 📈

RLHF is especially useful in two scenarios 🌟:

You can’t create a good loss function
- Example: how do you calculate a metric to measure if the model’s output was funny?
You want to train with production data, but you can’t easily label your production data

dsdanielpark / gist:6087c6d8e17d1fce4472d1ffc9ea7176

Created July 25, 2023 06:59 — forked from rxaviers/gist:7360908

Complete list of github markdown emoji markup

People

`:bowtie:`	😄 `:smile:`	😆 `:laughing:`
😊 `:blush:`	😃 `:smiley:`	☺️ `:relaxed:`
😏 `:smirk:`	😍 `:heart_eyes:`	😘 `:kissing_heart:`
😚 `:kissing_closed_eyes:`	😳 `:flushed:`	😌 `:relieved:`
😆 `:satisfied:`	😁 `:grin:`	😉 `:wink:`
😜 `:stuck_out_tongue_winking_eye:`	😝 `:stuck_out_tongue_closed_eyes:`	😀 `:grinning:`
😗 `:kissing:`	😙 `:kissing_smiling_eyes:`	😛 `:stuck_out_tongue:`

dsdanielpark / shpinx.md

Last active January 23, 2024 17:30

shpinx auto doc

Shpinx

Installation

pip install Sphinx

Quick start

mkdir docs
cd docs

dsdanielpark / github_unstar.md

Last active April 11, 2023 13:27

make star clear

How to unstar all repository.

Reference: https://gist.github.com/justlaputa/a6da84981eca963817e652b5f2452cfc

Generate authorization token for unstar. https://github.com/settings/tokens
Export variable

export APIKEY=xxxxxxxxx

dsdanielpark / git_ssh.md

Last active April 11, 2023 11:18

manage mutiple git ssh

SSH rsa key gen in local storage

   2 cd ~/.ssh
   
   3 ls -al

   # SSH Keygen
   5 ssh-keygen -t rsa -C "[email protected]" -f "id_rsa_gitId1"

dsdanielpark / mongoose.md

Created April 10, 2023 14:01

mongoose web server