Skip to content

Instantly share code, notes, and snippets.

@jrhumberto

jrhumberto/gradientaccumulation-for-continual-pretraining.ipynb

Forked from Arunprakash-A/gradientaccumulation-for-continual-pretraining.ipynb
Created August 18, 2024 08:34
Show Gist options
  • Save jrhumberto/82a5f1e3df6ef4e5dd3c3444547e7368 to your computer and use it in GitHub Desktop.
Save jrhumberto/82a5f1e3df6ef4e5dd3c3444547e7368 to your computer and use it in GitHub Desktop.
Download ZIP
GradientAccumulation-for-continual-pretraining.ipynb
Display the source blob
Display the rendered blob
Raw
gradientaccumulation-for-continual-pretraining.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment