1
0
Fork 0
mirror of https://github.com/karpathy/minGPT synced 2024-06-02 04:46:07 +02:00

Fix broken hugging face link & add link to huggingface / transformers

This commit is contained in:
Mishig Davaadorj 2021-12-08 11:37:43 +01:00 committed by Andrej Karpathy
parent 8fcaafb367
commit fd2977c4e0

View File

@ -50,7 +50,7 @@ Code:
- [openai/gpt-2](https://github.com/openai/gpt-2) has the model but not the training code, and in TensorFlow
- [openai/image-gpt](https://github.com/openai/image-gpt) has some more modern gpt-3 like modification in its code, good reference as well
- huggingface/transformers has a [language-modeling example](https://github.com/huggingface/transformers/tree/master/examples/language-modeling). It is full-featured but as a result also somewhat challenging to trace. E.g. some large functions have as much as 90% unused code behind various branching statements that is unused in the default setting of simple language modeling.
- [huggingface/transformers](https://github.com/huggingface/transformers) has a [language-modeling example](https://github.com/huggingface/transformers/tree/master/examples/pytorch/language-modeling). It is full-featured but as a result also somewhat challenging to trace. E.g. some large functions have as much as 90% unused code behind various branching statements that is unused in the default setting of simple language modeling.
Papers + some implementation notes: