GPT3 Tutorial: Easy methods to Obtain And Use GPT3(GPT Neo)

On this video, I’m going over the best way to obtain and run the open-source implementation of GPT3, known as GPT Neo. This mannequin is 2.7 billion parameters, which is identical measurement as GPT3 Ada. The outcomes are excellent and are a big enchancment over GPT-2. I’m excited to mess around with this mannequin extra and for the way forward for even bigger NLP fashions.

Pocket book https://github.com/mallorbc/GPTNeo_notebookGPT Neo github https://github.com/EleutherAI/gpt-neo (use the primary launch tag)GPT Neo HuggingFace docs https://huggingface.co/transformers/model_doc/gpt_neo.htmlA helpful article about transformer parameters https://huggingface.co/blog/how-to-generate

00:00 – GPT3 Background01:07 – GPT3 Interview02:06 – GPT Neo Github03:14 – GPT Neo HuggingFace03:52 – Establishing Anaconda and Jupyter05:05 – Beginning the Jupyter pocket book06:14 – Putting in dependencies within the pocket book06:58 – Importing wanted dependencies07:33 – Deciding on what GPT mannequin to make use of08:45 – Checking our pc {hardware}09:36 – Loading the tokenizer09:55 – Giving our inputs10:39 – Producing the tokens with the mannequin11:42 – Decoding and studying the consequence13:22 – Reflections on Transformers14:26 – Outro questions future work

The post GPT3 Tutorial: Easy methods to Obtain And Use GPT3(GPT Neo) appeared first on AIPressRoom.