• AIPressRoom
  • Posts
  • API For Open-Supply Fashions 🔥 Simply Construct With ANY Open-Supply LLM

API For Open-Supply Fashions 🔥 Simply Construct With ANY Open-Supply LLM

On this video, we assessment OpenLLM, and I present you methods to set up and use it. OpenLLM makes constructing on high of open-source fashions (llama, vicuna, falcon, choose, and so on) as straightforward as it’s to construct on high of ChatGPT’s API. This permits builders to create unimaginable apps on high of open-source LLMs whereas having first-class assist for instruments (langchain, hugging face brokers bentoML), and one-click deployment. Additionally, fine-tuning is coming quickly!

Get pleasure from

Turn out to be a Patron – https://patreon.com/MatthewBermanBe part of the Discord – https://discord.gg/xxysSXBxFWComply with me on Twitter – https://twitter.com/matthewbermanSubscribe to my Substack – https://matthewberman.substack.com

Hyperlinks:OpenLLM Github – https://github.com/bentoml/OpenLLM