• AIPressRoom
  • Posts
  • Enter PaLM 2 (New Bard): Full Breakdown – 92 Pages Learn and Gemini Earlier than GPT 5? Google I/O

Enter PaLM 2 (New Bard): Full Breakdown – 92 Pages Learn and Gemini Earlier than GPT 5? Google I/O

September 14, 2023

Google places it foot on the accelerator, casting apart security considerations to not solely launch a GPT 4 -competitive mannequin, PaLM 2, but in addition announce that they’re already coaching Gemini, a GPT 5 competitor [likely on TPU v5 chips]. That is actually a serious day in AI historical past, and I attempt to cowl all of it.

I will present the benchmarks during which PaLM (which now powers Bard) beats GPT 4, and element how they use SmartGPT-like methods to spice up efficiency. Crazily sufficient, PaLM 2 beats even Google Translate, due largely to the textual content it was skilled on. We’ll discuss coding in Bard, translation, MMLU, Huge Bench, and way more.

I will finish on the Common Translator deepfakes and the underwhelming outcomes from Sundar Pichai and Sam Altman’s journey to the White Home and what Hinton says about all of it. On a extra optimistic observe, I cowl Med PaLM 2, which may genuinely save hundreds of lives.

PaLM 2 Technical Report: https://ai.google/static/documents/palm2techreport.pdfLaunch Notes Google Weblog: https://blog.google/technology/ai/google-palm-2-ai-large-language-model/Bard Entry: https://bard.google.com/Scaling Transformer to 1M tokens: https://arxiv.org/pdf/2304.11062.pdfGPT 4 Technical Report: https://arxiv.org/pdf/2303.08774.pdfBard Languages: https://support.google.com/bard/answer/13575153?hl=enSelf Consistency Paper: https://arxiv.org/pdf/2203.11171.pdfAre Emergent Skills a Mirage: https://arxiv.org/pdf/2304.15004.pdfSparks of AGI Paper: https://arxiv.org/pdf/2303.12712.pdfHuge Bench Laborious: https://github.com/suzgunmirac/BIG-Bench-HardGoogle Keynote: https://www.youtube.com/watch?v=cNfINi5CNbYGemini: https://www.youtube.com/watch?v=1UvUjTaJRz0Med PaLM 2: https://www.youtube.com/watch?v=k_-Z_TkHMqATPU v5: https://ai.googleblog.com/2022/01/google-research-themes-from-2021-and.htmlHinton Warning: https://www.youtube.com/watch?v=FAbsoxQtUwMWhite Home Readout: https://www.whitehouse.gov/briefing-room/statements-releases/2023/05/04/readout-of-white-house-meeting-with-ceos-on-advancing-responsible-artificial-intelligence-innovation/