Posted by itvision 14 hours ago
Enjoying the Ian Cutress / TechTechPotato video on Taalas. Some ok good technical details on the tech, and some good insider baseball, whose who stuff. (What a treasure having tech discussions like this about.) https://youtu.be/3MKRjt59hh4
so instead of RTX xx70 series, I can buy xxTA that have kimi integrated ??? is that right ??
You need to be able to add|mul where the data (the weights) are stored.
Bonsai Ternary (1.7bits/weight) is a compromise, compromise that has to make sense in the context - efficient when translated into transistors.