Top
Best
New

Posted by DeepLogin 4 days ago

Generative AI uses more energy on non-English text(news.umich.edu)
163 points | 90 commentspage 2
ejazarain 8 hours ago|
Training is what makes neural networks faster, language usage makes one fluent and English’s frequent usage speeds up generative translation.

why not to test different language with similar and repeated tasks?

The language inter-operability is improving every movement for many models.

bandit-x 5 hours ago||
I think that depends to the language not the LLM. they do not translate, but if a lnaguage express same thing with longer tokens that counts.
robrenaud 7 hours ago||
Use different tokenizers for different languages. Or at least, use different tokenizers for different scripts.
davidmurdoch 8 hours ago||
Isn't English one of the most information dense languages?
tinza123 7 hours ago||
English is not dense at all. I had to change my thread naming to Chinese because the side bar in codex is narrow and English just can’t be as expressive per word
davidmurdoch 7 hours ago||
Written English is still pretty good when compared to all languages. When considering UTF-8 bytes, a English is almost as good as Chinese, since Chinese uses about 3 bytes per character.

For spoken language, French and English are at the top, but most languages are about the same bits/second. Languages with less information density are just spoken faster to make up for it.

bloak 7 hours ago||
How fast people speak is more a cultural thing than a language thing. People in Texas, for example, speak more slowly than other speakers of American English.
davidmurdoch 7 hours ago||
Here's a study on it, I don't know if they included Texans or not: https://verbavia.com/blog/which-language-is-spoken-the-faste...
aprilthird2021 8 hours ago||
Maybe Chinese / Japanese / Korean is more
quickthrowman 7 hours ago||
Yeah I’d imagine having several thousand pictograms is more information dense, but there are huge drawbacks to using pictograms in computing that alphabets do not have, text input being a major one.
ion_trapper 2 hours ago||
The choice to measure in “energy” instead of just “cost” suggests to me this is an unserious attempt at activism instead of a worthwhile benchmarks of LLMs.

Also: Gemma 3, Llama 3.1, come on…

oytis 2 hours ago||
English is the most climate-friendly language, yay!
Dwedit 8 hours ago||
How does Multi-Token Prediction factor into this?
j45 6 hours ago||
I suspect the quality might be higher too when using more energy.
wickedsight 3 hours ago||
Recently, while I was doing a presentation on LLMs at work, I got the question whether prompting in Dutch was fine, or whether English was better. I made the argument that English was probably better, since much more of the content it was trained in was probably English than Dutch and therefore I would assume it would have better understanding of it. I never considered this would also have an impact on the amount of energy being used. Pretty interesting.
juleiie 3 hours ago|
This is what I have been proposing all along:

Ban any language other than English from prompting.

This has multiple benefits - first you restrict third world from spamming USA data centers. Why would America pay for some guy in India using free model?

This alone is worth considering but also you can optimise LLMs further for a single language as opposed to having to translate and couple weights for every single concept.

Why would American LLMs support Chinese language or Arabic? Make them learn English and come to work for us. No more free stuff for the third world.

More comments...