That is a good point actually (this is how we at Hugston measure tokens, in bytes). 270k tokens should be around ~1100kb or 1 MB, so not really enough for a serious project.
greatsage_sh 1 day ago||
[flagged]
feiz45607 1 day ago||
[flagged]
robkam 2 days ago||
[flagged]
rotariuvladimir 1 day ago||
[dead]
nttylock 2 days ago||
[flagged]
greenoracle9 2 days ago||
[dead]
cyb3ralbert 2 days ago||
Context size cuts like this are usually a cost/latency tradeoff rather than a capability one - serving a smaller window is cheaper and keeps latency in check, and most sessions probably don't need anywhere near 372k tokens anyway. Curious if this affects people who were actually relying on the larger window for big codebases.
mikhailt 1 day ago|
We'll have to wait because Tibo (OpenAI) said this was a temporary measure and it'd go back to 372k soon.
The issue was more specific to higher token burn rates, not latency.
CurbStomper 1 day ago||
[dead]
aurbxyajwur 2 days ago|
5.6 is a mess
gurjeet 1 day ago|
Please elaborate.
> Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something.