I would argue that none of "Weltschmerz", "Gaekwar", "Ucalegon" and "Houghmagandy" are really English words, although I already knew 2 of them.

And one of them prevented me from a perfect score, when I guessed wrong.

On the second run-through there was significant overlap. Maybe 30 or 40% of the words were from the first run-through.

I found a big problem with this - I noticed that the longest answer is very often the correct one, which kinda ruined the game. Even though I didn't want it to, it started affecting my decision-making. Luckily, I only noticed this around question 85, though those are really the tricky ones.

Good news for the project is that I think you can easily tweak the LLM to generate better alternatives.

I got 89/100, which extrapolates to 72,700. As a non-native speaker, I'm quite happy with that.

Cool idea, am working through.

It's annoying that you need to click 3 times per question, and the buttons are in 2 different places.

Maybe would be better to just let me click the answer I want and then instantly show me the next question?

Also who is Sandi?

I'm sure everyones scores would be a lot lower if we had to describe each word instead of selecting between silly/smart sounding definitions. As was mentioned before, it needs "I don't know" button, otherwise it's too easy to guess.

This approach could also work for getting more accurate results:

1. Show word without any definitions

2. User clicks "I know" or "I don't know"

3. If user clicked "I know", show actual definition of word

4. User selects "I was correct" or "I was not correct"

This was fun! The progression seems logical.

I scored 71,000.

Whole thingy has one giant problem which is that correct answer is probably the longest one.

First try I noticed it in about the middle of the quiz and got ~65k Second try I selected only the longest and got ~78k

Good fun! At first I was scared of having to answer 100 questions, but when the words got more sophisticated it turned to be more engaging. Also, the result is good for self-esteem! :) Many thanks to the author!

I wonder if the test is calibrated to the fact that some answers are just well guessed? I am not a native English speaker, but I speak 3 languages overall and have basic notions in Latin, and I have to admit it helped a lot in "deciphering" a few words that I didn't know at all. And in at least 2 cases I just guessed correctly.

The longest answer choice is correct 80%+ of the time, when it should be closer to 25%. I was able to breeze through unfamiliar words just by picking the longest option every time…

71050, not bad for a non native speaker I guess. I missed 9/100.

But to be honest many that might catch out a native speaker are just the Spanish/French/Latin word, so it was too easy in a way.

This is cute, but here is the result I got by always clicking the longest answer, or the first one if two seemed equal:

Scientific Estimate: 71,650 words

"Unbelievable. Are you actually Stephen Fry in disguise?"

Core Basics: 16/20

Intermediate: 15/20

Advanced: 19/20

Expert: 18/20

Grandmaster: 16/20

This is significant beyond this particular app, because biases like this are found all over the place in popular LLM benchmarks.