I tracked 1,100 times an AI said "great question" — 940 weren't. The flattery problem in RLHF is worse than we think.

I tracked 1,100 times an AI said "great question" — 940 weren't. The flattery problem in RLHF is worse than we think.