« #AI reviewers are here — we are not ready » – by Giorgio F. Gilestro
Researchers understand, for instance, which experiments are feasible within realistic budget and time constraints, and which protocols are robust or temperamental. But an LLM can only reflect the literature, and published claims can be exaggerated. Moreover, specialists know when older approaches in their field have been, or should be, superseded by techniques that are just starting to appear in an LLM’s training data set.
🤔 This sounds the same criticism as Wittgenstein’s book, right?