"Interesting behavior": Developers of a new rival to ChatGPT say their AI appears to be aware of when they're testing how smart it is, a skill apparently not yet seen in this kind of software. Sebastian Gollnow/dpa
The latest rival to ChatGPT claims the ability to recognize when people are testing it, according to developers at Anthropic, touting what appears to be a new level of awareness for an AI-powered chatbot.
To assess the capabilities of such chatbots, developers typically run a so-called "needle-in-a-haystack" evaluation, which involves asking the software about a longer text into which an unrelated sentence has been artificially inserted.
The aim is to find out how well the software can identify the relevance of information in its context.
Report typos and corrections to corrections@rawstory.com.
For customer support contact support@rawstory.com.
