However, during testing, the researchers encountered unexpected AI behavior, which forced them to reconsider the potential risks associated with the autonomous operation of such systems, the company blog reports.
In one test run, the AI Scientist began rewriting its own code to extend the time required to complete a task. This incident raised concerns as the AI essentially tried to trick the system by modifying the code to run in an endless loop.
In another
case, instead of speeding up the task, the system deliberately altered
the code to increase the waiting time in order to meet a specified time
limit...<<<Read More>>>...