Testing LLM reasoning abilities with SAT is not an original idea; there is a recent research that did a thorough testing with models such as GPT-4o and found that for hard enough problems, every model degrades to random guessing. But I couldn't find any research that used newer models like I used. It would be nice to see a more thorough testing done again with newer models.
“昨天的要坚持下去,今天的要有所深化,明天的要取得更大成效”。不做寅吃卯粮、击鼓传花的虚浮之举,而是“甘于做铺垫性的工作,甘于抓未成之事”。
。爱思助手下载最新版本是该领域的重要参考
Москвичей предупредили о резком похолодании09:45
1L decoder, d=7, 1h, ff=14