I used z3 theorem prover to assess LLM output, which is a pretty decent SAT solver. I considered the LLM output successful if it determines the formula is SAT or UNSAT correctly, and for SAT case it needs to provide a valid assignment. Testing the assignment is easy, given an assignment you can add a single variable clause to the formula. If the resulting formula is still SAT, that means the assignment is valid otherwise it means that the assignment contradicts with the formula, and it is invalid.
FT Digital Edition: our digitised print edition。业内人士推荐同城约会作为进阶阅读
Что думаешь? Оцени!，详情可参考Line官方版本下载
Jonah Fisher,Climate correspondent