> that's almost the perfect task where AI can do both ends. [..] Which is pretty much a sign that assessments such as this have low educational impact.
This seems like a bit too far of a leap.
When teaching math, we want students to be able to prove novel theorems. But all the open problems in mathematics are really hard, so teachers often start by getting students to practice on easier theorems that have already been proven.
In this context, something like "prove the Pythagorean Theorem" is a useful exercise and valuable assessment! You just need to make sure the student actually does it instead of copying the answer from the Internet (directly or via ChatGPT).
This seems like a bit too far of a leap.
When teaching math, we want students to be able to prove novel theorems. But all the open problems in mathematics are really hard, so teachers often start by getting students to practice on easier theorems that have already been proven.
In this context, something like "prove the Pythagorean Theorem" is a useful exercise and valuable assessment! You just need to make sure the student actually does it instead of copying the answer from the Internet (directly or via ChatGPT).