Discussion about this post

User's avatar
Jenni Majumdar's avatar

The escalation question matches my experience from the requesting side. Our last scoping-review search returned about eight thousand records, and the judgement that carried the most weight was knowing in advance which of our concepts the indexing would handle badly. No amount of wording gets you that; it comes from having been burned by that concept before. Naming it as a design input rather than a preference is what makes it something an engineer can build against. Worth adding that the domain expert also has to be willing to state the stopping rule out loud, which is harder than it sounds.

Shreya Wadhwa's avatar

Your point about junior learning is the one that stayed with me. If an agent takes over the routine work where people learn what errors look like, we may eventually have fewer experts capable of judging the agent’s output or improving the workflow around it. Have you seen a convincing way to preserve that apprenticeship while still automating the repetitive parts?

No posts

Ready for more?