JAWS is getting agentic AI soon. From the demos it was able to take a Word document out of protected mode and pick a date in an inaccessible date picker. It can do multi-step actions too and speaks each step as it does it. If it fails or only partially completes, it speaks a message explaining why. It works both on and off the web. #NFB26
@JonathanMosen @emassey0135 If you're a NVDA user, don't worry! I created computer use Addon for NVDA a few months ago, so NVDA can use your computer using mouse and keyboard commands and perform tasks with inaccessible UI based on your prompt.
Also if you're a Mac users, VOCR on Mac was able to do this for a while now. :)
https://github.com/chigkim/NVDAComputerUse/
https://github.com/chigkim/VOCR/