I am building an assistive technology communication system for a Traumatic Brain Injury client with visual impairment.
To accommodate visual limitations, I have a 2 monitor setup with one accommodating an on-screen keyboard + screen reader for user input and the other displays the apps / windows in use.
The screen reader software I am using (JAWS) reads the keyboard keys being highlighted when a traditional mouse is used, but not when I am using Sesame Enable. Additionally, the range of motion appears to be limited to whichever monitor Sesame Enable begins operation on (mouse tracking stops at the perimeter of the primary monitor but won’t track on the second monitor / extended desktop).
Is it possible to add 1) extended desktop / dual monitor capability & 2) on-screen reader functionality (doesn’t need to be JAWS, that was just an example) so that the key being highlighted by the mouse can be announced?
I’ve added the request to support multiple monitors to our work queue. Will update here once a version update is released that contains this feature.
As for highlighting of on screen keyboard – I verified the behavior you mention. It seems while all other keys are highlighted OK with the Sesame mouse, the keys of the on-screen keyboard do not. I suspect they integrate separately with the mouse cursor, and we’ll need further research into this. Added as well to the queue.
For the time being, perhaps voice dictation could supplement the onscreen keyboard?
Many thanks for reaching out, will update when we’ve progressed on the above.