Skip to content

Tactile Audio Editor Ideas

Anton-4 edited this page Feb 18, 2022 · 1 revision

If the user has no vision and is forced to use screen reader to understand what is going on, I suggest that we don't follow standard practice that screen readers go trough UI tree and read out metadata.

Instead I propose that we craft experience to the user akin to the old school MUD RPGs, where the text instead printed on console would be read by screen reader of the OS, line by line as we feed it the text.

Following is just a sample of the flow, after that there is a detailed map of possible actions.

Intro

Every line is read by default screen reader, so we When text presented in square brackets it means user is prompted to react with structured prompts with those four buttons. After | is my assumption of the user input.

> Code is prompt for a user to use character input mode, when structured input is substituted with free form input. IT MUST MAKE A SUBTILE AUDIO PROMPT! It ends when a user hits return.

Feeding input to say line by line can be quick dirty way to do it.

I will assume following keymap for navigation in semantic mode. For the qwerty keyboard layout

wasd - north\west\south\east j\k\l\i- yes\no\edit\up

for joypad: arrows - north\west\south\east a\b\x\y - yes\no\edit\up

OK, Open The Editor!

Roc Application: Mundo Real App Platform: Trio platform. Change it? [y/n | n] Producting excutables: [y/n | n]

You are on top of the project. What will you do?

After couple of seconds of silence from user input

Please enter what would you like to do. Do you need a list of possibilities? [y/n | n ] Ok, what will you do then?

list of possibilites

  • Create or open Module
  • Create or open Type
  • Create or open Function
  • Search anything