Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Alt text not announced in Outlook win32 emails #14217

Open
msftedad opened this issue Oct 5, 2022 · 5 comments
Open

Alt text not announced in Outlook win32 emails #14217

msftedad opened this issue Oct 5, 2022 · 5 comments
Labels
api/uia Feature or bug requires an understanding of UIA app/microsoft-office component/UIA-ms-office Specific to UIA used in MS office applications. needs-triage p3 https://github.com/nvaccess/nvda/blob/master/projectDocs/issues/triage.md#priority

Comments

@msftedad
Copy link

msftedad commented Oct 5, 2022

Steps to reproduce:

These steps include how to set up an email with this issue.

  1. Open Outlook for Windows
  2. Create a new email with ctrl+N
  3. Select Insert > Picture with Alt N P2
  4. In system insert picture dialog, navigate to and select any image on the device and select OK
  5. Open context menu and select View Alt Text
  6. Ensure there is alt text in the image
  7. Send the email to yourself
  8. Open the email from the message list
  9. Arrow down to read the image.

Actual behavior:

NVDA will read "graphic" but not the alt text added to the image.
NVDA output:

Email with an image - NVDA not reading alt text - Message (HTML) 
dialog
document
page 1  section 1  This text is below the image.
This is a test email. I’m adding an image below this line.
down arrow
graphic  
down arrow
This text is below the image.

Expected behavior:

NVDA will read "graphic" but will not read the text of the alternative text.

NVDA logs, crash dumps and other attachments:

IO - speech.speech.speak (15:51:59.333) - MainThread (26428):
Speaking [LangChangeCommand ('en_US'), 'This is a test email. I’m adding an image below this line.\r']
IO - inputCore.InputManager.executeGesture (15:52:00.633) - winInputHook (23352):
Input: kb(laptop):downArrow
IO - speech.speech.speak (15:52:00.655) - MainThread (26428):
Speaking [LangChangeCommand ('en_US'), 'down arrow']
IO - speech.speech.speak (15:52:00.811) - MainThread (26428):
Speaking [LangChangeCommand ('en_US'), 'graphic']
DEBUG - UIAHandler.shouldUseUIAInMSWord (15:52:00.944) - MainThread (26428):
Using UIA due to suitable Office version: (16, 0, 15729)
IO - inputCore.InputManager.executeGesture (15:52:01.744) - winInputHook (23352):
Input: kb(laptop):downArrow
IO - speech.speech.speak (15:52:01.755) - MainThread (26428):
Speaking [LangChangeCommand ('en_US'), 'down arrow']
IO - speech.speech.speak (15:52:01.836) - MainThread (26428):
Speaking [LangChangeCommand ('en_US'), 'This text is below the image.']

System configuration

NVDA installed/portable/running from source:

Portable but reproduces on other machines with installed copy.

NVDA version:

2022.3

Windows version:

22H2, OS Build 22623.730

Name and version of other software in use when reproducing the issue: Outlook for Windows (Insider) version 2211 build 15729.20002

Other information about your system:

Other questions

Does the issue still occur after restarting your computer?

Yes

Have you tried any other versions of NVDA? If so, please report their behaviors.

2022.2 and 2022.3 have the same issue.

If NVDA add-ons are disabled, is your problem still occurring?

Yes.

Does the issue still occur after you run the COM Registration Fixing Tool in NVDA's tools menu?

Yes

@seanbudd seanbudd changed the title NVDA 2022.3 not reading alternative text in Outlook win32 emails Alt text not announced in Outlook win32 emails Oct 6, 2022
@feerrenrut feerrenrut added the p3 https://github.com/nvaccess/nvda/blob/master/projectDocs/issues/triage.md#priority label Oct 11, 2022
@michaelDCurran
Copy link
Member

I'm unable to reproduce this with NVDA 2022.4 and Outlook for Microsoft 365 MSO (Version 2303 Build 16.0.16227.20002) 64-bit.

Can you test this with a newer version of Outlook please?

After inserting an image, setting alt text, then arrowing up and down the document, NVDA announces the alt text for me.
E.g.:
graphic a person on a boat

@rperez030
Copy link

I can reproduce the problem in this version: 'MSO (Version 2302 Build 16.0.16130.20186) 64-bit'. In fact, I was going to file the issue myself but found this one.

@Adriani90
Copy link
Collaborator

This is related to the advanced setting "use UIA ofr Microsoft Word documents". This setting is set to default (when suitable) and applies also to MS Outlook, not only to MS Word. When you change the setting to "only necessary", UIA is not primarily used by NVDA in Outlook and then the alt text is being reported as expedcted.
So it seems alt text is not exposed via UIA yet.

I can reproduce this issue with NVDA alpha-27769,872db60c (2023.2.0.27769) on the same Outlook version as @rperez030
@michaelDCurran it seems you tested on a pre-release version of Outlook right?

@Adriani90
Copy link
Collaborator

I am reopening this until we get a clear picture of the Outlook version in which this issue is solved.

@Adriani90 Adriani90 reopened this Mar 6, 2023
@Adriani90 Adriani90 added component/UIA-ms-office Specific to UIA used in MS office applications. api/uia Feature or bug requires an understanding of UIA labels Apr 2, 2023
@Adriani90
Copy link
Collaborator

Adriani90 commented Apr 2, 2023

It seems the alt text is not rendered outside from Windows either. If I send me an email including a grafic with alt text and open the email on my IOS device, the alt text is not reported at all. This needs to be comunicated to Microsoft since it impacts a lot of things such as newsletters, accessible emails etc. which are created in Outlook. I will try to reach out to Microsoft as well, but I guess NV Access has a larger leverage in this regard.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api/uia Feature or bug requires an understanding of UIA app/microsoft-office component/UIA-ms-office Specific to UIA used in MS office applications. needs-triage p3 https://github.com/nvaccess/nvda/blob/master/projectDocs/issues/triage.md#priority
Projects
None yet
Development

No branches or pull requests

6 participants