[Whisper test] Fix some failing tests

[ylacombe]

What does this PR do?

This PR proposes multiple simple fix to some Whisper failing tests:

1. Fix failing tensor device
2. Fix long-form integration tests that weren't using return_timestamps=True

UPDATE: ready for review, I'll correct more tests in the coming days

cc @LysandreJik and @ydshieh

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[ydshieh]

It would be a good opportunity to use the run-slow in this PR

[ylacombe]

There'll be failing tests though FYI, there's a lot of work to do around Whisper!

[ydshieh]

Yeah I understand. (just want to make sure the tests fixed in this PR are passing).

The core maintainers could still merge in that case.

[LysandreJik]

Thanks for the fixes @ylacombe!

[ylacombe]

@ydshieh, do you know why this error happens ?
Bus error (core dumped)

[ydshieh]

No, it happens in some models and runs. It's more a infra issue I think.

[ydshieh]

I re-triggered it. Let's see

[ylacombe]

Still happening!

[ydshieh]

Let me see what I can do manually.

[ydshieh]

I pushed a commit to run slow ci on the (about to deploy) new cluster. Let me know how it goes 🙏

(before merge, let me revert my commits 🙏 )

[ydshieh]

Could you check if the fixed tests are passing in the following run ?

https://github.com/huggingface/transformers/actions/runs/10885416563/job/30203010247?pr=33450

or download the artifact

https://github.com/huggingface/transformers/actions/runs/10885416563?pr=33450

and check the file summary_short.txt would be easier

[ylacombe]

Hey @ydshieh, they passed indeed ! Thanks for helping me on this,
I'll merge once you revert the commit!

[ydshieh]

Nice! Reverted!