RuntimeError: mat1 and mat2 must have the same dtype, but got Float and Half

#1
by Bluebomber182 - opened

I got this error message

Errore nella generazione dell'audio: mat1 and mat2 must have the same dtype, but got Float and Half

Traceback dettagliato:
Traceback (most recent call last):
  File "/mnt/12tb/aurora-1.6b/app.py", line 255, in text_to_speech
    speech = model.generate_speech(
             ^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/12tb/aurora-1.6b/venv/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 116, in decorate_context
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/12tb/aurora-1.6b/venv/lib/python3.11/site-packages/transformers/models/speecht5/modeling_speecht5.py", line 2944, in generate_speech
    return _generate_speech(
           ^^^^^^^^^^^^^^^^^
  File "/mnt/12tb/aurora-1.6b/venv/lib/python3.11/site-packages/transformers/models/speecht5/modeling_speecht5.py", line 2521, in _generate_speech
    decoder_hidden_states = model.speecht5.decoder.prenet(output_sequence, speaker_embeddings)
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/12tb/aurora-1.6b/venv/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1751, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/12tb/aurora-1.6b/venv/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1762, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/12tb/aurora-1.6b/venv/lib/python3.11/site-packages/transformers/models/speecht5/modeling_speecht5.py", line 701, in forward
    inputs_embeds = nn.functional.relu(self.speaker_embeds_layer(inputs_embeds))
                                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/12tb/aurora-1.6b/venv/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1751, in _wrapped_call_impl
    return self._call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/12tb/aurora-1.6b/venv/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1762, in _call_impl
    return forward_call(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/12tb/aurora-1.6b/venv/lib/python3.11/site-packages/torch/nn/modules/linear.py", line 125, in forward
    return F.linear(input, self.weight, self.bias)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: mat1 and mat2 must have the same dtype, but got Float and Half

Sign up or log in to comment