2024-10-22 09:40:39,200 - SpeechQuantizer - INFO - Loading model components on cuda... 2024-10-22 09:40:39,307 - SpeechQuantizer - INFO - Attempting to load tokenizer from Omarrran/english_speecht5_finetuned 2024-10-22 09:40:39,416 - SpeechQuantizer - WARNING - Original tokenizer loading failed: expected str, bytes or os.PathLike object, not NoneType 2024-10-22 09:40:39,428 - SpeechQuantizer - INFO - Attempting to load tokenizer from fallback model facebook/s2t-small-librispeech-asr 2024-10-22 09:40:39,553 - SpeechQuantizer - INFO - Successfully loaded tokenizer from facebook/s2t-small-librispeech-asr 2024-10-22 09:40:40,372 - SpeechQuantizer - INFO - Model components loaded successfully 2024-10-22 09:40:40,386 - SpeechQuantizer - INFO - Memory usage: RSS=3731.4MB 2024-10-22 09:40:40,395 - SpeechQuantizer - INFO - GPU memory: 2342.8MB allocated 2024-10-22 09:40:40,404 - SpeechQuantizer - INFO - Starting model calibration... 2024-10-22 09:40:40,414 - SpeechQuantizer - INFO - Generating 10 calibration samples... 2024-10-22 09:40:45,565 - SpeechQuantizer - INFO - Successfully generated 10 calibration samples 2024-10-22 09:40:45,749 - SpeechQuantizer - INFO - Calibrating model with 10 samples... 2024-10-22 09:40:45,766 - SpeechQuantizer - INFO - Calibration completed successfully: 10/10 samples processed (100%) 2024-10-22 09:40:45,785 - SpeechQuantizer - INFO - Calibration statistics: 2024-10-22 09:40:45,801 - SpeechQuantizer - INFO - - Mean Absolute Error: 0.0432 2024-10-22 09:40:45,814 - SpeechQuantizer - INFO - - Mean Squared Error: 0.0019 2024-10-22 09:40:45,824 - SpeechQuantizer - INFO - - R-squared: 0.9876 2024-10-22 09:40:45,832 - SpeechQuantizer - INFO - Calibration completed successfully 2024-10-22 09:40:45,840 - SpeechQuantizer - WARNING - No successful calibrations. Proceeding with caution. 2024-10-22 09:40:45,847 - SpeechQuantizer - INFO - Starting quantization process... 2024-10-22 09:40:46,529 - SpeechQuantizer - INFO - Applying dynamic quantization... 2024-10-22 09:40:48,931 - SpeechQuantizer - INFO - Quantization completed successfully 2024-10-22 09:40:48,950 - SpeechQuantizer - INFO - Saving and pushing model...