diff --git "a/[MMars]fine_tune_whisper_small_ar.ipynb" "b/[MMars]fine_tune_whisper_small_ar.ipynb" deleted file mode 100644--- "a/[MMars]fine_tune_whisper_small_ar.ipynb" +++ /dev/null @@ -1,20997 +0,0 @@ -{ - "cells": [ - { - "cell_type": "markdown", - "id": "75b58048-7d14-4fc6-8085-1fc08c81b4a6", - "metadata": { - "id": "75b58048-7d14-4fc6-8085-1fc08c81b4a6" - }, - "source": [ - "# Fine-Tune Whisper For Multilingual ASR with ๐Ÿค— Transformers" - ] - }, - { - "cell_type": "markdown", - "id": "fbfa8ad5-4cdc-4512-9058-836cbbf65e1a", - "metadata": { - "id": "fbfa8ad5-4cdc-4512-9058-836cbbf65e1a" - }, - "source": [ - "In this Colab, we present a step-by-step guide on how to fine-tune Whisper \n", - "for any multilingual ASR dataset using Hugging Face ๐Ÿค— Transformers. This is a \n", - "more \"hands-on\" version of the accompanying [blog post](https://huggingface.co/blog/fine-tune-whisper). \n", - "For a more in-depth explanation of Whisper, the Common Voice dataset and the theory behind fine-tuning, the reader is advised to refer to the blog post." - ] - }, - { - "cell_type": "markdown", - "id": "afe0d503-ae4e-4aa7-9af4-dbcba52db41e", - "metadata": { - "id": "afe0d503-ae4e-4aa7-9af4-dbcba52db41e" - }, - "source": [ - "## Introduction" - ] - }, - { - "cell_type": "markdown", - "id": "9ae91ed4-9c3e-4ade-938e-f4c2dcfbfdc0", - "metadata": { - "id": "9ae91ed4-9c3e-4ade-938e-f4c2dcfbfdc0" - }, - "source": [ - "Whisper is a pre-trained model for automatic speech recognition (ASR) \n", - "published in [September 2022](https://openai.com/blog/whisper/) by the authors \n", - "Alec Radford et al. from OpenAI. Unlike many of its predecessors, such as \n", - "[Wav2Vec 2.0](https://arxiv.org/abs/2006.11477), which are pre-trained \n", - "on un-labelled audio data, Whisper is pre-trained on a vast quantity of \n", - "**labelled** audio-transcription data, 680,000 hours to be precise. \n", - "This is an order of magnitude more data than the un-labelled audio data used \n", - "to train Wav2Vec 2.0 (60,000 hours). What is more, 117,000 hours of this \n", - "pre-training data is multilingual ASR data. This results in checkpoints \n", - "that can be applied to over 96 languages, many of which are considered \n", - "_low-resource_.\n", - "\n", - "When scaled to 680,000 hours of labelled pre-training data, Whisper models \n", - "demonstrate a strong ability to generalise to many datasets and domains.\n", - "The pre-trained checkpoints achieve competitive results to state-of-the-art \n", - "ASR systems, with near 3% word error rate (WER) on the test-clean subset of \n", - "LibriSpeech ASR and a new state-of-the-art on TED-LIUM with 4.7% WER (_c.f._ \n", - "Table 8 of the [Whisper paper](https://cdn.openai.com/papers/whisper.pdf)).\n", - "The extensive multilingual ASR knowledge acquired by Whisper during pre-training \n", - "can be leveraged for other low-resource languages; through fine-tuning, the \n", - "pre-trained checkpoints can be adapted for specific datasets and languages \n", - "to further improve upon these results. We'll show just how Whisper can be fine-tuned \n", - "for low-resource languages in this Colab." - ] - }, - { - "cell_type": "markdown", - "id": "e59b91d6-be24-4b5e-bb38-4977ea143a72", - "metadata": { - "id": "e59b91d6-be24-4b5e-bb38-4977ea143a72" - }, - "source": [ - "
\n", - "\"Trulli\"\n", - "
Figure 1: Whisper model. The architecture \n", - "follows the standard Transformer-based encoder-decoder model. A \n", - "log-Mel spectrogram is input to the encoder. The last encoder \n", - "hidden states are input to the decoder via cross-attention mechanisms. The \n", - "decoder autoregressively predicts text tokens, jointly conditional on the \n", - "encoder hidden states and previously predicted tokens. Figure source: \n", - "OpenAI Whisper Blog.
\n", - "
" - ] - }, - { - "cell_type": "markdown", - "id": "21b6316e-8a55-4549-a154-66d3da2ab74a", - "metadata": { - "id": "21b6316e-8a55-4549-a154-66d3da2ab74a" - }, - "source": [ - "The Whisper checkpoints come in five configurations of varying model sizes.\n", - "The smallest four are trained on either English-only or multilingual data.\n", - "The largest checkpoint is multilingual only. All nine of the pre-trained checkpoints \n", - "are available on the [Hugging Face Hub](https://huggingface.co/models?search=openai/whisper). The \n", - "checkpoints are summarised in the following table with links to the models on the Hub:\n", - "\n", - "| Size | Layers | Width | Heads | Parameters | English-only | Multilingual |\n", - "|--------|--------|-------|-------|------------|------------------------------------------------------|---------------------------------------------------|\n", - "| tiny | 4 | 384 | 6 | 39 M | [โœ“](https://huggingface.co/openai/whisper-tiny.en) | [โœ“](https://huggingface.co/openai/whisper-tiny.) |\n", - "| base | 6 | 512 | 8 | 74 M | [โœ“](https://huggingface.co/openai/whisper-base.en) | [โœ“](https://huggingface.co/openai/whisper-base) |\n", - "| small | 12 | 768 | 12 | 244 M | [โœ“](https://huggingface.co/openai/whisper-small.en) | [โœ“](https://huggingface.co/openai/whisper-small) |\n", - "| medium | 24 | 1024 | 16 | 769 M | [โœ“](https://huggingface.co/openai/whisper-medium.en) | [โœ“](https://huggingface.co/openai/whisper-medium) |\n", - "| large | 32 | 1280 | 20 | 1550 M | x | [โœ“](https://huggingface.co/openai/whisper-large) |\n", - "\n", - "For demonstration purposes, we'll fine-tune the multilingual version of the \n", - "[`\"small\"`](https://huggingface.co/openai/whisper-small) checkpoint with 244M params (~= 1GB). \n", - "As for our data, we'll train and evaluate our system on a low-resource language \n", - "taken from the [Common Voice](https://huggingface.co/datasets/mozilla-foundation/common_voice_11_0)\n", - "dataset. We'll show that with as little as 8 hours of fine-tuning data, we can achieve \n", - "strong performance in this language." - ] - }, - { - "cell_type": "markdown", - "id": "3a680dfc-cbba-4f6c-8a1f-e1a5ff3f123a", - "metadata": { - "id": "3a680dfc-cbba-4f6c-8a1f-e1a5ff3f123a" - }, - "source": [ - "------------------------------------------------------------------------\n", - "\n", - "\\\\({}^1\\\\) The name Whisper follows from the acronym โ€œWSPSRโ€, which stands for โ€œWeb-scale Supervised Pre-training for Speech Recognitionโ€." - ] - }, - { - "cell_type": "markdown", - "id": "55fb8d21-df06-472a-99dd-b59567be6dad", - "metadata": { - "id": "55fb8d21-df06-472a-99dd-b59567be6dad" - }, - "source": [ - "## Prepare Environment" - ] - }, - { - "cell_type": "markdown", - "id": "844a4861-929c-4762-b29b-80b1e95aba4b", - "metadata": { - "id": "844a4861-929c-4762-b29b-80b1e95aba4b" - }, - "source": [ - "First of all, let's try to secure a decent GPU for our Colab! Unfortunately, it's becoming much harder to get access to a good GPU with the free version of Google Colab. However, with Google Colab Pro one should have no issues in being allocated a V100 or P100 GPU.\n", - "\n", - "To get a GPU, click _Runtime_ -> _Change runtime type_, then change _Hardware accelerator_ from _None_ to _GPU_." - ] - }, - { - "cell_type": "markdown", - "id": "9abea5d7-9d54-434b-a6bd-399d1b3c6c1a", - "metadata": { - "id": "9abea5d7-9d54-434b-a6bd-399d1b3c6c1a" - }, - "source": [ - "We can verify that we've been assigned a GPU and view its specifications:" - ] - }, - { - "cell_type": "code", - "execution_count": 1, - "id": "95048026-a3b7-43f0-a274-1bad65e407b4", - "metadata": { - "id": "95048026-a3b7-43f0-a274-1bad65e407b4" - }, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Sun Dec 18 21:59:00 2022 \n", - "+-----------------------------------------------------------------------------+\n", - "| NVIDIA-SMI 515.65.01 Driver Version: 515.65.01 CUDA Version: 11.7 |\n", - "|-------------------------------+----------------------+----------------------+\n", - "| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |\n", - "| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |\n", - "| | | MIG M. |\n", - "|===============================+======================+======================|\n", - "| 0 NVIDIA A100-SXM... On | 00000000:06:00.0 Off | 0 |\n", - "| N/A 32C P0 47W / 400W | 0MiB / 40960MiB | 0% Default |\n", - "| | | Disabled |\n", - "+-------------------------------+----------------------+----------------------+\n", - " \n", - "+-----------------------------------------------------------------------------+\n", - "| Processes: |\n", - "| GPU GI CI PID Type Process name GPU Memory |\n", - "| ID ID Usage |\n", - "|=============================================================================|\n", - "| No running processes found |\n", - "+-----------------------------------------------------------------------------+\n" - ] - } - ], - "source": [ - "gpu_info = !nvidia-smi\n", - "gpu_info = '\\n'.join(gpu_info)\n", - "if gpu_info.find('failed') >= 0:\n", - " print('Not connected to a GPU')\n", - "else:\n", - " print(gpu_info)" - ] - }, - { - "cell_type": "markdown", - "id": "9cd52dc1-ade1-44bb-a2d7-2ed98f110fed", - "metadata": { - "id": "9cd52dc1-ade1-44bb-a2d7-2ed98f110fed" - }, - "source": [ - "Next, we need to update the Unix package `ffmpeg` to version 4:" - ] - }, - { - "cell_type": "code", - "execution_count": 2, - "id": "69ee227d-60c5-44bf-b04d-c2092f997454", - "metadata": { - "id": "69ee227d-60c5-44bf-b04d-c2092f997454" - }, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "\u001b[1;31mE: \u001b[0mCould not open lock file /var/lib/dpkg/lock-frontend - open (13: Permission denied)\u001b[0m\n", - "\u001b[1;31mE: \u001b[0mUnable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), are you root?\u001b[0m\n", - "Reading package lists... Done\n", - "\u001b[1;31mE: \u001b[0mCould not open lock file /var/lib/apt/lists/lock - open (13: Permission denied)\u001b[0m\n", - "\u001b[1;31mE: \u001b[0mUnable to lock directory /var/lib/apt/lists/\u001b[0m\n", - "\u001b[1;33mW: \u001b[0mProblem unlinking the file /var/cache/apt/pkgcache.bin - RemoveCaches (13: Permission denied)\u001b[0m\n", - "\u001b[1;33mW: \u001b[0mProblem unlinking the file /var/cache/apt/srcpkgcache.bin - RemoveCaches (13: Permission denied)\u001b[0m\n", - "Error: must run as root\n" - ] - } - ], - "source": [ - "!apt install -y ffmpeg\n", - "!apt update\n", - "!add-apt-repository -y ppa:jonathonf/ffmpeg-4\n" - ] - }, - { - "cell_type": "markdown", - "id": "1d85d613-1c7e-46ac-9134-660bbe7ebc9d", - "metadata": { - "id": "1d85d613-1c7e-46ac-9134-660bbe7ebc9d" - }, - "source": [ - "We'll employ several popular Python packages to fine-tune the Whisper model.\n", - "We'll use `datasets` to download and prepare our training data and \n", - "`transformers` to load and train our Whisper model. We'll also require\n", - "the `soundfile` package to pre-process audio files, `evaluate` and `jiwer` to\n", - "assess the performance of our model. Finally, we'll\n", - "use `gradio` to build a flashy demo of our fine-tuned model." - ] - }, - { - "cell_type": "code", - "execution_count": 3, - "id": "e68ea9f8-9b61-414e-8885-3033b67c2850", - "metadata": { - "id": "e68ea9f8-9b61-414e-8885-3033b67c2850" - }, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "\n", - "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip available: \u001b[0m\u001b[31;49m22.3\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m22.3.1\u001b[0m\n", - "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpython3 -m pip install --upgrade pip\u001b[0m\n", - "Defaulting to user installation because normal site-packages is not writeable\n", - "Collecting git+https://github.com/huggingface/transformers\n", - " Cloning https://github.com/huggingface/transformers to /tmp/pip-req-build-u8_6wo82\n", - " Running command git clone --filter=blob:none --quiet https://github.com/huggingface/transformers /tmp/pip-req-build-u8_6wo82\n", - " Resolved https://github.com/huggingface/transformers to commit 7032e0203262ebb2ebf55da8d2e01f873973e835\n", - " Installing build dependencies ... \u001b[?25ldone\n", - "\u001b[?25h Getting requirements to build wheel ... \u001b[?25ldone\n", - "\u001b[?25h Preparing metadata (pyproject.toml) ... \u001b[?25ldone\n", - "\u001b[?25hRequirement already satisfied: huggingface-hub<1.0,>=0.10.0 in ./.local/lib/python3.8/site-packages (from transformers==4.26.0.dev0) (0.11.1)\n", - "Requirement already satisfied: numpy>=1.17 in ./.local/lib/python3.8/site-packages (from transformers==4.26.0.dev0) (1.23.4)\n", - "Requirement already satisfied: tqdm>=4.27 in ./.local/lib/python3.8/site-packages (from transformers==4.26.0.dev0) (4.64.1)\n", - "Requirement already satisfied: filelock in /usr/lib/python3/dist-packages (from transformers==4.26.0.dev0) (3.0.12)\n", - "Requirement already satisfied: pyyaml>=5.1 in /usr/lib/python3/dist-packages (from transformers==4.26.0.dev0) (5.3.1)\n", - "Requirement already satisfied: requests in ./.local/lib/python3.8/site-packages (from transformers==4.26.0.dev0) (2.28.1)\n", - "Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in ./.local/lib/python3.8/site-packages (from transformers==4.26.0.dev0) (0.13.2)\n", - "Requirement already satisfied: packaging>=20.0 in ./.local/lib/python3.8/site-packages (from transformers==4.26.0.dev0) (21.3)\n", - "Requirement already satisfied: regex!=2019.12.17 in ./.local/lib/python3.8/site-packages (from transformers==4.26.0.dev0) (2022.10.31)\n", - "Requirement already satisfied: typing-extensions>=3.7.4.3 in ./.local/lib/python3.8/site-packages (from huggingface-hub<1.0,>=0.10.0->transformers==4.26.0.dev0) (4.4.0)\n", - "Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/lib/python3/dist-packages (from packaging>=20.0->transformers==4.26.0.dev0) (2.4.6)\n", - "Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./.local/lib/python3.8/site-packages (from requests->transformers==4.26.0.dev0) (1.26.13)\n", - "Requirement already satisfied: certifi>=2017.4.17 in /usr/lib/python3/dist-packages (from requests->transformers==4.26.0.dev0) (2019.11.28)\n", - "Requirement already satisfied: charset-normalizer<3,>=2 in ./.local/lib/python3.8/site-packages (from requests->transformers==4.26.0.dev0) (2.1.1)\n", - "Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3/dist-packages (from requests->transformers==4.26.0.dev0) (2.8)\n", - "\n", - "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip available: \u001b[0m\u001b[31;49m22.3\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m22.3.1\u001b[0m\n", - "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpython3 -m pip install --upgrade pip\u001b[0m\n", - "Defaulting to user installation because normal site-packages is not writeable\n", - "Requirement already satisfied: librosa in ./.local/lib/python3.8/site-packages (0.9.2)\n", - "Requirement already satisfied: packaging>=20.0 in ./.local/lib/python3.8/site-packages (from librosa) (21.3)\n", - "Requirement already satisfied: audioread>=2.1.9 in ./.local/lib/python3.8/site-packages (from librosa) (3.0.0)\n", - "Requirement already satisfied: joblib>=0.14 in ./.local/lib/python3.8/site-packages (from librosa) (1.2.0)\n", - "Requirement already satisfied: numpy>=1.17.0 in ./.local/lib/python3.8/site-packages (from librosa) (1.23.4)\n", - "Requirement already satisfied: numba>=0.45.1 in ./.local/lib/python3.8/site-packages (from librosa) (0.56.4)\n", - "Requirement already satisfied: soundfile>=0.10.2 in ./.local/lib/python3.8/site-packages (from librosa) (0.11.0)\n", - "Requirement already satisfied: decorator>=4.0.10 in /usr/lib/python3/dist-packages (from librosa) (4.4.2)\n", - "Requirement already satisfied: pooch>=1.0 in ./.local/lib/python3.8/site-packages (from librosa) (1.6.0)\n", - "Requirement already satisfied: scikit-learn>=0.19.1 in /usr/lib/python3/dist-packages (from librosa) (0.22.2.post1)\n", - "Requirement already satisfied: resampy>=0.2.2 in ./.local/lib/python3.8/site-packages (from librosa) (0.4.2)\n", - "Requirement already satisfied: scipy>=1.2.0 in ./.local/lib/python3.8/site-packages (from librosa) (1.9.3)\n", - "Requirement already satisfied: llvmlite<0.40,>=0.39.0dev0 in ./.local/lib/python3.8/site-packages (from numba>=0.45.1->librosa) (0.39.1)\n", - "Requirement already satisfied: importlib-metadata in ./.local/lib/python3.8/site-packages (from numba>=0.45.1->librosa) (5.0.0)\n", - "Requirement already satisfied: setuptools in /usr/lib/python3/dist-packages (from numba>=0.45.1->librosa) (45.2.0)\n", - "Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/lib/python3/dist-packages (from packaging>=20.0->librosa) (2.4.6)\n", - "Requirement already satisfied: requests>=2.19.0 in ./.local/lib/python3.8/site-packages (from pooch>=1.0->librosa) (2.28.1)\n", - "Requirement already satisfied: appdirs>=1.3.0 in /usr/lib/python3/dist-packages (from pooch>=1.0->librosa) (1.4.3)\n", - "Requirement already satisfied: cffi>=1.0 in /usr/lib/python3/dist-packages (from soundfile>=0.10.2->librosa) (1.14.0)\n", - "Requirement already satisfied: charset-normalizer<3,>=2 in ./.local/lib/python3.8/site-packages (from requests>=2.19.0->pooch>=1.0->librosa) (2.1.1)\n", - "Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3/dist-packages (from requests>=2.19.0->pooch>=1.0->librosa) (2.8)\n", - "Requirement already satisfied: certifi>=2017.4.17 in /usr/lib/python3/dist-packages (from requests>=2.19.0->pooch>=1.0->librosa) (2019.11.28)\n", - "Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./.local/lib/python3.8/site-packages (from requests>=2.19.0->pooch>=1.0->librosa) (1.26.13)\n", - "Requirement already satisfied: zipp>=0.5 in /usr/lib/python3/dist-packages (from importlib-metadata->numba>=0.45.1->librosa) (1.0.0)\n", - "\n", - "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip available: \u001b[0m\u001b[31;49m22.3\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m22.3.1\u001b[0m\n", - "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpython3 -m pip install --upgrade pip\u001b[0m\n", - "\n", - "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip available: \u001b[0m\u001b[31;49m22.3\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m22.3.1\u001b[0m\n", - "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpython3 -m pip install --upgrade pip\u001b[0m\n", - "Defaulting to user installation because normal site-packages is not writeable\n", - "Requirement already satisfied: jiwer in ./.local/lib/python3.8/site-packages (2.5.1)\n", - "Requirement already satisfied: levenshtein==0.20.2 in ./.local/lib/python3.8/site-packages (from jiwer) (0.20.2)\n", - "Requirement already satisfied: rapidfuzz<3.0.0,>=2.3.0 in ./.local/lib/python3.8/site-packages (from levenshtein==0.20.2->jiwer) (2.13.6)\n", - "\n", - "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip available: \u001b[0m\u001b[31;49m22.3\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m22.3.1\u001b[0m\n", - "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpython3 -m pip install --upgrade pip\u001b[0m\n", - "Defaulting to user installation because normal site-packages is not writeable\n", - "Requirement already satisfied: gradio in ./.local/lib/python3.8/site-packages (3.14.0)\n", - "Requirement already satisfied: pandas in ./.local/lib/python3.8/site-packages (from gradio) (1.5.1)\n", - "Requirement already satisfied: pydantic in ./.local/lib/python3.8/site-packages (from gradio) (1.10.2)\n", - "Requirement already satisfied: jinja2 in ./.local/lib/python3.8/site-packages (from gradio) (3.1.2)\n", - "Requirement already satisfied: matplotlib in ./.local/lib/python3.8/site-packages (from gradio) (3.5.3)\n", - "Requirement already satisfied: pillow in /usr/lib/python3/dist-packages (from gradio) (7.0.0)\n", - "Requirement already satisfied: fastapi in ./.local/lib/python3.8/site-packages (from gradio) (0.88.0)\n", - "Requirement already satisfied: fsspec in ./.local/lib/python3.8/site-packages (from gradio) (2022.11.0)\n", - "Requirement already satisfied: markupsafe in ./.local/lib/python3.8/site-packages (from gradio) (2.1.1)\n", - "Requirement already satisfied: markdown-it-py[linkify,plugins] in ./.local/lib/python3.8/site-packages (from gradio) (2.1.0)\n", - "Requirement already satisfied: pyyaml in /usr/lib/python3/dist-packages (from gradio) (5.3.1)\n", - "Requirement already satisfied: pydub in ./.local/lib/python3.8/site-packages (from gradio) (0.25.1)\n", - "Requirement already satisfied: aiohttp in ./.local/lib/python3.8/site-packages (from gradio) (3.8.3)\n", - "Requirement already satisfied: httpx in ./.local/lib/python3.8/site-packages (from gradio) (0.23.1)\n", - "Requirement already satisfied: requests in ./.local/lib/python3.8/site-packages (from gradio) (2.28.1)\n", - "Requirement already satisfied: uvicorn in ./.local/lib/python3.8/site-packages (from gradio) (0.20.0)\n", - "Requirement already satisfied: websockets>=10.0 in ./.local/lib/python3.8/site-packages (from gradio) (10.4)\n", - "Requirement already satisfied: pycryptodome in ./.local/lib/python3.8/site-packages (from gradio) (3.16.0)\n", - "Requirement already satisfied: python-multipart in ./.local/lib/python3.8/site-packages (from gradio) (0.0.5)\n", - "Requirement already satisfied: numpy in ./.local/lib/python3.8/site-packages (from gradio) (1.23.4)\n", - "Requirement already satisfied: altair in ./.local/lib/python3.8/site-packages (from gradio) (4.2.0)\n", - "Requirement already satisfied: ffmpy in ./.local/lib/python3.8/site-packages (from gradio) (0.3.0)\n", - "Requirement already satisfied: orjson in ./.local/lib/python3.8/site-packages (from gradio) (3.8.3)\n", - "Requirement already satisfied: yarl<2.0,>=1.0 in ./.local/lib/python3.8/site-packages (from aiohttp->gradio) (1.8.2)\n", - "Requirement already satisfied: aiosignal>=1.1.2 in ./.local/lib/python3.8/site-packages (from aiohttp->gradio) (1.3.1)\n", - "Requirement already satisfied: charset-normalizer<3.0,>=2.0 in ./.local/lib/python3.8/site-packages (from aiohttp->gradio) (2.1.1)\n", - "Requirement already satisfied: multidict<7.0,>=4.5 in ./.local/lib/python3.8/site-packages (from aiohttp->gradio) (6.0.3)\n", - "Requirement already satisfied: attrs>=17.3.0 in /usr/lib/python3/dist-packages (from aiohttp->gradio) (19.3.0)\n", - "Requirement already satisfied: frozenlist>=1.1.1 in ./.local/lib/python3.8/site-packages (from aiohttp->gradio) (1.3.3)\n", - "Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in ./.local/lib/python3.8/site-packages (from aiohttp->gradio) (4.0.2)\n", - "Requirement already satisfied: jsonschema>=3.0 in /usr/lib/python3/dist-packages (from altair->gradio) (3.2.0)\n", - "Requirement already satisfied: entrypoints in /usr/lib/python3/dist-packages (from altair->gradio) (0.3)\n", - "Requirement already satisfied: toolz in /usr/lib/python3/dist-packages (from altair->gradio) (0.9.0)\n", - "Requirement already satisfied: python-dateutil>=2.8.1 in ./.local/lib/python3.8/site-packages (from pandas->gradio) (2.8.2)\n", - "Requirement already satisfied: pytz>=2020.1 in ./.local/lib/python3.8/site-packages (from pandas->gradio) (2022.5)\n", - "Requirement already satisfied: starlette==0.22.0 in ./.local/lib/python3.8/site-packages (from fastapi->gradio) (0.22.0)\n", - "Requirement already satisfied: anyio<5,>=3.4.0 in ./.local/lib/python3.8/site-packages (from starlette==0.22.0->fastapi->gradio) (3.6.2)\n", - "Requirement already satisfied: typing-extensions>=3.10.0 in ./.local/lib/python3.8/site-packages (from starlette==0.22.0->fastapi->gradio) (4.4.0)\n", - "Requirement already satisfied: sniffio in ./.local/lib/python3.8/site-packages (from httpx->gradio) (1.3.0)\n", - "Requirement already satisfied: certifi in /usr/lib/python3/dist-packages (from httpx->gradio) (2019.11.28)\n", - "Requirement already satisfied: rfc3986[idna2008]<2,>=1.3 in ./.local/lib/python3.8/site-packages (from httpx->gradio) (1.5.0)\n", - "Requirement already satisfied: httpcore<0.17.0,>=0.15.0 in ./.local/lib/python3.8/site-packages (from httpx->gradio) (0.16.2)\n", - "Requirement already satisfied: mdurl~=0.1 in ./.local/lib/python3.8/site-packages (from markdown-it-py[linkify,plugins]->gradio) (0.1.2)\n", - "Requirement already satisfied: mdit-py-plugins in ./.local/lib/python3.8/site-packages (from markdown-it-py[linkify,plugins]->gradio) (0.3.3)\n", - "Requirement already satisfied: linkify-it-py~=1.0 in ./.local/lib/python3.8/site-packages (from markdown-it-py[linkify,plugins]->gradio) (1.0.3)\n", - "Requirement already satisfied: cycler>=0.10 in /usr/lib/python3/dist-packages (from matplotlib->gradio) (0.10.0)\n", - "Requirement already satisfied: pyparsing>=2.2.1 in /usr/lib/python3/dist-packages (from matplotlib->gradio) (2.4.6)\n", - "Requirement already satisfied: kiwisolver>=1.0.1 in /usr/lib/python3/dist-packages (from matplotlib->gradio) (1.0.1)\n", - "Requirement already satisfied: fonttools>=4.22.0 in ./.local/lib/python3.8/site-packages (from matplotlib->gradio) (4.38.0)\n", - "Requirement already satisfied: packaging>=20.0 in ./.local/lib/python3.8/site-packages (from matplotlib->gradio) (21.3)\n", - "Requirement already satisfied: six>=1.4.0 in /usr/lib/python3/dist-packages (from python-multipart->gradio) (1.14.0)\n", - "Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3/dist-packages (from requests->gradio) (2.8)\n", - "Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./.local/lib/python3.8/site-packages (from requests->gradio) (1.26.13)\n", - "Requirement already satisfied: click>=7.0 in /usr/lib/python3/dist-packages (from uvicorn->gradio) (7.0)\n", - "Requirement already satisfied: h11>=0.8 in ./.local/lib/python3.8/site-packages (from uvicorn->gradio) (0.14.0)\n", - "Requirement already satisfied: uc-micro-py in ./.local/lib/python3.8/site-packages (from linkify-it-py~=1.0->markdown-it-py[linkify,plugins]->gradio) (1.0.1)\n", - "\n", - "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip available: \u001b[0m\u001b[31;49m22.3\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m22.3.1\u001b[0m\n", - "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpython3 -m pip install --upgrade pip\u001b[0m\n" - ] - } - ], - "source": [ - "!pip install datasets>=2.6.1\n", - "!pip install git+https://github.com/huggingface/transformers\n", - "!pip install librosa\n", - "!pip install evaluate>=0.30\n", - "!pip install jiwer\n", - "!pip install gradio" - ] - }, - { - "cell_type": "markdown", - "id": "1f60d173-8de1-4ed7-bc9a-d281cf237203", - "metadata": { - "id": "1f60d173-8de1-4ed7-bc9a-d281cf237203" - }, - "source": [ - "We strongly advise you to upload model checkpoints directly the [Hugging Face Hub](https://huggingface.co/) \n", - "whilst training. The Hub provides:\n", - "- Integrated version control: you can be sure that no model checkpoint is lost during training.\n", - "- Tensorboard logs: track important metrics over the course of training.\n", - "- Model cards: document what a model does and its intended use cases.\n", - "- Community: an easy way to share and collaborate with the community!\n", - "\n", - "Linking the notebook to the Hub is straightforward - it simply requires entering your \n", - "Hub authentication token when prompted. Find your Hub authentication token [here](https://huggingface.co/settings/tokens):" - ] - }, - { - "cell_type": "code", - "execution_count": 23, - "id": "b045a39e-2a3e-4153-bdb5-281500bcd348", - "metadata": { - "id": "b045a39e-2a3e-4153-bdb5-281500bcd348" - }, - "outputs": [ - { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "fba6cbb348874ff2a0fecdd6f44a27ac", - "version_major": 2, - "version_minor": 0 - }, - "text/plain": [ - "VBox(children=(HTML(value='
\n", - "\"Trulli\"\n", - "
Figure 2: Conversion of sampled audio array to log-Mel spectrogram.\n", - "Left: sampled 1-dimensional audio signal. Right: corresponding log-Mel spectrogram. Figure source:\n", - "Google SpecAugment Blog.\n", - "
" - ] - }, - { - "cell_type": "markdown", - "id": "b2ef54d5-b946-4c1d-9fdc-adc5d01b46aa", - "metadata": { - "id": "b2ef54d5-b946-4c1d-9fdc-adc5d01b46aa" - }, - "source": [ - "We'll load the feature extractor from the pre-trained checkpoint with the default values:" - ] - }, - { - "cell_type": "code", - "execution_count": 7, - "id": "bc77d7bb-f9e2-47f5-b663-30f7a4321ce5", - "metadata": { - "id": "bc77d7bb-f9e2-47f5-b663-30f7a4321ce5" - }, - "outputs": [], - "source": [ - "from transformers import WhisperFeatureExtractor\n", - "\n", - "feature_extractor = WhisperFeatureExtractor.from_pretrained(\"openai/whisper-small\")" - ] - }, - { - "cell_type": "markdown", - "id": "93748af7-b917-4ecf-a0c8-7d89077ff9cb", - "metadata": { - "id": "93748af7-b917-4ecf-a0c8-7d89077ff9cb" - }, - "source": [ - "### Load WhisperTokenizer" - ] - }, - { - "cell_type": "markdown", - "id": "2bc82609-a9fb-447a-a2af-99597c864029", - "metadata": { - "id": "2bc82609-a9fb-447a-a2af-99597c864029" - }, - "source": [ - "The Whisper model outputs a sequence of _token ids_. The tokenizer maps each of these token ids to their corresponding text string. For Hindi, we can load the pre-trained tokenizer and use it for fine-tuning without any further modifications. We simply have to \n", - "specify the target language and the task. These arguments inform the \n", - "tokenizer to prefix the language and task tokens to the start of encoded \n", - "label sequences:" - ] - }, - { - "cell_type": "code", - "execution_count": 8, - "id": "c7b07f9b-ae0e-4f89-98f0-0c50d432eab6", - "metadata": { - "colab": { - "referenced_widgets": [ - "90d056e20b3e4f14ae0199a1a4ab1bb0", - "d82a88daec0e4f14add691b7b903064c", - "350acdb0f40e454099fa901e66de55f0", - "2e6a82a462cc411d90fa1bea4ee60790", - "c74bfee0198b4817832ea86e8e88d96c", - "04fb2d81eff646068e10475a08ae42f4" - ] - }, - "id": "c7b07f9b-ae0e-4f89-98f0-0c50d432eab6", - "outputId": "5c004b44-86e7-4e00-88be-39e0af5eed69" - }, - "outputs": [], - "source": [ - "from transformers import WhisperTokenizer\n", - "\n", - "tokenizer = WhisperTokenizer.from_pretrained(\"openai/whisper-small\", language=\"Arabic\", task=\"transcribe\")" - ] - }, - { - "cell_type": "markdown", - "id": "d2ef23f3-f4a8-483a-a2dc-080a7496cb1b", - "metadata": { - "id": "d2ef23f3-f4a8-483a-a2dc-080a7496cb1b" - }, - "source": [ - "### Combine To Create A WhisperProcessor" - ] - }, - { - "cell_type": "markdown", - "id": "5ff67654-5a29-4bb8-a69d-0228946c6f8d", - "metadata": { - "id": "5ff67654-5a29-4bb8-a69d-0228946c6f8d" - }, - "source": [ - "To simplify using the feature extractor and tokenizer, we can _wrap_ \n", - "both into a single `WhisperProcessor` class. This processor object \n", - "inherits from the `WhisperFeatureExtractor` and `WhisperProcessor`, \n", - "and can be used on the audio inputs and model predictions as required. \n", - "In doing so, we only need to keep track of two objects during training: \n", - "the `processor` and the `model`:" - ] - }, - { - "cell_type": "code", - "execution_count": 9, - "id": "77d9f0c5-8607-4642-a8ac-c3ab2e223ea6", - "metadata": { - "id": "77d9f0c5-8607-4642-a8ac-c3ab2e223ea6" - }, - "outputs": [], - "source": [ - "from transformers import WhisperProcessor\n", - "\n", - "processor = WhisperProcessor.from_pretrained(\"openai/whisper-small\", language=\"Arabic\", task=\"transcribe\")" - ] - }, - { - "cell_type": "markdown", - "id": "381acd09-0b0f-4d04-9eb3-f028ac0e5f2c", - "metadata": { - "id": "381acd09-0b0f-4d04-9eb3-f028ac0e5f2c" - }, - "source": [ - "### Prepare Data" - ] - }, - { - "cell_type": "markdown", - "id": "9649bf01-2e8a-45e5-8fca-441c13637b8f", - "metadata": { - "id": "9649bf01-2e8a-45e5-8fca-441c13637b8f" - }, - "source": [ - "Let's print the first example of the Common Voice dataset to see \n", - "what form the data is in:" - ] - }, - { - "cell_type": "code", - "execution_count": 10, - "id": "6e6b0ec5-0c94-4e2c-ae24-c791be1b2255", - "metadata": { - "id": "6e6b0ec5-0c94-4e2c-ae24-c791be1b2255" - }, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "Defaulting to user installation because normal site-packages is not writeable\n", - "Requirement already satisfied: torchaudio in ./.local/lib/python3.8/site-packages (0.13.1)\n", - "Requirement already satisfied: torch==1.13.1 in ./.local/lib/python3.8/site-packages (from torchaudio) (1.13.1)\n", - "Requirement already satisfied: nvidia-cuda-runtime-cu11==11.7.99 in ./.local/lib/python3.8/site-packages (from torch==1.13.1->torchaudio) (11.7.99)\n", - "Requirement already satisfied: nvidia-cuda-nvrtc-cu11==11.7.99 in ./.local/lib/python3.8/site-packages (from torch==1.13.1->torchaudio) (11.7.99)\n", - "Requirement already satisfied: nvidia-cublas-cu11==11.10.3.66 in ./.local/lib/python3.8/site-packages (from torch==1.13.1->torchaudio) (11.10.3.66)\n", - "Requirement already satisfied: nvidia-cudnn-cu11==8.5.0.96 in ./.local/lib/python3.8/site-packages (from torch==1.13.1->torchaudio) (8.5.0.96)\n", - "Requirement already satisfied: typing-extensions in ./.local/lib/python3.8/site-packages (from torch==1.13.1->torchaudio) (4.4.0)\n", - "Requirement already satisfied: setuptools in /usr/lib/python3/dist-packages (from nvidia-cublas-cu11==11.10.3.66->torch==1.13.1->torchaudio) (45.2.0)\n", - "Requirement already satisfied: wheel in /usr/lib/python3/dist-packages (from nvidia-cublas-cu11==11.10.3.66->torch==1.13.1->torchaudio) (0.34.2)\n", - "\n", - "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m A new release of pip available: \u001b[0m\u001b[31;49m22.3\u001b[0m\u001b[39;49m -> \u001b[0m\u001b[32;49m22.3.1\u001b[0m\n", - "\u001b[1m[\u001b[0m\u001b[34;49mnotice\u001b[0m\u001b[1;39;49m]\u001b[0m\u001b[39;49m To update, run: \u001b[0m\u001b[32;49mpython3 -m pip install --upgrade pip\u001b[0m\n", - "{'audio': {'path': '/home/ubuntu/.cache/huggingface/datasets/downloads/extracted/d27f3a991789fe1631f955b0f76bf7c7bc2ecb409f7198408b9881a9d31407b7/common_voice_ar_24082672.mp3', 'array': array([-1.6076937e-15, -1.0766865e-13, -5.3649478e-14, ...,\n", - " 8.6992582e-09, 1.5384171e-07, 1.3540763e-07], dtype=float32), 'sampling_rate': 48000}, 'sentence': 'ูˆู…ุง ุฃุฏุฑุงูƒ ู…ุง ูŠูˆู… ุงู„ุฏูŠู†'}\n" - ] - } - ], - "source": [ - "!pip install torchaudio\n", - "print(common_voice[\"train\"][0])" - ] - }, - { - "cell_type": "markdown", - "id": "5a679f05-063d-41b3-9b58-4fc9c6ccf4fd", - "metadata": { - "id": "5a679f05-063d-41b3-9b58-4fc9c6ccf4fd" - }, - "source": [ - "Since \n", - "our input audio is sampled at 48kHz, we need to _downsample_ it to \n", - "16kHz prior to passing it to the Whisper feature extractor, 16kHz being the sampling rate expected by the Whisper model. \n", - "\n", - "We'll set the audio inputs to the correct sampling rate using dataset's \n", - "[`cast_column`](https://huggingface.co/docs/datasets/package_reference/main_classes.html?highlight=cast_column#datasets.DatasetDict.cast_column)\n", - "method. This operation does not change the audio in-place, \n", - "but rather signals to `datasets` to resample audio samples _on the fly_ the \n", - "first time that they are loaded:" - ] - }, - { - "cell_type": "code", - "execution_count": 11, - "id": "f12e2e57-156f-417b-8cfb-69221cc198e8", - "metadata": { - "id": "f12e2e57-156f-417b-8cfb-69221cc198e8" - }, - "outputs": [], - "source": [ - "from datasets import Audio\n", - "\n", - "common_voice = common_voice.cast_column(\"audio\", Audio(sampling_rate=16000))" - ] - }, - { - "cell_type": "markdown", - "id": "00382a3e-abec-4cdd-a54c-d1aaa3ea4707", - "metadata": { - "id": "00382a3e-abec-4cdd-a54c-d1aaa3ea4707" - }, - "source": [ - "Re-loading the first audio sample in the Common Voice dataset will resample \n", - "it to the desired sampling rate:" - ] - }, - { - "cell_type": "code", - "execution_count": 12, - "id": "87122d71-289a-466a-afcf-fa354b18946b", - "metadata": { - "id": "87122d71-289a-466a-afcf-fa354b18946b" - }, - "outputs": [ - { - "name": "stdout", - "output_type": "stream", - "text": [ - "{'audio': {'path': '/home/ubuntu/.cache/huggingface/datasets/downloads/extracted/d27f3a991789fe1631f955b0f76bf7c7bc2ecb409f7198408b9881a9d31407b7/common_voice_ar_24082672.mp3', 'array': array([-3.4152155e-14, 2.7470058e-14, 8.5115027e-14, ...,\n", - " -2.4172088e-08, -2.2456084e-07, 4.5994945e-08], dtype=float32), 'sampling_rate': 16000}, 'sentence': 'ูˆู…ุง ุฃุฏุฑุงูƒ ู…ุง ูŠูˆู… ุงู„ุฏูŠู†'}\n" - ] - } - ], - "source": [ - "print(common_voice[\"train\"][0])" - ] - }, - { - "cell_type": "markdown", - "id": "91edc72d-08f8-4f01-899d-74e65ce441fc", - "metadata": { - "id": "91edc72d-08f8-4f01-899d-74e65ce441fc", - "tags": [] - }, - "source": [ - "Now we can write a function to prepare our data ready for the model:\n", - "1. We load and resample the audio data by calling `batch[\"audio\"]`. As explained above, ๐Ÿค— Datasets performs any necessary resampling operations on the fly.\n", - "2. We use the feature extractor to compute the log-Mel spectrogram input features from our 1-dimensional audio array.\n", - "3. We encode the transcriptions to label ids through the use of the tokenizer." - ] - }, - { - "cell_type": "code", - "execution_count": 13, - "id": "6525c478-8962-4394-a1c4-103c54cce170", - "metadata": { - "id": "6525c478-8962-4394-a1c4-103c54cce170", - "tags": [] - }, - "outputs": [], - "source": [ - "def prepare_dataset(batch):\n", - " # load and resample audio data from 48 to 16kHz\n", - " audio = batch[\"audio\"]\n", - "\n", - " # compute log-Mel input features from input audio array \n", - " batch[\"input_features\"] = feature_extractor(audio[\"array\"], sampling_rate=audio[\"sampling_rate\"]).input_features[0]\n", - "\n", - " # encode target text to label ids \n", - " batch[\"labels\"] = tokenizer(batch[\"sentence\"]).input_ids\n", - " return batch" - ] - }, - { - "cell_type": "markdown", - "id": "70b319fb-2439-4ef6-a70d-a47bf41c4a13", - "metadata": { - "id": "70b319fb-2439-4ef6-a70d-a47bf41c4a13", - "tags": [] - }, - "source": [ - "We can apply the data preparation function to all of our training examples using dataset's `.map` method. The argument `num_proc` specifies how many CPU cores to use. Setting `num_proc` > 1 will enable multiprocessing. If the `.map` method hangs with multiprocessing, set `num_proc=1` and process the dataset sequentially." - ] - }, - { - "cell_type": "code", - "execution_count": 14, - "id": "7b73ab39-ffaf-4b9e-86e5-782963c6134b", - "metadata": { - "id": "7b73ab39-ffaf-4b9e-86e5-782963c6134b" - }, - "outputs": [ - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Loading cached processed dataset at /home/ubuntu/.cache/huggingface/datasets/mozilla-foundation___common_voice_11_0/ar/11.0.0/f8e47235d9b4e68fa24ed71d63266a02018ccf7194b2a8c9c598a5f3ab304d9f/cache-46007ea52905c1cd.arrow\n", - "Loading cached processed dataset at /home/ubuntu/.cache/huggingface/datasets/mozilla-foundation___common_voice_11_0/ar/11.0.0/f8e47235d9b4e68fa24ed71d63266a02018ccf7194b2a8c9c598a5f3ab304d9f/cache-c5216ad26076e4d2.arrow\n" - ] - } - ], - "source": [ - "common_voice = common_voice.map(prepare_dataset, remove_columns=common_voice.column_names[\"train\"], num_proc=1)" - ] - }, - { - "cell_type": "markdown", - "id": "263a5a58-0239-4a25-b0df-c625fc9c5810", - "metadata": { - "id": "263a5a58-0239-4a25-b0df-c625fc9c5810", - "tags": [] - }, - "source": [ - "## Training and Evaluation" - ] - }, - { - "cell_type": "markdown", - "id": "a693e768-c5a6-453f-89a1-b601dcf7daf7", - "metadata": { - "id": "a693e768-c5a6-453f-89a1-b601dcf7daf7" - }, - "source": [ - "Now that we've prepared our data, we're ready to dive into the training pipeline. \n", - "The [๐Ÿค— Trainer](https://huggingface.co/transformers/master/main_classes/trainer.html?highlight=trainer)\n", - "will do much of the heavy lifting for us. All we have to do is:\n", - "\n", - "- Define a data collator: the data collator takes our pre-processed data and prepares PyTorch tensors ready for the model.\n", - "\n", - "- Evaluation metrics: during evaluation, we want to evaluate the model using the [word error rate (WER)](https://huggingface.co/metrics/wer) metric. We need to define a `compute_metrics` function that handles this computation.\n", - "\n", - "- Load a pre-trained checkpoint: we need to load a pre-trained checkpoint and configure it correctly for training.\n", - "\n", - "- Define the training configuration: this will be used by the ๐Ÿค— Trainer to define the training schedule.\n", - "\n", - "Once we've fine-tuned the model, we will evaluate it on the test data to verify that we have correctly trained it \n", - "to transcribe speech in Arabic." - ] - }, - { - "cell_type": "markdown", - "id": "8d230e6d-624c-400a-bbf5-fa660881df25", - "metadata": { - "id": "8d230e6d-624c-400a-bbf5-fa660881df25" - }, - "source": [ - "### Define a Data Collator" - ] - }, - { - "cell_type": "markdown", - "id": "04def221-0637-4a69-b242-d3f0c1d0ee78", - "metadata": { - "id": "04def221-0637-4a69-b242-d3f0c1d0ee78" - }, - "source": [ - "The data collator for a sequence-to-sequence speech model is unique in the sense that it \n", - "treats the `input_features` and `labels` independently: the `input_features` must be \n", - "handled by the feature extractor and the `labels` by the tokenizer.\n", - "\n", - "The `input_features` are already padded to 30s and converted to a log-Mel spectrogram \n", - "of fixed dimension by action of the feature extractor, so all we have to do is convert the `input_features`\n", - "to batched PyTorch tensors. We do this using the feature extractor's `.pad` method with `return_tensors=pt`.\n", - "\n", - "The `labels` on the other hand are un-padded. We first pad the sequences\n", - "to the maximum length in the batch using the tokenizer's `.pad` method. The padding tokens \n", - "are then replaced by `-100` so that these tokens are **not** taken into account when \n", - "computing the loss. We then cut the BOS token from the start of the label sequence as we \n", - "append it later during training.\n", - "\n", - "We can leverage the `WhisperProcessor` we defined earlier to perform both the \n", - "feature extractor and the tokenizer operations:" - ] - }, - { - "cell_type": "code", - "execution_count": 15, - "id": "8326221e-ec13-4731-bb4e-51e5fc1486c5", - "metadata": { - "id": "8326221e-ec13-4731-bb4e-51e5fc1486c5" - }, - "outputs": [], - "source": [ - "import torch\n", - "\n", - "from dataclasses import dataclass\n", - "from typing import Any, Dict, List, Union\n", - "\n", - "@dataclass\n", - "class DataCollatorSpeechSeq2SeqWithPadding:\n", - " processor: Any\n", - "\n", - " def __call__(self, features: List[Dict[str, Union[List[int], torch.Tensor]]]) -> Dict[str, torch.Tensor]:\n", - " # split inputs and labels since they have to be of different lengths and need different padding methods\n", - " # first treat the audio inputs by simply returning torch tensors\n", - " input_features = [{\"input_features\": feature[\"input_features\"]} for feature in features]\n", - " batch = self.processor.feature_extractor.pad(input_features, return_tensors=\"pt\")\n", - "\n", - " # get the tokenized label sequences\n", - " label_features = [{\"input_ids\": feature[\"labels\"]} for feature in features]\n", - " # pad the labels to max length\n", - " labels_batch = self.processor.tokenizer.pad(label_features, return_tensors=\"pt\")\n", - "\n", - " # replace padding with -100 to ignore loss correctly\n", - " labels = labels_batch[\"input_ids\"].masked_fill(labels_batch.attention_mask.ne(1), -100)\n", - "\n", - " # if bos token is appended in previous tokenization step,\n", - " # cut bos token here as it's append later anyways\n", - " if (labels[:, 0] == self.processor.tokenizer.bos_token_id).all().cpu().item():\n", - " labels = labels[:, 1:]\n", - "\n", - " batch[\"labels\"] = labels\n", - "\n", - " return batch" - ] - }, - { - "cell_type": "markdown", - "id": "3cae7dbf-8a50-456e-a3a8-7fd005390f86", - "metadata": { - "id": "3cae7dbf-8a50-456e-a3a8-7fd005390f86" - }, - "source": [ - "Let's initialise the data collator we've just defined:" - ] - }, - { - "cell_type": "code", - "execution_count": 16, - "id": "fc834702-c0d3-4a96-b101-7b87be32bf42", - "metadata": { - "id": "fc834702-c0d3-4a96-b101-7b87be32bf42" - }, - "outputs": [], - "source": [ - "data_collator = DataCollatorSpeechSeq2SeqWithPadding(processor=processor)" - ] - }, - { - "cell_type": "markdown", - "id": "d62bb2ab-750a-45e7-82e9-61d6f4805698", - "metadata": { - "id": "d62bb2ab-750a-45e7-82e9-61d6f4805698" - }, - "source": [ - "### Evaluation Metrics" - ] - }, - { - "cell_type": "markdown", - "id": "66fee1a7-a44c-461e-b047-c3917221572e", - "metadata": { - "id": "66fee1a7-a44c-461e-b047-c3917221572e" - }, - "source": [ - "We'll use the word error rate (WER) metric, the 'de-facto' metric for assessing \n", - "ASR systems. For more information, refer to the WER [docs](https://huggingface.co/metrics/wer). We'll load the WER metric from ๐Ÿค— Evaluate:" - ] - }, - { - "cell_type": "code", - "execution_count": 17, - "id": "b22b4011-f31f-4b57-b684-c52332f92890", - "metadata": { - "id": "b22b4011-f31f-4b57-b684-c52332f92890" - }, - "outputs": [], - "source": [ - "import evaluate\n", - "\n", - "metric = evaluate.load(\"wer\")" - ] - }, - { - "cell_type": "markdown", - "id": "4f32cab6-31f0-4cb9-af4c-40ba0f5fc508", - "metadata": { - "id": "4f32cab6-31f0-4cb9-af4c-40ba0f5fc508" - }, - "source": [ - "We then simply have to define a function that takes our model \n", - "predictions and returns the WER metric. This function, called\n", - "`compute_metrics`, first replaces `-100` with the `pad_token_id`\n", - "in the `label_ids` (undoing the step we applied in the \n", - "data collator to ignore padded tokens correctly in the loss).\n", - "It then decodes the predicted and label ids to strings. Finally,\n", - "it computes the WER between the predictions and reference labels:" - ] - }, - { - "cell_type": "code", - "execution_count": 18, - "id": "23959a70-22d0-4ffe-9fa1-72b61e75bb52", - "metadata": { - "id": "23959a70-22d0-4ffe-9fa1-72b61e75bb52" - }, - "outputs": [], - "source": [ - "def compute_metrics(pred):\n", - " pred_ids = pred.predictions\n", - " label_ids = pred.label_ids\n", - "\n", - " # replace -100 with the pad_token_id\n", - " label_ids[label_ids == -100] = tokenizer.pad_token_id\n", - "\n", - " # we do not want to group tokens when computing the metrics\n", - " pred_str = tokenizer.batch_decode(pred_ids, skip_special_tokens=True)\n", - " label_str = tokenizer.batch_decode(label_ids, skip_special_tokens=True)\n", - "\n", - " wer = 100 * metric.compute(predictions=pred_str, references=label_str)\n", - "\n", - " return {\"wer\": wer}" - ] - }, - { - "cell_type": "markdown", - "id": "daf2a825-6d9f-4a23-b145-c37c0039075b", - "metadata": { - "id": "daf2a825-6d9f-4a23-b145-c37c0039075b" - }, - "source": [ - "###ย Load a Pre-Trained Checkpoint" - ] - }, - { - "cell_type": "markdown", - "id": "437a97fa-4864-476b-8abc-f28b8166cfa5", - "metadata": { - "id": "437a97fa-4864-476b-8abc-f28b8166cfa5" - }, - "source": [ - "Now let's load the pre-trained Whisper `small` checkpoint. Again, this \n", - "is trivial through use of ๐Ÿค— Transformers!" - ] - }, - { - "cell_type": "code", - "execution_count": 19, - "id": "5a10cc4b-07ec-4ebd-ac1d-7c601023594f", - "metadata": { - "id": "5a10cc4b-07ec-4ebd-ac1d-7c601023594f" - }, - "outputs": [], - "source": [ - "from transformers import WhisperForConditionalGeneration\n", - "\n", - "model = WhisperForConditionalGeneration.from_pretrained(\"openai/whisper-small\")" - ] - }, - { - "cell_type": "markdown", - "id": "a15ead5f-2277-4a39-937b-585c2497b2df", - "metadata": { - "id": "a15ead5f-2277-4a39-937b-585c2497b2df" - }, - "source": [ - "Override generation arguments - no tokens are forced as decoder outputs (see [`forced_decoder_ids`](https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.generation_utils.GenerationMixin.generate.forced_decoder_ids)), no tokens are suppressed during generation (see [`suppress_tokens`](https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.generation_utils.GenerationMixin.generate.suppress_tokens)):" - ] - }, - { - "cell_type": "code", - "execution_count": 20, - "id": "62038ba3-88ed-4fce-84db-338f50dcd04f", - "metadata": { - "id": "62038ba3-88ed-4fce-84db-338f50dcd04f" - }, - "outputs": [], - "source": [ - "model.config.forced_decoder_ids = None\n", - "model.config.suppress_tokens = []" - ] - }, - { - "cell_type": "markdown", - "id": "2178dea4-80ca-47b6-b6ea-ba1915c90c06", - "metadata": { - "id": "2178dea4-80ca-47b6-b6ea-ba1915c90c06" - }, - "source": [ - "### Define the Training Configuration" - ] - }, - { - "cell_type": "markdown", - "id": "c21af1e9-0188-4134-ac82-defc7bdcc436", - "metadata": { - "id": "c21af1e9-0188-4134-ac82-defc7bdcc436" - }, - "source": [ - "In the final step, we define all the parameters related to training. For more detail on the training arguments, refer to the Seq2SeqTrainingArguments [docs](https://huggingface.co/docs/transformers/main_classes/trainer#transformers.Seq2SeqTrainingArguments)." - ] - }, - { - "cell_type": "code", - "execution_count": 26, - "id": "0ae3e9af-97b7-4aa0-ae85-20b23b5bcb3a", - "metadata": { - "id": "0ae3e9af-97b7-4aa0-ae85-20b23b5bcb3a" - }, - "outputs": [ - { - "name": "stderr", - "output_type": "stream", - "text": [ - "PyTorch: setting up devices\n" - ] - } - ], - "source": [ - "from transformers import Seq2SeqTrainingArguments\n", - "\n", - "training_args = Seq2SeqTrainingArguments(\n", - " output_dir=\"./whisper-small-ar/whisper-small-ar\", # change to a repo name of your choice\n", - " per_device_train_batch_size=16,\n", - " gradient_accumulation_steps=1, # increase by 2x for every 2x decrease in batch size\n", - " learning_rate=1e-5,\n", - " warmup_steps=500,\n", - " max_steps=4000,\n", - " gradient_checkpointing=True,\n", - " fp16=True,\n", - " evaluation_strategy=\"steps\",\n", - " per_device_eval_batch_size=8,\n", - " predict_with_generate=True,\n", - " generation_max_length=225,\n", - " save_steps=1000,\n", - " eval_steps=1000,\n", - " logging_steps=25,\n", - " report_to=[\"tensorboard\"],\n", - " load_best_model_at_end=True,\n", - " metric_for_best_model=\"wer\",\n", - " greater_is_better=False,\n", - " push_to_hub=False,\n", - ")" - ] - }, - { - "cell_type": "markdown", - "id": "b3a944d8-3112-4552-82a0-be25988b3857", - "metadata": { - "id": "b3a944d8-3112-4552-82a0-be25988b3857" - }, - "source": [ - "**Note**: if one does not want to upload the model checkpoints to the Hub, \n", - "set `push_to_hub=False`." - ] - }, - { - "cell_type": "markdown", - "id": "bac29114-d226-4f54-97cf-8718c9f94e1e", - "metadata": { - "id": "bac29114-d226-4f54-97cf-8718c9f94e1e" - }, - "source": [ - "We can forward the training arguments to the ๐Ÿค— Trainer along with our model,\n", - "dataset, data collator and `compute_metrics` function:" - ] - }, - { - "cell_type": "code", - "execution_count": 27, - "id": "d546d7fe-0543-479a-b708-2ebabec19493", - "metadata": { - "id": "d546d7fe-0543-479a-b708-2ebabec19493" - }, - "outputs": [ - { - "name": "stderr", - "output_type": "stream", - "text": [ - "max_steps is given, it will override any value given in num_train_epochs\n", - "Using cuda_amp half precision backend\n" - ] - } - ], - "source": [ - "from transformers import Seq2SeqTrainer\n", - "\n", - "trainer = Seq2SeqTrainer(\n", - " args=training_args,\n", - " model=model,\n", - " train_dataset=common_voice[\"train\"],\n", - " eval_dataset=common_voice[\"test\"],\n", - " data_collator=data_collator,\n", - " compute_metrics=compute_metrics,\n", - " tokenizer=processor.feature_extractor,\n", - ")" - ] - }, - { - "cell_type": "markdown", - "id": "uOrRhDGtN5S4", - "metadata": { - "id": "uOrRhDGtN5S4" - }, - "source": [ - "We'll save the processor object once before starting training. Since the processor is not trainable, it won't change over the course of training:" - ] - }, - { - "cell_type": "code", - "execution_count": 28, - "id": "-2zQwMfEOBJq", - "metadata": { - "id": "-2zQwMfEOBJq" - }, - "outputs": [ - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Feature extractor saved in ./whisper-small-ar/whisper-small-ar/preprocessor_config.json\n", - "tokenizer config file saved in ./whisper-small-ar/whisper-small-ar/tokenizer_config.json\n", - "Special tokens file saved in ./whisper-small-ar/whisper-small-ar/special_tokens_map.json\n", - "added tokens file saved in ./whisper-small-ar/whisper-small-ar/added_tokens.json\n" - ] - } - ], - "source": [ - "processor.save_pretrained(training_args.output_dir)" - ] - }, - { - "cell_type": "markdown", - "id": "7f404cf9-4345-468c-8196-4bd101d9bd51", - "metadata": { - "id": "7f404cf9-4345-468c-8196-4bd101d9bd51" - }, - "source": [ - "### Training" - ] - }, - { - "cell_type": "markdown", - "id": "5e8b8d56-5a70-4f68-bd2e-f0752d0bd112", - "metadata": { - "id": "5e8b8d56-5a70-4f68-bd2e-f0752d0bd112" - }, - "source": [ - "Training will take approximately 5-10 hours depending on your GPU or the one \n", - "allocated to this Google Colab. If using this Google Colab directly to \n", - "fine-tune a Whisper model, you should make sure that training isn't \n", - "interrupted due to inactivity. A simple workaround to prevent this is \n", - "to paste the following code into the console of this tab (_right mouse click_ \n", - "-> _inspect_ -> _Console tab_ -> _insert code_)." - ] - }, - { - "cell_type": "markdown", - "id": "890a63ed-e87b-4e53-a35a-6ec1eca560af", - "metadata": { - "id": "890a63ed-e87b-4e53-a35a-6ec1eca560af" - }, - "source": [ - "```javascript\n", - "function ConnectButton(){\n", - " console.log(\"Connect pushed\"); \n", - " document.querySelector(\"#top-toolbar > colab-connect-button\").shadowRoot.querySelector(\"#connect\").click() \n", - "}\n", - "setInterval(ConnectButton, 60000);\n", - "```" - ] - }, - { - "cell_type": "markdown", - "id": "5a55168b-2f46-4678-afa0-ff22257ec06d", - "metadata": { - "id": "5a55168b-2f46-4678-afa0-ff22257ec06d" - }, - "source": [ - "The peak GPU memory for the given training configuration is approximately 15.8GB. \n", - "Depending on the GPU allocated to the Google Colab, it is possible that you will encounter a CUDA `\"out-of-memory\"` error when you launch training. \n", - "In this case, you can reduce the `per_device_train_batch_size` incrementally by factors of 2 \n", - "and employ [`gradient_accumulation_steps`](https://huggingface.co/docs/transformers/main_classes/trainer#transformers.Seq2SeqTrainingArguments.gradient_accumulation_steps)\n", - "to compensate.\n", - "\n", - "To launch training, simply execute:" - ] - }, - { - "cell_type": "code", - "execution_count": 29, - "id": "ee8b7b8e-1c9a-4d77-9137-1778a629e6de", - "metadata": { - "id": "ee8b7b8e-1c9a-4d77-9137-1778a629e6de" - }, - "outputs": [ - { - "name": "stderr", - "output_type": "stream", - "text": [ - "Loading model from ./whisper-small-ar/whisper-small-ar/checkpoint-3000.\n", - "/home/ubuntu/.local/lib/python3.8/site-packages/transformers/optimization.py:306: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning\n", - " warnings.warn(\n", - "***** Running training *****\n", - " Num examples = 38481\n", - " Num Epochs = 2\n", - " Instantaneous batch size per device = 16\n", - " Total train batch size (w. parallel, distributed & accumulation) = 16\n", - " Gradient Accumulation steps = 1\n", - " Total optimization steps = 4000\n", - " Number of trainable parameters = 241734912\n", - " Continuing training from checkpoint, will skip to saved global_step\n", - " Continuing training from epoch 1\n", - " Continuing training from global step 3000\n", - " Will skip the first 1 epochs then the first 594 batches in the first epoch. If this takes a lot of time, you can add the `--ignore_data_skip` flag to your launch command, but you will resume the training on data already seen by your model.\n" - ] - }, - { - "data": { - "application/vnd.jupyter.widget-view+json": { - "model_id": "fc9631b183e94e3eb25ed1b14e706a49", - "version_major": 2, - "version_minor": 0 - }, - "text/plain": [ - " 0%| | 0/594 [00:00\n", - " \n", - " \n", - " [4000/4000 1:15:29, Epoch 1/2]\n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - " \n", - "
StepTraining LossValidation LossWer
40000.1476000.32255044.976586

" - ], - "text/plain": [ - "" - ] - }, - "metadata": {}, - "output_type": "display_data" - }, - { - "name": "stderr", - "output_type": "stream", - "text": [ - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "`use_cache = True` is incompatible with gradient checkpointing. Setting `use_cache = False`...\n", - "***** Running Evaluation *****\n", - " Num examples = 10440\n", - " Batch size = 8\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "/home/ubuntu/.local/lib/python3.8/site-packages/transformers/generation/utils.py:1134: UserWarning: You have modified the pretrained model configuration to control generation. This is a deprecated strategy to control generation and will be removed soon, in a future version. Please use a generation configuration file (see https://huggingface.co/docs/transformers/main_classes/text_generation)\n", - " warnings.warn(\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Generate config GenerationConfig {\n", - " \"begin_suppress_tokens\": [\n", - " 220,\n", - " 50257\n", - " ],\n", - " \"bos_token_id\": 50257,\n", - " \"decoder_start_token_id\": 50258,\n", - " \"eos_token_id\": 50257,\n", - " \"max_length\": 448,\n", - " \"pad_token_id\": 50257,\n", - " \"suppress_tokens\": [],\n", - " \"transformers_version\": \"4.26.0.dev0\"\n", - "}\n", - "\n", - "Saving model checkpoint to ./whisper-small-ar/whisper-small-ar/checkpoint-4000\n", - "Configuration saved in ./whisper-small-ar/whisper-small-ar/checkpoint-4000/config.json\n", - "Model weights saved in ./whisper-small-ar/whisper-small-ar/checkpoint-4000/pytorch_model.bin\n", - "Feature extractor saved in ./whisper-small-ar/whisper-small-ar/checkpoint-4000/preprocessor_config.json\n", - "\n", - "\n", - "Training completed. Do not forget to share your model on huggingface.co/models =)\n", - "\n", - "\n", - "Loading best model from ./whisper-small-ar/whisper-small-ar/checkpoint-4000 (score: 44.976586172068686).\n" - ] - }, - { - "data": { - "text/plain": [ - "TrainOutput(global_step=4000, training_loss=0.03815199482440949, metrics={'train_runtime': 5424.3836, 'train_samples_per_second': 11.799, 'train_steps_per_second': 0.737, 'total_flos': 1.84651368394752e+19, 'train_loss': 0.03815199482440949, 'epoch': 1.66})" - ] - }, - "execution_count": 29, - "metadata": {}, - "output_type": "execute_result" - } - ], - "source": [ - "trainer.train(resume_from_checkpoint = True)" - ] - }, - { - "cell_type": "markdown", - "id": "810ced54-7187-4a06-b2fe-ba6dcca94dc3", - "metadata": { - "id": "810ced54-7187-4a06-b2fe-ba6dcca94dc3" - }, - "source": [ - "Our best WER is 32.0% - not bad for 8h of training data! We can submit our checkpoint to the [`hf-speech-bench`](https://huggingface.co/spaces/huggingface/hf-speech-bench) on push by setting the appropriate key-word arguments (kwargs):" - ] - }, - { - "cell_type": "code", - "execution_count": 33, - "id": "c704f91e-241b-48c9-b8e0-f0da396a9663", - "metadata": { - "id": "c704f91e-241b-48c9-b8e0-f0da396a9663" - }, - "outputs": [], - "source": [ - "kwargs = {\n", - " \"dataset_tags\": \"mozilla-foundation/common_voice_11_0\",\n", - " \"dataset\": \"Common Voice 11.0\", # a 'pretty' name for the training dataset\n", - " \"dataset_args\": \"config: ar, split: test\",\n", - " \"language\": \"ar\",\n", - " \"model_name\": \"Whisper Small ar - Mourad Mars\", # a 'pretty' name for our model\n", - " \"finetuned_from\": \"openai/whisper-small\",\n", - " \"tasks\": \"automatic-speech-recognition\",\n", - " \"tags\": \"hf-asr-leaderboard\",\n", - "}" - ] - }, - { - "cell_type": "markdown", - "id": "090d676a-f944-4297-a938-a40eda0b2b68", - "metadata": { - "id": "090d676a-f944-4297-a938-a40eda0b2b68" - }, - "source": [ - "The training results can now be uploaded to the Hub. To do so, execute the `push_to_hub` command and save the preprocessor object we created:" - ] - }, - { - "cell_type": "code", - "execution_count": 31, - "id": "d7030622-caf7-4039-939b-6195cdaa2585", - "metadata": { - "id": "d7030622-caf7-4039-939b-6195cdaa2585" - }, - "outputs": [ - { - "ename": "OSError", - "evalue": "Tried to clone a repository in a non-empty folder that isn't a git repository. If you really want to do this, do it manually:\ngit init && git remote add origin && git pull origin main\n or clone repo to a new folder and move your existing files there afterwards.", - "output_type": "error", - "traceback": [ - "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m", - "\u001b[0;31mOSError\u001b[0m Traceback (most recent call last)", - "\u001b[0;32m\u001b[0m in \u001b[0;36m\u001b[0;34m\u001b[0m\n\u001b[0;32m----> 1\u001b[0;31m \u001b[0mtrainer\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mpush_to_hub\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m", - "\u001b[0;32m~/.local/lib/python3.8/site-packages/transformers/trainer.py\u001b[0m in \u001b[0;36mpush_to_hub\u001b[0;34m(self, commit_message, blocking, **kwargs)\u001b[0m\n\u001b[1;32m 3467\u001b[0m \u001b[0;31m# it might fail.\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 3468\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0mhasattr\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m\"repo\"\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m-> 3469\u001b[0;31m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0minit_git_repo\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 3470\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 3471\u001b[0m \u001b[0mmodel_name\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mkwargs\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mpop\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m\"model_name\"\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;32mNone\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", - "\u001b[0;32m~/.local/lib/python3.8/site-packages/transformers/trainer.py\u001b[0m in \u001b[0;36minit_git_repo\u001b[0;34m(self, at_init)\u001b[0m\n\u001b[1;32m 3320\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 3321\u001b[0m \u001b[0;32mtry\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m-> 3322\u001b[0;31m self.repo = Repository(\n\u001b[0m\u001b[1;32m 3323\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0margs\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0moutput_dir\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 3324\u001b[0m \u001b[0mclone_from\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mrepo_name\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", - "\u001b[0;32m~/.local/lib/python3.8/site-packages/huggingface_hub/utils/_deprecation.py\u001b[0m in \u001b[0;36minner_f\u001b[0;34m(*args, **kwargs)\u001b[0m\n\u001b[1;32m 99\u001b[0m \u001b[0mmessage\u001b[0m \u001b[0;34m+=\u001b[0m \u001b[0;34m\"\\n\\n\"\u001b[0m \u001b[0;34m+\u001b[0m \u001b[0mcustom_message\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 100\u001b[0m \u001b[0mwarnings\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mwarn\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mmessage\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mFutureWarning\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 101\u001b[0;31m \u001b[0;32mreturn\u001b[0m \u001b[0mf\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m*\u001b[0m\u001b[0margs\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 102\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 103\u001b[0m \u001b[0;32mreturn\u001b[0m \u001b[0minner_f\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", - "\u001b[0;32m~/.local/lib/python3.8/site-packages/huggingface_hub/utils/_validators.py\u001b[0m in \u001b[0;36m_inner_fn\u001b[0;34m(*args, **kwargs)\u001b[0m\n\u001b[1;32m 122\u001b[0m )\n\u001b[1;32m 123\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 124\u001b[0;31m \u001b[0;32mreturn\u001b[0m \u001b[0mfn\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m*\u001b[0m\u001b[0margs\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 125\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 126\u001b[0m \u001b[0;32mreturn\u001b[0m \u001b[0m_inner_fn\u001b[0m \u001b[0;31m# type: ignore\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", - "\u001b[0;32m~/.local/lib/python3.8/site-packages/huggingface_hub/repository.py\u001b[0m in \u001b[0;36m__init__\u001b[0;34m(self, local_dir, clone_from, repo_type, token, git_user, git_email, revision, private, skip_lfs_files, client)\u001b[0m\n\u001b[1;32m 526\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 527\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0mclone_from\u001b[0m \u001b[0;32mis\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0;32mNone\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 528\u001b[0;31m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mclone_from\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mrepo_url\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mclone_from\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 529\u001b[0m \u001b[0;32melse\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 530\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0mis_git_repo\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mlocal_dir\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", - "\u001b[0;32m~/.local/lib/python3.8/site-packages/huggingface_hub/utils/_validators.py\u001b[0m in \u001b[0;36m_inner_fn\u001b[0;34m(*args, **kwargs)\u001b[0m\n\u001b[1;32m 122\u001b[0m )\n\u001b[1;32m 123\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 124\u001b[0;31m \u001b[0;32mreturn\u001b[0m \u001b[0mfn\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m*\u001b[0m\u001b[0margs\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 125\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 126\u001b[0m \u001b[0;32mreturn\u001b[0m \u001b[0m_inner_fn\u001b[0m \u001b[0;31m# type: ignore\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", - "\u001b[0;32m~/.local/lib/python3.8/site-packages/huggingface_hub/repository.py\u001b[0m in \u001b[0;36mclone_from\u001b[0;34m(self, repo_url, token)\u001b[0m\n\u001b[1;32m 760\u001b[0m \u001b[0;31m# Check if the folder is the root of a git repository\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 761\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0mis_git_repo\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mlocal_dir\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 762\u001b[0;31m raise EnvironmentError(\n\u001b[0m\u001b[1;32m 763\u001b[0m \u001b[0;34m\"Tried to clone a repository in a non-empty folder that isn't a\"\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 764\u001b[0m \u001b[0;34m\" git repository. If you really want to do this, do it\"\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", - "\u001b[0;31mOSError\u001b[0m: Tried to clone a repository in a non-empty folder that isn't a git repository. If you really want to do this, do it manually:\ngit init && git remote add origin && git pull origin main\n or clone repo to a new folder and move your existing files there afterwards." - ] - } - ], - "source": [ - "trainer.push_to_hub(**kwargs)" - ] - }, - { - "cell_type": "markdown", - "id": "34d4360d-5721-426e-b6ac-178f833fedeb", - "metadata": { - "id": "34d4360d-5721-426e-b6ac-178f833fedeb" - }, - "source": [ - "## Building a Demo" - ] - }, - { - "cell_type": "markdown", - "id": "e65489b7-18d1-447c-ba69-cd28dd80dad9", - "metadata": { - "id": "e65489b7-18d1-447c-ba69-cd28dd80dad9" - }, - "source": [ - "Now that we've fine-tuned our model we can build a demo to show \n", - "off its ASR capabilities! We'll make use of ๐Ÿค— Transformers \n", - "`pipeline`, which will take care of the entire ASR pipeline, \n", - "right from pre-processing the audio inputs to decoding the \n", - "model predictions.\n", - "\n", - "Running the example below will generate a Gradio demo where we \n", - "can record speech through the microphone of our computer and input it to \n", - "our fine-tuned Whisper model to transcribe the corresponding text:" - ] - }, - { - "cell_type": "code", - "execution_count": 32, - "id": "e0ace3aa-1ef3-45cb-933f-6ddca037c5aa", - "metadata": { - "id": "e0ace3aa-1ef3-45cb-933f-6ddca037c5aa" - }, - "outputs": [ - { - "ename": "OSError", - "evalue": "MMars/whisper-small-ar does not appear to have a file named config.json. Checkout 'https://huggingface.co/MMars/whisper-small-ar/None' for available files.", - "output_type": "error", - "traceback": [ - "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m", - "\u001b[0;31mOSError\u001b[0m Traceback (most recent call last)", - "\u001b[0;32m\u001b[0m in \u001b[0;36m\u001b[0;34m\u001b[0m\n\u001b[1;32m 2\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mgradio\u001b[0m \u001b[0;32mas\u001b[0m \u001b[0mgr\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 3\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m----> 4\u001b[0;31m \u001b[0mpipe\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mpipeline\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mmodel\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0;34m\"MMars/whisper-small-ar\"\u001b[0m\u001b[0;34m)\u001b[0m \u001b[0;31m# change to \"your-username/the-name-you-picked\"\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 5\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 6\u001b[0m \u001b[0;32mdef\u001b[0m \u001b[0mtranscribe\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0maudio\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", - "\u001b[0;32m~/.local/lib/python3.8/site-packages/transformers/pipelines/__init__.py\u001b[0m in \u001b[0;36mpipeline\u001b[0;34m(task, model, config, tokenizer, feature_extractor, framework, revision, use_fast, use_auth_token, device, device_map, torch_dtype, trust_remote_code, model_kwargs, pipeline_class, **kwargs)\u001b[0m\n\u001b[1;32m 653\u001b[0m \u001b[0mhub_kwargs\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m\"_commit_hash\"\u001b[0m\u001b[0;34m]\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mconfig\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_commit_hash\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 654\u001b[0m \u001b[0;32melif\u001b[0m \u001b[0mconfig\u001b[0m \u001b[0;32mis\u001b[0m \u001b[0;32mNone\u001b[0m \u001b[0;32mand\u001b[0m \u001b[0misinstance\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mmodel\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mstr\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 655\u001b[0;31m \u001b[0mconfig\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mAutoConfig\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mfrom_pretrained\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mmodel\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0m_from_pipeline\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mtask\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mhub_kwargs\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mmodel_kwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 656\u001b[0m \u001b[0mhub_kwargs\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m\"_commit_hash\"\u001b[0m\u001b[0;34m]\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mconfig\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_commit_hash\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 657\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n", - "\u001b[0;32m~/.local/lib/python3.8/site-packages/transformers/models/auto/configuration_auto.py\u001b[0m in \u001b[0;36mfrom_pretrained\u001b[0;34m(cls, pretrained_model_name_or_path, **kwargs)\u001b[0m\n\u001b[1;32m 824\u001b[0m \u001b[0mkwargs\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m\"name_or_path\"\u001b[0m\u001b[0;34m]\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mpretrained_model_name_or_path\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 825\u001b[0m \u001b[0mtrust_remote_code\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mkwargs\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mpop\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m\"trust_remote_code\"\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;32mFalse\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 826\u001b[0;31m \u001b[0mconfig_dict\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0munused_kwargs\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mPretrainedConfig\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mget_config_dict\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mpretrained_model_name_or_path\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 827\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0;34m\"auto_map\"\u001b[0m \u001b[0;32min\u001b[0m \u001b[0mconfig_dict\u001b[0m \u001b[0;32mand\u001b[0m \u001b[0;34m\"AutoConfig\"\u001b[0m \u001b[0;32min\u001b[0m \u001b[0mconfig_dict\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m\"auto_map\"\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 828\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0mtrust_remote_code\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", - "\u001b[0;32m~/.local/lib/python3.8/site-packages/transformers/configuration_utils.py\u001b[0m in \u001b[0;36mget_config_dict\u001b[0;34m(cls, pretrained_model_name_or_path, **kwargs)\u001b[0m\n\u001b[1;32m 557\u001b[0m \u001b[0moriginal_kwargs\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mcopy\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mdeepcopy\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 558\u001b[0m \u001b[0;31m# Get config dict associated with the base config file\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 559\u001b[0;31m \u001b[0mconfig_dict\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mkwargs\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mcls\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m_get_config_dict\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mpretrained_model_name_or_path\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 560\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0;34m\"_commit_hash\"\u001b[0m \u001b[0;32min\u001b[0m \u001b[0mconfig_dict\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 561\u001b[0m \u001b[0moriginal_kwargs\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m\"_commit_hash\"\u001b[0m\u001b[0;34m]\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mconfig_dict\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m\"_commit_hash\"\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", - "\u001b[0;32m~/.local/lib/python3.8/site-packages/transformers/configuration_utils.py\u001b[0m in \u001b[0;36m_get_config_dict\u001b[0;34m(cls, pretrained_model_name_or_path, **kwargs)\u001b[0m\n\u001b[1;32m 612\u001b[0m \u001b[0;32mtry\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 613\u001b[0m \u001b[0;31m# Load from local folder or from cache or download from model Hub and cache\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 614\u001b[0;31m resolved_config_file = cached_file(\n\u001b[0m\u001b[1;32m 615\u001b[0m \u001b[0mpretrained_model_name_or_path\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 616\u001b[0m \u001b[0mconfiguration_file\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", - "\u001b[0;32m~/.local/lib/python3.8/site-packages/transformers/utils/hub.py\u001b[0m in \u001b[0;36mcached_file\u001b[0;34m(path_or_repo_id, filename, cache_dir, force_download, resume_download, proxies, use_auth_token, revision, local_files_only, subfolder, user_agent, _raise_exceptions_for_missing_entries, _raise_exceptions_for_connection_errors, _commit_hash)\u001b[0m\n\u001b[1;32m 378\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0mos\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mpath\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0misfile\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mresolved_file\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 379\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0m_raise_exceptions_for_missing_entries\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 380\u001b[0;31m raise EnvironmentError(\n\u001b[0m\u001b[1;32m 381\u001b[0m \u001b[0;34mf\"{path_or_repo_id} does not appear to have a file named {full_filename}. Checkout \"\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 382\u001b[0m \u001b[0;34mf\"'https://huggingface.co/{path_or_repo_id}/{revision}' for available files.\"\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", - "\u001b[0;31mOSError\u001b[0m: MMars/whisper-small-ar does not appear to have a file named config.json. Checkout 'https://huggingface.co/MMars/whisper-small-ar/None' for available files." - ] - } - ], - "source": [ - "from transformers import pipeline\n", - "import gradio as gr\n", - "\n", - "pipe = pipeline(model=\"MMars/whisper-small-ar\") # change to \"your-username/the-name-you-picked\"\n", - "\n", - "def transcribe(audio):\n", - " text = pipe(audio)[\"text\"]\n", - " return text\n", - "\n", - "iface = gr.Interface(\n", - " fn=transcribe, \n", - " inputs=gr.Audio(source=\"microphone\", type=\"filepath\"), \n", - " outputs=\"text\",\n", - " title=\"Whisper Small Arabic [Mourad Mars]\",\n", - " description=\"Realtime demo for Arabic speech recognition using a fine-tuned Whisper small model.\",\n", - ")\n", - "\n", - "iface.launch()" - ] - }, - { - "cell_type": "markdown", - "id": "ca743fbd-602c-48d4-ba8d-a2fe60af64ba", - "metadata": { - "id": "ca743fbd-602c-48d4-ba8d-a2fe60af64ba" - }, - "source": [ - "## Closing Remarks" - ] - }, - { - "cell_type": "markdown", - "id": "7f737783-2870-4e35-aa11-86a42d7d997a", - "metadata": { - "id": "7f737783-2870-4e35-aa11-86a42d7d997a" - }, - "source": [ - "In this blog, we covered a step-by-step guide on fine-tuning Whisper for multilingual ASR \n", - "using ๐Ÿค— Datasets, Transformers and the Hugging Face Hub. For more details on the Whisper model, the Common Voice dataset and the theory behind fine-tuning, refere to the accompanying [blog post](https://huggingface.co/blog/fine-tune-whisper). If you're interested in fine-tuning other \n", - "Transformers models, both for English and multilingual ASR, be sure to check out the \n", - "examples scripts at [examples/pytorch/speech-recognition](https://github.com/huggingface/transformers/tree/main/examples/pytorch/speech-recognition)." - ] - } - ], - "metadata": { - "colab": { - "provenance": [] - }, - "kernelspec": { - "display_name": "Python 3", - "language": "python", - "name": "python3" - }, - "language_info": { - "codemirror_mode": { - "name": "ipython", - "version": 3 - }, - "file_extension": ".py", - "mimetype": "text/x-python", - "name": "python", - "nbconvert_exporter": "python", - "pygments_lexer": "ipython3", - "version": "3.8.10" - } - }, - "nbformat": 4, - "nbformat_minor": 5 -}