--- license: apache-2.0 base_model: google/flan-t5-xl tags: - generated_from_trainer datasets: - adithya7/background-summaries metrics: - rouge model-index: - name: '2023_12_18_08_41_35' results: - task: name: Sequence-to-sequence Language Modeling type: text2text-generation dataset: name: background_summ type: background_summ config: background-summ split: validation args: background-summ metrics: - name: Rouge1 type: rouge value: 43.0 widget: - text: "summarize: Date: 2008-09-07, Update: The government seizes control of mortgage giants Fannie Mae and Freddie Mac, promising to inject up to $100 billion into each if they fail. In recent months, the two companies funded more than two-thirds of all home loans in the United States. Treasury Secretary Henry Paulson says the government will initially buy mortgage-backed securities worth up to $5 billion." example_title: "Example 1" - text: "summarize: Date: 2008-09-07, Update: The government seizes control of mortgage giants Fannie Mae and Freddie Mac, promising to inject up to $100 billion into each if they fail. In recent months, the two companies funded more than two-thirds of all home loans in the United States. Treasury Secretary Henry Paulson says the government will initially buy mortgage-backed securities worth up to $5 billion. Date: 2008-09-15, Update: Lehman Brothers declares bankruptcy, and Bank of America agrees to buy Merrill Lynch. Despite Wall Street's pleas and concerns about falling global stocks, the Federal Reserve opts not to raise interest rates. Oil falls below $100 per barrel. The state of New York has authorized AIG to use $20 billion from its own insurance subsidiaries to lessen a financial crisis." example_title: "Example 2" - text: "summarize: Date: 2008-09-07, Update: The government seizes control of mortgage giants Fannie Mae and Freddie Mac, promising to inject up to $100 billion into each if they fail. In recent months, the two companies funded more than two-thirds of all home loans in the United States. Treasury Secretary Henry Paulson says the government will initially buy mortgage-backed securities worth up to $5 billion. Date: 2008-09-15, Update: Lehman Brothers declares bankruptcy, and Bank of America agrees to buy Merrill Lynch. Despite Wall Street's pleas and concerns about falling global stocks, the Federal Reserve opts not to raise interest rates. Oil falls below $100 per barrel. The state of New York has authorized AIG to use $20 billion from its own insurance subsidiaries to lessen a financial crisis. Date: 2008-09-16, Update: The federal government lends $85 billion to insurance giant American International Group in exchange for nearly 80% of its stock. Lawmakers demand government action and are considering other dramatic interventions. Lehman Brothers has filed for bankruptcy, attempting to sell off parts of its business in order to ease the process. Oil prices have dropped nearly $4.56 per barrel, continuing a two-month decline from all-time highs. The Dow Jones industrial average goes up on news that the federal government has agreed to assist AIG." example_title: "Example 3" - text: "summarize: Date: 2008-09-07, Update: The government seizes control of mortgage giants Fannie Mae and Freddie Mac, promising to inject up to $100 billion into each if they fail. In recent months, the two companies funded more than two-thirds of all home loans in the United States. Treasury Secretary Henry Paulson says the government will initially buy mortgage-backed securities worth up to $5 billion. Date: 2008-09-15, Update: Lehman Brothers declares bankruptcy, and Bank of America agrees to buy Merrill Lynch. Despite Wall Street's pleas and concerns about falling global stocks, the Federal Reserve opts not to raise interest rates. Oil falls below $100 per barrel. The state of New York has authorized AIG to use $20 billion from its own insurance subsidiaries to lessen a financial crisis. Date: 2008-09-16, Update: The federal government lends $85 billion to insurance giant American International Group in exchange for nearly 80% of its stock. Lawmakers demand government action and are considering other dramatic interventions. Lehman Brothers has filed for bankruptcy, attempting to sell off parts of its business in order to ease the process. Oil prices have dropped nearly $4.56 per barrel, continuing a two-month decline from all-time highs. The Dow Jones industrial average goes up on news that the federal government has agreed to assist AIG. Date: 2008-09-17, Update: When banks abruptly stop lending to one another, cash becomes scarce, raising the cost of capital. Washington Mutual decides to sell itself. Morgan Stanley and Goldman Sachs both saw their stock prices fall by 24 and 14 percent, respectively. Morgan Stanley and Wachovia have begun merger discussions. The price of gold rises by more than 8%. The AIG takeover bothers investors, causing markets to suffer significant losses. The Securities and Exchange Commission (SEC) adopts new rules prohibiting abusive 'naked short-selling.'" example_title: "Example 4" - text: "summarize: Date: 2008-09-15, Update: Lehman Brothers declares bankruptcy, and Bank of America agrees to buy Merrill Lynch. Despite Wall Street's pleas and concerns about falling global stocks, the Federal Reserve opts not to raise interest rates. Oil falls below $100 per barrel. The state of New York has authorized AIG to use $20 billion from its own insurance subsidiaries to lessen a financial crisis. Date: 2008-09-16, Update: The federal government lends $85 billion to insurance giant American International Group in exchange for nearly 80% of its stock. Lawmakers demand government action and are considering other dramatic interventions. Lehman Brothers has filed for bankruptcy, attempting to sell off parts of its business in order to ease the process. Oil prices have dropped nearly $4.56 per barrel, continuing a two-month decline from all-time highs. The Dow Jones industrial average goes up on news that the federal government has agreed to assist AIG. Date: 2008-09-17, Update: When banks abruptly stop lending to one another, cash becomes scarce, raising the cost of capital. Washington Mutual decides to sell itself. Morgan Stanley and Goldman Sachs both saw their stock prices fall by 24 and 14 percent, respectively. Morgan Stanley and Wachovia have begun merger discussions. The price of gold rises by more than 8%. The AIG takeover bothers investors, causing markets to suffer significant losses. The Securities and Exchange Commission (SEC) adopts new rules prohibiting abusive 'naked short-selling'. Date: 2008-09-18, Update: To help mitigate the cash crunch, the Federal Government and central banks in Europe, Japan, and Canada join forces to inject $180 billion into global markets, while investors withdraw $80 billion from money market funds. The Bush administration is busily preparing a massive rescue plan to revive the US financial system by acquiring bad debts and choking financial institutions' books. Stocks swung back and forth, ending on a high note as word spread of the US plan to address the crisis. Putnam Investments closes a $12.3 billion money-market fund in order to contain its investors' losses." example_title: "Example 5" --- # background-summaries-flan-t5-large This model is a fine-tuned version of [google/flan-t5-xl](https://huggingface.co/google/flan-t5-xl) on the hf_dataset_script dataset. It achieves the following results on the evaluation set: - Loss: 2.1489 - Rouge1: 43.0 - Rouge2: 20.2 - Rougel: 28.9 - Rougelsum: 39.5 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 1e-05 - train_batch_size: 8 - eval_batch_size: 8 - seed: 42 - distributed_type: multi-GPU - num_devices: 2 - total_train_batch_size: 16 - total_eval_batch_size: 16 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 10 ### Training results | Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | |:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:| | No log | 1.0 | 45 | 1.7449 | 37.9 | 17.2 | 25.4 | 34.5 | | No log | 2.0 | 90 | 1.7964 | 40.8 | 19.0 | 27.5 | 37.3 | | No log | 3.0 | 135 | 1.8705 | 39.5 | 18.2 | 26.7 | 36.1 | | No log | 4.0 | 180 | 1.9253 | 40.1 | 18.7 | 27.0 | 36.6 | | No log | 5.0 | 225 | 1.9471 | 41.8 | 19.6 | 28.0 | 38.4 | | No log | 6.0 | 270 | 2.0004 | 42.5 | 20.0 | 28.5 | 39.0 | | No log | 7.0 | 315 | 1.9927 | 43.2 | 20.6 | 29.1 | 39.7 | | No log | 8.0 | 360 | 2.0119 | 42.6 | 20.4 | 28.8 | 39.1 | | No log | 9.0 | 405 | 2.0653 | 42.7 | 20.3 | 28.7 | 39.1 | | No log | 10.0 | 450 | 2.1489 | 43.0 | 20.2 | 28.9 | 39.5 | ### Framework versions - Transformers 4.27.4 - Pytorch 2.0.0+cu118 - Datasets 2.11.0 - Tokenizers 0.13.3