INT8 ONNX version of sachith-surge/Evol-Orca-LaMini-flan-t5-small to use with Transformers.js.

Example usage

import { pipeline } from '@xenova/transformers';

const generator = await pipeline('text2text-generation', 'Felladrin/onnx-Evol-Orca-LaMini-flan-t5-small');
const output =  await generator("How can I become more healthy?", { add_special_tokens: true, max_new_tokens: 50, repetition_penalty: 1.2});
console.log(output); // 1. Exercise: Exercise can help you stay fit and healthy. It can help you stay fit and...
Downloads last month
14
Inference Examples
Inference API (serverless) does not yet support transformers.js models for this pipeline type.

Model tree for Felladrin/onnx-Evol-Orca-LaMini-flan-t5-small

Quantized
(1)
this model