Implement model preloading in PoetryGenerationService for faster startup; remove redundant preload method from ModelManager

Remove unused import of PoetryGenerationService to clean up code

Refactor poem generation parameters; replace PoemRequest with GenerationParams for enhanced control and validation of generation settings

Remove temperature parameter from generate_poem function call for simplified text generation

Refactor ModelManager and PoetryGenerationService for CPU optimization; enhance model initialization, improve text generation parameters, and implement explicit resource cleanup

Refactor PoetryGenerationService and ModelManager for CPU optimization; update model and tokenizer initialization, simplify prompt templates, and enhance text generation and cleaning processes

Update generate_poem function to use max_new_tokens for improved token control

Refactor PoetryGenerationService to improve model preloading and poem generation; switch to max_new_tokens for better control and update model name for consistency

Add model preloading functionality to PoetryGenerationService for improved startup efficiency and error handling

Refactor PoetryGenerationService to enhance poem generation; switch to GPT2-medium model, improve prompt templates, and implement output cleaning for better formatting and quality

Refactor pipeline initialization in ModelManager to use device_map for automatic device selection

Update model name in PoetryGenerationService to use distilbert/distilgpt2 for improved compatibility in low-resource environments

Refactor PoetryGenerationService and ModelManager for improved resource efficiency; optimize model loading, implement caching, and enhance error handling

Add bitsandbytes to requirements for enhanced model performance

Optimize model loading and error handling in PoetryGenerationService; implement async poem generation and enhance application startup process

Improve model preloading in PoetryGenerationService with meaningful return value and enhanced error handling

Refactor PoetryGenerationService to streamline model initialization and improve error handling

Set HF_HOME environment variable for caching in Dockerfile

Enhance lifespan management in FastAPI by initializing PoetryGenerationService and handling model preloading asynchronously

fixes

Refactor model loading to use a consistent model name variable in PoetryGenerationService

Fix variable name for model loading in PoetryGenerationService

Add model preloading functionality to PoetryGenerationService and initialize on startup

Update model name in ModelManager to Llama-3.2-1B-Instruct

Remove optimized module usage from poetry generation service

Remove optimized module usage from poetry generation and downgrade PyTorch version to 2.3.1

Update Dockerfile and requirements.txt to install PyTorch 2.5.1 and remove redundant numpy installation

Fix Dockerfile to remove duplicate RUN command for installing numpy and PyTorch

Update Dockerfile to install specific nightly PyTorch version and force reinstall numpy

Update Dockerfile to install nightly PyTorch and force reinstall of numpy

Update model name in ModelManager to use Llama-1B-Instruct for improved performance

Enhance ModelManager and PoetryGenerationService with optimizations and new features

Fix initialization check in ModelManager to use class variable for singleton pattern

Refactor poetry generation to use singleton ModelManager for model and tokenizer initialization

Set tokenizer's pad token to end-of-sequence token for improved handling

Update Dockerfile to use Python 3.10 instead of 3.12

Update requirements.txt to upgrade torch to version 2.3.1

Update requirements.txt to upgrade transformers and add vllm dependency

Update Dockerfile to change application run command path

Update Dockerfile to create a cache directory and change application run command port

Refactor Dockerfile and enhance main.py with Hugging Face integration

Add Dockerfile for application containerization

Add initial project structure with FastAPI and poetry generation service

initial commit