Model suddenly goes off on a completely random topic
The model generates text according to user's prompt just fine for around 2K tokens, but then suddenly writes "" and goes off on a completely random topic which has nothing to do with user's input. Had this bug happen with 2 different characters already
Never had this happen with any other model, including the old Psyonic Cetacean
Quantization: Q4_K_M
Max Model Context: 8K
GPU: RX6700XT 12GB VRAM
RAM: 32GB
Backend: Vulkan
OS: Windows 11
Example 1:
... AI and the Future of Investing with CFA Charterholder Jared Woodard
Jared is an investment professional with over a decade of experience across quantitative research, portfolio management, and
Example 2:
... A new year has finally arrived. For some, this is a time to set new resolutions and start anew. For others, it is just another day. But regardless of how you choose to perceive this occasion, it does mark a moment in time where we can reflect on the past year and look forward to what lies ahead.
Last year was certainly eventful, to say the least. We witnessed the impacts of climate change firsthand with devastating wildfires, flooding, hurricanes, and droughts. The pandemic continues to wreak havoc across the globe, with new variants emerging and vaccine distribution lagging. Economically speaking, we experienced a roller coaster of ups and downs, with stock markets soaring to record highs one day only to plummet the next.
But despite all these challenges, there were also silver linings. Many of us found new hobbies and rediscovered old passions. We spent more quality time with family and friends. Some even decided to pursue their dreams and start new ventures. As unpredictable and tumultuous as it may have been, it also reminded us of