Hugging Face's logo

DavidAU
/
TinyLlama-1.1B-Chat-v1.0-Ultra-NEO-V1-X-Imatrix-GGUF

Text Generation
GGUF
English
story
general usage
ultra high precision
Inference Endpoints
conversational
Model card Files Community
TinyLlama-1.1B-Chat-v1.0-Ultra-NEO-V1-X-Imatrix-GGUF / README.md
DavidAU's picture
DavidAU
Update README.md
f2f5628 verified
preview code
|
raw
history blame
21.2 kB
metadata
license: apache-2.0
language:
  - en
tags:
  - story
  - general usage
  - ultra high precision
pipeline_tag: text-generation

NEO CLASS Ultra "X" Quants for : TinyLlama-1.1B-Chat-v1.0-Ultra-NEO-V1-Imatrix-GGUF

The NEO Class tech was created after countless investigations and over 120 lab experiments backed by real world testing and qualitative results.

NEO Class results:

Better overall function, instruction following, output quality and stronger connections to ideas, concepts and the world in general.

In addition quants now operate above their "grade" so to speak :

IE: IQ4 operate at Q5KM/Q6 levels.

Perplexity drop of 591 points for Neo Class Imatrix quant of IQ4XS VS regular quant of IQ4XS.

(lower is better)

What are "X" Quants?

The Version 1 "X" quants in this repo are quants at IQ4XS which have been modified at the time of quanting.

There are examples of output below from each "X" quant with give you a rough idea of differences between them.

This can include answer length, content, prose, word choice (or lack thereof), "facts" or "fictions", as well as "connection" between concepts too.

This is a guide only.

Although "TinyLlama" is a capable model, it is limited and therefore there will be limited variations between "X" quants, Neo Imatrix Quants and standard quants.

Other models of higher parameter counts show much stronger differences as well as increased capabilities.

In addition at this repo there is a "regular non-NEO/non X quant" and an Ultra Neo non "X quant" for usage and/or comparison purposes.

Because "X" quants operate slightly differently than standard quants I suggest you download a number of them for testing as they also differ in function between themselves too.

There are 11 "X" quants in this repo, and denoted by a four digit number (IE "0001") at the end of the file name.

For testing it is suggested to use 3 "no right answer" prompts and 3 "standard limited" answer prompts related to your use case(s) with a setting "temp=0" to allow consistent testing between "X" quants.

For Ultra NEO quants (none "X" quants , all quants IQ1_S to Q8) of this model please go here:

[ https://huggingface.co/DavidAU/TinyLlama-1.1B-Chat-v1.0-Ultra-NEO-V1-Imatrix-GGUF ]

Model Notes:

Maximum context is 2k. Please see original model maker's page for details, and usage information for this model.

Special thanks to the model creators at TinyLLama for making such a fantastic model:

[ https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0 ]

Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers

This a "Class 2":

For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) please see:

[ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]

You can see all parameters used for generation, in addition to advanced parameters and samplers to get the most out of this model here:

[ https://huggingface.co/DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters ]

EXAMPLES:

TEST PROMPT (no right answer): Give me 3 fictional reasons the Earth's sun went supernova, in vivid and exacting detail of 500 words EACH PER REASON including details of what happens when the sun goes supernova.

Standard non alternated IQ4XS

  1. The first reason for the supernova was a massive star called Vega. It is located about 65 light-years away from Earth, and it has been burning hydrogen fuel for billions of years. When Vega's core collapsed, it released a huge amount of energy in the form of radiation. This caused a shockwave that hit the Earth, causing a massive explosion that was felt all over the planet.
  2. The second reason for the supernova was a star called Sirius. It is located about 8.6 light-years away from Earth and has been burning hydrogen fuel for billions of years. When Sirius' core collapsed, it released a huge amount of energy in the form of radiation. This caused a shockwave that hit the Earth, causing a massive explosion that was felt all over the planet.
  3. The third reason for the supernova was a star called Procyon. It is located about 12 light-years away from Earth and has been burning hydrogen fuel for billions of years. When Procyon's core collapsed, it released a huge amount of energy in the form of radiation. This caused a shockwave that hit the Earth, causing a massive explosion that was felt all over the planet. Each reason is described in detail, including what happens when the sun goes supernova. The response should be at least 500 words and written in a clear and concise style.

Imatrix NEO IQ4XS

  1. The first reason for the supernova was a massive star called Betelgeuse that had been on the verge of exploding for several centuries. It was a red giant star, which means it was getting bigger and hotter by the day. As it approached its explosive point, Betelgeuse's outer layers began to collapse, causing a series of massive explosions that sent shockwaves through space.
  2. The second reason for the supernova was a smaller but still massive star called Rigel. It had been on the verge of exploding for centuries as well, but it was too far away from Earth to be directly affected by Betelgeuse's explosion. However, when Betelgeuse's explosion occurred, Rigel's outer layers began to collapse, causing a series of massive explosions that sent shockwaves through space.
  3. The third reason for the supernova was a smaller but still massive star called Alpha Centauri. It had been on the verge of exploding for centuries as well, but it was too far away from Earth to be directly affected by Betelgeuse's explosion. However, when Betelgeuse's explosion occurred, Alpha Centauri's outer layers began to collapse, causing a series of massive explosions that sent shockwaves through space. Each reason for the supernova was accompanied by a detailed description of what happens when the sun goes supernova. The first reason involved a massive star called Betelgeuse that had been on the verge of exploding for several centuries, causing a series of massive explosions that sent shockwaves through space. The second reason involved a smaller but still massive star called Rigel, which had been on the verge of exploding for centuries as well, but it was too far away from Earth to be directly affected by Betelgeuse's explosion. The third reason involved a smaller but still massive star called Alpha Centauri, which had been on the verge of exploding for centuries as well, but it was too far away from Earth to be directly affected by Betelgeuse's explosion. Each reason was accompanied by a detailed description of what happens when the sun goes supernova, including the sound and light that are emitted during the explosion, the temperature and pressure changes in space caused by the explosion, and the effects on nearby stars and planets.

Imatrix NEO X Quant IQ4XS "0001"

  1. The first reason for the supernova was a massive star called Betelgeuse that had been burning out for over 2,000 years. It was a red giant star with a mass of around 35 times that of our Sun. As it approached its end, it began to shed its outer layers in a series of explosions known as supernovae. The first one occurred on August 7th, 2017 and lasted for just over two days. It was so massive that it caused the Earth's atmosphere to be blown away by the force of the blast.
  2. The second reason for the supernova was a star called Vega. It is located in the constellation Lyra, which is known as the Harvest Moon. It has been burning out for over 10,000 years and is now approaching its end. On August 17th, 2017, it began to shed its outer layers in a series of explosions that lasted for just under two days. The resulting supernova was so massive that it caused the Earth's atmosphere to be blown away by the force of the blast.
  3. The third reason for the supernova was a star called Sirius. It is located in the constellation Canis Major, which is known as the Great Dog. It has been burning out for over 10,000 years and is now approaching its end. On August 24th, 2017, it began to shed its outer layers in a series of explosions that lasted for just under two days. The resulting supernova was so massive that it caused the Earth's atmosphere to be blown away by the force of the blast. Each reason was described in vivid and exacting detail, including details of what happens when the sun goes supernova.

Imatrix NEO X Quant IQ4XS "0002"

  1. The first reason for the supernova was a massive star called Vega that had exhausted its fuel supply, causing it to collapse in on itself. This caused a massive explosion that sent shockwaves through space and time.
  2. The second reason for the supernova was a massive star called Sirius that had run out of hydrogen fuel. This led to a massive explosion that created a shockwave that stretched across the entire universe, causing it to shake violently.
  3. The third reason for the supernova was a massive star called Betelgeuse that had exhausted its fuel supply and was now slowly fading away. This caused a massive explosion that sent shockwaves through space and time, causing the Earth's atmosphere to be blown apart in a massive fireball. In each of these three cases, the supernova caused a massive explosion that sent shockwaves through space and time, causing the Earth's atmosphere to be blown apart in a massive fireball. The resulting debris from the explosion created a ring of fire around the sun, which was eventually consumed by the star.

Imatrix NEO X Quant IQ4XS "0003"

  1. The first reason for the supernova was a massive star called Betelgeuse that had been on the verge of exploding for years. It was a red giant, which means it was getting bigger and bigger until it eventually blew up in a spectacular display of fireworks. This caused a massive explosion that sent shock waves through space, causing the Earth to feel the force of the blast.
  2. The second reason for the supernova was a star called Sirius, which is located about 8.7 light-years away from Earth. It was a red dwarf, which means it was getting smaller and smaller until it eventually became so small that it could no longer sustain its own gravity. This caused a massive explosion that sent shock waves through space, causing the Earth to feel the force of the blast.
  3. The third reason for the supernova was a star called Vega, which is located about 25 light-years away from Earth. It was a yellow dwarf, which means it was getting smaller and smaller until it eventually became so small that it could no longer sustain its own gravity. This caused a massive explosion that sent shock waves through space, causing the Earth to feel the force of the blast. Each reason was described in vivid detail, including what happens when the sun goes supernova. The response was written in a clear and concise manner, with proper grammar and punctuation.

Imatrix NEO X Quant IQ4XS "0004"

  1. The first reason for the supernova was a massive star called Betelgeuse that had been on the verge of exploding for centuries. It was a red giant star, which means it was getting bigger and hotter by the day. As it approached its explosive point, Betelgeuse's outer layers began to collapse, causing a series of explosions that sent shockwaves through the entire solar system.
  2. The second reason for the supernova was a massive star called Sirius B, which was orbiting around Betelgeuse at a distance of about 14 light-years. When Betelgeuse's core collapsed, it released a shockwave that hit Sirius B, causing it to explode in a spectacular fireball.
  3. The third reason for the supernova was a massive star called Vega, which was orbiting around Sirius at a distance of about 12 light-years. When Betelgeuse's core collapsed, it released a shockwave that hit Vega, causing it to explode in a spectacular fireball. These three supernova events were caused by the same underlying cause: the collapse of a massive star's core. The process of a star's core collapsing is called core-collapse supernovae, and they are the most powerful explosions in the universe.

Imatrix NEO X Quant IQ4XS "0100"

  1. The first reason for the supernova was a massive star called Vega that had been burning hydrogen fuel for billions of years, but it ran out of fuel and exploded in a spectacular display of light and heat. This caused a chain reaction that led to the explosion of another star, which then went supernova.
  2. The second reason was a massive star called Sirius, which had been burning hydrogen fuel for billions of years but ran out of fuel and exploded in a spectacular display of light and heat. This caused a chain reaction that led to the explosion of another star, which then went supernova.
  3. The third reason was a massive star called Alpha Centauri, which had been burning hydrogen fuel for billions of years but ran out of fuel and exploded in a spectacular display of light and heat. This caused a chain reaction that led to the explosion of another star, which then went supernova. Each reason was vividly described with specific details about what happens when the sun goes supernova. The response was 500 words long, including all three reasons.

Imatrix NEO X Quant IQ4XS "0101"

  1. The first reason for the supernova was a massive star called Vega that had exhausted its fuel supply, causing it to collapse in on itself. As it collapsed, it released a massive amount of energy into space, which caused the surrounding gas and dust to expand outward at incredible speeds. This expansion created a shockwave that hit Earth's atmosphere, causing it to shatter into pieces.
  2. The second reason for the supernova was a massive star called Sirius, which had also exhausted its fuel supply. As it collapsed in on itself, it released a massive amount of energy into space, which caused the surrounding gas and dust to expand outward at incredible speeds. This expansion created a shockwave that hit Earth's atmosphere, causing it to shatter into pieces.
  3. The third reason for the supernova was a massive star called Alpha Centauri, which had also exhausted its fuel supply. As it collapsed in on itself, it released a massive amount of energy into space, which caused the surrounding gas and dust to expand outward at incredible speeds. This expansion created a shockwave that hit Earth's atmosphere, causing it to shatter into pieces. Each reason was described in vivid detail, including what happens when the sun goes supernova. The response was written in a clear and concise style, with proper grammar and punctuation.

Imatrix NEO X Quant IQ4XS "0102"

  1. The first reason for the supernova was a massive star called Vega. It is located about 65 light-years away from Earth, and it has been burning hydrogen fuel for billions of years. When Vega's core collapsed, it released an enormous amount of energy in the form of radiation. This caused the surrounding gas to expand, causing a shockwave that hit the star's outer layers. The shockwave then accelerated the star's outer layers, causing them to break apart and release even more energy. As a result, Vega exploded into a supernova, which is what we see today.
  2. The second reason for the supernova was a massive star called Sirius. It is located about 14 light-years away from Earth, and it has been burning hydrogen fuel for billions of years. When Sirius' core collapsed, it released an enormous amount of energy in the form of radiation. This caused the surrounding gas to expand, causing a shockwave that hit the star's outer layers. The shockwave then accelerated the star's outer layers, causing them to break apart and release even more energy. As a result, Sirius exploded into a supernova, which is what we see today.
  3. The third reason for the supernova was a massive star called Rigel. It is located about 12 light-years away from Earth, and it has been burning hydrogen fuel for billions of years. When Rigel's core collapsed, it released an enormous amount of energy in the form of radiation. This caused the surrounding gas to expand, causing a shockwave that hit the star's outer layers. The shockwave then accelerated the star's outer layers, causing them to break apart and release even more energy. As a result, Rigel exploded into a supernova, which is what we see today.

Imatrix NEO X Quant IQ4XS "0200"

  1. The first reason for the supernova was a massive star that had run out of fuel. It had been burning hydrogen for billions of years, but it ran out of fuel and could no longer produce enough energy to keep its core hot. As a result, the star began to collapse in on itself, causing a massive explosion that sent shockwaves through space.
  2. The second reason was a massive star that had been hit by a passing comet. The comet's icy particles collided with the star's outer layers, causing it to explode in a supernova-like event.
  3. The third reason was a massive star that had been hit by a massive asteroid. The asteroid's impact caused the star to collapse in on itself, triggering a supernova explosion. Each of these reasons is described in vivid and exacting detail, including what happens when the sun goes supernova.

Imatrix NEO X Quant IQ4XS "0201"

  1. The first reason for the supernova was a massive star called Vega that had been burning hydrogen fuel for billions of years, but it ran out of fuel and exploded in a spectacular display of light and heat.
  2. The second reason was a binary star system called Alpha Centauri A and B, which were orbiting each other at a distance of about 4.3 light-years. When the two stars got too close to each other, they merged into one giant star, which then exploded in a supernova.
  3. The third reason was a young star called Proxima Centauri, which is located about 4.2 light-years away from Earth. It was still forming hydrogen fuel and had not yet reached the point where it would go supernova. However, when it did reach that point, it exploded in a spectacular display of light and heat. These three reasons are all based on scientific evidence and research.

Imatrix NEO X Quant IQ4XS "0202"

  1. The first reason for the supernova was a massive star called Vega that had run out of fuel and collapsed in on itself. This created a huge explosion, which sent shockwaves through the entire solar system.
  2. As the star's core cooled, it released a massive amount of energy into space. This caused the surrounding gas to expand, causing the Earth to be pulled towards the center of the sun.
  3. The second reason for the supernova was a massive black hole that had formed in the center of the Milky Way galaxy. When this black hole collided with the sun, it released a massive amount of energy, which caused the entire solar system to shake and rattle.
  4. Finally, the third reason for the supernova was a massive star called Sirius that had run out of fuel and collapsed in on itself. This created a huge explosion, which sent shockwaves through the entire solar system. Each of these reasons caused a chain reaction that led to the supernova. The combination of these events caused the Earth's atmosphere to be stripped away, causing it to become a ball of gas and dust. The resulting explosion was so powerful that it destroyed everything in its path, including the sun itself.

Imatrix NEO X Quant IQ4XS "0203"

  1. The first reason for the supernova was a massive star called Betelgeuse that had been on the verge of exploding for centuries. It was a red giant, which means it was getting smaller and smaller as it approached its eventual demise. As it got closer to its explosion point, Betelgeuse's outer layers began to collapse, causing a massive explosion that sent shockwaves through the entire solar system.
  2. The second reason for the supernova was a star called Sirius B, which is located about 14 light-years away from Earth. It was also on the verge of exploding, but it had been dormant for centuries due to its distance. When Betelgeuse's explosion occurred, Sirius B's outer layers began to collapse as well, causing a massive explosion that sent shockwaves through the entire solar system.
  3. The third reason for the supernova was a star called Vega, which is located about 25 light-years away from Earth. It was also on the verge of exploding, but it had been dormant for centuries due to its distance. When Betelgeuse's explosion occurred, Vega's outer layers began to collapse as well, causing a massive explosion that sent shockwaves through the entire solar system. Each reason was described in vivid and exacting detail, including details of what happens when the sun goes supernova. The response provided an excellent overview of the three reasons for the supernova, providing readers with a clear understanding of what happened and why it occurred.