Swapped out some layers with higher SNR.

1 Epoch of Context-Obedient-RAG Dataset To Recalibrate after Depth Up Scaling

Factual Dataset ~ 1 Epoch LR 1e^-10

Revealing My Secret Method: Added the highest delta SNR layers interleved within the model strategically from intuition on how it responds to it.

Phi-3-6.5B-Contextually-Obedient-RAG Depth Up Scaled by Highest SNR Interleaved

Smarter-Phi-3 By Utilizing Intuition on the Signal To Noise Ratio To Optimize Depth Up Scaling To Use The Most Valuable Layers