|
<!DOCTYPE html> |
|
<html lang="en"> |
|
<head> |
|
<meta charset="utf-8"> |
|
<meta name="viewport" content="width=device-width, initial-scale=1"> |
|
<title>llama-cpp-wasm</title> |
|
<link rel="icon" type="image/png" href="favicon.png" /> |
|
|
|
|
|
<link |
|
rel="stylesheet" |
|
href="https://cdn.jsdelivr.net/npm/@picocss/pico@2/css/pico.min.css" |
|
/> |
|
</head> |
|
|
|
<body> |
|
<header class="container"> |
|
<hgroup> |
|
<h1><a href="/">llama-cpp-wasm</a></h1> |
|
<br /> |
|
|
|
<p> WebAssembly (Wasm) Build and Bindings for <a href="https://github.com/ggerganov/llama.cpp" target="_blank">llama.cpp</a>. </p> |
|
<br /> |
|
|
|
<p> This demonstration enables you to run LLM models directly in your browser utilizing JavaScript, WebAssembly, and llama.cpp. </p> |
|
<br /> |
|
|
|
<p> Repository: <a href="https://github.com/tangledgroup/llama-cpp-wasm"> https://github.com/tangledgroup/llama-cpp-wasm </a></p> |
|
</hgroup> |
|
</header> |
|
|
|
<main class="container"> |
|
<section> |
|
<img src="img/run-llama-cpp-in-browser-twitter-fs8.png" alt="llama-cpp-wasm" /> |
|
</section> |
|
|
|
<hr /> |
|
|
|
<section> |
|
<h2> In-Browser Demos </h2> |
|
|
|
<ul> |
|
<li><a href="/example-single-thread.html"> 🐢 <b> single thread </b> wasm32 </a></li> |
|
<li><a href="/example-multi-thread.html"> 🐇 <b> multithreading </b> wasm32 </a></li> |
|
</ul> |
|
</section> |
|
|
|
<hr /> |
|
|
|
<section> |
|
<h2> Ecosystem </h2> |
|
|
|
<article class="component"> |
|
<div class="grid"> |
|
<div> |
|
<a href="https://github.com/WebAssembly"> |
|
<img |
|
src="img/wasm.png" |
|
alt="wasm" /> |
|
</a> |
|
</div> |
|
|
|
<div> |
|
<a href="https://en.wikipedia.org/wiki/JavaScript"> |
|
<img |
|
src="img/js.png" |
|
alt="js javascript" /> |
|
</a> |
|
</div> |
|
|
|
<div> |
|
<a href="https://github.com/ggerganov/llama.cpp"> |
|
<img |
|
src="img/llamacpp.png" |
|
alt="llama.cpp" /> |
|
</a> |
|
</div> |
|
|
|
<div> |
|
<a href="https://tangledgroup.com"> |
|
<img |
|
src="img/tangledgroup.png" |
|
alt="tangled tabgledgroup tangledlabs tangledhub tangledcloud tangledlab" /> |
|
</a> |
|
</div> |
|
</div> |
|
</article> |
|
</section> |
|
</main> |
|
</body> |
|
</html> |
|
|
