Instructions to use Enferlain/ellmo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Enferlain/ellmo with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="Enferlain/ellmo",
	filename="13b/Fimbulvetr-11B-v2-Test-14.q6_K.gguf",
)

output = llm(
	"Once upon a time,",
	max_tokens=512,
	echo=True
)
print(output)

Notebooks
Google Colab
Kaggle
Local Apps

llama.cpp

How to use Enferlain/ellmo with llama.cpp:

Install from brew

brew install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf Enferlain/ellmo:Q4_K_M
# Run inference directly in the terminal:
llama-cli -hf Enferlain/ellmo:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf Enferlain/ellmo:Q4_K_M
# Run inference directly in the terminal:
llama-cli -hf Enferlain/ellmo:Q4_K_M

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf Enferlain/ellmo:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf Enferlain/ellmo:Q4_K_M

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf Enferlain/ellmo:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf Enferlain/ellmo:Q4_K_M

Use Docker

docker model run hf.co/Enferlain/ellmo:Q4_K_M

LM Studio
Jan
Ollama
How to use Enferlain/ellmo with Ollama:
```
ollama run hf.co/Enferlain/ellmo:Q4_K_M
```

Unsloth Studio new

How to use Enferlain/ellmo with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for Enferlain/ellmo to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for Enferlain/ellmo to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for Enferlain/ellmo to start chatting

Docker Model Runner
How to use Enferlain/ellmo with Docker Model Runner:
```
docker model run hf.co/Enferlain/ellmo:Q4_K_M
```

Lemonade

How to use Enferlain/ellmo with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull Enferlain/ellmo:Q4_K_M

Run and chat with the model

lemonade run user.ellmo-Q4_K_M

List all available models

lemonade list

Enferlain commited on Feb 1, 2024

Commit

12b262f

verified ·

1 Parent(s): 3202dee

Upload folder using huggingface_hub

Browse files

Files changed (24) hide show

13b/MLewd-L2-13B-v2-1-015.q4_K_S.gguf +3 -0
13b/MLewdBoros-LRPSGPT-2Char-13B.q5_K_M.gguf +3 -0
13b/Oniichat_hermes-limarp-13b-merged.ggmlv3.q4_K_M.bin +3 -0
13b/ReMM-Mistral-13B.q5_k_m.gguf +3 -0
13b/ReMM-S-Kimiko-v2-13B.q5_K_M.gguf +3 -0
13b/ReMM-SLERP-L2-13B.q5_K_M.gguf +3 -0
13b/Slerpeno-Q5_K_M.gguf +3 -0
13b/Stheno-1.8-L2-13B.q5_K_M.gguf +3 -0
13b/UndiMix-v4-13B.q5_K_M.gguf +3 -0
13b/Unholy-v1.1-13B.q5_K_M.gguf +3 -0
13b/Utopia-13B.q5_k_m.gguf +3 -0
13b/mythalion-13b.Q5_K_M.gguf +3 -0
13b/mythomax-kimiko-mix.Q5_K_M.gguf +3 -0
13b/mythomax-l2-13b.ggmlv3.q4_K_M.bin +3 -0
13b/mythomix-l2-13b.ggmlv3.q5_K_M.bin +3 -0
13b/nous-hermes-2-solar-10.7b.Q8_0.gguf +3 -0
13b/nous-hermes-llama2-13b.ggmlv3.q4_K_M.bin +3 -0
13b/openorca-platypus2-13b.ggmlv3.q4_K_M.bin +3 -0
13b/sheep-duck-llama-2-13b.Q5_K_M.gguf +3 -0
13b/spicyboros-13b-2.2-ggml-model-Q5_K_M.gguf +3 -0
13b/stheno-inverted-l2-13b.Q5_K_M.gguf +3 -0
13b/undimix-v2-13b.Q5_K_M.gguf +3 -0
13b/xwin-lm-13b-v0.1.Q5_K_M.gguf +3 -0
13b/xwin-mlewd-13b-v0.2.Q5_K_M.gguf +3 -0

13b/MLewd-L2-13B-v2-1-015.q4_K_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:44d0e15bef2dc1711a709f3bad62a51fd7a2591b026b67bfca637fb045b00aaf
+size 7414331328

13b/MLewdBoros-LRPSGPT-2Char-13B.q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:aa1f488bb659382b921a84f2e441b175cf69667d38a36828874f80c2fc3d3438
+size 9229924288

13b/Oniichat_hermes-limarp-13b-merged.ggmlv3.q4_K_M.bin ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d38995367cf8d6586f62e3cdde1d1826afcceeaa014bea332379a4d5e807da27
+size 8059367040

13b/ReMM-Mistral-13B.q5_k_m.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:aaaa88e5c67f72ee935bdf91e57a654b35ca698b668a9d16408a2a18c5a18914
+size 9229924224

13b/ReMM-S-Kimiko-v2-13B.q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a118b107dd15e4edf951ada57b0765348dede6dd3d7988bf61b30e65be6337f6
+size 9229924288

13b/ReMM-SLERP-L2-13B.q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:46ee3da6ceed644cdfbc71036fbeab72895044d94bcd95891406d9ea09fa7f20
+size 9229924224

13b/Slerpeno-Q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5c22c616688c6556666bb33f0a24c7398c8a75d8b2e177310a6caf94ccef59fb
+size 9229924224

13b/Stheno-1.8-L2-13B.q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4aea9d4ce93ab92317cf3be921c6a0886a0403f28b4c10b657b0cd2ece63cfc9
+size 9229924288

13b/UndiMix-v4-13B.q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:833dc5934bd77860af907390471bb32f37985c1482fd1b52f8c2fb83641eb526
+size 9229924288

13b/Unholy-v1.1-13B.q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4c962cf73e3d518239b04690b0093d098f312025efdba52be15523fd8a717f41
+size 9229924288

13b/Utopia-13B.q5_k_m.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:831e1a09bad842e32f40c99ae5c6dddac33ddd8a19f2afebe29a9054378423c3
+size 9229924288

13b/mythalion-13b.Q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:baf65ebec7944ac60170c00c2ae6968ac1a585c0c3e0f9bbab01f1d2e02852ff
+size 9229924224

13b/mythomax-kimiko-mix.Q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c5d8365f3815d1c5725a14031864d322c6895fb683b9a39fdbe9600f6485c2be
+size 9229931904

13b/mythomax-l2-13b.ggmlv3.q4_K_M.bin ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e40552454d43de1accbbd468139f38bf9552c3d4f45745c4a80b3327c6e43f00
+size 7865666688

13b/mythomix-l2-13b.ggmlv3.q5_K_M.bin ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c00a471c72ec2d63b18467f8e1ca4e336e427b0ae644e14fba9acb18011abf6f
+size 9229634688

13b/nous-hermes-2-solar-10.7b.Q8_0.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5caf35d80939c5d3e753f36bd08ef1b6b697e13f52dcdf3aad91f8f6a6f0769c
+size 11404172448

13b/nous-hermes-llama2-13b.ggmlv3.q4_K_M.bin ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4640c0ccc7c234817a1ab461db6411277d7a2450b30aa6b002dacef3c03cb726
+size 8059367072

13b/openorca-platypus2-13b.ggmlv3.q4_K_M.bin ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fffe078c5ac1b23bbd529a0036babb5716eadc6e4680f1ac56969ea8a1336e84
+size 8058972960

13b/sheep-duck-llama-2-13b.Q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c6ee1727f7bf8984efb6326c85206b8824513b5e8de1a98f5d07750ab1b32bd5
+size 9229924288

13b/spicyboros-13b-2.2-ggml-model-Q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:45188e82e52a1503f4d00616b9a00664aa26c95cb6e11ada3e87518943b13637
+size 9229924224

13b/stheno-inverted-l2-13b.Q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c07dc3dbcbedd35663eb5a6493665f1965db0678a2e0374841b6452b98f519db
+size 9229924224

13b/undimix-v2-13b.Q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ca563fc1ea329b503b9976621814a20edadbee4ae99b783c736de466175a4f42
+size 9229924224

13b/xwin-lm-13b-v0.1.Q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6bd714f66419cf09b9f9be0923bab83737d0cb0b074003b93d54d1cfb6a0b3c9
+size 9229924224

13b/xwin-mlewd-13b-v0.2.Q5_K_M.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c5dba5eefdef1a49b95f63dc130aba946b49b2c04f2d126790f3d633778a6a4d
+size 9229924320