mlx-community
/

LongWriter-llama3.1-8b-8bit

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions

Felladrin commited on Sep 29

Commit

13da8bc

·

verified ·

1 Parent(s): d52b1a5

Update README.md

Files changed (1) hide show

README.md +3 -3

README.md CHANGED Viewed

@@ -15,9 +15,9 @@ license: llama3.1
 base_model: zai-org/LongWriter-llama3.1-8b
 ---
-# Felladrin/LongWriter-llama3.1-8b-mlx-8Bit
-The Model [Felladrin/LongWriter-llama3.1-8b-mlx-8Bit](https://huggingface.co/Felladrin/LongWriter-llama3.1-8b-mlx-8Bit) was converted to MLX format from [zai-org/LongWriter-llama3.1-8b](https://huggingface.co/zai-org/LongWriter-llama3.1-8b) using mlx-lm version **0.26.4**.
 ## Use with mlx
@@ -28,7 +28,7 @@ pip install mlx-lm
 ```python
 from mlx_lm import load, generate
-model, tokenizer = load("Felladrin/LongWriter-llama3.1-8b-mlx-8Bit")
 prompt="hello"

 base_model: zai-org/LongWriter-llama3.1-8b
 ---
+# mlx-community/LongWriter-llama3.1-8b-8bit
+The Model [mlx-community/LongWriter-llama3.1-8b-8bit](https://huggingface.co/mlx-community/LongWriter-llama3.1-8b-8bit) was converted to MLX format from [zai-org/LongWriter-llama3.1-8b](https://huggingface.co/zai-org/LongWriter-llama3.1-8b) using mlx-lm version **0.26.4**.
 ## Use with mlx
 ```python
 from mlx_lm import load, generate
+model, tokenizer = load("mlx-community/LongWriter-llama3.1-8b-8bit")
 prompt="hello"