Text Generation
GGUF
English
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
story
writing
fiction
float32
roleplaying
rp
llama
llama-2
llama2
enhanced
neo class
32 bit upscale
imatrix
Instructions to use DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF:IQ4_XS # Run inference directly in the terminal: llama cli -hf DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF:IQ4_XS
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF:IQ4_XS # Run inference directly in the terminal: llama cli -hf DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF:IQ4_XS
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF:IQ4_XS # Run inference directly in the terminal: ./llama-cli -hf DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF:IQ4_XS
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF:IQ4_XS # Run inference directly in the terminal: ./build/bin/llama-cli -hf DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF:IQ4_XS
Use Docker
docker model run hf.co/DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF:IQ4_XS
- LM Studio
- Jan
- vLLM
How to use DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF:IQ4_XS
- Ollama
How to use DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF with Ollama:
ollama run hf.co/DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF:IQ4_XS
- Unsloth Desktop
- Docker Model Runner
How to use DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF with Docker Model Runner:
docker model run hf.co/DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF:IQ4_XS
- Lemonade
How to use DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull DavidAU/Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF:IQ4_XS
Run and chat with the model
lemonade run user.Psyonic-Cetacean-MythoMax-Prose-Crazy-Ultra-Quality-29B-GGUF-IQ4_XS
List all available models
lemonade list
- Atomic Chat
Update README.md
Browse files
README.md
CHANGED
|
@@ -519,3 +519,44 @@ The second figure was a lithe woman, her every line and angle honed by a lifetim
|
|
| 519 |
The third figure was a boy, not yet grown into manhood but standing tall and straight-backed nonetheless, his slender frame taut as a bowstring about to snap. His dark curls fell in disarray around his pale, heart-shaped face, framing large, expressive hazel eyes that darted restlessly from one grim visage to the next, brimming with anguish and unshed tears.
|
| 520 |
|
| 521 |
The silence stretched tauter still, until it felt as though it might snap like a twisted, over-tightened bowstring, sending all their carefully contained emotions flying free in a cathartic explosion of rage and grief. But the moment never came. Instead, the fireplace sighed its final breath and died out with a contented sigh, plunging them back into impenetrable darkness and the relentless, suffocating grip of the silence that engulfed them all.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 519 |
The third figure was a boy, not yet grown into manhood but standing tall and straight-backed nonetheless, his slender frame taut as a bowstring about to snap. His dark curls fell in disarray around his pale, heart-shaped face, framing large, expressive hazel eyes that darted restlessly from one grim visage to the next, brimming with anguish and unshed tears.
|
| 520 |
|
| 521 |
The silence stretched tauter still, until it felt as though it might snap like a twisted, over-tightened bowstring, sending all their carefully contained emotions flying free in a cathartic explosion of rage and grief. But the moment never came. Instead, the fireplace sighed its final breath and died out with a contented sigh, plunging them back into impenetrable darkness and the relentless, suffocating grip of the silence that engulfed them all.
|
| 522 |
+
|
| 523 |
+
|
| 524 |
+
---
|
| 525 |
+
|
| 526 |
+
<h2>Special Thanks:</h2>
|
| 527 |
+
|
| 528 |
+
---
|
| 529 |
+
|
| 530 |
+
Special thanks to all the following, and many more...
|
| 531 |
+
|
| 532 |
+
All the model makers, fine tuners, mergers, and tweakers:
|
| 533 |
+
- Provides the raw "DNA" for almost all my models.
|
| 534 |
+
- Sources of model(s) can be found on the repo pages, especially the "source" repos with link(s) to the model creator(s).
|
| 535 |
+
|
| 536 |
+
Huggingface [ https://huggingface.co ] :
|
| 537 |
+
- The place to store, merge, and tune models endlessly.
|
| 538 |
+
- THE reason we have an open source community.
|
| 539 |
+
|
| 540 |
+
LlamaCPP [ https://github.com/ggml-org/llama.cpp ] :
|
| 541 |
+
- The ability to compress and run models on GPU(s), CPU(s) and almost all devices.
|
| 542 |
+
- Imatrix, Quantization, and other tools to tune the quants and the models.
|
| 543 |
+
- Llama-Server : A cli based direct interface to run GGUF models.
|
| 544 |
+
- The only tool I use to quant models.
|
| 545 |
+
|
| 546 |
+
Quant-Masters: Team Mradermacher, Bartowski, and many others:
|
| 547 |
+
- Quant models day and night for us all to use.
|
| 548 |
+
- They are the lifeblood of open source access.
|
| 549 |
+
|
| 550 |
+
MergeKit [ https://github.com/arcee-ai/mergekit ] :
|
| 551 |
+
- The universal online/offline tool to merge models together and forge something new.
|
| 552 |
+
- Over 20 methods to almost instantly merge model, pull them apart and put them together again.
|
| 553 |
+
- The tool I have used to create over 1500 models.
|
| 554 |
+
|
| 555 |
+
Lmstudio [ https://lmstudio.ai/ ] :
|
| 556 |
+
- The go to tool to test and run models in GGUF format.
|
| 557 |
+
- The Tool I use to test/refine and evaluate new models.
|
| 558 |
+
- LMStudio forum on discord; endless info and community for open source.
|
| 559 |
+
|
| 560 |
+
Text Generation Webui // KolboldCPP // SillyTavern:
|
| 561 |
+
- Excellent tools to run GGUF models with - [ https://github.com/oobabooga/text-generation-webui ] [ https://github.com/LostRuins/koboldcpp ] .
|
| 562 |
+
- Sillytavern [ https://github.com/SillyTavern/SillyTavern ] can be used with LMSTudio [ https://lmstudio.ai/ ] , TextGen [ https://github.com/oobabooga/text-generation-webui ], Kolboldcpp [ https://github.com/LostRuins/koboldcpp ], Llama-Server [part of LLAMAcpp] as a off the scale front end control system and interface to work with models.
|