14 lines
623 B
Markdown
14 lines
623 B
Markdown
# Diffusion Text Generation
|
|
|
|
This directory contains implementations for Diffusion LLMs (DLLMs)
|
|
|
|
More Info:
|
|
- https://github.com/ggml-org/llama.cpp/pull/14644
|
|
- https://github.com/ggml-org/llama.cpp/pull/14771
|
|
|
|
|
|
Example of using Dream architechture: `llama-diffusion-cli -m dream7b.gguf -p "write code to train MNIST in pytorch" -ub 512 --diffusion-eps 0.001 --diffusion-algorithm 3 --diffusion-steps 256 --diffusion-visual`
|
|
|
|
Example of using LLaDA architechture: `llama-diffusion-cli -m llada-8b.gguf -p "write code to train MNIST in pytorch" -ub 512 --diffusion-block-length 32 --diffusion-steps 256 --diffusion-visual`
|
|
|