Sigma5C
Request Beta Access

Local models

Public local-model catalog definitions in the Sigma5C lab, with named tags and recorded model-format details. Catalog presence is separate from model execution or observation results.

Catalog definitions from local model tag indexes. Separate tags and revisions are retained as records; these definitions do not establish model execution or on-disk file validation.

706 catalog definitions. Tags and weight definitions are recorded separately; they are not a count of distinct model architectures or completed observations.

  • CognitiveComputations/dolphin-2.9.2-qwen2-7b

    Tag: CognitiveComputations/dolphin-2.9.2-qwen2-7b:Q2_K

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q2_K
    Format
    gguf

  • CognitiveComputations/dolphin-2.9.2-qwen2-7b

    Tag: CognitiveComputations/dolphin-2.9.2-qwen2-7b:Q3_K_M

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q3_K_M
    Format
    gguf

  • CognitiveComputations/dolphin-2.9.2-qwen2-7b

    Tag: CognitiveComputations/dolphin-2.9.2-qwen2-7b:Q3_K_S

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q3_K_S
    Format
    gguf

  • CognitiveComputations/dolphin-gemma2

    Tag: CognitiveComputations/dolphin-gemma2:2b

    Family
    gemma2
    Parameters
    2.6B
    Quantization
    Q4_0
    Format
    gguf

  • CognitiveComputations/dolphin-llama3.1

    Tag: CognitiveComputations/dolphin-llama3.1:latest

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • CognitiveComputations/dolphin-mistral-nemo

    Tag: CognitiveComputations/dolphin-mistral-nemo:12b

    Family
    llama
    Parameters
    12.2B
    Quantization
    Q4_0
    Format
    gguf

  • HammerAI/mistral-nemo-uncensored

    Tag: HammerAI/mistral-nemo-uncensored:latest

    Family
    llama
    Parameters
    12.2B
    Quantization
    Q4_0
    Format
    gguf

  • LiquidAI/lfm2.5-1.2b-instruct

    Tag: LiquidAI/lfm2.5-1.2b-instruct:latest

    Family
    lfm2
    Parameters
    1.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • LiquidAI/lfm2.5-350m

    Tag: LiquidAI/lfm2.5-350m:latest

    Family
    lfm2
    Parameters
    354.48M
    Quantization
    Q8_0
    Format
    gguf

  • all-minilm

    Tag: all-minilm:22m

    Family
    bert
    Parameters
    23M
    Quantization
    F16
    Format
    gguf

  • all-minilm

    Tag: all-minilm:33m

    Family
    bert
    Parameters
    33M
    Quantization
    F16
    Format
    gguf

  • all-minilm

    Tag: all-minilm:33m-128k

    Family
    bert
    Parameters
    33.21M
    Quantization
    F16
    Format
    gguf

  • all-minilm

    Tag: all-minilm:33m-16k

    Family
    bert
    Parameters
    33.21M
    Quantization
    F16
    Format
    gguf

  • all-minilm

    Tag: all-minilm:33m-32k

    Family
    bert
    Parameters
    33.21M
    Quantization
    F16
    Format
    gguf

  • all-minilm

    Tag: all-minilm:33m-64k

    Family
    bert
    Parameters
    33.21M
    Quantization
    F16
    Format
    gguf

  • all-minilm

    Tag: all-minilm:33m-8k

    Family
    bert
    Parameters
    33.21M
    Quantization
    F16
    Format
    gguf

  • all-minilm

    Tag: all-minilm:latest

    Family
    bert
    Parameters
    23M
    Quantization
    F16
    Format
    gguf

  • all-minilm

    Tag: all-minilm:latest-128k

    Family
    bert
    Parameters
    22.57M
    Quantization
    F16
    Format
    gguf

  • all-minilm

    Tag: all-minilm:latest-16k

    Family
    bert
    Parameters
    22.57M
    Quantization
    F16
    Format
    gguf

  • all-minilm

    Tag: all-minilm:latest-32k

    Family
    bert
    Parameters
    22.57M
    Quantization
    F16
    Format
    gguf

  • all-minilm

    Tag: all-minilm:latest-64k

    Family
    bert
    Parameters
    22.57M
    Quantization
    F16
    Format
    gguf

  • all-minilm

    Tag: all-minilm:latest-8k

    Family
    bert
    Parameters
    22.57M
    Quantization
    F16
    Format
    gguf

  • aya-expanse

    Tag: aya-expanse:latest

    Family
    command-r
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • aya-expanse

    Tag: aya-expanse:latest-128k

    Family
    command-r
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • aya-expanse

    Tag: aya-expanse:latest-16k

    Family
    command-r
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • aya-expanse

    Tag: aya-expanse:latest-32k

    Family
    command-r
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • aya-expanse

    Tag: aya-expanse:latest-64k

    Family
    command-r
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • bakllava

    Tag: bakllava:7b

    Family
    llama
    Parameters
    7B
    Quantization
    Q4_0
    Format
    gguf

  • bakllava

    Tag: bakllava:latest

    Family
    llama
    Parameters
    7B
    Quantization
    Q4_0
    Format
    gguf

  • bakllava

    Tag: bakllava:latest-128k

    Family
    llama
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • bakllava

    Tag: bakllava:latest-16k

    Family
    llama
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • bakllava

    Tag: bakllava:latest-32k

    Family
    llama
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • bakllava

    Tag: bakllava:latest-64k

    Family
    llama
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • bakllava

    Tag: bakllava:latest-8k

    Family
    llama
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • bge-large

    Tag: bge-large:335m

    Family
    bert
    Parameters
    334.09M
    Quantization
    F16
    Format
    gguf

  • bge-large

    Tag: bge-large:latest

    Family
    bert
    Parameters
    334.09M
    Quantization
    F16
    Format
    gguf

  • bge-large

    Tag: bge-large:latest-128k

    Family
    bert
    Parameters
    334.09M
    Quantization
    F16
    Format
    gguf

  • bge-large

    Tag: bge-large:latest-16k

    Family
    bert
    Parameters
    334.09M
    Quantization
    F16
    Format
    gguf

  • bge-large

    Tag: bge-large:latest-32k

    Family
    bert
    Parameters
    334.09M
    Quantization
    F16
    Format
    gguf

  • bge-large

    Tag: bge-large:latest-64k

    Family
    bert
    Parameters
    334.09M
    Quantization
    F16
    Format
    gguf

  • bge-large

    Tag: bge-large:latest-8k

    Family
    bert
    Parameters
    334.09M
    Quantization
    F16
    Format
    gguf

  • bge-m3

    Tag: bge-m3:567m

    Family
    bert
    Parameters
    566.70M
    Quantization
    F16
    Format
    gguf

  • bge-m3

    Tag: bge-m3:latest

    Family
    bert
    Parameters
    566.70M
    Quantization
    F16
    Format
    gguf

  • bge-m3

    Tag: bge-m3:latest-128k

    Family
    bert
    Parameters
    566.70M
    Quantization
    F16
    Format
    gguf

  • bge-m3

    Tag: bge-m3:latest-16k

    Family
    bert
    Parameters
    566.70M
    Quantization
    F16
    Format
    gguf

  • bge-m3

    Tag: bge-m3:latest-32k

    Family
    bert
    Parameters
    566.70M
    Quantization
    F16
    Format
    gguf

  • bge-m3

    Tag: bge-m3:latest-64k

    Family
    bert
    Parameters
    566.70M
    Quantization
    F16
    Format
    gguf

  • bonsai-2

    Tag: bonsai-2:27b

    Family
    qwen35
    Parameters
    26.9B
    Quantization
    Q2_0
    Format
    gguf

  • bonsai-2

    Tag: bonsai-2:2b

    Family
    qwen35
    Parameters
    1.9B
    Quantization
    Q2_0
    Format
    gguf

  • bonsai-2

    Tag: bonsai-2:4b

    Family
    qwen35
    Parameters
    4.2B
    Quantization
    Q2_0
    Format
    gguf

  • bonsai-2

    Tag: bonsai-2:latest

    Family
    qwen35
    Parameters
    9.0B
    Quantization
    Q2_0
    Format
    gguf

  • clef-flash

    Tag: clef-flash:9b

    Family
    clef
    Parameters
    9.1B
    Quantization
    Q8_0
    Format
    gguf

  • clef

    Tag: clef:27b

    Family
    clef
    Parameters
    27.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • clef

    Tag: clef:27b-q4_K_M

    Family
    clef
    Parameters
    27.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • codegemma

    Tag: codegemma:2b

    Family
    gemma
    Parameters
    3B
    Quantization
    Q4_0
    Format
    gguf

  • codegemma

    Tag: codegemma:2b-128k

    Family
    gemma
    Parameters
    2.5B
    Quantization
    Q4_0
    Format
    gguf

  • codegemma

    Tag: codegemma:2b-16k

    Family
    gemma
    Parameters
    2.5B
    Quantization
    Q4_0
    Format
    gguf

  • codegemma

    Tag: codegemma:2b-32k

    Family
    gemma
    Parameters
    2.5B
    Quantization
    Q4_0
    Format
    gguf

  • codegemma

    Tag: codegemma:2b-64k

    Family
    gemma
    Parameters
    2.5B
    Quantization
    Q4_0
    Format
    gguf

  • codegemma

    Tag: codegemma:7b

    Family
    gemma
    Parameters
    9B
    Quantization
    Q4_0
    Format
    gguf

  • codegemma

    Tag: codegemma:7b-128k

    Family
    gemma
    Parameters
    8.5B
    Quantization
    Q4_0
    Format
    gguf

  • codegemma

    Tag: codegemma:7b-16k

    Family
    gemma
    Parameters
    8.5B
    Quantization
    Q4_0
    Format
    gguf

  • codegemma

    Tag: codegemma:7b-32k

    Family
    gemma
    Parameters
    8.5B
    Quantization
    Q4_0
    Format
    gguf

  • codegemma

    Tag: codegemma:7b-64k

    Family
    gemma
    Parameters
    8.5B
    Quantization
    Q4_0
    Format
    gguf

  • codegemma

    Tag: codegemma:latest

    Family
    gemma
    Parameters
    9B
    Quantization
    Q4_0
    Format
    gguf

  • codegemma

    Tag: codegemma:latest-128k

    Family
    gemma
    Parameters
    8.5B
    Quantization
    Q4_0
    Format
    gguf

  • codegemma

    Tag: codegemma:latest-16k

    Family
    gemma
    Parameters
    8.5B
    Quantization
    Q4_0
    Format
    gguf

  • codegemma

    Tag: codegemma:latest-32k

    Family
    gemma
    Parameters
    8.5B
    Quantization
    Q4_0
    Format
    gguf

  • codegemma

    Tag: codegemma:latest-64k

    Family
    gemma
    Parameters
    8.5B
    Quantization
    Q4_0
    Format
    gguf

  • codeqwen

    Tag: codeqwen:latest

    Family
    qwen2
    Parameters
    7.3B
    Quantization
    Q4_0
    Format
    gguf

  • codestral

    Tag: codestral:latest

    Family
    llama
    Parameters
    22.2B
    Quantization
    Q4_0
    Format
    gguf

  • codestral

    Tag: codestral:latest-128k

    Family
    llama
    Parameters
    22.2B
    Quantization
    Q4_0
    Format
    gguf

  • codestral

    Tag: codestral:latest-64k

    Family
    llama
    Parameters
    22.2B
    Quantization
    Q4_0
    Format
    gguf

  • cogito

    Tag: cogito:14b

    Family
    qwen2
    Parameters
    14.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • cogito

    Tag: cogito:32b

    Family
    qwen2
    Parameters
    32.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • cogito

    Tag: cogito:3b

    Family
    llama
    Parameters
    3.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • cogito

    Tag: cogito:8b

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • cogito

    Tag: cogito:latest

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • command-r7b-arabic

    Tag: command-r7b-arabic:latest

    Family
    cohere2
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • command-r7b

    Tag: command-r7b:latest

    Family
    cohere2
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • command-r

    Tag: command-r:latest

    Family
    command-r
    Parameters
    32.3B
    Quantization
    Q4_0
    Format
    gguf

  • d1-omni

    Tag: d1-omni:600m

    Family
    lfm2
    Parameters
    380.73M
    Quantization
    Q8_0
    Format
    gguf

  • d1

    Tag: d1:3b

    Family
    lfm2
    Parameters
    2.7B
    Quantization
    Q8_0
    Format
    gguf

  • d1

    Tag: d1:3b-q8_0

    Family
    lfm2
    Parameters
    2.7B
    Quantization
    Q8_0
    Format
    gguf

  • d3

    Tag: d3:2b

    Family
    qwen35
    Parameters
    2.4B
    Quantization
    Q8_0
    Format
    gguf

  • d3

    Tag: d3:4b

    Family
    qwen35
    Parameters
    4.8B
    Quantization
    Q8_0
    Format
    gguf

  • d3

    Tag: d3:9b

    Family
    qwen35
    Parameters
    9.0B
    Quantization
    Q8_0
    Format
    gguf

  • d3

    Tag: d3:latest

    Family
    qwen35
    Parameters
    4.8B
    Quantization
    Q8_0
    Format
    gguf

  • deepcoder

    Tag: deepcoder:1.5b

    Family
    qwen2
    Parameters
    1.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • deepcoder

    Tag: deepcoder:14b

    Family
    qwen2
    Parameters
    14.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • deepscaler

    Tag: deepscaler:1.5b

    Family
    qwen2
    Parameters
    1.8B
    Quantization
    F16
    Format
    gguf

  • deepscaler

    Tag: deepscaler:latest

    Family
    qwen2
    Parameters
    1.8B
    Quantization
    F16
    Format
    gguf

  • deepseek-coder-v2

    Tag: deepseek-coder-v2:latest

    Family
    deepseek2
    Parameters
    15.7B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-coder

    Tag: deepseek-coder:1.3b

    Family
    llama
    Parameters
    1B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-coder

    Tag: deepseek-coder:1.3b-128k

    Family
    llama
    Parameters
    1.3B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-coder

    Tag: deepseek-coder:1.3b-32k

    Family
    llama
    Parameters
    1.3B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-coder

    Tag: deepseek-coder:1.3b-64k

    Family
    llama
    Parameters
    1.3B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-coder

    Tag: deepseek-coder:33b

    Family
    llama
    Parameters
    33B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-coder

    Tag: deepseek-coder:33b-128k

    Family
    llama
    Parameters
    33.3B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-coder

    Tag: deepseek-coder:33b-32k

    Family
    llama
    Parameters
    33.3B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-coder

    Tag: deepseek-coder:33b-64k

    Family
    llama
    Parameters
    33.3B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-coder

    Tag: deepseek-coder:6.7b

    Family
    llama
    Parameters
    7B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-coder

    Tag: deepseek-coder:6.7b-128k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-coder

    Tag: deepseek-coder:6.7b-32k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-coder

    Tag: deepseek-coder:6.7b-64k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-coder

    Tag: deepseek-coder:latest

    Family
    llama
    Parameters
    1B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-coder

    Tag: deepseek-coder:latest-128k

    Family
    llama
    Parameters
    1.3B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-coder

    Tag: deepseek-coder:latest-32k

    Family
    llama
    Parameters
    1.3B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-coder

    Tag: deepseek-coder:latest-64k

    Family
    llama
    Parameters
    1.3B
    Quantization
    Q4_0
    Format
    gguf

  • deepseek-ocr

    Tag: deepseek-ocr:3b

    Family
    deepseekocr
    Parameters
    3.3B
    Quantization
    F16
    Format
    gguf

  • deepseek-ocr

    Tag: deepseek-ocr:latest

    Family
    deepseekocr
    Parameters
    3.3B
    Quantization
    F16
    Format
    gguf

  • deepseek-r1

    Tag: deepseek-r1:1.5b

    Family
    qwen2
    Parameters
    1.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • deepseek-r1

    Tag: deepseek-r1:7b

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • deepseek-r1

    Tag: deepseek-r1:8b

    Family
    qwen3
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • deepseek-r1

    Tag: deepseek-r1:latest

    Family
    qwen3
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • devstral-small-2

    Tag: devstral-small-2:latest

    Family
    mistral3
    Parameters
    24.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • devstral

    Tag: devstral:24b

    Family
    llama
    Parameters
    23.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • devstral

    Tag: devstral:latest

    Family
    llama
    Parameters
    23.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • dolphin-llama3

    Tag: dolphin-llama3:latest

    Family
    llama
    Parameters
    8B
    Quantization
    Q4_0
    Format
    gguf

  • dolphin-llama3

    Tag: dolphin-llama3:latest-128k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • dolphin-llama3

    Tag: dolphin-llama3:latest-16k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • dolphin-llama3

    Tag: dolphin-llama3:latest-32k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • dolphin-llama3

    Tag: dolphin-llama3:latest-64k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • dolphin-mistral

    Tag: dolphin-mistral:latest

    Family
    llama
    Parameters
    7B
    Quantization
    Q4_0
    Format
    gguf

  • dolphin-mistral

    Tag: dolphin-mistral:latest-128k

    Family
    llama
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • dolphin-mistral

    Tag: dolphin-mistral:latest-64k

    Family
    llama
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • dolphin-mixtral

    Tag: dolphin-mixtral:latest

    Family
    llama
    Parameters
    46.7B
    Quantization
    Q4_0
    Format
    gguf

  • dolphin-phi

    Tag: dolphin-phi:latest

    Family
    phi2
    Parameters
    3B
    Quantization
    Q4_0
    Format
    gguf

  • dolphin3

    Tag: dolphin3:latest

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • embeddinggemma-2

    Tag: embeddinggemma-2:270m

    Family
    gemma-embedding2
    Parameters
    271.00M
    Quantization
    Q8_0
    Format
    gguf

  • embeddinggemma-2

    Tag: embeddinggemma-2:440m

    Family
    gemma-embedding2
    Parameters
    271.00M
    Quantization
    Q8_0
    Format
    gguf

  • embeddinggemma-2

    Tag: embeddinggemma-2:570m

    Family
    gemma-embedding2
    Parameters
    271.00M
    Quantization
    Q8_0
    Format
    gguf

  • embeddinggemma-2

    Tag: embeddinggemma-2:740m-q8_0

    Family
    gemma-embedding2
    Parameters
    271.00M
    Quantization
    Q8_0
    Format
    gguf

  • embeddinggemma-2

    Tag: embeddinggemma-2:latest

    Family
    gemma-embedding2
    Parameters
    271.00M
    Quantization
    Q8_0
    Format
    gguf

  • embeddinggemma

    Tag: embeddinggemma:300m

    Family
    gemma3
    Parameters
    307.58M
    Quantization
    BF16
    Format
    gguf

  • embeddinggemma

    Tag: embeddinggemma:latest

    Family
    gemma3
    Parameters
    307.58M
    Quantization
    BF16
    Format
    gguf

  • exaone-deep

    Tag: exaone-deep:2.4b

    Family
    exaone
    Parameters
    2.7B
    Quantization
    Q4_K_M
    Format
    gguf

  • exaone-deep

    Tag: exaone-deep:32b

    Family
    exaone
    Parameters
    32.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • exaone-deep

    Tag: exaone-deep:7.8b

    Family
    exaone
    Parameters
    7.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • exaone-deep

    Tag: exaone-deep:latest

    Family
    exaone
    Parameters
    7.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • exaone3.5

    Tag: exaone3.5:2.4b

    Family
    exaone
    Parameters
    2.7B
    Quantization
    Q4_K_M
    Format
    gguf

  • exaone3.5

    Tag: exaone3.5:2.4b-128k

    Family
    exaone
    Parameters
    2.7B
    Quantization
    Q4_K_M
    Format
    gguf

  • exaone3.5

    Tag: exaone3.5:2.4b-64k

    Family
    exaone
    Parameters
    2.7B
    Quantization
    Q4_K_M
    Format
    gguf

  • exaone3.5

    Tag: exaone3.5:latest

    Family
    exaone
    Parameters
    7.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • exaone3.5

    Tag: exaone3.5:latest-128k

    Family
    exaone
    Parameters
    7.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • exaone3.5

    Tag: exaone3.5:latest-64k

    Family
    exaone
    Parameters
    7.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • falcon3

    Tag: falcon3:10b

    Family
    llama
    Parameters
    10.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • falcon3

    Tag: falcon3:10b-128k

    Family
    llama
    Parameters
    10.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • falcon3

    Tag: falcon3:10b-64k

    Family
    llama
    Parameters
    10.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • falcon3

    Tag: falcon3:1b

    Family
    llama
    Parameters
    1.7B
    Quantization
    Q8_0
    Format
    gguf

  • falcon3

    Tag: falcon3:1b-128k

    Family
    llama
    Parameters
    1.7B
    Quantization
    Q8_0
    Format
    gguf

  • falcon3

    Tag: falcon3:1b-16k

    Family
    llama
    Parameters
    1.7B
    Quantization
    Q8_0
    Format
    gguf

  • falcon3

    Tag: falcon3:1b-32k

    Family
    llama
    Parameters
    1.7B
    Quantization
    Q8_0
    Format
    gguf

  • falcon3

    Tag: falcon3:1b-64k

    Family
    llama
    Parameters
    1.7B
    Quantization
    Q8_0
    Format
    gguf

  • falcon3

    Tag: falcon3:3b

    Family
    llama
    Parameters
    3.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • falcon3

    Tag: falcon3:3b-128k

    Family
    llama
    Parameters
    3.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • falcon3

    Tag: falcon3:3b-64k

    Family
    llama
    Parameters
    3.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • falcon3

    Tag: falcon3:7b

    Family
    llama
    Parameters
    7.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • falcon3

    Tag: falcon3:7b-128k

    Family
    llama
    Parameters
    7.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • falcon3

    Tag: falcon3:7b-64k

    Family
    llama
    Parameters
    7.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • falcon3

    Tag: falcon3:latest

    Family
    llama
    Parameters
    7.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • flint

    Tag: flint:latest

    Family
    flint
    Parameters
    39.8B
    Quantization
    NVFP4
    Format
    gguf

  • functiongemma

    Tag: functiongemma:270m

    Family
    gemma3
    Parameters
    268.10M
    Quantization
    Q8_0
    Format
    gguf

  • functiongemma

    Tag: functiongemma:latest

    Family
    gemma3
    Parameters
    268.10M
    Quantization
    Q8_0
    Format
    gguf

  • gemma2

    Tag: gemma2:27b

    Family
    gemma2
    Parameters
    27.2B
    Quantization
    Q4_0
    Format
    gguf

  • gemma2

    Tag: gemma2:2b

    Family
    gemma2
    Parameters
    2.6B
    Quantization
    Q4_0
    Format
    gguf

  • gemma2

    Tag: gemma2:2b-128k

    Family
    gemma2
    Parameters
    2.6B
    Quantization
    Q4_0
    Format
    gguf

  • gemma2

    Tag: gemma2:2b-16k

    Family
    gemma2
    Parameters
    2.6B
    Quantization
    Q4_0
    Format
    gguf

  • gemma2

    Tag: gemma2:2b-32k

    Family
    gemma2
    Parameters
    2.6B
    Quantization
    Q4_0
    Format
    gguf

  • gemma2

    Tag: gemma2:2b-64k

    Family
    gemma2
    Parameters
    2.6B
    Quantization
    Q4_0
    Format
    gguf

  • gemma2

    Tag: gemma2:9b

    Family
    gemma2
    Parameters
    9.2B
    Quantization
    Q4_0
    Format
    gguf

  • gemma2

    Tag: gemma2:latest

    Family
    gemma2
    Parameters
    9.2B
    Quantization
    Q4_0
    Format
    gguf

  • gemma2

    Tag: gemma2:latest-128k

    Family
    gemma2
    Parameters
    9.2B
    Quantization
    Q4_0
    Format
    gguf

  • gemma2

    Tag: gemma2:latest-16k

    Family
    gemma2
    Parameters
    9.2B
    Quantization
    Q4_0
    Format
    gguf

  • gemma2

    Tag: gemma2:latest-32k

    Family
    gemma2
    Parameters
    9.2B
    Quantization
    Q4_0
    Format
    gguf

  • gemma2

    Tag: gemma2:latest-64k

    Family
    gemma2
    Parameters
    9.2B
    Quantization
    Q4_0
    Format
    gguf

  • gemma3

    Tag: gemma3:12b

    Family
    gemma3
    Parameters
    12.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • gemma3

    Tag: gemma3:1b

    Family
    gemma3
    Parameters
    999.89M
    Quantization
    Q4_K_M
    Format
    gguf

  • gemma3

    Tag: gemma3:270m

    Family
    gemma3
    Parameters
    268.10M
    Quantization
    Q8_0
    Format
    gguf

  • gemma3

    Tag: gemma3:27b

    Family
    gemma3
    Parameters
    27.4B
    Quantization
    Q4_K_M
    Format
    gguf

  • gemma3

    Tag: gemma3:4b

    Family
    gemma3
    Parameters
    4.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • gemma3

    Tag: gemma3:latest

    Family
    gemma3
    Parameters
    4.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • gemma3n

    Tag: gemma3n:e2b

    Family
    gemma3n
    Parameters
    4.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • gemma3n

    Tag: gemma3n:e4b

    Family
    gemma3n
    Parameters
    6.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • gemma3n

    Tag: gemma3n:latest

    Family
    gemma3n
    Parameters
    6.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • gemma4

    Tag: gemma4:12b

    Family
    gemma4
    Parameters
    11.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • gemma4

    Tag: gemma4:26b

    Family
    gemma4
    Parameters
    25.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • gemma4

    Tag: gemma4:31b

    Family
    gemma4
    Parameters
    30.7B
    Quantization
    Q4_K_M
    Format
    gguf

  • gemma4

    Tag: gemma4:e2b

    Family
    gemma4
    Parameters
    5.1B
    Quantization
    Q4_K_M
    Format
    gguf

  • gemma4

    Tag: gemma4:e2b

    Family
    gemma4
    Parameters
    4.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • gemma4

    Tag: gemma4:e4b

    Family
    gemma4
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • gemma4

    Tag: gemma4:latest

    Family
    gemma4
    Parameters
    7.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • gemma

    Tag: gemma:2b

    Family
    gemma
    Parameters
    3B
    Quantization
    Q4_0
    Format
    gguf

  • gemma

    Tag: gemma:2b-128k

    Family
    gemma
    Parameters
    2.5B
    Quantization
    Q4_0
    Format
    gguf

  • gemma

    Tag: gemma:2b-16k

    Family
    gemma
    Parameters
    2.5B
    Quantization
    Q4_0
    Format
    gguf

  • gemma

    Tag: gemma:2b-32k

    Family
    gemma
    Parameters
    2.5B
    Quantization
    Q4_0
    Format
    gguf

  • gemma

    Tag: gemma:2b-64k

    Family
    gemma
    Parameters
    2.5B
    Quantization
    Q4_0
    Format
    gguf

  • gemma

    Tag: gemma:7b

    Family
    gemma
    Parameters
    9B
    Quantization
    Q4_0
    Format
    gguf

  • gemma

    Tag: gemma:7b-128k

    Family
    gemma
    Parameters
    8.5B
    Quantization
    Q4_0
    Format
    gguf

  • gemma

    Tag: gemma:7b-16k

    Family
    gemma
    Parameters
    8.5B
    Quantization
    Q4_0
    Format
    gguf

  • gemma

    Tag: gemma:7b-32k

    Family
    gemma
    Parameters
    8.5B
    Quantization
    Q4_0
    Format
    gguf

  • gemma

    Tag: gemma:7b-64k

    Family
    gemma
    Parameters
    8.5B
    Quantization
    Q4_0
    Format
    gguf

  • gemma

    Tag: gemma:latest

    Family
    gemma
    Parameters
    9B
    Quantization
    Q4_0
    Format
    gguf

  • glm-ocr

    Tag: glm-ocr:bf16

    Family
    glm4
    Parameters
    891.14M
    Quantization
    F16
    Format
    gguf

  • glm-ocr

    Tag: glm-ocr:latest

    Family
    glmocr
    Parameters
    1.1B
    Quantization
    F16
    Format
    gguf

  • glm-ocr

    Tag: glm-ocr:latest

    Family
    glm4
    Parameters
    891.14M
    Quantization
    F16
    Format
    gguf

  • glm-ocr

    Tag: glm-ocr:q8_0

    Family
    glmocr
    Parameters
    1.1B
    Quantization
    Q8_0
    Format
    gguf

  • glm-ocr

    Tag: glm-ocr:q8_0

    Family
    glm4
    Parameters
    891.14M
    Quantization
    Q8_0
    Format
    gguf

  • gpt-oss-safeguard

    Tag: gpt-oss-safeguard:20b

    Family
    gptoss
    Parameters
    20.9B
    Quantization
    MXFP4
    Format
    gguf

  • gpt-oss

    Tag: gpt-oss:20b

    Family
    gptoss
    Parameters
    20.9B
    Quantization
    MXFP4
    Format
    gguf

  • gpt-oss

    Tag: gpt-oss:20b

    Family
    gpt-oss
    Parameters
    20.9B
    Quantization
    MXFP4
    Format
    gguf

  • granite-code

    Tag: granite-code:latest

    Family
    llama
    Parameters
    3.5B
    Quantization
    Q4_0
    Format
    gguf

  • granite-embedding

    Tag: granite-embedding:278m

    Family
    bert
    Parameters
    277.45M
    Quantization
    F16
    Format
    gguf

  • granite-embedding

    Tag: granite-embedding:30m

    Family
    bert
    Parameters
    30.15M
    Quantization
    F16
    Format
    gguf

  • granite-embedding

    Tag: granite-embedding:latest

    Family
    bert
    Parameters
    30.15M
    Quantization
    F16
    Format
    gguf

  • granite3-dense

    Tag: granite3-dense:8b

    Family
    granite
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-dense

    Tag: granite3-dense:8b-128k

    Family
    granite
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-dense

    Tag: granite3-dense:8b-16k

    Family
    granite
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-dense

    Tag: granite3-dense:8b-32k

    Family
    granite
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-dense

    Tag: granite3-dense:8b-64k

    Family
    granite
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-dense

    Tag: granite3-dense:8b-8k

    Family
    granite
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-dense

    Tag: granite3-dense:latest

    Family
    granite
    Parameters
    2.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-dense

    Tag: granite3-dense:latest-128k

    Family
    granite
    Parameters
    2.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-dense

    Tag: granite3-dense:latest-16k

    Family
    granite
    Parameters
    2.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-dense

    Tag: granite3-dense:latest-32k

    Family
    granite
    Parameters
    2.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-dense

    Tag: granite3-dense:latest-64k

    Family
    granite
    Parameters
    2.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-dense

    Tag: granite3-dense:latest-8k

    Family
    granite
    Parameters
    2.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-moe

    Tag: granite3-moe:3b

    Family
    granitemoe
    Parameters
    3.4B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-moe

    Tag: granite3-moe:3b-128k

    Family
    granitemoe
    Parameters
    3.4B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-moe

    Tag: granite3-moe:3b-16k

    Family
    granitemoe
    Parameters
    3.4B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-moe

    Tag: granite3-moe:3b-32k

    Family
    granitemoe
    Parameters
    3.4B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-moe

    Tag: granite3-moe:3b-64k

    Family
    granitemoe
    Parameters
    3.4B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-moe

    Tag: granite3-moe:3b-8k

    Family
    granitemoe
    Parameters
    3.4B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-moe

    Tag: granite3-moe:latest

    Family
    granitemoe
    Parameters
    1.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-moe

    Tag: granite3-moe:latest-128k

    Family
    granitemoe
    Parameters
    1.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-moe

    Tag: granite3-moe:latest-16k

    Family
    granitemoe
    Parameters
    1.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-moe

    Tag: granite3-moe:latest-32k

    Family
    granitemoe
    Parameters
    1.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-moe

    Tag: granite3-moe:latest-64k

    Family
    granitemoe
    Parameters
    1.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3-moe

    Tag: granite3-moe:latest-8k

    Family
    granitemoe
    Parameters
    1.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3.1-dense

    Tag: granite3.1-dense:2b

    Family
    granite
    Parameters
    2.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3.1-dense

    Tag: granite3.1-dense:2b

    Family
    granite
    Parameters
    2.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3.1-dense

    Tag: granite3.1-dense:latest

    Family
    granite
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3.1-dense

    Tag: granite3.1-dense:latest

    Family
    granite
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3.1-moe

    Tag: granite3.1-moe:1b

    Family
    granitemoe
    Parameters
    1.3B
    Quantization
    Q8_0
    Format
    gguf

  • granite3.1-moe

    Tag: granite3.1-moe:3b

    Family
    granitemoe
    Parameters
    3.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3.1-moe

    Tag: granite3.1-moe:latest

    Family
    granitemoe
    Parameters
    3.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3.1-moe

    Tag: granite3.1-moe:latest

    Family
    granitemoe
    Parameters
    3.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3.2-vision

    Tag: granite3.2-vision:2b

    Family
    granite
    Parameters
    2.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3.2-vision

    Tag: granite3.2-vision:latest

    Family
    granite
    Parameters
    2.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3.2

    Tag: granite3.2:2b

    Family
    granite
    Parameters
    2.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3.2

    Tag: granite3.2:latest

    Family
    granite
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3.3

    Tag: granite3.3:2b

    Family
    granite
    Parameters
    2.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3.3

    Tag: granite3.3:8b

    Family
    granite
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite3.3

    Tag: granite3.3:latest

    Family
    granite
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4.1-guardian

    Tag: granite4.1-guardian:8b

    Family
    granite
    Parameters
    8.4B
    Quantization
    Q6_K
    Format
    gguf

  • granite4.1

    Tag: granite4.1:30b

    Family
    granite
    Parameters
    28.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4.1

    Tag: granite4.1:3b

    Family
    granite
    Parameters
    3.4B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4.1

    Tag: granite4.1:8b

    Family
    granite
    Parameters
    8.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4.2

    Tag: granite4.2:30b

    Family
    granite
    Parameters
    29.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4.2

    Tag: granite4.2:30b

    Family
    granite
    Parameters
    29.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4.2

    Tag: granite4.2:3b

    Family
    granite
    Parameters
    3.7B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4.2

    Tag: granite4.2:3b

    Family
    granite
    Parameters
    3.7B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4.2

    Tag: granite4.2:8b

    Family
    granite
    Parameters
    8.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4.2

    Tag: granite4.2:8b

    Family
    granite
    Parameters
    8.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4.2

    Tag: granite4.2:latest

    Family
    granite
    Parameters
    8.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4.2

    Tag: granite4.2:latest

    Family
    granite
    Parameters
    8.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4

    Tag: granite4:1b

    Family
    granite
    Parameters
    1.6B
    Quantization
    BF16
    Format
    gguf

  • granite4

    Tag: granite4:350m

    Family
    granite
    Parameters
    352.38M
    Quantization
    BF16
    Format
    gguf

  • granite4

    Tag: granite4:3b

    Family
    granite
    Parameters
    3.4B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4

    Tag: granite4:latest

    Family
    granite
    Parameters
    3.4B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4

    Tag: granite4:micro

    Family
    granite
    Parameters
    3.4B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4

    Tag: granite4:micro-h

    Family
    granitehybrid
    Parameters
    3.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4

    Tag: granite4:small-h

    Family
    granitehybrid
    Parameters
    32.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • granite4

    Tag: granite4:tiny-h

    Family
    granitehybrid
    Parameters
    6.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • hermes3

    Tag: hermes3:3b

    Family
    llama
    Parameters
    3.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • hermes3

    Tag: hermes3:3b

    Family
    llama
    Parameters
    3.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • hermes3

    Tag: hermes3:8b

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • hf.co/arcee-ai/Trinity-Mini-GGUF

    Tag: hf.co/arcee-ai/Trinity-Mini-GGUF:Q4_K_M

    Family
    afmoe
    Parameters
    26.1B
    Quantization
    Q4_K_M
    Format
    gguf

  • hf.co/arcee-ai/Trinity-Nano-Preview-GGUF

    Tag: hf.co/arcee-ai/Trinity-Nano-Preview-GGUF:Q4_K_M

    Family
    afmoe
    Parameters
    6.12B
    Quantization
    Q4_K_M
    Format
    gguf

  • huihui_ai/dolphin3-abliterated

    Tag: huihui_ai/dolphin3-abliterated:8b

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • huihui_ai/dolphin3-abliterated

    Tag: huihui_ai/dolphin3-abliterated:latest

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • impactframes/dolphin_llama3_omost

    Tag: impactframes/dolphin_llama3_omost:latest

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • internlm2

    Tag: internlm2:1.8b

    Family
    internlm2
    Parameters
    1.9B
    Quantization
    Q4_0
    Format
    gguf

  • internlm2

    Tag: internlm2:1m

    Family
    internlm2
    Parameters
    7.7B
    Quantization
    Q4_0
    Format
    gguf

  • jewelzufo/LFM2.5-350M-GGUF

    Tag: jewelzufo/LFM2.5-350M-GGUF:latest

    Family
    lfm2
    Parameters
    421.59M
    Quantization
    Q4_K_M
    Format
    gguf

  • jpmarindiaz/lfm2.5-vl-450m

    Tag: jpmarindiaz/lfm2.5-vl-450m:latest

    Family
    lfm2
    Parameters
    354.48M
    Quantization
    Q4_0
    Format
    gguf

  • kev

    Tag: kev:0.8b-bf16

    Family
    qwen35
    Parameters
    752.92M
    Quantization
    BF16
    Format
    gguf

  • kev

    Tag: kev:0.8b-q8_0

    Family
    qwen35
    Parameters
    752.92M
    Quantization
    Q8_0
    Format
    gguf

  • kev

    Tag: kev:4b-bf16

    Family
    qwen35
    Parameters
    4.2B
    Quantization
    BF16
    Format
    gguf

  • kev

    Tag: kev:4b-q4_K_M

    Family
    qwen35
    Parameters
    4.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • kev

    Tag: kev:4b-q8_0

    Family
    qwen35
    Parameters
    4.2B
    Quantization
    Q8_0
    Format
    gguf

  • kev

    Tag: kev:9b-bf16

    Family
    qwen35
    Parameters
    9.0B
    Quantization
    BF16
    Format
    gguf

  • kev

    Tag: kev:9b-q4_K_M

    Family
    qwen35
    Parameters
    9.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • kev

    Tag: kev:9b-q8_0

    Family
    qwen35
    Parameters
    9.0B
    Quantization
    Q8_0
    Format
    gguf

  • kev

    Tag: kev:latest

    Family
    qwen35
    Parameters
    9.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • laguna-xs-2.1

    Tag: laguna-xs-2.1:latest

    Family
    laguna
    Parameters
    33.4B
    Quantization
    Q4_K_M
    Format
    gguf

  • laguna-xs-2.1

    Tag: laguna-xs-2.1:q4_K_M

    Family
    laguna
    Parameters
    33.4B
    Quantization
    Q4_K_M
    Format
    gguf

  • laguna-xs.2

    Tag: laguna-xs.2:latest

    Family
    laguna
    Parameters
    33.4B
    Quantization
    Q4_K_M
    Format
    gguf

  • laya

    Tag: laya:322m-multilingual-bf16

    Family
    modern-bert
    Parameters
    321.71M
    Quantization
    BF16
    Format
    gguf

  • laya

    Tag: laya:421m-english-bf16

    Family
    modern-bert
    Parameters
    421.03M
    Quantization
    BF16
    Format
    gguf

  • laya

    Tag: laya:421m-typed-decisions-bf16

    Family
    modern-bert
    Parameters
    421.03M
    Quantization
    BF16
    Format
    gguf

  • laya

    Tag: laya:latest

    Family
    modern-bert
    Parameters
    421.03M
    Quantization
    BF16
    Format
    gguf

  • lfm2.5-thinking

    Tag: lfm2.5-thinking:1.2b

    Family
    lfm2
    Parameters
    1.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • lfm2.5-thinking

    Tag: lfm2.5-thinking:latest

    Family
    lfm2
    Parameters
    1.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • lfm2.5

    Tag: lfm2.5:24b

    Family
    lfm2moe
    Parameters
    24.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • lfm2.5

    Tag: lfm2.5:8b

    Family
    lfm2moe
    Parameters
    8.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • lfm2.5

    Tag: lfm2.5:latest

    Family
    lfm2moe
    Parameters
    8.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • llama-pro

    Tag: llama-pro:latest

    Family
    llama
    Parameters
    8B
    Quantization
    Q4_0
    Format
    gguf

  • llama-pro

    Tag: llama-pro:latest-128k

    Family
    llama
    Parameters
    8.4B
    Quantization
    Q4_0
    Format
    gguf

  • llama-pro

    Tag: llama-pro:latest-16k

    Family
    llama
    Parameters
    8.4B
    Quantization
    Q4_0
    Format
    gguf

  • llama-pro

    Tag: llama-pro:latest-32k

    Family
    llama
    Parameters
    8.4B
    Quantization
    Q4_0
    Format
    gguf

  • llama-pro

    Tag: llama-pro:latest-64k

    Family
    llama
    Parameters
    8.4B
    Quantization
    Q4_0
    Format
    gguf

  • llama-pro

    Tag: llama-pro:latest-8k

    Family
    llama
    Parameters
    8.4B
    Quantization
    Q4_0
    Format
    gguf

  • llama2-uncensored

    Tag: llama2-uncensored:latest

    Family
    llama
    Parameters
    7B
    Quantization
    Q4_0
    Format
    gguf

  • llama2-uncensored

    Tag: llama2-uncensored:latest-128k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • llama2-uncensored

    Tag: llama2-uncensored:latest-16k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • llama2-uncensored

    Tag: llama2-uncensored:latest-32k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • llama2-uncensored

    Tag: llama2-uncensored:latest-64k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • llama2-uncensored

    Tag: llama2-uncensored:latest-8k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • llama2

    Tag: llama2:latest

    Family
    llama
    Parameters
    7B
    Quantization
    Q4_0
    Format
    gguf

  • llama2

    Tag: llama2:latest-128k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • llama2

    Tag: llama2:latest-16k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • llama2

    Tag: llama2:latest-32k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • llama2

    Tag: llama2:latest-64k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • llama2

    Tag: llama2:latest-8k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • llama3-chatqa

    Tag: llama3-chatqa:latest

    Family
    llama
    Parameters
    8B
    Quantization
    Q4_0
    Format
    gguf

  • llama3-chatqa

    Tag: llama3-chatqa:latest-128k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • llama3-chatqa

    Tag: llama3-chatqa:latest-16k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • llama3-chatqa

    Tag: llama3-chatqa:latest-32k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • llama3-chatqa

    Tag: llama3-chatqa:latest-64k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • llama3-gradient

    Tag: llama3-gradient:latest

    Family
    llama
    Parameters
    8B
    Quantization
    Q4_0
    Format
    gguf

  • llama3-groq-tool-use

    Tag: llama3-groq-tool-use:latest

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • llama3-groq-tool-use

    Tag: llama3-groq-tool-use:latest-128k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • llama3-groq-tool-use

    Tag: llama3-groq-tool-use:latest-16k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • llama3-groq-tool-use

    Tag: llama3-groq-tool-use:latest-32k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • llama3-groq-tool-use

    Tag: llama3-groq-tool-use:latest-64k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • llama3.1

    Tag: llama3.1:latest

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • llama3.2-vision

    Tag: llama3.2-vision:11b

    Family
    mllama
    Parameters
    10.7B
    Quantization
    Q4_K_M
    Format
    gguf

  • llama3.2-vision

    Tag: llama3.2-vision:latest

    Family
    mllama
    Parameters
    9.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • llama3.2

    Tag: llama3.2:1b

    Family
    llama
    Parameters
    1.2B
    Quantization
    Q8_0
    Format
    gguf

  • llama3.2

    Tag: llama3.2:3b

    Family
    llama
    Parameters
    3.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • llama3.2

    Tag: llama3.2:latest

    Family
    llama
    Parameters
    3.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • llama3

    Tag: llama3:latest

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • llama3

    Tag: llama3:latest-128k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • llama3

    Tag: llama3:latest-16k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • llama3

    Tag: llama3:latest-32k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • llama3

    Tag: llama3:latest-64k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_0
    Format
    gguf

  • llava-llama3

    Tag: llava-llama3:latest

    Family
    llama
    Parameters
    8B
    Quantization
    Q4_K_M
    Format
    gguf

  • llava-llama3

    Tag: llava-llama3:latest-128k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • llava-llama3

    Tag: llava-llama3:latest-16k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • llava-llama3

    Tag: llava-llama3:latest-32k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • llava-llama3

    Tag: llava-llama3:latest-64k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • llava-llama3

    Tag: llava-llama3:latest-8k

    Family
    llama
    Parameters
    8.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • llava-phi3

    Tag: llava-phi3:3.8b

    Family
    llama
    Parameters
    4B
    Quantization
    Q4_K_M
    Format
    gguf

  • llava-phi3

    Tag: llava-phi3:latest

    Family
    llama
    Parameters
    4B
    Quantization
    Q4_K_M
    Format
    gguf

  • llava-phi3

    Tag: llava-phi3:latest-128k

    Family
    llama
    Parameters
    3.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • llava-phi3

    Tag: llava-phi3:latest-16k

    Family
    llama
    Parameters
    3.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • llava-phi3

    Tag: llava-phi3:latest-32k

    Family
    llama
    Parameters
    3.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • llava-phi3

    Tag: llava-phi3:latest-64k

    Family
    llama
    Parameters
    3.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • llava-phi3

    Tag: llava-phi3:latest-8k

    Family
    llama
    Parameters
    3.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • llava

    Tag: llava:13b

    Family
    llama
    Parameters
    13B
    Quantization
    Q4_0
    Format
    gguf

  • llava

    Tag: llava:13b-128k

    Family
    llama
    Parameters
    13.0B
    Quantization
    Q4_0
    Format
    gguf

  • llava

    Tag: llava:13b-16k

    Family
    llama
    Parameters
    13.0B
    Quantization
    Q4_0
    Format
    gguf

  • llava

    Tag: llava:13b-32k

    Family
    llama
    Parameters
    13.0B
    Quantization
    Q4_0
    Format
    gguf

  • llava

    Tag: llava:13b-64k

    Family
    llama
    Parameters
    13.0B
    Quantization
    Q4_0
    Format
    gguf

  • llava

    Tag: llava:13b-8k

    Family
    llama
    Parameters
    13.0B
    Quantization
    Q4_0
    Format
    gguf

  • llava

    Tag: llava:latest

    Family
    llama
    Parameters
    7B
    Quantization
    Q4_0
    Format
    gguf

  • llava

    Tag: llava:latest-128k

    Family
    llama
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • llava

    Tag: llava:latest-64k

    Family
    llama
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • magistral

    Tag: magistral:24b

    Family
    llama
    Parameters
    23.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • medgemma1.5

    Tag: medgemma1.5:latest

    Family
    gemma3
    Parameters
    4.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • minicpm-v4.5

    Tag: minicpm-v4.5:8b

    Family
    qwen3
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • minicpm-v4.5

    Tag: minicpm-v4.5:latest

    Family
    qwen3
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • minicpm-v4.6

    Tag: minicpm-v4.6:1b

    Family
    qwen35
    Parameters
    752.16M
    Quantization
    Q4_K_M
    Format
    gguf

  • minicpm-v4.6

    Tag: minicpm-v4.6:latest

    Family
    qwen35
    Parameters
    752.16M
    Quantization
    Q4_K_M
    Format
    gguf

  • minicpm-v

    Tag: minicpm-v:8b

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_0
    Format
    gguf

  • minicpm-v

    Tag: minicpm-v:latest

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_0
    Format
    gguf

  • minicpm-v

    Tag: minicpm-v:latest-128k

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_0
    Format
    gguf

  • minicpm-v

    Tag: minicpm-v:latest-64k

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_0
    Format
    gguf

  • ministral-3

    Tag: ministral-3:14b

    Family
    mistral3
    Parameters
    13.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • ministral-3

    Tag: ministral-3:14b

    Family
    mistral3
    Parameters
    13.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • ministral-3

    Tag: ministral-3:3b

    Family
    mistral3
    Parameters
    3.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • ministral-3

    Tag: ministral-3:3b

    Family
    mistral3
    Parameters
    3.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • ministral-3

    Tag: ministral-3:8b

    Family
    mistral3
    Parameters
    8.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • ministral-3

    Tag: ministral-3:latest

    Family
    mistral3
    Parameters
    8.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • mistral-nemo

    Tag: mistral-nemo:latest

    Family
    llama
    Parameters
    12.2B
    Quantization
    Q4_0
    Format
    gguf

  • mistral-small3.2

    Tag: mistral-small3.2:24b

    Family
    mistral3
    Parameters
    24.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • mistral-small3.2

    Tag: mistral-small3.2:latest

    Family
    mistral3
    Parameters
    24.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • mistral-small

    Tag: mistral-small:latest

    Family
    llama
    Parameters
    22.2B
    Quantization
    Q4_0
    Format
    gguf

  • mistral

    Tag: mistral:latest

    Family
    llama
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • mistral

    Tag: mistral:latest-128k

    Family
    llama
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • mistral

    Tag: mistral:latest-64k

    Family
    llama
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • moondream

    Tag: moondream:1.8b

    Family
    phi2
    Parameters
    1B
    Quantization
    Q4_0
    Format
    gguf

  • moondream

    Tag: moondream:latest

    Family
    phi2
    Parameters
    1B
    Quantization
    Q4_0
    Format
    gguf

  • moondream

    Tag: moondream:latest-128k

    Family
    phi2
    Parameters
    1.4B
    Quantization
    Q4_0
    Format
    gguf

  • moondream

    Tag: moondream:latest-16k

    Family
    phi2
    Parameters
    1.4B
    Quantization
    Q4_0
    Format
    gguf

  • moondream

    Tag: moondream:latest-32k

    Family
    phi2
    Parameters
    1.4B
    Quantization
    Q4_0
    Format
    gguf

  • moondream

    Tag: moondream:latest-64k

    Family
    phi2
    Parameters
    1.4B
    Quantization
    Q4_0
    Format
    gguf

  • moondream

    Tag: moondream:latest-8k

    Family
    phi2
    Parameters
    1.4B
    Quantization
    Q4_0
    Format
    gguf

  • muse-glimmer

    Tag: muse-glimmer:30b

    Family
    muse-glimmer
    Parameters
    27.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • muse-glimmer

    Tag: muse-glimmer:latest

    Family
    muse-glimmer
    Parameters
    27.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • mxbai-embed-large

    Tag: mxbai-embed-large:latest

    Family
    bert
    Parameters
    334M
    Quantization
    F16
    Format
    gguf

  • nemotron-3-nano

    Tag: nemotron-3-nano:30b

    Family
    nemotron_h_moe
    Parameters
    31.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • nemotron-3-nano

    Tag: nemotron-3-nano:4b

    Family
    nemotron_h
    Parameters
    4.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • nemotron-3-nano

    Tag: nemotron-3-nano:latest

    Family
    nemotron_h_moe
    Parameters
    31.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • nemotron-3.5-bolt

    Tag: nemotron-3.5-bolt:e4b

    Family
    gemma4
    Parameters
    7.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • nemotron-3.5-bolt

    Tag: nemotron-3.5-bolt:latest

    Family
    nemotron_h_moe
    Parameters
    74.0B
    Quantization
    IQ2_XXS
    Format
    gguf

  • nemotron-3.5-lightning

    Tag: nemotron-3.5-lightning:30b

    Family
    nemotron_h_moe
    Parameters
    32.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • nemotron-3.5-lightning

    Tag: nemotron-3.5-lightning:30b-a3b-q4_K_M

    Family
    nemotron_h_moe
    Parameters
    32.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • nemotron-mini

    Tag: nemotron-mini:latest

    Family
    nemotron
    Parameters
    4.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • nemotron-mini

    Tag: nemotron-mini:latest-128k

    Family
    nemotron
    Parameters
    4.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • nemotron-mini

    Tag: nemotron-mini:latest-16k

    Family
    nemotron
    Parameters
    4.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • nemotron-mini

    Tag: nemotron-mini:latest-32k

    Family
    nemotron
    Parameters
    4.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • nemotron-mini

    Tag: nemotron-mini:latest-64k

    Family
    nemotron
    Parameters
    4.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • nemotron-mini

    Tag: nemotron-mini:latest-8k

    Family
    nemotron
    Parameters
    4.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • nemotron3

    Tag: nemotron3:33b

    Family
    nemotron_h_omni
    Parameters
    33.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • nimble-v3

    Tag: nimble-v3:9b

    Family
    qwen35
    Parameters
    9.0B
    Quantization
    Q8_0
    Format
    gguf

  • nimble

    Tag: nimble:9b

    Family
    qwen35
    Parameters
    9.0B
    Quantization
    Q8_0
    Format
    gguf

  • nimble

    Tag: nimble:latest

    Family
    qwen35
    Parameters
    9.0B
    Quantization
    Q8_0
    Format
    gguf

  • nomic-embed-text-v2-moe

    Tag: nomic-embed-text-v2-moe:latest

    Family
    nomic-bert-moe
    Parameters
    475.29M
    Quantization
    F16
    Format
    gguf

  • nomic-embed-text

    Tag: nomic-embed-text:137m-v1.5-fp16

    Family
    nomic-bert
    Parameters
    137M
    Quantization
    F16
    Format
    gguf

  • nomic-embed-text

    Tag: nomic-embed-text:latest

    Family
    nomic-bert
    Parameters
    137M
    Quantization
    F16
    Format
    gguf

  • nomic-embed-text

    Tag: nomic-embed-text:v1.5

    Family
    nomic-bert
    Parameters
    137M
    Quantization
    F16
    Format
    gguf

  • north-mini-code-1.0

    Tag: north-mini-code-1.0:latest

    Family
    cohere2moe
    Parameters
    30.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • north-mini-code-1.0

    Tag: north-mini-code-1.0:q4_K_M

    Family
    cohere2moe
    Parameters
    30.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • north-mini-code-1.0

    Tag: north-mini-code-1.0:q8_0

    Family
    cohere2moe
    Parameters
    30.5B
    Quantization
    Q8_0
    Format
    gguf

  • nuextract

    Tag: nuextract:latest

    Family
    phi3
    Parameters
    3.8B
    Quantization
    Q4_0
    Format
    gguf

  • oamazonasgabriel/lfm2-1.2b-tool

    Tag: oamazonasgabriel/lfm2-1.2b-tool:f16-8gbGPU

    Family
    lfm2
    Parameters
    1.2B
    Quantization
    F16
    Format
    gguf

  • oamazonasgabriel/lfm2.5-2.6b

    Tag: oamazonasgabriel/lfm2.5-2.6b:q4_k_m-8gbGPU

    Family
    lfm2
    Parameters
    2.7B
    Quantization
    Q4_K_M
    Format
    gguf

  • oamazonasgabriel/lfm2.5-230m

    Tag: oamazonasgabriel/lfm2.5-230m:bf16-8gbRAM

    Family
    lfm2
    Parameters
    229.69M
    Quantization
    BF16
    Format
    gguf

  • oamazonasgabriel/lfm2.5-8b-a1b

    Tag: oamazonasgabriel/lfm2.5-8b-a1b:q4_k_m-8gbGPU

    Family
    lfm2moe
    Parameters
    8.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • olmo-3

    Tag: olmo-3:7b-instruct

    Family
    olmo3
    Parameters
    7.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • olmo2

    Tag: olmo2:7b

    Family
    olmo2
    Parameters
    7.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • opencoder

    Tag: opencoder:1.5b

    Family
    llama
    Parameters
    1.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • openthinker

    Tag: openthinker:7b

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • orca-mini

    Tag: orca-mini:latest

    Family
    llama
    Parameters
    3B
    Quantization
    Q4_0
    Format
    gguf

  • ornith-1.5

    Tag: ornith-1.5:35b

    Family
    qwen35moe
    Parameters
    35.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • ornith-1.5

    Tag: ornith-1.5:9b

    Family
    qwen35
    Parameters
    9.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • ornith

    Tag: ornith:9b

    Family
    qwen35
    Parameters
    9.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • paraphrase-multilingual

    Tag: paraphrase-multilingual:278m

    Family
    bert
    Parameters
    277.45M
    Quantization
    F16
    Format
    gguf

  • paraphrase-multilingual

    Tag: paraphrase-multilingual:latest

    Family
    bert
    Parameters
    277.45M
    Quantization
    F16
    Format
    gguf

  • paraphrase-multilingual

    Tag: paraphrase-multilingual:latest-128k

    Family
    bert
    Parameters
    277.45M
    Quantization
    F16
    Format
    gguf

  • paraphrase-multilingual

    Tag: paraphrase-multilingual:latest-16k

    Family
    bert
    Parameters
    277.45M
    Quantization
    F16
    Format
    gguf

  • paraphrase-multilingual

    Tag: paraphrase-multilingual:latest-32k

    Family
    bert
    Parameters
    277.45M
    Quantization
    F16
    Format
    gguf

  • paraphrase-multilingual

    Tag: paraphrase-multilingual:latest-64k

    Family
    bert
    Parameters
    277.45M
    Quantization
    F16
    Format
    gguf

  • paraphrase-multilingual

    Tag: paraphrase-multilingual:latest-8k

    Family
    bert
    Parameters
    277.45M
    Quantization
    F16
    Format
    gguf

  • phi3.5

    Tag: phi3.5:latest

    Family
    phi3
    Parameters
    3.8B
    Quantization
    Q4_0
    Format
    gguf

  • phi3

    Tag: phi3:14b

    Family
    phi3
    Parameters
    14.0B
    Quantization
    Q4_0
    Format
    gguf

  • phi3

    Tag: phi3:latest

    Family
    phi3
    Parameters
    3.8B
    Quantization
    Q4_0
    Format
    gguf

  • phi3

    Tag: phi3:mini

    Family
    phi3
    Parameters
    3.8B
    Quantization
    Q4_0
    Format
    gguf

  • phi4-mini-reasoning

    Tag: phi4-mini-reasoning:latest

    Family
    phi3
    Parameters
    3.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • phi4-mini

    Tag: phi4-mini:latest

    Family
    phi3
    Parameters
    3.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • phi4

    Tag: phi4:latest

    Family
    phi3
    Parameters
    14.7B
    Quantization
    Q4_K_M
    Format
    gguf

  • phi

    Tag: phi:latest

    Family
    phi2
    Parameters
    3B
    Quantization
    Q4_0
    Format
    gguf

  • phi

    Tag: phi:latest-128k

    Family
    phi2
    Parameters
    2.8B
    Quantization
    Q4_0
    Format
    gguf

  • phi

    Tag: phi:latest-16k

    Family
    phi2
    Parameters
    2.8B
    Quantization
    Q4_0
    Format
    gguf

  • phi

    Tag: phi:latest-32k

    Family
    phi2
    Parameters
    2.8B
    Quantization
    Q4_0
    Format
    gguf

  • phi

    Tag: phi:latest-64k

    Family
    phi2
    Parameters
    2.8B
    Quantization
    Q4_0
    Format
    gguf

  • phi

    Tag: phi:latest-8k

    Family
    phi2
    Parameters
    2.8B
    Quantization
    Q4_0
    Format
    gguf

  • phonon

    Tag: phonon:31m-en

    Format
    safetensors

  • phonon

    Tag: phonon:40m-de

    Format
    safetensors

  • phonon

    Tag: phonon:40m-en

    Format
    safetensors

  • phonon

    Tag: phonon:40m-es

    Format
    safetensors

  • phonon

    Tag: phonon:40m-fr

    Format
    safetensors

  • phonon

    Tag: phonon:40m-multilingual

    Format
    safetensors

  • phonon

    Tag: phonon:40m-pt

    Format
    safetensors

  • phonon

    Tag: phonon:de

    Format
    safetensors

  • phonon

    Tag: phonon:en

    Format
    safetensors

  • phonon

    Tag: phonon:es

    Format
    safetensors

  • phonon

    Tag: phonon:fr

    Format
    safetensors

  • phonon

    Tag: phonon:latest

    Format
    safetensors

  • phonon

    Tag: phonon:multilingual

    Format
    safetensors

  • phonon

    Tag: phonon:pt

    Format
    safetensors

  • pplx-decider

    Tag: pplx-decider:27b

    Family
    qwen35
    Parameters
    26.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • pplx-decider

    Tag: pplx-decider:27b-q4_K_M

    Family
    qwen35
    Parameters
    26.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2-math

    Tag: qwen2-math:1.5b

    Family
    qwen2
    Parameters
    1.5B
    Quantization
    Q4_0
    Format
    gguf

  • qwen2-math

    Tag: qwen2-math:latest

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_0
    Format
    gguf

  • qwen2.5-coder-14b-optimized

    Tag: qwen2.5-coder-14b-optimized:latest

    Family
    qwen2
    Parameters
    14.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder-32b-optimized

    Tag: qwen2.5-coder-32b-optimized:latest

    Family
    qwen2
    Parameters
    32.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:0.5b

    Family
    qwen2
    Parameters
    494.03M
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:1.5b

    Family
    qwen2
    Parameters
    1.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:14b

    Family
    qwen2
    Parameters
    14.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:14b

    Family
    qwen2
    Parameters
    14.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:14b-128k

    Family
    qwen2
    Parameters
    14.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:14b-64k

    Family
    qwen2
    Parameters
    14.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:32b

    Family
    qwen2
    Parameters
    32.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:32b

    Family
    qwen2
    Parameters
    32.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:32b-128k

    Family
    qwen2
    Parameters
    32.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:32b-64k

    Family
    qwen2
    Parameters
    32.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:3b

    Family
    qwen2
    Parameters
    3.1B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:3b

    Family
    qwen2
    Parameters
    3.1B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:3b-128k

    Family
    qwen2
    Parameters
    3.1B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:3b-64k

    Family
    qwen2
    Parameters
    3.1B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:7b

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:7b

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:7b-128k

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:7b-64k

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:7b-instruct-q4_0

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_0
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:7b-instruct-q4_K_M

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:7b-instruct-q5_K_M

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q5_K_M
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:7b-instruct-q8_0

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q8_0
    Format
    gguf

  • qwen2.5-coder

    Tag: qwen2.5-coder:latest

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:0.5b

    Family
    qwen2
    Parameters
    494.03M
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:0.5b-128k

    Family
    qwen2
    Parameters
    494.03M
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:0.5b-64k

    Family
    qwen2
    Parameters
    494.03M
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:1.5b

    Family
    qwen2
    Parameters
    1.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:1.5b-128k

    Family
    qwen2
    Parameters
    1.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:1.5b-64k

    Family
    qwen2
    Parameters
    1.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:14b

    Family
    qwen2
    Parameters
    14.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:14b-128k

    Family
    qwen2
    Parameters
    14.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:14b-64k

    Family
    qwen2
    Parameters
    14.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:14b-instruct-q4_0

    Family
    qwen2
    Parameters
    14.8B
    Quantization
    Q4_0
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:14b-instruct-q4_K_M

    Family
    qwen2
    Parameters
    14.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:14b-instruct-q5_K_M

    Family
    qwen2
    Parameters
    14.8B
    Quantization
    Q5_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:14b-instruct-q8_0

    Family
    qwen2
    Parameters
    14.8B
    Quantization
    Q8_0
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:32b

    Family
    qwen2
    Parameters
    32.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:32b-128k

    Family
    qwen2
    Parameters
    32.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:32b-64k

    Family
    qwen2
    Parameters
    32.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:3b

    Family
    qwen2
    Parameters
    3.1B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:3b-128k

    Family
    qwen2
    Parameters
    3.1B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:3b-64k

    Family
    qwen2
    Parameters
    3.1B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:7b

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:7b-128k

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:7b-64k

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:7b-instruct-q4_0

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_0
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:7b-instruct-q4_K_M

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:7b-instruct-q5_K_M

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q5_K_M
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:7b-instruct-q8_0

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q8_0
    Format
    gguf

  • qwen2.5

    Tag: qwen2.5:latest

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5vl

    Tag: qwen2.5vl:32b

    Family
    qwen25vl
    Parameters
    33.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5vl

    Tag: qwen2.5vl:3b

    Family
    qwen25vl
    Parameters
    3.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5vl

    Tag: qwen2.5vl:7b

    Family
    qwen25vl
    Parameters
    8.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2.5vl

    Tag: qwen2.5vl:latest

    Family
    qwen25vl
    Parameters
    8.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2

    Tag: qwen2:0.5b

    Family
    qwen2
    Parameters
    494.03M
    Quantization
    Q4_0
    Format
    gguf

  • qwen2

    Tag: qwen2:1.5b

    Family
    qwen2
    Parameters
    1.5B
    Quantization
    Q4_0
    Format
    gguf

  • qwen2

    Tag: qwen2:1.5b-128k

    Family
    qwen2
    Parameters
    1.5B
    Quantization
    Q4_0
    Format
    gguf

  • qwen2

    Tag: qwen2:1.5b-64k

    Family
    qwen2
    Parameters
    1.5B
    Quantization
    Q4_0
    Format
    gguf

  • qwen2

    Tag: qwen2:7b

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_0
    Format
    gguf

  • qwen2

    Tag: qwen2:7b-128k

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_0
    Format
    gguf

  • qwen2

    Tag: qwen2:7b-64k

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_0
    Format
    gguf

  • qwen2

    Tag: qwen2:7b-instruct-q4_0

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_0
    Format
    gguf

  • qwen2

    Tag: qwen2:7b-instruct-q4_K_M

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen2

    Tag: qwen2:7b-instruct-q5_K_M

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q5_K_M
    Format
    gguf

  • qwen2

    Tag: qwen2:7b-instruct-q8_0

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q8_0
    Format
    gguf

  • qwen2

    Tag: qwen2:latest

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_0
    Format
    gguf

  • qwen3-coder

    Tag: qwen3-coder:30b

    Family
    qwen3moe
    Parameters
    30.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3-embedding

    Tag: qwen3-embedding:0.6b

    Family
    qwen3
    Parameters
    595.78M
    Quantization
    Q8_0
    Format
    gguf

  • qwen3-embedding

    Tag: qwen3-embedding:4b

    Family
    qwen3
    Parameters
    4.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3-embedding

    Tag: qwen3-embedding:8b

    Family
    qwen3
    Parameters
    7.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3-embedding

    Tag: qwen3-embedding:latest

    Family
    qwen3
    Parameters
    7.6B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3-vl

    Tag: qwen3-vl:2b

    Family
    qwen3vl
    Parameters
    2.1B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3-vl

    Tag: qwen3-vl:4b

    Family
    qwen3vl
    Parameters
    4.4B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3-vl

    Tag: qwen3-vl:latest

    Family
    qwen3vl
    Parameters
    8.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3.5

    Tag: qwen3.5:0.8b

    Family
    qwen35
    Parameters
    752.39M
    Quantization
    Q8_0
    Format
    gguf

  • qwen3.5

    Tag: qwen3.5:0.8b

    Family
    qwen35
    Parameters
    873.44M
    Quantization
    Q8_0
    Format
    gguf

  • qwen3.5

    Tag: qwen3.5:27b

    Family
    qwen35
    Parameters
    26.9B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3.5

    Tag: qwen3.5:27b

    Family
    qwen35
    Parameters
    27.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3.5

    Tag: qwen3.5:2b

    Family
    qwen35
    Parameters
    1.9B
    Quantization
    Q8_0
    Format
    gguf

  • qwen3.5

    Tag: qwen3.5:2b

    Family
    qwen35
    Parameters
    2.3B
    Quantization
    Q8_0
    Format
    gguf

  • qwen3.5

    Tag: qwen3.5:2b-worker

    Family
    qwen35
    Parameters
    2.3B
    Quantization
    Q8_0
    Format
    gguf

  • qwen3.5

    Tag: qwen3.5:35b

    Family
    qwen35moe
    Parameters
    34.7B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3.5

    Tag: qwen3.5:4b

    Family
    qwen35
    Parameters
    4.7B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3.5

    Tag: qwen3.5:4b

    Family
    qwen35
    Parameters
    4.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3.5

    Tag: qwen3.5:9b

    Family
    qwen35
    Parameters
    9.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3.5

    Tag: qwen3.5:latest

    Family
    qwen35
    Parameters
    9.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3.5

    Tag: qwen3.5:latest

    Family
    qwen35
    Parameters
    9.7B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3.6

    Tag: qwen3.6:27b

    Family
    qwen35
    Parameters
    27.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3.8

    Tag: qwen3.8:27b

    Family
    qwen35
    Parameters
    27.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3.8

    Tag: qwen3.8:latest

    Family
    qwen35
    Parameters
    27.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3

    Tag: qwen3:0.6b

    Family
    qwen3
    Parameters
    751.63M
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3

    Tag: qwen3:1.7b

    Family
    qwen3
    Parameters
    2.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3

    Tag: qwen3:14b

    Family
    qwen3
    Parameters
    14.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3

    Tag: qwen3:30b

    Family
    qwen3moe
    Parameters
    30.5B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3

    Tag: qwen3:32b

    Family
    qwen3
    Parameters
    32.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3

    Tag: qwen3:4b

    Family
    qwen3
    Parameters
    4.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3

    Tag: qwen3:8b

    Family
    qwen3
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen3

    Tag: qwen3:latest

    Family
    qwen3
    Parameters
    8.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen

    Tag: qwen:0.5b

    Family
    qwen2
    Parameters
    620M
    Quantization
    Q4_0
    Format
    gguf

  • qwen

    Tag: qwen:0.5b-128k

    Family
    qwen2
    Parameters
    619.57M
    Quantization
    Q4_0
    Format
    gguf

  • qwen

    Tag: qwen:0.5b-64k

    Family
    qwen2
    Parameters
    619.57M
    Quantization
    Q4_0
    Format
    gguf

  • qwen

    Tag: qwen:1.8b

    Family
    qwen2
    Parameters
    2B
    Quantization
    Q4_0
    Format
    gguf

  • qwen

    Tag: qwen:1.8b-128k

    Family
    qwen2
    Parameters
    1.8B
    Quantization
    Q4_0
    Format
    gguf

  • qwen

    Tag: qwen:1.8b-64k

    Family
    qwen2
    Parameters
    1.8B
    Quantization
    Q4_0
    Format
    gguf

  • qwen

    Tag: qwen:14b

    Family
    qwen2
    Parameters
    14B
    Quantization
    Q4_0
    Format
    gguf

  • qwen

    Tag: qwen:32b

    Family
    qwen2
    Parameters
    33B
    Quantization
    Q4_0
    Format
    gguf

  • qwen

    Tag: qwen:4b

    Family
    qwen2
    Parameters
    4B
    Quantization
    Q4_0
    Format
    gguf

  • qwen

    Tag: qwen:4b-128k

    Family
    qwen2
    Parameters
    4.0B
    Quantization
    Q4_0
    Format
    gguf

  • qwen

    Tag: qwen:4b-64k

    Family
    qwen2
    Parameters
    4.0B
    Quantization
    Q4_0
    Format
    gguf

  • qwen

    Tag: qwen:7b

    Family
    qwen2
    Parameters
    8B
    Quantization
    Q4_0
    Format
    gguf

  • qwen

    Tag: qwen:7b-128k

    Family
    qwen2
    Parameters
    7.7B
    Quantization
    Q4_0
    Format
    gguf

  • qwen

    Tag: qwen:7b-64k

    Family
    qwen2
    Parameters
    7.7B
    Quantization
    Q4_0
    Format
    gguf

  • qwen

    Tag: qwen:7b-chat-q4_0

    Family
    qwen
    Parameters
    8B
    Quantization
    Q4_0
    Format
    gguf

  • qwen

    Tag: qwen:7b-chat-q4_K_M

    Family
    qwen
    Parameters
    8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwen

    Tag: qwen:7b-chat-q5_K_M

    Family
    qwen
    Parameters
    8B
    Quantization
    Q5_K_M
    Format
    gguf

  • qwen

    Tag: qwen:7b-chat-q8_0

    Family
    qwen
    Parameters
    8B
    Quantization
    Q8_0
    Format
    gguf

  • qwen

    Tag: qwen:latest

    Family
    qwen2
    Parameters
    4B
    Quantization
    Q4_0
    Format
    gguf

  • qwopus-9b

    Tag: qwopus-9b:latest

    Family
    qwen35
    Parameters
    9.0B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwq

    Tag: qwq:latest

    Family
    qwen2
    Parameters
    32.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwq

    Tag: qwq:latest-128k

    Family
    qwen2
    Parameters
    32.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • qwq

    Tag: qwq:latest-64k

    Family
    qwen2
    Parameters
    32.8B
    Quantization
    Q4_K_M
    Format
    gguf

  • reader-lm

    Tag: reader-lm:0.5b

    Family
    qwen2
    Parameters
    494.03M
    Quantization
    Q4_0
    Format
    gguf

  • reader-lm

    Tag: reader-lm:1.5b

    Family
    qwen2
    Parameters
    1.5B
    Quantization
    Q4_0
    Format
    gguf

  • rnj-1

    Tag: rnj-1:8b

    Family
    gemma3
    Parameters
    8.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • rnj-1

    Tag: rnj-1:latest

    Family
    gemma3
    Parameters
    8.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • s5c-probe-20261016-d1__3b-q8_0

    Tag: s5c-probe-20261016-d1__3b-q8_0:ctx2048

    Family
    lfm2
    Parameters
    2.7B
    Quantization
    Q8_0
    Format
    gguf

  • sailor2

    Tag: sailor2:1b

    Family
    qwen2
    Parameters
    988.06M
    Quantization
    Q8_0
    Format
    gguf

  • sam860/LFM2

    Tag: sam860/LFM2:1.2b

    Family
    lfm2
    Parameters
    1.17B
    Quantization
    Q5_K_M
    Format
    gguf

  • sam860/LFM2

    Tag: sam860/LFM2:2.6b

    Family
    lfm2
    Parameters
    2.57B
    Quantization
    Q5_K_M
    Format
    gguf

  • sam860/LFM2

    Tag: sam860/LFM2:350m

    Family
    lfm2
    Parameters
    354M
    Quantization
    Q8_0
    Format
    gguf

  • sam860/LFM2

    Tag: sam860/LFM2:700m

    Family
    lfm2
    Parameters
    742M
    Quantization
    Q8_0
    Format
    gguf

  • sam860/LFM2

    Tag: sam860/LFM2:8b

    Family
    lfm2moe
    Parameters
    8.34B
    Quantization
    Q5_K_M
    Format
    gguf

  • scorpion7slayer/LFM2.5-2.6B-GGUF

    Tag: scorpion7slayer/LFM2.5-2.6B-GGUF:Q6_K

    Family
    lfm2
    Parameters
    2.7B
    Quantization
    Q6_K
    Format
    gguf

  • smallthinker

    Tag: smallthinker:3b

    Family
    qwen2
    Parameters
    3.4B
    Quantization
    Q8_0
    Format
    gguf

  • smallthinker

    Tag: smallthinker:latest

    Family
    qwen2
    Parameters
    3.4B
    Quantization
    Q8_0
    Format
    gguf

  • smallthinker

    Tag: smallthinker:multi-gpu

    Family
    qwen2
    Parameters
    7.6B
    Quantization
    Q4_0
    Format
    gguf

  • smollm2

    Tag: smollm2:1.7b

    Family
    llama
    Parameters
    1.7B
    Quantization
    Q8_0
    Format
    gguf

  • smollm2

    Tag: smollm2:1.7b-128k

    Family
    llama
    Parameters
    1.7B
    Quantization
    Q8_0
    Format
    gguf

  • smollm2

    Tag: smollm2:1.7b-16k

    Family
    llama
    Parameters
    1.7B
    Quantization
    Q8_0
    Format
    gguf

  • smollm2

    Tag: smollm2:1.7b-32k

    Family
    llama
    Parameters
    1.7B
    Quantization
    Q8_0
    Format
    gguf

  • smollm2

    Tag: smollm2:1.7b-64k

    Family
    llama
    Parameters
    1.7B
    Quantization
    Q8_0
    Format
    gguf

  • smollm2

    Tag: smollm2:135m

    Family
    llama
    Parameters
    134.52M
    Quantization
    F16
    Format
    gguf

  • smollm2

    Tag: smollm2:135m

    Family
    llama
    Parameters
    134.52M
    Quantization
    F16
    Format
    gguf

  • smollm2

    Tag: smollm2:135m-128k

    Family
    llama
    Parameters
    134.52M
    Quantization
    F16
    Format
    gguf

  • smollm2

    Tag: smollm2:135m-16k

    Family
    llama
    Parameters
    134.52M
    Quantization
    F16
    Format
    gguf

  • smollm2

    Tag: smollm2:135m-32k

    Family
    llama
    Parameters
    134.52M
    Quantization
    F16
    Format
    gguf

  • smollm2

    Tag: smollm2:135m-64k

    Family
    llama
    Parameters
    134.52M
    Quantization
    F16
    Format
    gguf

  • smollm2

    Tag: smollm2:360m

    Family
    llama
    Parameters
    361.82M
    Quantization
    F16
    Format
    gguf

  • smollm2

    Tag: smollm2:360m

    Family
    llama
    Parameters
    361.82M
    Quantization
    F16
    Format
    gguf

  • smollm2

    Tag: smollm2:360m-128k

    Family
    llama
    Parameters
    361.82M
    Quantization
    F16
    Format
    gguf

  • smollm2

    Tag: smollm2:360m-16k

    Family
    llama
    Parameters
    361.82M
    Quantization
    F16
    Format
    gguf

  • smollm2

    Tag: smollm2:360m-32k

    Family
    llama
    Parameters
    361.82M
    Quantization
    F16
    Format
    gguf

  • smollm2

    Tag: smollm2:360m-64k

    Family
    llama
    Parameters
    361.82M
    Quantization
    F16
    Format
    gguf

  • smollm2

    Tag: smollm2:latest

    Family
    llama
    Parameters
    1.7B
    Quantization
    Q8_0
    Format
    gguf

  • smollm2

    Tag: smollm2:latest-128k

    Family
    llama
    Parameters
    1.7B
    Quantization
    Q8_0
    Format
    gguf

  • smollm2

    Tag: smollm2:latest-16k

    Family
    llama
    Parameters
    1.7B
    Quantization
    Q8_0
    Format
    gguf

  • smollm2

    Tag: smollm2:latest-32k

    Family
    llama
    Parameters
    1.7B
    Quantization
    Q8_0
    Format
    gguf

  • smollm2

    Tag: smollm2:latest-64k

    Family
    llama
    Parameters
    1.7B
    Quantization
    Q8_0
    Format
    gguf

  • smollm

    Tag: smollm:1.7b

    Family
    llama
    Parameters
    1.7B
    Quantization
    Q4_0
    Format
    gguf

  • smollm

    Tag: smollm:135m

    Family
    llama
    Parameters
    134.52M
    Quantization
    Q4_0
    Format
    gguf

  • smollm

    Tag: smollm:360m

    Family
    llama
    Parameters
    361.82M
    Quantization
    Q4_0
    Format
    gguf

  • snowflake-arctic-embed2

    Tag: snowflake-arctic-embed2:568m

    Family
    bert
    Parameters
    566.70M
    Quantization
    F16
    Format
    gguf

  • snowflake-arctic-embed2

    Tag: snowflake-arctic-embed2:latest

    Family
    bert
    Parameters
    566.70M
    Quantization
    F16
    Format
    gguf

  • snowflake-arctic-embed

    Tag: snowflake-arctic-embed:110m

    Family
    bert
    Parameters
    109M
    Quantization
    F16
    Format
    gguf

  • snowflake-arctic-embed

    Tag: snowflake-arctic-embed:137m

    Family
    nomic-bert
    Parameters
    137M
    Quantization
    F16
    Format
    gguf

  • snowflake-arctic-embed

    Tag: snowflake-arctic-embed:22m

    Family
    bert
    Parameters
    23M
    Quantization
    F16
    Format
    gguf

  • snowflake-arctic-embed

    Tag: snowflake-arctic-embed:335m

    Family
    bert
    Parameters
    334M
    Quantization
    F16
    Format
    gguf

  • snowflake-arctic-embed

    Tag: snowflake-arctic-embed:33m

    Family
    bert
    Parameters
    33M
    Quantization
    F16
    Format
    gguf

  • snowflake-arctic-embed

    Tag: snowflake-arctic-embed:latest

    Family
    bert
    Parameters
    334M
    Quantization
    F16
    Format
    gguf

  • srizon/pixie

    Tag: srizon/pixie:latest

    Family
    llama
    Parameters
    8B
    Quantization
    Q4_0
    Format
    gguf

  • stable-code

    Tag: stable-code:latest

    Family
    stablelm
    Parameters
    3B
    Quantization
    Q4_0
    Format
    gguf

  • stable-code

    Tag: stable-code:latest-128k

    Family
    stablelm
    Parameters
    2.8B
    Quantization
    Q4_0
    Format
    gguf

  • stable-code

    Tag: stable-code:latest-32k

    Family
    stablelm
    Parameters
    2.8B
    Quantization
    Q4_0
    Format
    gguf

  • stable-code

    Tag: stable-code:latest-64k

    Family
    stablelm
    Parameters
    2.8B
    Quantization
    Q4_0
    Format
    gguf

  • stablelm-zephyr

    Tag: stablelm-zephyr:latest

    Family
    stablelm
    Parameters
    3B
    Quantization
    Q4_0
    Format
    gguf

  • stablelm2

    Tag: stablelm2:latest

    Family
    stablelm
    Parameters
    2B
    Quantization
    Q4_0
    Format
    gguf

  • starcoder2

    Tag: starcoder2:15b

    Family
    starcoder2
    Parameters
    16B
    Quantization
    Q4_0
    Format
    gguf

  • starcoder2

    Tag: starcoder2:15b-128k

    Family
    starcoder2
    Parameters
    16.0B
    Quantization
    Q4_0
    Format
    gguf

  • starcoder2

    Tag: starcoder2:15b-32k

    Family
    starcoder2
    Parameters
    16.0B
    Quantization
    Q4_0
    Format
    gguf

  • starcoder2

    Tag: starcoder2:15b-64k

    Family
    starcoder2
    Parameters
    16.0B
    Quantization
    Q4_0
    Format
    gguf

  • starcoder2

    Tag: starcoder2:7b

    Family
    starcoder2
    Parameters
    7B
    Quantization
    Q4_0
    Format
    gguf

  • starcoder2

    Tag: starcoder2:7b-128k

    Family
    starcoder2
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • starcoder2

    Tag: starcoder2:7b-32k

    Family
    starcoder2
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • starcoder2

    Tag: starcoder2:7b-64k

    Family
    starcoder2
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • starcoder2

    Tag: starcoder2:latest

    Family
    starcoder2
    Parameters
    3B
    Quantization
    Q4_0
    Format
    gguf

  • starcoder2

    Tag: starcoder2:latest-128k

    Family
    starcoder2
    Parameters
    3.0B
    Quantization
    Q4_0
    Format
    gguf

  • starcoder2

    Tag: starcoder2:latest-32k

    Family
    starcoder2
    Parameters
    3.0B
    Quantization
    Q4_0
    Format
    gguf

  • starcoder2

    Tag: starcoder2:latest-64k

    Family
    starcoder2
    Parameters
    3.0B
    Quantization
    Q4_0
    Format
    gguf

  • starcoder

    Tag: starcoder:1b

    Family
    starcoder
    Parameters
    1B
    Quantization
    Q4_0
    Format
    gguf

  • starcoder

    Tag: starcoder:3b

    Family
    starcoder
    Parameters
    3B
    Quantization
    Q4_0
    Format
    gguf

  • strands-decider

    Tag: strands-decider:2b

    Quantization
    mxfp8
    Format
    safetensors

  • strands-decider

    Tag: strands-decider:2b-mlx-bf16

    Format
    safetensors

  • strands-decider

    Tag: strands-decider:2b-mxfp8

    Quantization
    mxfp8
    Format
    safetensors

  • strands-decider

    Tag: strands-decider:2b-nvfp4

    Format
    safetensors

  • strands-decider

    Tag: strands-decider:latest

    Quantization
    mxfp8
    Format
    safetensors

  • tev1

    Tag: tev1:0.8b

    Family
    qwen35
    Parameters
    772.85M
    Quantization
    Q8_0
    Format
    gguf

  • tev1

    Tag: tev1:0.8b-q8_0

    Family
    qwen35
    Parameters
    772.85M
    Quantization
    Q8_0
    Format
    gguf

  • tev1

    Tag: tev1:4b

    Family
    qwen35
    Parameters
    4.3B
    Quantization
    Q8_0
    Format
    gguf

  • tev1

    Tag: tev1:4b-q4_K_M

    Family
    qwen35
    Parameters
    4.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • tev1

    Tag: tev1:latest

    Family
    qwen35
    Parameters
    4.3B
    Quantization
    Q8_0
    Format
    gguf

  • tinydolphin

    Tag: tinydolphin:latest

    Family
    llama
    Parameters
    1B
    Quantization
    Q4_0
    Format
    gguf

  • tinydolphin

    Tag: tinydolphin:latest-128k

    Family
    llama
    Parameters
    1.1B
    Quantization
    Q4_0
    Format
    gguf

  • tinydolphin

    Tag: tinydolphin:latest-16k

    Family
    llama
    Parameters
    1.1B
    Quantization
    Q4_0
    Format
    gguf

  • tinydolphin

    Tag: tinydolphin:latest-32k

    Family
    llama
    Parameters
    1.1B
    Quantization
    Q4_0
    Format
    gguf

  • tinydolphin

    Tag: tinydolphin:latest-64k

    Family
    llama
    Parameters
    1.1B
    Quantization
    Q4_0
    Format
    gguf

  • tinydolphin

    Tag: tinydolphin:latest-8k

    Family
    llama
    Parameters
    1.1B
    Quantization
    Q4_0
    Format
    gguf

  • tinyllama

    Tag: tinyllama:latest

    Family
    llama
    Parameters
    1B
    Quantization
    Q4_0
    Format
    gguf

  • translategemma

    Tag: translategemma:12b

    Family
    gemma3
    Parameters
    12.2B
    Quantization
    Q4_K_M
    Format
    gguf

  • translategemma

    Tag: translategemma:4b

    Family
    gemma3
    Parameters
    4.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • translategemma

    Tag: translategemma:latest

    Family
    gemma3
    Parameters
    4.3B
    Quantization
    Q4_K_M
    Format
    gguf

  • vicuna

    Tag: vicuna:latest

    Family
    llama
    Parameters
    7B
    Quantization
    Q4_0
    Format
    gguf

  • vicuna

    Tag: vicuna:latest-128k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • vicuna

    Tag: vicuna:latest-16k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • vicuna

    Tag: vicuna:latest-32k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • vicuna

    Tag: vicuna:latest-64k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • vicuna

    Tag: vicuna:latest-8k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • wizard-vicuna-uncensored

    Tag: wizard-vicuna-uncensored:latest

    Family
    llama
    Parameters
    7B
    Quantization
    Q4_0
    Format
    gguf

  • wizard-vicuna-uncensored

    Tag: wizard-vicuna-uncensored:latest-128k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • wizard-vicuna-uncensored

    Tag: wizard-vicuna-uncensored:latest-16k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • wizard-vicuna-uncensored

    Tag: wizard-vicuna-uncensored:latest-32k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • wizard-vicuna-uncensored

    Tag: wizard-vicuna-uncensored:latest-64k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • wizard-vicuna-uncensored

    Tag: wizard-vicuna-uncensored:latest-8k

    Family
    llama
    Parameters
    6.7B
    Quantization
    Q4_0
    Format
    gguf

  • wizardlm2

    Tag: wizardlm2:latest

    Family
    llama
    Parameters
    7B
    Quantization
    Q4_0
    Format
    gguf

  • wizardlm2

    Tag: wizardlm2:latest-128k

    Family
    llama
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • wizardlm2

    Tag: wizardlm2:latest-64k

    Family
    llama
    Parameters
    7.2B
    Quantization
    Q4_0
    Format
    gguf

  • xe/phi-4

    Tag: xe/phi-4:latest

    Family
    phi3
    Parameters
    14.7B
    Quantization
    Q4_K_M
    Format
    gguf

  • yi-coder

    Tag: yi-coder:1.5b

    Family
    llama
    Parameters
    1.5B
    Quantization
    Q4_0
    Format
    gguf

Browse the Observatory

AI-generated & AI-scored. Every observation on this site is produced and judged by AI, and AI makes mistakes. Treat each result as a recorded observation under a declared protocol, as of its date. Method and marker legend