Groq
About Groq
Groq develops inference hardware and model-serving infrastructure. Its current platform materials describe the LPU and LPX computing platforms and hosted inference access. The hardware route, serving provider and upstream model identity each provide different context for an observed run.
Focus
- Inference hardware
- Hosted model inference
- Model-serving infrastructure
Projects and interfaces
Groq inference platform
hardware and service
Infrastructure described for executing AI-model inference workloads.
Scope and limitations
- A hosted model's original developer and the serving platform should be recorded separately.
Official references
- Groq official website. Checked .
Models
38 named catalog records. These are name and distribution records, not a count of distinct model architectures.
- llama3-groq-tool-use
- llama3-groq-tool-use:70b
- llama3-groq-tool-use:70b-fp16
- llama3-groq-tool-use:70b-q2_K
- llama3-groq-tool-use:70b-q3_K_L
- llama3-groq-tool-use:70b-q3_K_M
- llama3-groq-tool-use:70b-q3_K_S
- llama3-groq-tool-use:70b-q4_0
- llama3-groq-tool-use:70b-q4_1
- llama3-groq-tool-use:70b-q4_K_M
- llama3-groq-tool-use:70b-q4_K_S
- llama3-groq-tool-use:70b-q5_0
- llama3-groq-tool-use:70b-q5_1
- llama3-groq-tool-use:70b-q5_K_M
- llama3-groq-tool-use:70b-q5_K_S
- llama3-groq-tool-use:70b-q6_K
- llama3-groq-tool-use:70b-q8_0
- llama3-groq-tool-use:8b
- llama3-groq-tool-use:8b-fp16
- llama3-groq-tool-use:8b-q2_K
- llama3-groq-tool-use:8b-q3_K_L
- llama3-groq-tool-use:8b-q3_K_M
- llama3-groq-tool-use:8b-q3_K_S
- llama3-groq-tool-use:8b-q4_0
- llama3-groq-tool-use:8b-q4_1
- llama3-groq-tool-use:8b-q4_K_M
- llama3-groq-tool-use:8b-q4_K_S
- llama3-groq-tool-use:8b-q5_0
- llama3-groq-tool-use:8b-q5_1
- llama3-groq-tool-use:8b-q5_K_M
- llama3-groq-tool-use:8b-q5_K_S
- llama3-groq-tool-use:8b-q6_K
- llama3-groq-tool-use:8b-q8_0
- llama3-groq-tool-use:latest
- llama3-groq-tool-use:latest-128k
- llama3-groq-tool-use:latest-16k
- llama3-groq-tool-use:latest-32k
- llama3-groq-tool-use:latest-64k
Model families
- llama3-groq-tool-use