A Dapr conversation.yaml
component file has the following structure:
apiVersion: dapr.io/v1alpha1
kind: Component
metadata:
name: huggingface
spec:
type: conversation.huggingface
metadata:
- name: key
value: mykey
- name: model
value: meta-llama/Meta-Llama-3-8B
- name: cacheTTL
value: 10m
Field | Required | Details | Example |
---|---|---|---|
key | Y | API key for Huggingface. | mykey |
model | N | The Huggingface LLM to use. Defaults to meta-llama/Meta-Llama-3-8B . | meta-llama/Meta-Llama-3-8B |
cacheTTL | N | A time-to-live value for a prompt cache to expire. Uses Golang duration format. | 10m |