This is the multi-page printable view of this section.
Click here to print.
Return to the regular view of this page.
Conversation component specs
The supported conversation components that interface with Dapr
Table headers to note:
Header |
Description |
Example |
Status |
Component certification status |
Alpha
Beta
Stable
|
Component version |
The version of the component |
v1 |
Since runtime version |
The version of the Dapr runtime when the component status was set or updated |
1.11 |
<h3>Amazon Web Services (AWS)</h3>
<table width="100%">
<tr>
<th>Component</th>
<th>Status</th>
<th>Component version</th>
<th>Since runtime version</th>
</tr>
<tr>
<td><a href="/reference/components-reference/supported-conversation/aws-bedrock/">AWS Bedrock</a>
</td>
<td>Alpha</td>
<td>v1</td>
<td>1.15</td>
</tr>
</table>
<h3>Generic</h3>
<table width="100%">
<tr>
<th>Component</th>
<th>Status</th>
<th>Component version</th>
<th>Since runtime version</th>
</tr>
<tr>
<td><a href="/reference/components-reference/supported-conversation/anthropic/">Anthropic</a>
</td>
<td>Alpha</td>
<td>v1</td>
<td>1.15</td>
</tr>
<tr>
<td><a href="/reference/components-reference/supported-conversation/deepseek/">DeepSeek</a>
</td>
<td>Alpha</td>
<td>v1</td>
<td>1.15</td>
</tr>
<tr>
<td><a href="/reference/components-reference/supported-conversation/googleai/">GoogleAI</a>
</td>
<td>Alpha</td>
<td>v1</td>
<td>1.16</td>
</tr>
<tr>
<td><a href="/reference/components-reference/supported-conversation/hugging-face/">Huggingface</a>
</td>
<td>Alpha</td>
<td>v1</td>
<td>1.15</td>
</tr>
<tr>
<td><a href="/reference/components-reference/supported-conversation/mistral/">Mistral</a>
</td>
<td>Alpha</td>
<td>v1</td>
<td>1.15</td>
</tr>
<tr>
<td><a href="/reference/components-reference/supported-conversation/ollama/">Ollama</a>
</td>
<td>Alpha</td>
<td>v1</td>
<td>1.16</td>
</tr>
<tr>
<td><a href="/reference/components-reference/supported-conversation/openai/">OpenAI</a>
</td>
<td>Alpha</td>
<td>v1</td>
<td>1.15</td>
</tr>
</table>
1 - Anthropic
Detailed information on the Anthropic conversation component
A Dapr conversation.yaml
component file has the following structure:
apiVersion: dapr.io/v1alpha1
kind: Component
metadata:
name: anthropic
spec:
type: conversation.anthropic
metadata:
- name: key
value: "mykey"
- name: model
value: claude-3-5-sonnet-20240620
- name: cacheTTL
value: 10m
Warning
The above example uses secrets as plain strings. It is recommended to use a secret store for the secrets, as described
here.
Field |
Required |
Details |
Example |
key |
Y |
API key for Anthropic. |
"mykey" |
model |
N |
The Anthropic LLM to use. Defaults to claude-3-5-sonnet-20240620 |
claude-3-5-sonnet-20240620 |
cacheTTL |
N |
A time-to-live value for a prompt cache to expire. Uses Golang duration format. |
10m |
2 - AWS Bedrock
Detailed information on the AWS Bedrock conversation component
A Dapr conversation.yaml
component file has the following structure:
apiVersion: dapr.io/v1alpha1
kind: Component
metadata:
name: awsbedrock
spec:
type: conversation.aws.bedrock
metadata:
- name: endpoint
value: "http://localhost:4566"
- name: model
value: amazon.titan-text-express-v1
- name: cacheTTL
value: 10m
Warning
The above example uses secrets as plain strings. It is recommended to use a secret store for the secrets, as described
here.
Field |
Required |
Details |
Example |
endpoint |
N |
AWS endpoint for the component to use and connect to emulators. Not recommended for production AWS use. |
http://localhost:4566 |
model |
N |
The LLM to use. Defaults to Bedrock’s default provider model from Amazon. |
amazon.titan-text-express-v1 |
cacheTTL |
N |
A time-to-live value for a prompt cache to expire. Uses Golang duration format. |
10m |
Authenticating AWS
Instead of using a key
parameter, AWS Bedrock authenticates using Dapr’s standard method of IAM or static credentials. Learn more about authenticating with AWS.
3 - DeepSeek
Detailed information on the DeepSeek conversation component
A Dapr conversation.yaml
component file has the following structure:
apiVersion: dapr.io/v1alpha1
kind: Component
metadata:
name: deepseek
spec:
type: conversation.deepseek
metadata:
- name: key
value: mykey
- name: maxTokens
value: 2048
Warning
The above example uses secrets as plain strings. It is recommended to use a secret store for the secrets, as described
here.
Field |
Required |
Details |
Example |
key |
Y |
API key for DeepSeek. |
mykey |
maxTokens |
N |
The max amount of tokens for each request. |
2048 |
4 - Local Testing
Detailed information on the echo conversation component used for local testing
A Dapr conversation.yaml
component file has the following structure:
apiVersion: dapr.io/v1alpha1
kind: Component
metadata:
name: echo
spec:
type: conversation.echo
version: v1
Information
This component is only meant for local validation and testing of a Conversation component implementation. It does not actually send the data to any LLM but rather echos the input back directly.
5 - GoogleAI
Detailed information on the GoogleAI conversation component
A Dapr conversation.yaml
component file has the following structure:
apiVersion: dapr.io/v1alpha1
kind: Component
metadata:
name: googleai
spec:
type: conversation.googleai
metadata:
- name: key
value: mykey
- name: model
value: gemini-1.5-flash
- name: cacheTTL
value: 10m
Warning
The above example uses secrets as plain strings. It is recommended to use a secret store for the secrets, as described
here.
Field |
Required |
Details |
Example |
key |
Y |
API key for GoogleAI. |
mykey |
model |
N |
The GoogleAI LLM to use. Defaults to gemini-1.5-flash . |
gemini-2.0-flash |
cacheTTL |
N |
A time-to-live value for a prompt cache to expire. Uses Golang duration format. |
10m |
6 - Huggingface
Detailed information on the Huggingface conversation component
A Dapr conversation.yaml
component file has the following structure:
apiVersion: dapr.io/v1alpha1
kind: Component
metadata:
name: huggingface
spec:
type: conversation.huggingface
metadata:
- name: key
value: mykey
- name: model
value: meta-llama/Meta-Llama-3-8B
- name: cacheTTL
value: 10m
Warning
The above example uses secrets as plain strings. It is recommended to use a secret store for the secrets, as described
here.
Field |
Required |
Details |
Example |
key |
Y |
API key for Huggingface. |
mykey |
model |
N |
The Huggingface LLM to use. Defaults to meta-llama/Meta-Llama-3-8B . |
meta-llama/Meta-Llama-3-8B |
cacheTTL |
N |
A time-to-live value for a prompt cache to expire. Uses Golang duration format. |
10m |
7 - Mistral
Detailed information on the Mistral conversation component
A Dapr conversation.yaml
component file has the following structure:
apiVersion: dapr.io/v1alpha1
kind: Component
metadata:
name: mistral
spec:
type: conversation.mistral
metadata:
- name: key
value: mykey
- name: model
value: open-mistral-7b
- name: cacheTTL
value: 10m
Warning
The above example uses secrets as plain strings. It is recommended to use a secret store for the secrets, as described
here.
Field |
Required |
Details |
Example |
key |
Y |
API key for Mistral. |
mykey |
model |
N |
The Mistral LLM to use. Defaults to open-mistral-7b . |
open-mistral-7b |
cacheTTL |
N |
A time-to-live value for a prompt cache to expire. Uses Golang duration format. |
10m |
8 - Ollama
Detailed information on the Ollama conversation component
A Dapr conversation.yaml
component file has the following structure:
apiVersion: dapr.io/v1alpha1
kind: Component
metadata:
name: ollama
spec:
type: conversation.ollama
metadata:
- name: model
value: llama3.2:latest
- name: cacheTTL
value: 10m
Warning
The above example uses secrets as plain strings. It is recommended to use a secret store for the secrets, as described
here.
Field |
Required |
Details |
Example |
model |
N |
The Ollama LLM to use. Defaults to llama3.2:latest . |
phi4:latest |
cacheTTL |
N |
A time-to-live value for a prompt cache to expire. Uses Golang duration format. |
10m |
9 - OpenAI
Detailed information on the OpenAI conversation component
A Dapr conversation.yaml
component file has the following structure:
apiVersion: dapr.io/v1alpha1
kind: Component
metadata:
name: openai
spec:
type: conversation.openai
metadata:
- name: key
value: mykey
- name: model
value: gpt-4-turbo
- name: endpoint
value: 'https://api.openai.com/v1'
- name: cacheTTL
value: 10m
Warning
The above example uses secrets as plain strings. It is recommended to use a secret store for the secrets, as described
here.
Field |
Required |
Details |
Example |
key |
Y |
API key for OpenAI. |
mykey |
model |
N |
The OpenAI LLM to use. Defaults to gpt-4-turbo . |
gpt-4-turbo |
endpoint |
N |
Custom API endpoint URL for OpenAI API-compatible services. If not specified, the default OpenAI API endpoint is used. |
https://api.openai.com/v1 |
cacheTTL |
N |
A time-to-live value for a prompt cache to expire. Uses Golang duration format. |
10m |