[Beta]Service Accounts
Verwenden Sie dies, wenn Sie virtuelle Schlüssel erstellen möchten, die nicht einem bestimmten Benutzer gehören, sondern für Produktionsprojekte erstellt werden
Verwendung​
1. Einstellungen für Service Accounts festlegen​
Setzen Sie service_account_settings, wenn Sie Einstellungen erstellen möchten, die nur für Service-Account-Schlüssel gelten
general_settings:
service_account_settings:
enforced_params: ["user"] # this means the "user" param is enforced for all requests made through any service account keys
2. Service-Account-Schlüssel in der LiteLLM Proxy Admin UI erstellen​
3. Service-Account-Schlüssel testen​
- Fehlgeschlagener Aufruf
- Erfolgreicher Aufruf
curl --location 'https://:4000/chat/completions' \
--header 'Authorization: Bearer <sk-your-service-account>' \
--header 'Content-Type: application/json' \
--data '{
"model": "gpt-3.5-turbo",
"messages": [
{
"role": "user",
"content": "hello"
}
]
}'
Erwartete Antwort
{
"error": {
"message": "BadRequest please pass param=user in request body. This is a required param for service account",
"type": "bad_request_error",
"param": "user",
"code": "400"
}
}
curl --location 'https://:4000/chat/completions' \
--header 'Authorization: Bearer <sk-your-service-account>' \
--header 'Content-Type: application/json' \
--data '{
"model": "gpt-3.5-turbo",
"messages": [
{
"role": "user",
"content": "hello"
}
],
"user": "test-user"
}'
Erwartete Antwort
{
"id": "chatcmpl-ad9595c7e3784a6783b469218d92d95c",
"choices": [
{
"finish_reason": "stop",
"index": 0,
"message": {
"content": "\n\nHello there, how may I assist you today?",
"role": "assistant",
"tool_calls": null,
"function_call": null
}
}
],
"created": 1677652288,
"model": "gpt-3.5-turbo-0125",
"object": "chat.completion",
"system_fingerprint": "fp_44709d6fcb",
"usage": {
"completion_tokens": 12,
"prompt_tokens": 9,
"total_tokens": 21,
"completion_tokens_details": null
},
"service_tier": null
}