Jina AI

https://jina.ai/embeddings/

Unterstützte Endpunkte

• /embeddings
• /rerank

API-Schlüssel

# env variable
os.environ['JINA_AI_API_KEY']

Beispielnutzung - Einbettung

SDK

from litellm import embedding
import os

os.environ['JINA_AI_API_KEY'] = ""
response = embedding(
    model="jina_ai/jina-embeddings-v3",
    input=["good morning from litellm"],
)
print(response)

PROXY

1. Zu config.yaml hinzufügen

model_list:
  - model_name: embedding-model
    litellm_params:
      model: jina_ai/jina-embeddings-v3
      api_key: os.environ/JINA_AI_API_KEY

2. Proxy starten

litellm --config /path/to/config.yaml

# RUNNING on http://0.0.0.0:4000/

3. Testen Sie es!

curl -L -X POST 'http://0.0.0.0:4000/embeddings' \
-H 'Authorization: Bearer sk-1234' \
-H 'Content-Type: application/json' \
-d '{"input": ["hello world"], "model": "embedding-model"}'

Beispielverwendung – Rerank

SDK

from litellm import rerank
import os

os.environ["JINA_AI_API_KEY"] = "sk-..."

query = "What is the capital of the United States?"
documents = [
    "Carson City is the capital city of the American state of Nevada.",
    "The Commonwealth of the Northern Mariana Islands is a group of islands in the Pacific Ocean. Its capital is Saipan.",
    "Washington, D.C. is the capital of the United States.",
    "Capital punishment has existed in the United States since before it was a country.",
]

response = rerank(
    model="jina_ai/jina-reranker-v2-base-multilingual",
    query=query,
    documents=documents,
    top_n=3,
)
print(response)

PROXY

1. Zu config.yaml hinzufügen

model_list:
  - model_name: rerank-model
    litellm_params:
      model: jina_ai/jina-reranker-v2-base-multilingual
      api_key: os.environ/JINA_AI_API_KEY

2. Proxy starten

litellm --config /path/to/config.yaml

3. Testen Sie es!

curl -L -X POST 'http://0.0.0.0:4000/rerank' \
-H 'Authorization: Bearer sk-1234' \
-H 'Content-Type: application/json' \
-d '{
    "model": "rerank-model",
    "query": "What is the capital of the United States?",
    "documents": [
        "Carson City is the capital city of the American state of Nevada.",
        "The Commonwealth of the Northern Mariana Islands is a group of islands in the Pacific Ocean. Its capital is Saipan.",
        "Washington, D.C. is the capital of the United States.",
        "Capital punishment has existed in the United States since before it was a country."
    ],
    "top_n": 3
}'

Unterstützte Modelle

Alle hier aufgeführten Modelle https://jina.ai/embeddings/ werden unterstützt

Unterstützte optionale Rerank-Parameter

Alle Cohere Rerank-Parameter werden unterstützt.

Unterstützte optionale Embeddings-Parameter

dimensions

Anbieterspezifische Parameter

Übergeben Sie alle Jina AI-spezifischen Parameter als Schlüsselwortargument an die Funktion embedding oder rerank, z. B.

SDK

response = embedding(
    model="jina_ai/jina-embeddings-v3",
    input=["good morning from litellm"],
    dimensions=1536,
    my_custom_param="my_custom_value", # any other jina ai specific parameters
)

PROXY

curl -L -X POST 'http://0.0.0.0:4000/embeddings' \
-H 'Authorization: Bearer sk-1234' \
-H 'Content-Type: application/json' \
-d '{"input": ["good morning from litellm"], "model": "jina_ai/jina-embeddings-v3", "dimensions": 1536, "my_custom_param": "my_custom_value"}'