sentence similarity

gte-large

by thenlper

tags:

474,247 downloads307 likes

Get API Key

API Usage

Endpoint

POST https://api.gpu.fm/v1/inference

Request

curl -X POST https://api.gpu.fm/v1/inference \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "thenlper/gte-large",
    "inputs": "Your input here",
    "parameters": {
      "max_new_tokens": 256
    }
  }'

Response

{
  "result": "Model output",
  "usage": {
    "inputTokens": 12,
    "outputTokens": 128
  },
  "pricing": {
    "total": "0.000018"
  }
}

Python SDK

import requests

response = requests.post(
    "https://api.gpu.fm/v1/inference",
    headers={"Authorization": "Bearer YOUR_API_KEY"},
    json={
        "model": "thenlper/gte-large",
        "inputs": "Your input here",
        "parameters": {"max_new_tokens": 256}
    }
)

result = response.json()
print(result["result"])

Model Documentation

Full documentation available on HuggingFace →

Pricing

Per Request$0.0001/request

Billed from your prepaid credits. No minimum commitment.

Details

Model ID: thenlper/gte-large
Library: sentence-transformers
Pipeline: sentence similarity
Updated: 11/15/2024