You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/inference-providers/providers/hf-inference.md
+32Lines changed: 32 additions & 0 deletions
Original file line number
Diff line number
Diff line change
@@ -42,6 +42,8 @@ All supported HF Inference models can be found [here](https://huggingface.co/mod
42
42
HF Inference is the serverless Inference API powered by Hugging Face. This service used to be called "Inference API (serverless)" prior to Inference Providers.
43
43
If you are interested in deploying models to a dedicated and autoscaling infrastructure managed by Hugging Face, check out [Inference Endpoints](https://huggingface.co/docs/inference-endpoints/index) instead.
44
44
45
+
As of July 2025, hf-inference focuses mostly on CPU inference (e.g. embedding, text-ranking, text-classification, or smaller LLMs that have historical importance like BERT or GPT-2).
46
+
45
47
## Supported tasks
46
48
47
49
@@ -55,6 +57,16 @@ Find out more about Automatic Speech Recognition [here](../tasks/automatic_speec
55
57
/>
56
58
57
59
60
+
### Chat Completion (LLM)
61
+
62
+
Find out more about Chat Completion (LLM) [here](../tasks/chat-completion).
|**tool_prompt**|_string_| A prompt to be appended before the tools |
146
146
|**tools**|_object[]_| A list of tools the model may call. Currently, only functions are supported as a tool. Use this to provide a list of functions the model may generate JSON inputs for. |
Copy file name to clipboardExpand all lines: docs/inference-providers/tasks/zero-shot-classification.md
+5-1Lines changed: 5 additions & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -24,13 +24,17 @@ For more details about the `zero-shot-classification` task, check out its [dedic
24
24
25
25
### Recommended models
26
26
27
+
-[facebook/bart-large-mnli](https://huggingface.co/facebook/bart-large-mnli): Powerful zero-shot text classification model.
27
28
28
29
Explore all available models and find the one that suits you best [here](https://huggingface.co/models?inference=warm&pipeline_tag=zero-shot-classification&sort=trending).
29
30
30
31
### Using the API
31
32
32
33
33
-
There are currently no snippet examples for the **zero-shot-classification** task, as no providers support it yet.
0 commit comments