You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
"description": "## Overview\n\nThis is a beta version of **Aimon Rely.** It includes our proprietary hallucination detector. This is an beta-release, so please treat it as such. Check with us (send a note to [info@aimon.ai](https://mailto:info@aimon.ai)) before using this API in a production setting. There are limited uptime guarantees at the moment. Please report any issues to the Aimon team (at [info@aimon.ai](https://mailto:info@aimon.ai)).\n\n> Use the APIs with caution - do not send sensitive or protected data to this API. \n \n\n## Features\n\nGiven a context and the generated text, we are able to detect 2 different types of model hallucinations: intrinsic and extrinsic.\n\n- The \"is_hallucinated\" field indicates whether the \"generated_text\" (passed in the input) is hallucinated.\n- A top level passage level \"score\" indicates if the entire set of sentences contain any hallucinations. The score is a probabilty measure of how hallucinated the text is compared to the context. A score >= 0.5 can be classified as a hallucination.\n- We also provide sentence level scores to help with explanability.\n \n\n## **Limitations**\n\n- Input payloads with context sizes greater than 32,000 tokens will not work at the moment.\n- Maximum batch size is 25 items at the moment.",
"raw": "[\n {\n \"context\": \"the abc have reported that those who receive centrelink payments made up half of radio rental's income last year. Centrelink payments themselves were up 20%.\",\n \"generated_text\": \"those who receive centrelink payments that themselves were up 20% made up half of radio rental's income last year. Centrelink payments themselves were up 20%.\"\n },\n {\n \"context\": \"the abc have reported that those who receive centrelink payments made up half of radio rental's income last year. Centrelink payments themselves were up 20%.\",\n \"generated_text\": \"the abc have reported that those who receive centrelink payments that themselves were up 20% made up three fourths of radio rental's income last year.\"\n },\n {\n \"context\": \"the abc have reported that those who receive centrelink payments made up half of radio rental's income last year. Centrelink payments themselves were up 20%.\",\n \"generated_text\": \"the abc have reported that those who receive centrelink payments made up three fourths of radio rental's income last year. Centrelink payments themselves were 20% up.\"\n }\n]",
83
+
"options": {
84
+
"raw": {
85
+
"language": "json"
86
+
}
87
+
}
88
+
},
89
+
"url": {
90
+
"raw": "{{AIMON_HALLUCINATION_API_URL}}",
91
+
"host": [
92
+
"{{AIMON_HALLUCINATION_API_URL}}"
93
+
]
94
+
},
95
+
"description": "This request consists of an array of 3 items. The first item does not contain hallucinations but the 2nd and the 3rd items do contain hallucinations."
96
+
},
97
+
"response": [
98
+
{
99
+
"name": "Response",
100
+
"originalRequest": {
101
+
"method": "POST",
102
+
"header": [],
103
+
"body": {
104
+
"mode": "raw",
105
+
"raw": "[\n {\n \"context\": \"the abc have reported that those who receive centrelink payments made up half of radio rental's income last year. Centrelink payments themselves were up 20%.\",\n \"generated_text\": \"those who receive centrelink payments that themselves were up 20% made up half of radio rental's income last year. Centrelink payments themselves were up 20%.\"\n },\n {\n \"context\": \"the abc have reported that those who receive centrelink payments made up half of radio rental's income last year. Centrelink payments themselves were up 20%.\",\n \"generated_text\": \"the abc have reported that those who receive centrelink payments that themselves were up 20% made up three fourths of radio rental's income last year.\"\n },\n {\n \"context\": \"the abc have reported that those who receive centrelink payments made up half of radio rental's income last year. Centrelink payments themselves were up 20%.\",\n \"generated_text\": \"the abc have reported that those who receive centrelink payments made up three fourths of radio rental's income last year. Centrelink payments themselves were 20% up.\"\n }\n]",
106
+
"options": {
107
+
"raw": {
108
+
"language": "json"
109
+
}
110
+
}
111
+
},
112
+
"url": {
113
+
"raw": "{{AIMON_HALLUCINATION_API_URL}}",
114
+
"host": [
115
+
"{{AIMON_HALLUCINATION_API_URL}}"
116
+
]
117
+
}
118
+
},
119
+
"status": "OK",
120
+
"code": 200,
121
+
"_postman_previewlanguage": "json",
122
+
"header": [
123
+
{
124
+
"key": "Date",
125
+
"value": "Mon, 11 Mar 2024 07:11:23 GMT"
126
+
},
127
+
{
128
+
"key": "Content-Type",
129
+
"value": "application/json"
130
+
},
131
+
{
132
+
"key": "Content-Length",
133
+
"value": "786"
134
+
},
135
+
{
136
+
"key": "Connection",
137
+
"value": "keep-alive"
138
+
},
139
+
{
140
+
"key": "Access-Control-Allow-Origin",
141
+
"value": "*"
142
+
},
143
+
{
144
+
"key": "Strict-Transport-Security",
145
+
"value": "max-age=15724800; includeSubDomains"
146
+
}
147
+
],
148
+
"cookie": [],
149
+
"body": "[\n {\n \"is_hallucinated\": \"False\",\n \"score\": 0.07905,\n \"sentences\": [\n {\n \"score\": 0.07905,\n \"text\": \"those who receive centrelink payments that themselves were up 20% made up half of radio rental's income last year.\"\n },\n {\n \"score\": 0.01975,\n \"text\": \"Centrelink payments themselves were up 20%.\"\n }\n ]\n },\n {\n \"is_hallucinated\": \"True\",\n \"score\": 0.90819,\n \"sentences\": [\n {\n \"score\": 0.90819,\n \"text\": \"the abc have reported that those who receive centrelink payments that themselves were up 20% made up three fourths of radio rental's income last year.\"\n }\n ]\n },\n {\n \"is_hallucinated\": \"True\",\n \"score\": 0.99121,\n \"sentences\": [\n {\n \"score\": 0.99121,\n \"text\": \"the abc have reported that those who receive centrelink payments made up three fourths of radio rental's income last year.\"\n },\n {\n \"score\": 0.02108,\n \"text\": \"Centrelink payments themselves were 20% up.\"\n }\n ]\n }\n]"
150
+
}
151
+
]
152
+
},
153
+
{
154
+
"name": "Point Inference",
155
+
"request": {
156
+
"auth": {
157
+
"type": "bearer",
158
+
"bearer": [
159
+
{
160
+
"key": "token",
161
+
"value": "{{AIMON_API_KEY}}",
162
+
"type": "string"
163
+
}
164
+
]
165
+
},
166
+
"method": "POST",
167
+
"header": [],
168
+
"body": {
169
+
"mode": "raw",
170
+
"raw": "[\n {\n\"context\": \"five ambitious clubs are locked in a scramble for two champions league places behind chelsea and manchester city and it could prove more tense and exciting than the barclays premier league title race itself.\",\n\"generated_text\": \"five ambitious clubs are locked in a scramble for two champions league places.\"\n }\n]\n",
171
+
"options": {
172
+
"raw": {
173
+
"language": "json"
174
+
}
175
+
}
176
+
},
177
+
"url": {
178
+
"raw": "{{AIMON_HALLUCINATION_API_URL}}",
179
+
"host": [
180
+
"{{AIMON_HALLUCINATION_API_URL}}"
181
+
]
182
+
},
183
+
"description": "This is a point inference example i.e., the payload only contains one item for inference."
184
+
},
185
+
"response": [
186
+
{
187
+
"name": "Response",
188
+
"originalRequest": {
189
+
"method": "POST",
190
+
"header": [],
191
+
"body": {
192
+
"mode": "raw",
193
+
"raw": "[\n {\n\"context\": \"five ambitious clubs are locked in a scramble for two champions league places behind chelsea and manchester city and it could prove more tense and exciting than the barclays premier league title race itself.\",\n\"generated_text\": \"five ambitious clubs are locked in a scramble for two champions league places.\"\n }\n]\n",
194
+
"options": {
195
+
"raw": {
196
+
"language": "json"
197
+
}
198
+
}
199
+
},
200
+
"url": {
201
+
"raw": "{{AIMON_HALLUCINATION_API_URL}}",
202
+
"host": [
203
+
"{{AIMON_HALLUCINATION_API_URL}}"
204
+
]
205
+
}
206
+
},
207
+
"status": "OK",
208
+
"code": 200,
209
+
"_postman_previewlanguage": "json",
210
+
"header": [
211
+
{
212
+
"key": "Date",
213
+
"value": "Mon, 11 Mar 2024 07:53:18 GMT"
214
+
},
215
+
{
216
+
"key": "Content-Type",
217
+
"value": "application/json"
218
+
},
219
+
{
220
+
"key": "Content-Length",
221
+
"value": "166"
222
+
},
223
+
{
224
+
"key": "Connection",
225
+
"value": "keep-alive"
226
+
},
227
+
{
228
+
"key": "Access-Control-Allow-Origin",
229
+
"value": "*"
230
+
},
231
+
{
232
+
"key": "Strict-Transport-Security",
233
+
"value": "max-age=15724800; includeSubDomains"
234
+
}
235
+
],
236
+
"cookie": [],
237
+
"body": "[\n {\n\"is_hallucinated\": \"False\",\n\"score\": 0.01675,\n\"sentences\": [\n {\n\"score\": 0.01675,\n\"text\": \"five ambitious clubs are locked in a scramble for two champions league places.\"\n }\n ]\n }\n]"
0 commit comments