File tree Expand file tree Collapse file tree 1 file changed +6
-2
lines changed Expand file tree Collapse file tree 1 file changed +6
-2
lines changed Original file line number Diff line number Diff line change 1
1
garak.attempt
2
2
=============
3
3
4
- In garak, ``attempt `` objects track a single prompt and the results of running it on through the generator.
5
- Probes work by creating a set of garak.attempt objects and setting their class properties.
4
+ In garak, ``Attempt `` objects track a single prompt and the results of running it on through the generator.
5
+ Probes work by creating a set of garak.attempt.Attempt objects and setting their class properties.
6
6
These are passed by the harness to the generator, and the output added to the attempt.
7
7
Then, a detector assesses the outputs from that attempt and the detector's scores are saved in the attempt.
8
8
Finally, an evaluator makes judgments of these scores, and writes hits out to the hitlog for any successful probing attempts.
9
9
10
+ Within this, ``Turn `` objects encapsulate conversational turns either sent to models (i.e. prompts)
11
+ or returned from models (i.e. model output).
12
+ garak uses an object to encapsulate this to allow easy switching with multimodal probes and generators.
13
+
10
14
garak.attempt
11
15
=============
12
16
You can’t perform that action at this time.
0 commit comments