|
89 | 89 | </li> |
90 | 90 | <li class="toctree-l2"><a class="reference internal" href="#cpm.datasets.load_risky_choices">load_risky_choices</a> |
91 | 91 | </li> |
| 92 | + <li class="toctree-l2"><a class="reference internal" href="#cpm.datasets.load_metacognition_data">load_metacognition_data</a> |
| 93 | + </li> |
92 | 94 | </ul> |
93 | 95 | </li> |
94 | 96 | <li class="toctree-l1"><a class="reference internal" href="../models/">cpm.models</a> |
@@ -234,18 +236,126 @@ <h3 id="cpm.datasets.load_risky_choices" class="doc doc-heading"> |
234 | 236 |
|
235 | 237 | <details class="note" open> |
236 | 238 | <summary>Notes</summary> |
237 | | - <p>The dataset will include the following columns:</p> |
| 239 | + <p>The data are from a risky decision-making task (similar to e.g., Rutledge et al., 2014), a two-alternative forced-choice task, which is implemented as a smartphone-compatible gamified application available in the BrainExplorer app (https://brainexplorer.net/) as the game called "<em>Scavenger</em>". |
| 240 | +On each trial, participants are presented with two stimuli and asked to select one of them. After they make their choice, they receive feedback in the form of rewards (coins). |
| 241 | +The stimuli are cartoonish depictions of stranded spaceships that participants have to salvage in order to obtain coins. |
| 242 | +In addition, participants are shown a radar, two circles drawn at the bottom of the screen, revealing the possible outcomes for each spaceship and their associated probabilities. |
| 243 | +One of the spaceships always returns an outcome with 100% probability (i.e., the safe option). The other spaceship has a 50% probability of returning an either a 0 or non-zero outcome (i.e., the risky option). |
| 244 | +In gain trials, all possible outcomes are positive (except the outcome of 0). In loss trials, all possible outcomes are negative (except the outcome of 0). |
| 245 | +Furthermore, forming an additional within-participant manipulation, trials can be either ambiguous or non-ambiguous. |
| 246 | +In ambiguous trials, the radar provides only partial information about the probabilities of the possible outcomes of the risky choice option. |
| 247 | +In these trials, the risky choice option is shown to have at least a 25% probability of returning an outcome of 0, and at least a 25% probability of returning a different outcome. |
| 248 | +Unbeknownst to the participant, the true probability of both outcomes is always 50/50 (which is why the risky_probability values in the dataset are always 0.5). |
| 249 | +Participants play one block with 40 trials, including 10 non-ambiguous gain trials, 10 non-ambiguous loss trials, 10 ambiguous gain trials, and 10 ambiguous loss trials.</p> |
| 250 | +<p>The dataset includes the following columns:</p> |
238 | 251 | <pre><code>- `ppt`: the participant number. |
239 | | -- `safe_magnitudes`: the magnitudes of the safe option. |
240 | | -- `risky_magnitudes`: the magnitudes of the risky options. |
241 | | -- `risky_probability`: the probabilities of the risky options. |
| 252 | +- `safe_magnitudes`: the magnitude of the safe option. |
| 253 | +- `risky_magnitudes`: the non-zero outcome magnitude of the risky option. |
| 254 | +- `risky_probability`: the probability of the risky option. |
242 | 255 | - `choice`: the choice of the participant (1 for risky, 0 for safe). |
243 | 256 | - `optimal`: the optimal choice based on expected value (1 for risky, 0 for safe). |
244 | 257 | - `feedback`: the feedback (reward) given to the participant. |
245 | | -- `ambiguity`: whether the choice was ambiguous (1 for yes, 0 for no). |
| 258 | +- `ambiguity`: whether the trial was ambiguous (1 for yes, 0 for no). |
246 | 259 | - `attempt`: the number of the experimental session for a given participant (e.g. 2 here means that participant is completing the experiment the second time). |
247 | 260 | - `rt_flip`: the reaction time for the choice, measured in seconds, multiplied by -1 if the choice is not an optimal choice. It is used for fitting various drift diffusion models. |
248 | 261 | </code></pre> |
| 262 | +</details> |
| 263 | + |
| 264 | +<details class="see-also" open> |
| 265 | + <summary>See Also</summary> |
| 266 | + <p><a class="autorefs autorefs-internal" title="cpm.applications.decision_making.PTSM(data=None, parameters_settings=None, generate=False, utility_curve=None, weighting='tk')" href="../applications/#cpm.applications.decision_making.PTSM">cpm.applications.decision_making.PTSM</a>: simplified version of the Prospect Theory-based Softmax Model (PTSM) for decision-making tasks based on Tversky & Kahneman (1992).</p> |
| 267 | +<p><a class="autorefs autorefs-internal" title="cpm.applications.decision_making.PTSM1992(data=None, parameters_settings=None, utility_curve=None, weighting='tk')" href="../applications/#cpm.applications.decision_making.PTSM1992">cpm.applications.decision_making.PTSM1992</a>: full version of the Prospect Theory-based Softmax Model (PTSM) for decision-making tasks based on Tversky & Kahneman (1992).</p> |
| 268 | +<p><a class="autorefs autorefs-internal" title="cpm.applications.decision_making.PTSM2025(data=None, parameters_settings=None, utility_curve=None, variant='alpha')" href="../applications/#cpm.applications.decision_making.PTSM2025">cpm.applications.decision_making.PTSM2025</a>: Prospect Theory Softmax Model loosely based on Chew et al. (2019).</p> |
| 269 | +</details> |
| 270 | + |
| 271 | +<details class="references" open> |
| 272 | + <summary>References</summary> |
| 273 | + <p>Rutledge, R. B., Skandali, N., Dayan, P., & Dolan, R. J. (2014). A computational and neural model of momentary subjective well-being. Proceedings of the National Academy of Sciences of the United States of America, 111(33), 12252–12257. https://doi.org/10.1073/pnas.1407535111</p> |
| 274 | +</details> |
| 275 | + |
| 276 | + </div> |
| 277 | + |
| 278 | +</div> |
| 279 | + |
| 280 | +<div class="doc doc-object doc-function"> |
| 281 | + |
| 282 | + |
| 283 | +<h3 id="cpm.datasets.load_metacognition_data" class="doc doc-heading"> |
| 284 | + <code class="highlight language-python"><span class="n">cpm</span><span class="o">.</span><span class="n">datasets</span><span class="o">.</span><span class="n">load_metacognition_data</span><span class="p">()</span></code> |
| 285 | + |
| 286 | +</h3> |
| 287 | + |
| 288 | + |
| 289 | + <div class="doc doc-contents first"> |
| 290 | + |
| 291 | + <p>Load the metacognition dataset from a CSV file.</p> |
| 292 | + |
| 293 | + |
| 294 | +<table class="field-list"> |
| 295 | + <colgroup> |
| 296 | + <col class="field-name" /> |
| 297 | + <col class="field-body" /> |
| 298 | + </colgroup> |
| 299 | + <tbody valign="top"> |
| 300 | + <tr class="field"> |
| 301 | + <th class="field-name">Returns:</th> |
| 302 | + <td class="field-body"> |
| 303 | + <ul class="first simple"> |
| 304 | + <li> |
| 305 | + <code><span title="pandas.DataFrame">DataFrame</span></code> |
| 306 | + – |
| 307 | + <div class="doc-md-description"> |
| 308 | + <p>A pandas DataFrame containing the metacognition data.</p> |
| 309 | + </div> |
| 310 | + </li> |
| 311 | + </ul> |
| 312 | + </td> |
| 313 | + </tr> |
| 314 | + </tbody> |
| 315 | +</table> |
| 316 | + |
| 317 | +<p><span class="doc-section-title">Examples:</span></p> |
| 318 | + <div class="highlight"><pre><span></span><code><span class="gp">>>> </span><span class="n">data</span> <span class="o">=</span> <span class="n">load_metacognition_data</span><span class="p">()</span> |
| 319 | +<span class="gp">>>> </span><span class="nb">print</span><span class="p">(</span><span class="n">data</span><span class="o">.</span><span class="n">head</span><span class="p">())</span> |
| 320 | +</code></pre></div> |
| 321 | + |
| 322 | + |
| 323 | +<details class="note" open> |
| 324 | + <summary>Notes</summary> |
| 325 | + <p>The data are from an experiment combining a perceptual decision making task with an additional post-decision component assessing participants' confidence in their choices (Marzuki et al., 2025; Moses-Payne et al., 2021). |
| 326 | +The experiment is implemented as a gamified smartphone-compatible application available in the BrainExplorer platform (https://brainexplorer.net/) as the game "<em>Space Observer</em>". |
| 327 | +The task is designed to assess aspects of metacognition, i.e., the extent to which one can accurately reflect on and evaluate their own performance, specifically how well one’s confidence is calibrated to their actual performance. |
| 328 | +For a more thorough description of the experimental procedure, please refer to Marzuki et al. (2025). |
| 329 | +Briefly, in each trial of the game, participants are presented with a planet in the centre of the screen. |
| 330 | +On top of the planet, participants are shown 68 differently coloured aliens for 250 ms, overlaying the planet. |
| 331 | +The aliens are drawn from two distinct categories (S1 and S2), which differ in colour, but are identical in shape. |
| 332 | +After the 68 aliens disappear, participants are presented with an example of the two differently coloured aliens and asked to choose which of the two had been more abundant on that trial. |
| 333 | +After each of the trials, they are asked to indicate how confident they are about their decision on a visual analogue scale ranging from “totally guessing” (0) to “totally certain” (100). |
| 334 | +The scale is not labelled with numbers and participants are not informed about the numerical values associated with their confidence ratings. |
| 335 | +A staircase procedure (Cornsweet, 1962; García-Pérez, 1998; Levitt, 1971) is used throughout the task to dynamically adjust the stimulus intensity, defined as the difference in aliens required to keep participants’ performance at approximately 70%.</p> |
| 336 | +<p>The dataset includes the following columns:</p> |
| 337 | +<pre><code>- `participant`: the participant number. |
| 338 | +- `signal`: which alien is more abundant (0 = S1, 1 = S2). |
| 339 | +- `stimulus_intensity`: absolute difference in number of aliens (i.e., evidence strength). |
| 340 | +- `response`: participant's choice (0 = S1, 1 = S2). |
| 341 | +- `confidence`: participant's confidence rating for their response. |
| 342 | +- `accuracy`: accuracy of the participant's response (0 = incorrect, 1 = correct). |
| 343 | +</code></pre> |
| 344 | +</details> |
| 345 | + |
| 346 | +<details class="see-also" open> |
| 347 | + <summary>See Also</summary> |
| 348 | + <p><a class="autorefs autorefs-internal" title="cpm.applications.signal_detection.EstimatorMetaD(data=None, bins=None, cl=None, parallel=False, libraries=['numpy', 'pandas'], prior=False, display=False, ppt_identifier=None, ignore_invalid=False, **kwargs)" href="../applications/#cpm.applications.signal_detection.EstimatorMetaD">cpm.applications.signal_detection.EstimatorMetaD</a>: Class to estimate metacognitive sensitivity (meta-d') from confidence ratings and choices.</p> |
| 349 | +</details> |
| 350 | + |
| 351 | +<details class="references" open> |
| 352 | + <summary>References</summary> |
| 353 | + <p>Chen, Y., Daly, H. R., Pitt, M. A., & Van Zandt, T. (2024). Assessing the distortions introduced when calculating d’: A simulation approach. <em>Behavior Research Methods</em>. https://doi.org/10.3758/s13428-024-02447-8</p> |
| 354 | +<p>Cornsweet, T. (1962). The staircase-method in psychophysics. Am. J. Psychol. 75, 485491. https://doi.org/10.2307/1419876</p> |
| 355 | +<p>García-Pérez M.A. (1998). Forced-choice staircases with fixed step sizes: asymptotic and small-sample properties. Vision Res., 38(12), 1861-81. https://doi.org/10.1016/s0042-6989(97)00340-4.</p> |
| 356 | +<p>Levitt, H. (1971). Transformed up-down methods in psychoacoustics. Journal of the Acoustical Society of America, 49, 467–477. https://doi.org/10.1121/1.1912375</p> |
| 357 | +<p>Marzuki, A., Kosina, L., Dome, L., Hewitt, S., & Hauser, T. (2025). Metacognitive antecedents to states of mental ill-health: Drops in confidence precede symptoms of OCD. <em>Research Square</em>. https://doi.org/10.21203/rs.3.rs-7544256/v1</p> |
| 358 | +<p>Moses‐Payne, M. E., Habicht, J., Bowler, A., Steinbeis, N., & Hauser, T. U. (2021). I know better! Emerging metacognition allows adolescents to ignore false advice. Developmental Science, 24(5), e13101. https://doi.org/10.1111/desc.13101</p> |
249 | 359 | </details> |
250 | 360 |
|
251 | 361 | </div> |
|
0 commit comments