Documentation

Linglib.Phenomena.ScalarImplicatures.WeakEvidenceEffect

Weak Evidence Effect: Empirical Data #

@cite{barnett-griffiths-hawkins-2022}

Experimental data from @cite{barnett-griffiths-hawkins-2022} on how weak positive evidence can backfire when listeners expect speakers to have persuasive goals.

The Stick Contest #

Two contestants each want to convince a judge that the average of 5 hidden sticks (1"–9") is longer (or shorter) than the midpoint (5"). Each reveals one stick. Participants play both the speaker role (expectation phase) and judge role (listener judgment phase).

Key Findings #

  1. 67% of participants expected speakers to show the strongest evidence
  2. For this group, weak evidence backfired (m = 34.7 on 0–100 scale, vs 50 midpoint)
  3. The speaker-dependent RSA model outperforms anchor-and-adjust alternatives

Listener type inferred from speaker expectation phase

Instances For
    Equations
    • One or more equations did not get rendered due to their size.
    Instances For

      Evidence strength conditions (distance from midpoint 5")

      Instances For
        Equations
        • One or more equations did not get rendered due to their size.
        Instances For

          Which contestant goes first

          Instances For
            Equations
            • One or more equations did not get rendered due to their size.
            Instances For

              Stick Contest design parameters

              • nSticks :
              • minLength :
              • maxLength :
              • midpoint :
              • nParticipants :
              Instances For
                Equations
                • One or more equations did not get rendered due to their size.
                Instances For

                  The actual experimental parameters

                  Equations
                  Instances For

                    Proportion expecting strongest evidence (pragmatic listeners)

                    Equations
                    Instances For

                      Proportion expecting weaker evidence (literal listeners)

                      Equations
                      Instances For

                        Key interaction: speaker expectations × evidence strength. t(718) = 5.2, p < 0.001

                        Instances For
                          Equations
                          • One or more equations did not get rendered due to their size.
                          Instances For

                            Behavioral result for a listener group

                            Instances For
                              Equations
                              • One or more equations did not get rendered due to their size.
                              Instances For

                                Pragmatic group: weak evidence backfires (mean below 50)

                                Equations
                                • One or more equations did not get rendered due to their size.
                                Instances For

                                  Literal group: no weak evidence effect (mean at 50)

                                  Equations
                                  • One or more equations did not get rendered due to their size.
                                  Instances For

                                    Pragmatic group shows backfire: mean significantly below 50 (midpoint)

                                    Model families compared

                                    Instances For
                                      Equations
                                      • One or more equations did not get rendered due to their size.
                                      Instances For

                                        Model variant (how individual differences are handled)

                                        Instances For
                                          Equations
                                          • One or more equations did not get rendered due to their size.
                                          Instances For

                                            Model comparison result from Table 1

                                            Instances For
                                              Equations
                                              • One or more equations did not get rendered due to their size.
                                              Instances For

                                                Table 1 data

                                                Equations
                                                • One or more equations did not get rendered due to their size.
                                                Instances For

                                                  The RSA speaker-dependent model has the best (highest) log-likelihood

                                                  The RSA speaker-dependent model has the best (lowest) WAIC

                                                  Fitted parameters for the best model (RSA speaker-dependent)

                                                  • betaMAP :
                                                  • betaCV :
                                                  • responseOffset :
                                                  • pragmaticMixWeight :
                                                  • literalMixWeight :
                                                  Instances For
                                                    Equations
                                                    • One or more equations did not get rendered due to their size.
                                                    Instances For
                                                      Equations
                                                      • One or more equations did not get rendered due to their size.
                                                      Instances For

                                                        β > 0 provides strong support for non-zero persuasive bias

                                                        Pragmatic group is best explained by J1 (pragmatic listener model)

                                                        Literal group is best explained by J0 (literal listener model)