Documentation

Linglib.Phenomena.ScalarImplicatures.Studies.GoodmanStuhlmuller2013

@cite{goodman-stuhlmuller-2013}: Empirical Data #

@cite{goodman-stuhlmuller-2013}

"Knowledge and Implicature: Modeling Language Understanding as Social Cognition" Topics in Cognitive Science 5(1): 173-184

Paradigm #

Three objects that may have a property. Speaker observes a subset (access = 1, 2, or 3) and makes a quantified or numeral statement. Listener divides $100 among world states (0-3 objects have property). Speaker access is common knowledge.

Trials with knowledgeability bet <= 70 excluded from primary analysis.

Qualitative Findings #

The paper's central finding: scalar implicature and upper-bounded numeral interpretations are modulated by speaker knowledge. When the speaker has full access, listeners draw upper-bounded inferences; when access is partial, these inferences weaken or disappear.

#FindingWordAccessComparisonEvidence
1Implicature present"some"3state 2 > state 3t(43)=-10.2, p<.001
2Implicature canceled"some"1state 2 not > state 3t(31)=0.77, p=.78
3Implicature canceled"some"2state 2 not > state 3t(28)=-0.82, p=.21
4Upper-bounded"two"3state 2 > state 3t(43)=-10.2, p<.001
5Not upper-bounded"two"2state 2 not > state 3t(24)=1.1, p=.87
6Upper-bounded"one"3state 1 > state 2t(42)=-13.1, p<.001
7Upper-bounded"one"3state 1 > state 3t(42)=-17.1, p<.001
8Not upper-bounded"one"1state 1 not > state 2t(24)=1.9, p=.96
9Not upper-bounded"one"1state 1 not > state 3t(24)=3.2, p=1.0
10Partial"one"2state 1 > state 3t(25)=-3.9, p<.001
11Partial"one"2state 1 not > state 2t(25)=1.5, p=.92

The 11 qualitative findings from @cite{goodman-stuhlmuller-2013} Experiments 1-2. Each finding is a pairwise bet comparison between world states under a specific (word, access) condition.

  • some_full_implicature : Finding

    Full access: bets on state 2 > state 3 (scalar implicature present). Evidence: t(43) = -10.2, p < .001.

  • some_minimal_canceled : Finding

    Minimal access (a=1): state 2 does not exceed state 3 (canceled). Evidence: t(31) = 0.77, p = .78.

  • some_partial_canceled : Finding

    Partial access (a=2): state 2 does not exceed state 3 (canceled). Evidence: t(28) = -0.82, p = .21.

  • two_full_upper_bounded : Finding

    Full access: "two" -> state 2 > state 3 (upper-bounded reading). Evidence: t(43) = -10.2, p < .001.

  • two_partial_weakened : Finding

    Partial access (a=2): state 2 does not exceed state 3 (weakened). Evidence: t(24) = 1.1, p = .87.

  • one_full_1v2 : Finding

    Full access: "one" -> state 1 > state 2. Evidence: t(42) = -13.1, p < .001.

  • one_full_1v3 : Finding

    Full access: "one" -> state 1 > state 3. Evidence: t(42) = -17.1, p < .001.

  • one_minimal_1v2_canceled : Finding

    Minimal access (a=1): state 1 does not exceed state 2 (canceled). Evidence: t(24) = 1.9, p = .96.

  • one_minimal_1v3_canceled : Finding

    Minimal access (a=1): state 1 does not exceed state 3 (canceled). Evidence: t(24) = 3.2, p = 1.0.

  • one_partial_1v3 : Finding

    Partial access (a=2): state 1 > state 3 (partial implicature holds). Evidence: t(25) = -3.9, p < .001.

  • one_partial_1v2_canceled : Finding

    Partial access (a=2): state 1 does not exceed state 2 (still canceled). Evidence: t(25) = 1.5, p = .92.

Instances For
    Equations
    • One or more equations did not get rendered due to their size.
    Instances For

      All findings from the paper.

      Equations
      • One or more equations did not get rendered due to their size.
      Instances For

        A pairwise comparison of bets on two world states in a condition.

        The key observable: did participants allocate significantly more money to world state stateA than to stateB? A theory that predicts the listener's posterior P(state | word, access) can be checked against this.

        • experiment :
        • word : String
        • access :

          How many of 3 objects the speaker observed

        • stateA :
        • stateB :
        • aExceedsB : Bool

          Did bets on stateA significantly exceed bets on stateB?

        • evidence : String
        Instances For
          Equations
          • One or more equations did not get rendered due to their size.
          Instances For

            Access = 3: bets on state 2 > bets on state 3.

            Equations
            • One or more equations did not get rendered due to their size.
            Instances For

              Access = 1: bets on state 2 did NOT exceed bets on state 3.

              Equations
              • One or more equations did not get rendered due to their size.
              Instances For

                Access = 2: bets on state 2 did NOT exceed bets on state 3.

                Equations
                • One or more equations did not get rendered due to their size.
                Instances For

                  Bets on state 3 at access = 3 significantly lower than at access = 1.

                  Equations
                  • One or more equations did not get rendered due to their size.
                  Instances For

                    "two", access = 3: bets on state 2 > bets on state 3.

                    Equations
                    • One or more equations did not get rendered due to their size.
                    Instances For

                      "two", access = 2: bets on state 2 did NOT exceed bets on state 3.

                      Equations
                      • One or more equations did not get rendered due to their size.
                      Instances For

                        "one", access = 3: bets on state 1 > bets on state 2.

                        Equations
                        • One or more equations did not get rendered due to their size.
                        Instances For

                          "one", access = 3: bets on state 1 > bets on state 3.

                          Equations
                          • One or more equations did not get rendered due to their size.
                          Instances For

                            "one", access = 1: bets on state 1 did NOT exceed bets on state 2.

                            Equations
                            • One or more equations did not get rendered due to their size.
                            Instances For

                              "one", access = 1: bets on state 1 did NOT exceed bets on state 3.

                              Equations
                              • One or more equations did not get rendered due to their size.
                              Instances For

                                "one", access = 2: bets on state 1 > bets on state 3 (partial).

                                Equations
                                • One or more equations did not get rendered due to their size.
                                Instances For

                                  "one", access = 2: bets on state 1 did NOT exceed bets on state 2.

                                  Equations
                                  • One or more equations did not get rendered due to their size.
                                  Instances For
                                    Instances For
                                      Equations
                                      • One or more equations did not get rendered due to their size.
                                      Instances For
                                        Equations
                                        • One or more equations did not get rendered due to their size.
                                        Instances For
                                          Equations
                                          Instances For
                                            Equations
                                            Instances For
                                              Equations
                                              Instances For
                                                Equations
                                                • One or more equations did not get rendered due to their size.
                                                Instances For

                                                  The statistical evidence for each finding.

                                                  Equations
                                                  Instances For

                                                    The statistical evidence matches the predicted direction for every finding.

                                                    Bridge content (merged from Bridge.lean) #

                                                    @cite{goodman-stuhlmuller-2013}: RSA Bridge #

                                                    @cite{goodman-stuhlmuller-2013}

                                                    The paper's RSA model applied to the experimental data. A single gsCfg constructor parametric in the meaning function serves both experiments (quantifiers and lower-bound numerals). They share the same observation model, speaker belief, and S1 structure — the only thing that varies is the utterance type and literal semantics.

                                                    Architecture (Eq. 1–5) #

                                                    F_w : s → {0, 1} truth function for utterance w (§1)
                                                    P_lex(s | w) ∝ δ_{F_w(s)} literal interpretation (§1)
                                                    U(w; s) = ln P_lex(s | w) informativity (negative surprisal) (Eq. 3)
                                                    P(s | o, a) speaker's belief state (hypergeometric)
                                                    S1(w | o, a) ∝ exp(α · E_{P(s|o,a)}[U(w; s)]) (Eq. 2)
                                                                 = exp(α · Σ_s P(s | o, a) · ln P_lex(s | w))
                                                    S1(w | s, a) = Σ_o S1(w | o, a) · P(o | a, s) (Eq. 4)
                                                    L1(s | w, a) ∝ S1(w | s, a) · P(s) (Eq. 1)
                                                    

                                                    The speaker observes a subset of objects (hypergeometric sampling), forms a belief P(s | o, a), and soft-max optimizes expected informativity under that belief. L1 marginalizes over observations weighted by P(o | a, s).

                                                    The quality filter (utterance must be true at all worlds the speaker considers possible) is explicit because Real.log 0 = 0 in Lean/Mathlib, unlike WebPPL where log(0) = -∞ makes quality emerge from the score.

                                                    The model reproduces all 11 findings. All proofs use rsa_predict.

                                                    Data source: GoodmanStuhlmuller2013.Data Theories used: Theories.Pragmatics.RSA.Core.Config, Theories.Pragmatics.RSA.Quantities, Theories.Semantics.Lexical.Numeral.Semantics

                                                    World states: how many of 3 objects have the property.

                                                    Instances For
                                                      Equations
                                                      • One or more equations did not get rendered due to their size.
                                                      Instances For
                                                        Equations
                                                        • One or more equations did not get rendered due to their size.

                                                        Speaker access: how many of 3 objects the speaker can observe.

                                                        Instances For
                                                          Equations
                                                          • One or more equations did not get rendered due to their size.
                                                          Instances For

                                                            Observations: (number seen with property, access level). Latent variable in L1 — L1 marginalizes over observations.

                                                            Instances For
                                                              Equations
                                                              • One or more equations did not get rendered due to their size.
                                                              Instances For
                                                                Equations
                                                                • One or more equations did not get rendered due to their size.

                                                                Hypergeometric feasibility: can you draw obs.count successes when sampling obs.sampleSize from a population of 3 with s.toNat successes? True iff C(K, k) > 0 and C(3−K, n−k) > 0, i.e. k ≤ K and n−k ≤ 3−K. Derived from the combinatorial constraint rather than stipulated.

                                                                Equations
                                                                Instances For

                                                                  P(obs | access, world). Hypergeometric probability of observing k successes when sampling n from 3 total with K successes: P(k | N=3, K, n) = C(K,k) · C(3−K, n−k) / C(3,n). Instantiates Core.Distributions.hypergeometric for N=3.

                                                                  Equations
                                                                  • One or more equations did not get rendered due to their size.
                                                                  Instances For

                                                                    The observation model is an instance of the general hypergeometric from Core.Distributions (N=3). The ℝ-arithmetic form is used for rsa_predict compatibility; this theorem witnesses the equivalence.

                                                                    Speaker's posterior over world states given observation: P(state | obs) ∝ P(obs | state, access) · P(state). With uniform world prior, this is the normalized hypergeometric. The access level is derived from the observation itself.

                                                                    Equations
                                                                    • One or more equations did not get rendered due to their size.
                                                                    Instances For
                                                                      def Phenomena.ScalarImplicatures.GoodmanStuhlmuller2013.qualityOk {U : Type u_1} (meaning : UWorldStateBool) (obs : Obs) (u : U) :

                                                                      Quality filter: utterance u must be true at every world the speaker considers possible given observation obs. Explicit because Real.log 0 = 0 in Lean; in WebPPL, log(0) = -∞ makes quality emerge from the score.

                                                                      Equations
                                                                      • One or more equations did not get rendered due to their size.
                                                                      Instances For

                                                                        GS2013 model parametric in utterance type and meaning function.

                                                                        Eq. 1–4 from the paper: P_lex(s | w) ∝ ⟦w⟧(s) (literal listener) U(w; s) = ln P_lex(s | w) (Eq. 3) S1(w | o, a) ∝ exp(α · Σ_s P(s | o, a) · U(w; s)) (Eq. 2) S1(w | s, a) = Σ_o S1(w | o, a) · P(o | a, s) (Eq. 4) L1(s | w, a) ∝ S1(w | s, a) · P(s) (Eq. 1)

                                                                        The quality filter ensures the speaker only considers utterances true at all worlds compatible with their observation. L1 marginalizes over observations via latentPrior w obs = P(obs | a, w).

                                                                        Equations
                                                                        • One or more equations did not get rendered due to their size.
                                                                        Instances For
                                                                          Equations
                                                                          • One or more equations did not get rendered due to their size.
                                                                          Instances For
                                                                            Equations
                                                                            • One or more equations did not get rendered due to their size.
                                                                            Equations
                                                                            • One or more equations did not get rendered due to their size.
                                                                            Instances For
                                                                              Equations
                                                                              • One or more equations did not get rendered due to their size.

                                                                              Map each empirical finding to the RSA model prediction that accounts for it.

                                                                              Equations
                                                                              • One or more equations did not get rendered due to their size.
                                                                              Instances For

                                                                                The RSA model accounts for all 11 empirical findings from @cite{goodman-stuhlmuller-2013}.