Documentation

Linglib.Theories.Semantics.Probabilistic.SDS.Marginalization

Threshold Semantics Equivalences #

We show that the soft meanings defined in ThresholdSemantics.lean are equal to the SDS marginals computed via SDSConstraintSystem. The gradable noun threshold pattern draws on @cite{morzycki-2009}.

For a uniform threshold prior, the soft meaning of a gradable adjective equals the measure value.

This is because:

  • softMeaning(x) = P(θ < measure(x)) for θ ~ Uniform[0,1]
  • P(θ < m) = m for m ∈ [0,1]

The SDS formulation reproduces this via marginalization.

For a uniform prevalence prior, the soft truth of a generic equals the prevalence value.

Gradable noun semantics via SDS is equivalent to the direct check.

Since gradable nouns have trivial scenario factors (no uncertainty), the SDS machinery reduces to a simple Boolean check.

Bidirectional Translation: SDS ↔ LU-RSA #

We establish a formal correspondence between SDS constraint systems and Lexical Uncertainty RSA scenarios. The key insight is that both frameworks perform marginalization over latent semantic choices.

Forward Direction: SDS → LU-RSA #

Given an SDS system with:

We construct an LU-RSA scenario with:

Backward Direction: LU-RSA → SDS #

Given an LU-RSA scenario with:

We construct an SDS system with:

This shows SDS generalizes LU-RSA by factoring the prior.

The lexicon prior induced by an SDS system.

P(L_θ) ∝ selectionalFactor(θ) × scenarioFactor(θ)

This is the Product of Experts combination encoded as a single prior.

Equations
Instances For

    Theorem: SDS marginal equals LU-RSA marginal with induced prior.

    For any SDS system, the soft truth computed via SDS machinery equals the posterior probability in the induced LU-RSA scenario.

    Convert an LU-RSA lexicon to an SDS parameter.

    Each lexicon L becomes a parameter in the SDS parameter space.

    Instances For

      LU-RSA scenarios induce SDS systems with trivial selectional factors.

      When we view LU-RSA through the SDS lens:

      • Parameters = lexica
      • selectionalFactor = 1 (trivial/uniform)
      • scenarioFactor = P(L) (the lexicon prior)

      This shows that LU-RSA is a special case of SDS where the selectional factor is uninformative.

      Equations
      • One or more equations did not get rendered due to their size.

      LU-RSA has trivial selectional factors when viewed as Semantics.Probabilistic.SDS.

      Theorem: Every LU-RSA scenario can be represented as an SDS system.

      Given an LU-RSA scenario with lexicon prior P(L), we construct an SDS system where scenarioFactor = P(L) and selectionalFactor = 1.

      SDS with trivial selectional factors is equivalent to unfactored prior.

      When selectionalFactor(θ) = 1 for all θ, the SDS posterior reduces to just the scenario factor (normalized).

      SDS Extends LU-RSA with Factored Priors #

      The core difference between SDS and LU-RSA:

      LU-RSA: P(L) is a single, opaque prior distribution

      SDS: P(θ) = selectionalFactor(θ) × scenarioFactor(θ) is factored

      This factorization provides:

      1. Interpretability: We can see why a parameter is preferred
      2. Modularity: Factors can be learned/specified independently
      3. Conflict detection: When factors disagree, we can detect ambiguity
      4. Compositionality: Selectional factors can come from compositional semantics

      Examples #

      "The astronomer married the star" #

      SDS factorization:

      Product: P(CELEBRITY) ∝ 0.09, P(CELESTIAL) ∝ 0.09 → TIE → pun!

      Plain LU-RSA would need to stipulate P(L_celebrity) = P(L_celestial) without explaining why.

      SDS can detect conflicts that LU-RSA cannot.

      A conflict occurs when selectional and scenario factors prefer different values. This predicts puns, zeugma, and pragmatic ambiguity.

      Equations
      Instances For

        Formal Bidirectional Translation Theorems #

        We prove that SDS and LU-RSA are intertranslatable, establishing a formal correspondence between the frameworks.

        Structure representing an SDS system packaged for translation to LU-RSA.

        Instances For

          Structure representing an LU-RSA scenario packaged for translation to Semantics.Probabilistic.SDS.

          Instances For

            Forward translation: SDS → LU-RSA

            Every SDS system induces an equivalent LU-RSA structure where the lexicon prior encodes the Product of Experts combination.

            Note: This requires DecidableEq on the parameter type for the indicator function in the lexicon meaning.

            Equations
            • One or more equations did not get rendered due to their size.
            Instances For

              Backward translation: LU-RSA → SDS

              Every LU-RSA scenario is an SDS system with trivial selectional factors.

              Equations
              • One or more equations did not get rendered due to their size.
              Instances For

                Round-trip property: LU-RSA → SDS → LU-RSA preserves the prior structure.

                When we translate an LU-RSA scenario to SDS and back, the lexicon prior is preserved (up to the trivial selectional factor).

                Scale Structure from SDS Perspective #

                The Bigness Generalization follows from SDS structure:

                Positive adjectives (big) #

                Negative adjectives (small) #

                This is why "small idiot" doesn't work: the selectional constraint is always satisfied, providing no information.

                For positive adjectives, the minimum threshold is positive. This yields a substantive selectional constraint.

                For negative adjectives, the minimum threshold is 0. This yields a vacuous selectional constraint (always satisfied).

                Summary: SDS ↔ LU-RSA Correspondence #

                Bidirectional Translation #

                1. SDS → LU-RSA (sdsToLURSA): Every SDS system induces an LU-RSA scenario where the lexicon prior is the Product of Experts of selectional × scenario.

                2. LU-RSA → SDS (lursaToSDS): Every LU-RSA scenario is an SDS system where selectionalFactor = 1 (trivial) and scenarioFactor = P(L).

                Theorems #

                What SDS Adds #

                SDS extends LU-RSA with factored priors:

                Connection to Other Modules #