edu.stanford.nlp.tmt.model.lda

LDA

trait LDA [ModelState, Doc <: LDADocument[DocState], DocState] extends TopicModel[LDAModelParams, ModelState, LDADocumentParams, Doc, DocState] with ClosedTopicSet with DirichletTermSmoothing with DirichletTopicSmoothing

LDA models are a TopicModel on a fixed set of k topics with dirichlet term and topic smoothing.

linear super types: DirichletTopicSmoothing, DirichletTermSmoothing, ClosedTopicSet, TopicModel[LDAModelParams, ModelState, LDADocumentParams, Doc, DocState], RepCheck, Stateful[ModelState], AnyRef, Any
known subclasses: CVB0LDA, GibbsLDA
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. Hide All
  2. Show all
  1. LDA
  2. DirichletTopicSmoothing
  3. DirichletTermSmoothing
  4. ClosedTopicSet
  5. TopicModel
  6. RepCheck
  7. Stateful
  8. AnyRef
  9. Any
Visibility
  1. Public
  2. All
Impl.
  1. Concrete
  2. Abstract

Value Members

  1. def != (arg0: AnyRef) : Boolean

    attributes: final
    definition classes: AnyRef
  2. def != (arg0: Any) : Boolean

    o != arg0 is the same as !(o == (arg0)).

    o != arg0 is the same as !(o == (arg0)).

    arg0

    the object to compare against this object for dis-equality.

    returns

    false if the receiver object is equivalent to the argument; true otherwise.

    attributes: final
    definition classes: Any
  3. def ## () : Int

    attributes: final
    definition classes: AnyRef → Any
  4. def $asInstanceOf [T0] () : T0

    attributes: final
    definition classes: AnyRef
  5. def $isInstanceOf [T0] () : Boolean

    attributes: final
    definition classes: AnyRef
  6. def == (arg0: AnyRef) : Boolean

    o == arg0 is the same as if (o eq null) arg0 eq null else o.equals(arg0).

    o == arg0 is the same as if (o eq null) arg0 eq null else o.equals(arg0).

    arg0

    the object to compare against this object for equality.

    returns

    true if the receiver object is equivalent to the argument; false otherwise.

    attributes: final
    definition classes: AnyRef
  7. def == (arg0: Any) : Boolean

    o == arg0 is the same as o.equals(arg0).

    o == arg0 is the same as o.equals(arg0).

    arg0

    the object to compare against this object for equality.

    returns

    true if the receiver object is equivalent to the argument; false otherwise.

    attributes: final
    definition classes: Any
  8. def asInstanceOf [T0] : T0

    This method is used to cast the receiver object to be of type T0.

    This method is used to cast the receiver object to be of type T0.

    Note that the success of a cast at runtime is modulo Scala's erasure semantics. Therefore the expression1.asInstanceOf[String] will throw a ClassCastException at runtime, while the expressionList(1).asInstanceOf[List[String]] will not. In the latter example, because the type argument is erased as part of compilation it is not possible to check whether the contents of the list are of the requested typed.

    returns

    the receiver object.

    attributes: final
    definition classes: Any
  9. var checkers : List[Function0[_]]

    attributes: protected
    definition classes: RepCheck
  10. def checkrep () : Unit

    Assert invariants.

    Assert invariants.

    attributes: protected final
    definition classes: RepCheck
  11. def clone () : AnyRef

    This method creates and returns a copy of the receiver object.

    This method creates and returns a copy of the receiver object.

    The default implementation of the clone method is platform dependent.

    returns

    a copy of the receiver object.

    attributes: protected
    definition classes: AnyRef
  12. def computeCrossEntropy (doc: LDADocumentParams) : (Double, Int)

    Computes the total cross-entropy of the terms in the second half of the document based on an estimate of theta from the terms in the fisrt half of the doucment.

    Computes the total cross-entropy of the terms in the second half of the document based on an estimate of theta from the terms in the fisrt half of the doucment. Returns (sum crossEntropy, numTerms). This is used as the basis of computePerplexity.

  13. def computeLogPW (doc: Doc) : Double

    Computes the log probability for the current document.

    Computes the log probability for the current document. This measure treats the assignment to theta and the model counts as observed. Returns sum_i P(w_i | theta*, beta*). Beta maps from (topic,term) to probability.

  14. def computePerplexity (docs: Traversable[LDADocumentParams]) : Double

    Computes the average per-word perplexity of the given dataset.

    Computes the average per-word perplexity of the given dataset.

  15. def create (docParams: LDADocumentParams) : Doc

    Creates a document from the given document parameters.

    Creates a document from the given document parameters.

    attributes: abstract
    definition classes: TopicModel
  16. def eq (arg0: AnyRef) : Boolean

    This method is used to test whether the argument (arg0) is a reference to the receiver object (this).

    This method is used to test whether the argument (arg0) is a reference to the receiver object (this).

    The eq method implements an [http://en.wikipedia.org/wiki/Equivalence_relation equivalence relation] on non-null instances of AnyRef: * It is reflexive: for any non-null instance x of type AnyRef, x.eq(x) returns true. * It is symmetric: for any non-null instances x and y of type AnyRef, x.eq(y) returns true if and only if y.eq(x) returns true. * It is transitive: for any non-null instances x, y, and z of type AnyRef if x.eq(y) returns true and y.eq(z) returns true, then x.eq(z) returns true.

    Additionally, the eq method has three other properties. * It is consistent: for any non-null instances x and y of type AnyRef, multiple invocations of x.eq(y) consistently returns true or consistently returns false. * For any non-null instance x of type AnyRef, x.eq(null) and null.eq(x) returns false. * null.eq(null) returns true.

    When overriding the equals or hashCode methods, it is important to ensure that their behavior is consistent with reference equality. Therefore, if two objects are references to each other (o1 eq o2), they should be equal to each other (o1 == o2) and they should hash to the same value (o1.hashCode == o2.hashCode).

    arg0

    the object to compare against this object for reference equality.

    returns

    true if the argument is a reference to the receiver object; false otherwise.

    attributes: final
    definition classes: AnyRef
  17. def equals (arg0: Any) : Boolean

    This method is used to compare the receiver object (this) with the argument object (arg0) for equivalence.

    This method is used to compare the receiver object (this) with the argument object (arg0) for equivalence.

    The default implementations of this method is an [http://en.wikipedia.org/wiki/Equivalence_relation equivalence relation]: * It is reflexive: for any instance x of type Any, x.equals(x) should return true. * It is symmetric: for any instances x and y of type Any, x.equals(y) should return true if and only if y.equals(x) returns true. * It is transitive: for any instances x, y, and z of type AnyRef if x.equals(y) returns true and y.equals(z) returns true, then x.equals(z) should return true.

    If you override this method, you should verify that your implementation remains an equivalence relation. Additionally, when overriding this method it is often necessary to override hashCode to ensure that objects that are "equal" (o1.equals(o2) returns true) hash to the same scala.Int (o1.hashCode.equals(o2.hashCode)).

    arg0

    the object to compare against this object for equality.

    returns

    true if the receiver object is equivalent to the argument; false otherwise.

    definition classes: AnyRef → Any
  18. def finalize () : Unit

    This method is called by the garbage collector on the receiver object when garbage collection determines that there are no more references to the object.

    This method is called by the garbage collector on the receiver object when garbage collection determines that there are no more references to the object.

    The details of when and if the finalize method are invoked, as well as the interaction between finalizeand non-local returns and exceptions, are all platform dependent.

    attributes: protected
    definition classes: AnyRef
  19. def getClass () : java.lang.Class[_]

    Returns a representation that corresponds to the dynamic class of the receiver object.

    Returns a representation that corresponds to the dynamic class of the receiver object.

    The nature of the representation is platform dependent.

    returns

    a representation that corresponds to the dynamic class of the receiver object.

    attributes: final
    definition classes: AnyRef
  20. def getTopicTermDistribution (topic: String) : Array[Double]

    Returns the distribution over terms for the given topic.

    Returns the distribution over terms for the given topic. The return value of this method is assumed to have already incorporated the corresponding getTermSmoothing to the appropriate extent.

    attributes: final
    definition classes: ClosedTopicSet
  21. def getTopicTermDistribution (topic: Int) : Array[Double]

    Returns the distribution over terms for the given topic.

    Returns the distribution over terms for the given topic. The return value of this method is assumed to have already incorporated the corresponding getTermSmoothing to the appropriate extent.

    definition classes: ClosedTopicSet
  22. def hashCode () : Int

    Returns a hash code value for the object.

    Returns a hash code value for the object.

    The default hashing algorithm is platform dependent.

    Note that it is allowed for two objects to have identical hash codes (o1.hashCode.equals(o2.hashCode)) yet not be equal (o1.equals(o2) returns false). A degenerate implementation could always return 0. However, it is required that if two objects are equal (o1.equals(o2) returns true) that they have identical hash codes (o1.hashCode.equals(o2.hashCode)). Therefore, when overriding this method, be sure to verify that the behavior is consistent with the equals method.

    returns

    the hash code value for the object.

    definition classes: AnyRef → Any
  23. def infer (doc: String) : Array[Double]

    Does inference on the given document until convergence.

    Does inference on the given document until convergence.

  24. def infer (doc: LDADocumentParams) : Array[Double]

    Does inference on the given document until convergence.

    Does inference on the given document until convergence.

  25. def infer (doc: Doc) : Array[Double]

    Does inference on the given document until convergence.

    Does inference on the given document until convergence.

    attributes: abstract
  26. def isInstanceOf [T0] : Boolean

    This method is used to test whether the dynamic type of the receiver object is T0.

    This method is used to test whether the dynamic type of the receiver object is T0.

    Note that the test result of the test is modulo Scala's erasure semantics. Therefore the expression1.isInstanceOf[String] will return false, while the expression List(1).isInstanceOf[List[String]] will return true. In the latter example, because the type argument is erased as part of compilation it is not possible to check whether the contents of the list are of the requested typed.

    returns

    true if the receiver object is an instance of erasure of type T0; false otherwise.

    attributes: final
    definition classes: Any
  27. val log : (String) ⇒ Unit

    Where log messages go.

    Where log messages go. Defaults to System.err.println.

    definition classes: TopicModel
  28. def ne (arg0: AnyRef) : Boolean

    o.ne(arg0) is the same as !(o.eq(arg0)).

    o.ne(arg0) is the same as !(o.eq(arg0)).

    arg0

    the object to compare against this object for reference dis-equality.

    returns

    false if the argument is not a reference to the receiver object; true otherwise.

    attributes: final
    definition classes: AnyRef
  29. def notify () : Unit

    Wakes up a single thread that is waiting on the receiver object's monitor.

    Wakes up a single thread that is waiting on the receiver object's monitor.

    attributes: final
    definition classes: AnyRef
  30. def notifyAll () : Unit

    Wakes up all threads that are waiting on the receiver object's monitor.

    Wakes up all threads that are waiting on the receiver object's monitor.

    attributes: final
    definition classes: AnyRef
  31. val numTerms : Int

    The number of terms in the model.

    The number of terms in the model.

    definition classes: LDATopicModel
  32. val numTopics : Int

    The number of topics in the model.

    The number of topics in the model.

    definition classes: LDAClosedTopicSet
  33. def pTopicTerm (topic: String, term: String) : Double

    Returns the probability of the given term in the given topic.

    Returns the probability of the given term in the given topic.

    definition classes: ClosedTopicSet
  34. def pTopicTerm (topic: Int, term: Int) : Double

    Returns the probability of the given term in the given topic.

    Returns the probability of the given term in the given topic.

    attributes: abstract
    definition classes: ClosedTopicSet
  35. val params : LDAModelParams

    The parameters used to create this model.

    The parameters used to create this model.

    attributes: abstract
    definition classes: LDATopicModel
  36. def registerCheck (check: Function0[_]) : Unit

    Registers a function as a checker of invariants.

    Registers a function as a checker of invariants.

    attributes: protected
    definition classes: RepCheck
  37. def reset () : Unit

    Resets to the default state.

    Resets to the default state.

    attributes: abstract
    definition classes: Stateful
  38. def state : ModelState

    Gets the current state of this object.

    Gets the current state of this object.

    attributes: abstract
    definition classes: Stateful
  39. def state_= (state: ModelState) : Unit

    Sets the current state of this object.

    Sets the current state of this object.

    attributes: abstract
    definition classes: Stateful
  40. def synchronized [T0] (arg0: T0) : T0

    attributes: final
    definition classes: AnyRef
  41. def termIndex : Option[Index[String]]

    The term index describing which terms are in the model.

    The term index describing which terms are in the model.

    attributes: final
    definition classes: TopicModel
  42. def termIndex_= (index: Option[Index[String]]) : Unit

    attributes: protected final
    definition classes: TopicModel
  43. def termSmoothDenom : Double

    attributes: protected
    definition classes: DirichletTermSmoothing
  44. def termSmoothing : Array[Double]

    Add-k prior counts for each term (eta in the model formulation).

    Add-k prior counts for each term (eta in the model formulation).

    attributes: final
    definition classes: DirichletTermSmoothing
  45. def termSmoothing_= (smoothing: Array[Double]) : Unit

    attributes: protected
    definition classes: DirichletTermSmoothing
  46. def toString () : String

    Returns a string representation of the object.

    Returns a string representation of the object.

    The default representation is platform dependent.

    returns

    a string representation of the object.

    definition classes: AnyRef → Any
  47. def tokenize (document: String) : Iterable[Int]

    Tokenizes the given input string using our stored tokenizer and term index, if available.

    Tokenizes the given input string using our stored tokenizer and term index, if available. Otherwise, throws an IllegalArgumentException.

    attributes: protected
    definition classes: TopicModel
  48. def tokenizer : Option[Tokenizer]

    The tokenizer used to break input documents into terms.

    The tokenizer used to break input documents into terms.

    attributes: final
    definition classes: TopicModel
  49. def tokenizer_= (tokenizer: Option[Tokenizer]) : Unit

    attributes: protected final
    definition classes: TopicModel
  50. var topicIndex : Option[Index[String]]

    The term index describing which terms are in the model.

    The term index describing which terms are in the model.

    definition classes: ClosedTopicSet
  51. def topicName (topic: Int) : String

    Gets the name for this topic.

    Gets the name for this topic.

    definition classes: ClosedTopicSet
  52. def topicSmoothing : Array[Double]

    Prior counts for each topic (alpha in the model formulation).

    Prior counts for each topic (alpha in the model formulation).

    attributes: final
    definition classes: DirichletTopicSmoothing
  53. def topicSmoothing_= (smoothing: Array[Double]) : Unit

    attributes: protected
    definition classes: DirichletTopicSmoothing
  54. def wait () : Unit

    attributes: final
    definition classes: AnyRef
  55. def wait (arg0: Long, arg1: Int) : Unit

    attributes: final
    definition classes: AnyRef
  56. def wait (arg0: Long) : Unit

    attributes: final
    definition classes: AnyRef

Inherited from DirichletTopicSmoothing

Inherited from DirichletTermSmoothing

Inherited from ClosedTopicSet

Inherited from TopicModel[LDAModelParams, ModelState, LDADocumentParams, Doc, DocState]

Inherited from RepCheck

Inherited from Stateful[ModelState]

Inherited from AnyRef

Inherited from Any