Skip to main content

HierarchicalTopicModel

Struct HierarchicalTopicModel 

Source
pub struct HierarchicalTopicModel { /* private fields */ }
Expand description

Hierarchical LDA-style topic model with a tree-structured topic hierarchy.

See the module-level documentation for a full overview.

Implementations§

Source§

impl HierarchicalTopicModel

Source

pub fn new(config: HtmModelConfig) -> Self

Create a new model with the given configuration.

Source

pub fn add_topic_node( &mut self, parent: Option<HtmTopicNodeId>, label: Option<String>, ) -> Result<HtmTopicNodeId, String>

Add a new topic node to the hierarchy.

If parent is None the root node is used as the parent. Returns the new node’s ID. Returns an error string when the parent doesn’t exist or depth/children limits are exceeded.

Source

pub fn add_document(&mut self, tokens: &[&str]) -> HtmDocId

Add a document given a slice of string tokens.

Tokenisation: tokens are lower-cased; empty tokens are skipped. Returns the new document’s HtmDocId.

Source

pub fn run_inference(&mut self, n_iter: usize)

Run collapsed Gibbs sampling for n_iter iterations.

Each iteration sweeps all documents and re-samples each token’s topic assignment from the conditional posterior restricted to nodes on the document’s current root-to-leaf path.

Source

pub fn get_topic(&self, id: HtmTopicNodeId) -> Option<HtmTopic>

Retrieve an aggregated HtmTopic for the given node ID.

Returns None if the node doesn’t exist. The top-N words are computed using Laplace-smoothed probabilities (β smoothing).

Source

pub fn document_topics(&self, doc_id: HtmDocId) -> Vec<(HtmTopicNodeId, f64)>

Return proportional topic distribution along a document’s current path.

Each element is (topic_node_id, proportion) where proportion is the fraction of the document’s tokens assigned to that node. Sums to 1.0 (or 0.0 for empty documents).

Source

pub fn topic_hierarchy( &self, ) -> Vec<(u32, HtmTopicNodeId, Option<HtmTopicNodeId>)>

Return the full topic hierarchy as a flat list of (depth, node_id, parent_id) tuples sorted by depth then by node ID.

Source

pub fn compute_coherence(&self, topic_id: HtmTopicNodeId, top_n: usize) -> f64

Compute PMI-based coherence for a topic node using its top-top_n words.

The coherence score is the average pointwise mutual information for all pairs of top words, computed over the document corpus.

Returns 0.0 if the topic node doesn’t exist, has fewer than 2 words, or no documents.

Source

pub fn prune_empty_topics(&mut self)

Remove leaf topic nodes that have zero total word counts and no documents assigned.

The root node is never removed. Pruning is repeated until no further nodes can be removed.

Source

pub fn model_stats(&self) -> HtmModelStats

Return summary statistics for the current model state.

Source

pub fn n_topic_nodes(&self) -> usize

Return the number of topic nodes (including root).

Source

pub fn topic_node(&self, id: HtmTopicNodeId) -> Option<&HtmTopicNode>

Return a reference to a topic node, if it exists.

Source

pub fn vocab_size(&self) -> usize

Return the current vocabulary size.

Source

pub fn word_at(&self, idx: u32) -> Option<&str>

Return the word at a given vocabulary index.

Source

pub fn word_index(&self, word: &str) -> Option<u32>

Return the vocabulary index of a word (None if not present).

Source

pub fn get_document(&self, doc_id: HtmDocId) -> Option<&HtmDocument>

Retrieve a document by its ID.

Source

pub fn root_id(&self) -> HtmTopicNodeId

Return the ID of the root topic node.

Source

pub fn hash_bytes(data: &[u8]) -> u64

FNV-1a 64-bit hash helper (exposed for testing / external hashing needs).

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Allocation for T
where T: RefUnwindSafe + Send + Sync,

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<'a, T, E> AsTaggedExplicit<'a, E> for T
where T: 'a,

Source§

fn explicit(self, class: Class, tag: u32) -> TaggedParser<'a, Explicit, Self, E>

Source§

impl<'a, T, E> AsTaggedImplicit<'a, E> for T
where T: 'a,

Source§

fn implicit( self, class: Class, constructed: bool, tag: u32, ) -> TaggedParser<'a, Implicit, Self, E>

Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T> Instrument for T

Source§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided Span, returning an Instrumented wrapper. Read more
Source§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

impl<T> Pointable for T

Source§

const ALIGN: usize

The alignment of pointer.
Source§

type Init = T

The type for initializers.
Source§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
Source§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
Source§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
Source§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,

Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
Source§

impl<SS, SP> SupersetOf<SS> for SP
where SS: SubsetOf<SP>,

Source§

fn to_subset(&self) -> Option<SS>

The inverse inclusion map: attempts to construct self from the equivalent element of its superset. Read more
Source§

fn is_in_subset(&self) -> bool

Checks if self is actually part of its subset T (and can be converted to it).
Source§

fn to_subset_unchecked(&self) -> SS

Use with care! Same as self.to_subset but without any property checks. Always succeeds.
Source§

fn from_subset(element: &SS) -> SP

The inclusion map: converts self to the equivalent element of its superset.
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
Source§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

Source§

fn vzip(self) -> V

Source§

impl<T> WithSubscriber for T

Source§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a WithDispatch wrapper. Read more
Source§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a WithDispatch wrapper. Read more