Module ml_clients

Module ml_clients 

Source
Expand description

AI/ML API Client Integrations

This module provides async clients for AI/ML platforms including:

  • HuggingFace: Model hub and inference
  • Ollama: Local LLM inference
  • Replicate: Cloud ML models
  • TogetherAI: Open source model hosting
  • Papers With Code: ML research papers and benchmarks

All clients follow the framework’s patterns with rate limiting, mock fallbacks, and conversion to SemanticVector format for RuVector discovery.

Structs§

ClassificationResult
DatasetsResponse
Papers With Code datasets list response
GenerationResult
HuggingFaceClient
Client for HuggingFace model hub and inference API
HuggingFaceDataset
HuggingFace dataset information
HuggingFaceInferenceInput
HuggingFace inference input
HuggingFaceModel
HuggingFace model information
InferenceError
Method
Papers With Code method/technique
OllamaChatMessage
Ollama chat message
OllamaChatRequest
Ollama chat request
OllamaChatResponse
Ollama chat response
OllamaClient
Client for Ollama local LLM inference
OllamaEmbeddingsRequest
Ollama embeddings request
OllamaEmbeddingsResponse
Ollama embeddings response
OllamaGenerateRequest
Ollama generation request
OllamaGenerateResponse
Ollama generation response
OllamaMessage
OllamaModel
Ollama model information
OllamaModelsResponse
Ollama model list response
PaperAuthor
PaperWithCodeDataset
Papers With Code dataset
PaperWithCodePaper
Papers With Code paper
PapersSearchResponse
Papers With Code search results
PapersWithCodeClient
Client for Papers With Code ML research database
ReplicateClient
Client for Replicate cloud ML model API
ReplicateCollection
Replicate collection
ReplicateModel
Replicate model information
ReplicatePrediction
Replicate prediction response
ReplicatePredictionRequest
Replicate prediction request
ReplicateVersion
Replicate model version
SotaEntry
Papers With Code SOTA (State of the Art) benchmark result
TogetherAiClient
Client for TogetherAI open source model hosting
TogetherChatRequest
TogetherAI chat completion request
TogetherChatResponse
TogetherAI chat completion response
TogetherChoice
TogetherEmbeddingData
TogetherEmbeddingsRequest
TogetherAI embeddings request
TogetherEmbeddingsResponse
TogetherAI embeddings response
TogetherMessage
TogetherModel
TogetherAI model information
TogetherPricing
TogetherUsage

Enums§

HuggingFaceInferenceResponse
HuggingFace inference response