PeriFlow
generalOptimize large language model inference for cost and speed
general 369
General LLM tools include frameworks, APIs, evaluation utilities, and infrastructure specifically built around large language models. This category covers 369 tools that help developers build, test, fine-tune, and run applications on top of LLMs, from embedding calculators to full model-serving platforms.
Dstack
generalControl plane for GPU provisioning across clouds and clusters
Cognee
generalKnowledge graph platform for enterprises
UpTrain
generalEvaluate and monitor LLM applications
Gestell
generalConvert unstructured data into searchable databases for AI
LochBot
generalCheck LLM prompts against 31 jailbreak and injection patterns
AIWatch
generalReal-time status dashboard for 30+ AI services
Embedding Similarity Calculator
generalCompare vector embeddings using multiple distance metrics
Credyt
generalUsage-based monetization and billing for AI products
This is a technically focused category aimed primarily at developers and ML engineers. Tools like Cognee and UpTrain address retrieval-augmented generation (RAG) pipelines and model evaluation, while platforms like Dstack and PeriFlow handle compute infrastructure for training and inference. Embedding Similarity Calculator and similar utilities fill narrow but useful gaps in LLM development workflows. OpenAssistant and Cerebras-GPT represent open-source or open-weight models that developers can run or fine-tune directly. When comparing options, consider whether a tool is model-agnostic or tied to a specific provider, and whether it supports the models you are already using. Latency, throughput, and cost-per-token are the metrics that matter most for production workloads. Evaluation tools are often underinvested in early projects but become critical once you are shipping to users. Many tools here are open source with paid managed versions, while others are closed SaaS products with usage-based pricing.