LLM API
A hosted service that lets your app send prompts to a language model and receive generated text or structured output.
Compare LLM APIsAI definitions
Use this glossary when a tutorial, FAQ, or provider page assumes vocabulary you have not learned yet. Each definition links back to a practical FreeGrid guide.
Last updated September 17, 2026. Free tiers, model access, and dataset terms can change; verify official sources before launch.
A hosted service that lets your app send prompts to a language model and receive generated text or structured output.
Compare LLM APIsA vector representation that lets software compare meaning, not only exact keywords.
Compare embeddingsRetrieval-augmented generation: retrieve relevant source chunks first, then generate an answer grounded in those chunks.
Build RAGA storage and search system for embeddings, metadata, and similarity queries.
Compare vector DBsA model that reorders retrieved chunks so the answer model sees the most relevant evidence first.
RAG model guideThe amount of text or tokens a model can consider at once. Larger context helps, but better retrieval still matters.
Use context wiselyA piece of text used for model input and output accounting. Token count affects cost, latency, and context limits.
Estimate costA provider rule that caps requests, tokens, or usage over time. Good apps handle limits with retries and fallback UX.
Rate-limit guideA workflow where a model plans or decides steps and calls tools under constraints, logs, and approvals.
Agent stackOptical character recognition extracts text from scanned documents or images before search, RAG, or analysis.
OCR alternativesTraining a model further on task-specific examples. It is useful sometimes, but many projects should improve retrieval and prompts first.
Model selectionA language model running on your own computer or server instead of a hosted API.
Local vs APIAn open standard that connects AI applications to tools and data - like a USB-C port for AI apps. Build one MCP server and every compatible client can use it.
MCP guideA model that generates and refines many tokens in parallel instead of sequentially, trading the classic autoregressive pipeline for extreme speed - Mercury 2.5 exceeds 1,100 tokens/sec this way.
See it in the model waveMixture-of-Experts architecture where only a fraction of the parameters activate per token - DeepSeek V4.1 Flash runs 552B parameters while activating just 8B per input token, keeping costs near free-tier levels.
Compare cheap modelsThe token waste from running too many parallel sub-agents: they duplicate work and double-check each other without quality gains. OpenAI's Codex team recommends keeping it to about two.
Agent cost disciplineMaking content quotable by AI search: direct answers first, FAQPage schema, dated freshness signals, and comparison tables that AI Overviews and answer engines can cite verbatim.
The GEO playbookA model served through a router under an anonymous provider name - Union Alpha on OpenRouter is a free frontier-level example. Great for experiments; never send sensitive data.
Free model pathsStudy path
Start with API, model, token, and latency. Then learn embeddings, vector databases, RAG, reranking, and evaluation. After that, compare local deployment, fine-tuning, observability, and cost controls.
People also ask
Start with API, model, prompt, token, and latency. Those terms appear in almost every AI project decision.
Search retrieves relevant information. RAG uses retrieved information as context so a model can generate an answer with sources.
Embeddings help retrieve similar information. Fine-tuning changes model behavior with training examples. Many RAG projects need better embeddings before they need fine-tuning.