Generative AI & LLMsCohere is a Toronto-based AI company specialized in enterprise LLMs and retrieval. Founded in 2019 by Aidan Gomez (Transformer paper co-author), Ivan Zhang, and Nick Frosst, it offers Command R+, Embed v4, and Rerank for regulated industries.
Generative AI & LLMsTree of Thoughts is an LLM inference framework introduced by Yao et al. (NeurIPS 2023) that generalizes Chain of Thought by exploring multiple reasoning paths as a tree. This guide covers the algorithm, the Game of 24 benchmark with a 74% success rate, and production implementation patterns.
Machine Learning & Deep LearningTest-time Compute is the practice of spending more compute at inference to improve accuracy. This guide covers OpenAI o1/o3, DeepSeek-R1, the Chain-of-Thought connection, and how production systems balance latency, cost, and quality.
Generative AI & LLMsCodestral is Mistral AI's coding-specialized LLM released in May 2024. This guide covers the 22B-parameter open-weight model, support for 80+ programming languages, the 256K context window, the HumanEval 86.6% benchmark, and the 25.08 production update.
Generative AI & LLMsThe Web Search Tool is Anthropic's official real-time search feature for the Claude API. This guide covers how it works, pricing of $10 per 1,000 searches, implementation patterns, and how it differs from RAG.
Machine Learning & Deep LearningMamba is a Selective State Space Model architecture introduced by Gu and Dao in 2023 that scales linearly with sequence length, addressing the Transformer's quadratic-attention bottleneck. Hybrid Mamba-Attention models like Qwen3.6 and Jamba ship in production today.
Machine Learning & Deep LearningSpeculative Decoding accelerates LLM inference 2-3x without changing the output distribution. A small draft model proposes tokens, the target model verifies them in a single forward pass, and only matching tokens are accepted. Standard in vLLM, TGI, and TensorRT-LLM.
Generative AI & LLMsQwen3 is Alibaba's flagship open-weight LLM family. The 2026 Qwen3.6 generation includes a 27B dense model under Apache 2.0 with frontier-class agentic coding scores, plus a 1-trillion-parameter MoE Max-Preview accessed via Alibaba Cloud Model Studio.
Generative AI & LLMsCodex CLI is OpenAI's open-source coding agent that runs in your terminal. Built in Rust, it pairs with frontier models like GPT-5.5 to read, modify, and execute code on your machine, making it a direct competitor to Anthropic's Claude Code.
Generative AI & LLMsThe Message Batches API is Anthropic's asynchronous batch processing endpoint for Claude that handles up to 100,000 requests per batch within 24 hours at a flat 50% discount on both input and output tokens compared to the standard Messages API.
