An article published on October 27, 2025 proposes Tensor Product Attention, which represents queries, keys, and values with contextual low-rank components to seek lower KV cache memory use during inference.
Published on October 26, 2025, the entry describes Penny as a hand-built, open-source GPU communication library whose implementation can be examined and whose development can receive contributions.
A family of 7B–72B reward models based on EditReward-Bench is presented as support for RL training and, according to the post, outperforms GPT-5 on that benchmark.
An article published on October 24, 2025 presents DiscoRL, a method using meta-learning across agents and environments to discover reinforcement learning update rules.
An article dated October 24, 2025, examines reverse KL and forward KL in reinforcement learning, questioning whether the familiar intuition about mode-seeking and mass-covering applies directly.
Published on October 23, 2025, the work presents BAPO, a method using balanced policy optimization and adaptive clipping for off-policy training scenarios such as partial rollout and experience reuse.
A study published on October 23, 2025, revisits domain-specific fine-tuning of language models. Its summary says lower learning rates may preserve general capabilities while maintaining performance in the target domain.
The publication presents MoGA, a Mixture-of-Groups Attention approach for end-to-end long-video generation. The brief provides no implementation details or performance results.
Published on October 22, 2025, the post presents an OCR model for PDFs and scans, supporting tables, equations, and handwriting. Its approach combines synthetic data and unit tests as verifiable rewards.
Published on October 22, 2025, the summary presents Ring-1T, a reasoning MoE model with one trillion parameters and about 50 billion active per token, and describes its three-stage training.
Published on October 21, 2025, the post covers choosing OCR models, comparing leading options, deploying them locally or remotely, and exploring uses beyond OCR.
Published on October 21, 2025: Text-to-LoRA creates task-specific LoRA adapters for Mistral-7B-Instruct from text descriptions. Across 479 tasks, it reached 67.7% average accuracy.
A report published on October 21, 2025, describes rumors of a 16-core AMD processor with 192 MB of L3 cache and a 200 W TDP; the specifications are not official confirmation.
Published on October 20, 2025, the announcement describes a router board with a MediaTek MT7988A SoC, 8 GB of RAM, multiple Ethernet interfaces, and a Wi-Fi 7 option.
Published on October 20, 2025, version 2 of the MTEB suite introduces simplified evaluation, multimodal support, rerankers, new interfaces, documentation, dataset statistics, and migration guidance.
In a post dated October 19, 2025, Tencent presents LaSeR, a reinforcement learning algorithm that aligns last-token scores with real rewards for reasoning and LLM self-rewarding. The post mentions one extra token inference.