cs.CL · 2026-10-31 · No. 159

Computation and Language, 2026-10-31.

9 new papers in cs.CL. Titles, authors, abstracts. Links to arXiv. Want this in your inbox every morning? Subscribe →

01 — The papers

9 entries
  1. 01

    When to Assist and What to Suggest: Joint Gating and Memory-Grounded Hint Generation in One Compact Decoder

    A. J. A. Jubayer Talukder, Mohammad Ariful Haque

    cs.CL · cs.AI · cs.HC

    Proactive assistants offer short, memory-grounded hints during a conversation, deciding when to assist and what to suggest. Current systems split this between a gate and a larger generator; we evaluate both together on 28,058 decision points. Stage-wise generation scores are oracle-gate ceilings: behind a real gate, end-to-end exact match is 0.2619 against a ceiling of 0.2971, and end-to-end precision is 0.2387, leaving substantial headroom....

    arxiv.org/abs/2610.40611 · PDF

  2. 02

    Homebrewed SLMs: Autoregressive and Masked Diffusion Language Models Built at Home for Portuguese

    Pedro Carvalho Brom

    cs.CL · cs.LG

    Building a language model of one's own no longer requires a data centre. This tutorial trains one from scratch, tokenizer included, on one consumer GPU, and shows how to tell whether it is good for the tasks of a specialist domain. It proposes no new method. It releases a tested Python package and two notebooks in Brazilian Portuguese with autoregressive and masked diffusion generation on one network, a preregistered comparison protocol,...

    arxiv.org/abs/2610.40533 · PDF

  3. 03

    How I Aligned Your Model: Scaling Up Multilingual Safety Training with Templates

    Max Neuwinger, Hanna Yukhymenko, Imanol Schlag

    cs.CL · cs.AI · cs.LG

    Safety alignment for Large Language Models is heavily focused on English with limited multilingual representation, particularly damaging low-resource language performance. Related open training datasets are often limited in size or do not follow region-localized harmful topics to broaden the scope of alignment beyond cultures. We propose a scalable template-based augmentation pipeline to produce massive multilingual refusal and benign...

    arxiv.org/abs/2610.40516 · PDF

  4. 04

    Scaling Mathematical Proof Supervision from Structured Textbooks

    Youqing Fang, Zhouqi Hua, Yinhao Tang, Yuzhe Gu, Lingkai Kong, Bin Liu, Weiming Zhang, Kai Chen, Yanan Sun, Wenwei Zhang

    cs.CL · cs.AI

    Mathematical supervision for language models is typically flattened into isolated problem-solution pairs, discarding the curricular organization and evidential structure of the original sources. We introduce TOME-Math (Textbook-Oriented Mathematical Evidence), a large-scale corpus that converts 2,118 textbooks spanning the core areas of university-level mathematics subjects into approximately 380K structured proof-supervision records while...

    arxiv.org/abs/2610.40394 · PDF

  5. 05

    Decision and System One models in rheumatology: accuracy and calibration on specialty-training examination questions and diagnostic case vignettes

    Alfredo Madrid-García, Diego Benavent, Fabian Lechner, Phillip Kremer, Johannes Knitza, Beatriz Merino-Barbancho

    cs.CL · cs.AI

    Objectives: To evaluate the accuracy and calibration of Decision and System One models on rheumatology examination questions and diagnostic vignettes. Methods: Two benchmarks were analysed: 172 rheumatology questions from Spanish specialty-training examinations (expanded RheumaMIR dataset) in Spanish and English, and 70 English diagnostic vignettes from RheumBench with 5-18 candidate diagnoses, 52 of which included the reference diagnosis....

    arxiv.org/abs/2610.40318 · PDF

  6. 06

    Latent Path Exploration via Potential-Guided Subtrajectory Balance

    Xiaoling Zeng, Qi Zhang

    cs.CL · cs.LG

    Continuous latent reasoning enables language models to perform intermediate computation without generating explicit reasoning traces. Advances in stochastic latent reasoning allow multiple paths to be sampled in continuous space, but stochasticity alone does not ensure effective exploration. A key challenge is guiding stochastic transitions between intermediate latent states toward useful reasoning paths. We introduce SubLAT, which couples a...

    arxiv.org/abs/2610.40283 · PDF

  7. 07

    Upcycling Language Models for Multiple Specialized Domains

    Mingzi Cao, Xi Wang, Nikolaos Aletras

    cs.CL · cs.AI

    Effective multi-domain adaptation of large language models requires prioritizing relevant domain knowledge while minimizing interference from irrelevant domains. Existing approaches commonly use Low-Rank Adaptation (LoRA) to train a separate adapter for each domain and combine these adapters within one model. However, they either weight adapters equally regardless of the input domain or dynamically weight adapters while still activating all...

    arxiv.org/abs/2610.40091 · PDF

  8. 08

    Rethinking Pre-pretraining

    Alexander Stern, Tim Rocktäschel, Acyr Locatelli, Laura Ruis

    cs.CL · cs.AI

    We report that allocating compute to synthetic pre-pretraining (PPT) never outperforms pure natural-language training in our compute-matched experiments. This holds across four PPT curricula (k-Dyck, neural cellular automata (NCA), declarative reference corpora, and code) and three training regimes: data-constrained, data-unconstrained, and a high token-to-parameter-ratio regime (881M parameters trained on 50B tokens). When natural language...

    arxiv.org/abs/2610.40051 · PDF

  9. 09

    Prompts and probabilities in the linguistic assessment of language models: Evidence from semantic focus-sensitivity

    Robert Pasternak

    cs.CL · cs.AI

    As language models (LMs) have improved, an increasingly common means of evaluating their linguistic competence is through explicit prompting (e.g., "Which sentence is more acceptable?"). Prior work indicates that such prompting underperforms compared to standard token-probability-based methods in smaller models, but improves in larger models. We test this in a new domain: semantic focus-sensitivity, responsible for contrasts like "Lucy only...

    arxiv.org/abs/2610.39923 · PDF

This edition is part of The Daily Abstract — cs.CL archive. Subscribe to receive these in your inbox each morning, automatically translated to Spanish, with reply-to-PDF: arxivdaily.ignorelist.com.

Colophon Set in Georgia, with system sans for interface chrome and a monospaced stack for code and paper identifiers. Sole accent: amber #D99C5E. Built and served on an always-free VM. The masthead is set 14% letterspaced because newspapers do that and it works.