Skip to main content

Enhancing Non-Core Language Instruction-Following in Speech LLMs via Semi-Implicit Cross-Lingual CoT Reasoning

Hongfei Xue, Yufeng Tang, Hexin Liu, Jun Zhang, Xuelong Geng, Lei Xie

Trains speech language models to transcribe a question, translate it into English, form an English response, and answer in the original language. Progressively shortens the intermediate text while retaining sentence openings, reducing the amount of reasoning text generated.

First public: · Added to this list: November 9, 2026

Cite this paper

ArXiv preprint

arXiv:2504.20835 · Initial submission: 2025-04-29

BibTeX · CSL-JSON

Explore this approach

Internalized reasoning — Learn from worked solutions so that some or all of the reasoning can later happen without writing those steps. Training may use a separate teacher model or progressively remove written steps from the model being trained.