arXiv 2402.03300
DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
By Zhihong Shao, Peiyi Wang, et al.
Published 2024-02-05
Mindmap
Browse the paper's core ideas, clusters, and relationships in a structured outline.
Mathematical reasoning poses a significant challenge for language models due to its complex and structured nature. In this paper, we introduce DeepSeekMath 7B, which continues pre-training DeepSeek-Coder-Base-v1.5 7B with 120B math-related tokens sourced from Common Crawl, together with natural language and code data. DeepSeekMath 7B has achieved an impressive score of 51.7% on the competition-level MATH benchmark w…