{"entry_id": "e2037d5a-8b92-413a-bcd2-369736769fb8", "infos": [{"txt": "ICLR 2024重磅论文！", "language": "chinese", "position": {"atoms": [{"position_id": 0, "txt": "ICLR 2024重磅论文！", "x": ""}]}, "tags": [], "label": "O", "web_segment_id": 0, "global_sentence_id": 0, "edu_l1_label": "EDU_O"}, {"txt": "华人团队揭开OpenAI o1模型核心技术成功秘诀", "language": "chinese", "position": {"atoms": [{"position_id": 0, "txt": "华人团队揭开OpenAI o1模型核心技术成功秘诀", "x": ""}]}, "tags": [], "label": "O", "web_segment_id": 0, "global_sentence_id": 1, "edu_l1_label": "EDU_O"}, {"txt": "            ICLR 2024重磅论文！", "language": "chinese", "position": {"atoms": [{"position_id": 548, "txt": "\n            \nICLR 2024重磅论文！", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/h1"}]}, "tags": ["h1"], "label": "article_title", "web_segment_id": 37, "global_sentence_id": 2, "edu_l1_label": "BOT"}, {"txt": "华人团队揭开OpenAI o1模型核心技术成功秘诀          ", "language": "chinese", "position": {"atoms": [{"position_id": 549, "txt": "华人团队揭开OpenAI o1模型核心技术成功秘诀\n          ", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/h1"}]}, "tags": ["h1"], "label": "article_title", "web_segment_id": 37, "global_sentence_id": 3, "edu_l1_label": "BOT"}, {"txt": "OpenAI新发布的o1推理模型在AI领域引起广泛关注，它不仅在性能上有提升，更重要是在技术上实现重大突破，特别是强化学习和“私密思维链”的应用，让AI模型具备更接近人类的“思考”能力。", "language": "chinese", "position": {"atoms": [{"position_id": 551, "txt": "OpenAI新发布的o1推理模型在AI领域引起广泛关注，它不仅在性能上有提升，更重要是在技术上实现重大突破，特别是强化学习和“私密思维链”的应用，让AI模型具备更接近人类的“思考”能力。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[1]"}]}, "tags": [], "label": "content", "web_segment_id": 39, "global_sentence_id": 4, "edu_l1_label": "BOS"}, {"txt": "有关这项技术的核心原理，谷歌和斯坦福大学的研究人员在今年1月份ICLR 2024会议上已提出一些相关概念。", "language": "chinese", "position": {"atoms": [{"position_id": 553, "txt": "有关这项技术的核心原理，谷歌和斯坦福大学的研究人员在今年1月份ICLR 2024会议上已提出一些相关概念。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[1]/span[1]"}]}, "tags": [], "label": "content", "web_segment_id": 39, "global_sentence_id": 5, "edu_l1_label": "IOS"}, {"txt": "据相关报道，谷歌DeepMind的研究人员在8月份发表的一篇论文中揭示了o1模型的工作原理，即测试时计算比扩展模型参数更有效。", "language": "chinese", "position": {"atoms": [{"position_id": 555, "txt": "据相关报道，谷歌DeepMind的研究人员在8月份发表的一篇论文中揭示了o1模型的工作原理，即测试时计算比扩展模型参数更有效。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[1]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 39, "global_sentence_id": 6, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/UdvNKNFQ8P4zVMC84cNZ93.jpeg", "language": "chinese", "position": {"atoms": [{"position_id": 58, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/UdvNKNFQ8P4zVMC84cNZ93.jpeg", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[1]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 40, "global_sentence_id": 7, "edu_l1_label": "EDU_O"}, {"txt": "早在今年1月份，谷歌和斯坦福大学的研究人员在ICLR 2024会议上提出了思维链赋能Transformer的概念 。", "language": "chinese", "position": {"atoms": [{"position_id": 557, "txt": "早在今年", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[4]/span[1]"}, {"position_id": 559, "txt": "1月份，谷歌和斯坦福大学的研究人员在ICLR 2024会议上提出了思维链赋能Transformer的概念 。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[4]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 41, "global_sentence_id": 8, "edu_l1_label": "IOS"}, {"txt": "他们发表的名为“思维链赋能Transformer解决本质上的串行问题”的论文揭示了思维链在提升Transformer模型串行推理能力方面的潜力。", "language": "chinese", "position": {"atoms": [{"position_id": 560, "txt": "他们发表的名为“思维链赋能Transformer解决本质上的串行问题”的论文揭示了思维链在提升Transformer模型串行推理能力方面的潜力。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[4]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 41, "global_sentence_id": 9, "edu_l1_label": "IOS"}, {"txt": "虽然OpenAI并未直接引用该论文，但o1模型的成功无疑受到了这类研究的启发和影响。", "language": "chinese", "position": {"atoms": [{"position_id": 561, "txt": "虽然OpenAI并未直接引用该论文，但o1模型的成功无疑受到了这类研究的启发和影响。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[4]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 41, "global_sentence_id": 10, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/3eDITOVQape17peOb3Tce7h.png", "language": "chinese", "position": {"atoms": [{"position_id": 70, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/3eDITOVQape17peOb3Tce7h.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[2]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 42, "global_sentence_id": 11, "edu_l1_label": "EDU_O"}, {"txt": "论文地址：", "language": "chinese", "position": {"atoms": [{"position_id": 563, "txt": "论文地址：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[7]/span"}]}, "tags": [], "label": "content", "web_segment_id": 43, "global_sentence_id": 12, "edu_l1_label": "IOS"}, {"txt": "https://arxiv.org/pdf/2408.03314v1", "language": "chinese", "position": {"atoms": [{"position_id": 565, "txt": "https://arxiv.org/pdf/2408.03314v1", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[8]/span"}]}, "tags": [], "label": "content", "web_segment_id": 44, "global_sentence_id": 13, "edu_l1_label": "EDU_O"}, {"txt": "这篇名为“思维链赋能 Transformer 解决本质上的串行问题”的论文，是由清华大学姚班的李志远、Hong Liu、Google Brain推理团队创始人Denny Zhou以及斯坦福大学助理教授马腾宇共同发表。", "language": "chinese", "position": {"atoms": [{"position_id": 567, "txt": "这篇名为“思维链赋能 Transformer 解决本质上的串行问题”的论文，是由清华大学姚班的李志远、Hong Liu、Google Brain推理团队创始人Denny Zhou以及斯坦福大学助理教授马腾宇共同发表。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[10]"}]}, "tags": [], "label": "content", "web_segment_id": 45, "global_sentence_id": 14, "edu_l1_label": "IOS"}, {"txt": "论文通过数学证明展示了思维链（Chain-of-Thought, CoT）能够显著提升Transformer的表达能力和解决问题的能力。", "language": "chinese", "position": {"atoms": [{"position_id": 568, "txt": "论文通过数学证明展示了思维链（Chain-of-Thought, CoT）能够显著提升Transformer的表达能力和解决问题的能力。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[10]"}]}, "tags": [], "label": "content", "web_segment_id": 45, "global_sentence_id": 15, "edu_l1_label": "IOS"}, {"txt": "研究发现只要思维链足够长，Transformer就能够解决任何问题。", "language": "chinese", "position": {"atoms": [{"position_id": 569, "txt": "研究发现只要思维链足够长，Transformer就能够解决任何问题。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[10]"}]}, "tags": [], "label": "content", "web_segment_id": 45, "global_sentence_id": 16, "edu_l1_label": "IOS"}, {"txt": "这项研究不仅验证了CoT在提升模型表达能力方面的重要作用，还为未来的研究和发展提供了重要的理论基础 。", "language": "chinese", "position": {"atoms": [{"position_id": 570, "txt": "这项研究不仅验证了CoT在提升模型表达能力方面的重要作用，还为未来的研究和发展提供了重要的理论基础 。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[10]"}]}, "tags": [], "label": "content", "web_segment_id": 45, "global_sentence_id": 17, "edu_l1_label": "IOS"}, {"txt": "虽然OpenAI的o1模型在AI领域是一项重大突破，但其背后的核心原理和技术概念在学术界已有相应的研究和讨论。", "language": "chinese", "position": {"atoms": [{"position_id": 572, "txt": "虽然OpenAI的o1模型在AI领域是一项重大突破，但其背后的核心原理和技术概念在学术界已有相应的研究和讨论。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[10]/span"}]}, "tags": [], "label": "content", "web_segment_id": 45, "global_sentence_id": 18, "edu_l1_label": "IOS"}, {"txt": "这些研究为o1模型的发展奠定了理论基础，并指明了未来的研究方向。", "language": "chinese", "position": {"atoms": [{"position_id": 573, "txt": "这些研究为o1模型的发展奠定了理论基础，并指明了未来的研究方向。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[10]/span"}]}, "tags": [], "label": "content", "web_segment_id": 45, "global_sentence_id": 19, "edu_l1_label": "IOS"}, {"txt": "就在OpenAI o1推出不久后，这篇论文的作者之一 Denny Zhou（DeepMind 的首席科学家） 发出感慨：", "language": "chinese", "position": {"atoms": [{"position_id": 575, "txt": "就在OpenAI o1推出不久后，这篇论文的作者之一 ", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[12]/span/span[1]"}, {"position_id": 577, "txt": "Denny Zhou", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[12]/span/span[2]"}, {"position_id": 579, "txt": "（DeepMind 的首席科学家） 发出感慨：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[12]/span/span[3]"}]}, "tags": [], "label": "content", "web_segment_id": 46, "global_sentence_id": 20, "edu_l1_label": "IOS"}, {"txt": "“LLM 推理能力的极限是什么？", "language": "chinese", "position": {"atoms": [{"position_id": 581, "txt": "“LLM 推理能力的极限是什么？", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/blockquote/p/span"}]}, "tags": [], "label": "content", "web_segment_id": 47, "global_sentence_id": 21, "edu_l1_label": "IOS"}, {"txt": "天空才是极限。", "language": "chinese", "position": {"atoms": [{"position_id": 582, "txt": "天空才是极限。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/blockquote/p/span"}]}, "tags": [], "label": "content", "web_segment_id": 47, "global_sentence_id": 22, "edu_l1_label": "IOS"}, {"txt": "我们已经用数学方法证明了 Transformer 可以解决任何问题，只要允许它们根据需要生成任意数量的中间推理 token。", "language": "chinese", "position": {"atoms": [{"position_id": 583, "txt": "我们已经用数学方法证明了 Transformer 可以解决任何问题，只要允许它们根据需要生成任意数量的中间推理 token。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/blockquote/p/span"}]}, "tags": [], "label": "content", "web_segment_id": 47, "global_sentence_id": 23, "edu_l1_label": "IOS"}, {"txt": "值得注意的是，恒定深度就足够了。”", "language": "chinese", "position": {"atoms": [{"position_id": 584, "txt": "值得注意的是，恒定深度就足够了。”", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/blockquote/p/span"}]}, "tags": [], "label": "content", "web_segment_id": 47, "global_sentence_id": 24, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1PctpN1ToTh31hmtXOwtHaz.png", "language": "chinese", "position": {"atoms": [{"position_id": 96, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1PctpN1ToTh31hmtXOwtHaz.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[3]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 48, "global_sentence_id": 25, "edu_l1_label": "EDU_O"}, {"txt": "简单来说，这篇论文的核心思想就是：", "language": "chinese", "position": {"atoms": [{"position_id": 586, "txt": "简单来说，这篇论文的核心思想就是：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[14]/span"}]}, "tags": [], "label": "content", "web_segment_id": 49, "global_sentence_id": 26, "edu_l1_label": "IOS"}, {"txt": "只要给 LLM 足够的时间去“思考”，它就能解决任何问题！", "language": "chinese", "position": {"atoms": [{"position_id": 588, "txt": "只要给 LLM 足够的时间去“思考”，它就能解决任何问题！", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[14]/span/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 49, "global_sentence_id": 27, "edu_l1_label": "IOS"}, {"txt": " 而这个“思考”过程，就是通过生成一系列中间推理 token 来实现的。", "language": "chinese", "position": {"atoms": [{"position_id": 590, "txt": " 而这个“思考”过程，就是通过生成一系列中间推理 token 来实现的。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[14]/span/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 49, "global_sentence_id": 28, "edu_l1_label": "IOS"}, {"txt": "OpenAI o1 的发布，恰恰抢先证明了这篇论文的价值。", "language": "chinese", "position": {"atoms": [{"position_id": 591, "txt": "OpenAI o1 的发布，恰恰抢先证明了这篇论文的价值。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[14]/span/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 49, "global_sentence_id": 29, "edu_l1_label": "IOS"}, {"txt": "o1的发布，直接带OpenAI迈入新的台阶。", "language": "chinese", "position": {"atoms": [{"position_id": 593, "txt": "o1的发布，直接带OpenAI迈入新的台阶。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[16]/span[1]"}]}, "tags": [], "label": "content", "web_segment_id": 50, "global_sentence_id": 30, "edu_l1_label": "IOS"}, {"txt": "Sam Altman最近自豪发文表示：", "language": "chinese", "position": {"atoms": [{"position_id": 594, "txt": "Sam Altman最近自豪发文表示：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[16]/span[1]"}]}, "tags": [], "label": "content", "web_segment_id": 50, "global_sentence_id": 31, "edu_l1_label": "IOS"}, {"txt": "虽然花了一些时间，但OpenAI已经实现了第三个目标！", "language": "chinese", "position": {"atoms": [{"position_id": 595, "txt": "虽然花了一些时间，但OpenAI已经实现了第三个目标！", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[16]/span[1]"}]}, "tags": [], "label": "content", "web_segment_id": 50, "global_sentence_id": 32, "edu_l1_label": "IOS"}, {"txt": "如今，OpenAI真的把2016年的博客文章OpenAI Technical goals里的目标3实现了。", "language": "chinese", "position": {"atoms": [{"position_id": 596, "txt": "如今，OpenAI真的把2016年的博客文章OpenAI Technical goals", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[16]/span[1]"}, {"position_id": 598, "txt": "里的目标3实现了。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[16]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 50, "global_sentence_id": 33, "edu_l1_label": "IOS"}, {"txt": "这篇博文的作者是Ilya Sutskever、Greg Brockman、Sam Altman和Elon Musk。", "language": "chinese", "position": {"atoms": [{"position_id": 599, "txt": "这篇博文的", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[16]/span[2]"}, {"position_id": 601, "txt": "作者是Ilya Sutskever、Greg Brockman、Sam Altman和Elon Musk。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[16]/span[3]"}]}, "tags": [], "label": "content", "web_segment_id": 50, "global_sentence_id": 34, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1RqQr61ooR891llAd7337bc6.jpeg", "language": "chinese", "position": {"atoms": [{"position_id": 115, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1RqQr61ooR891llAd7337bc6.jpeg", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[4]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 51, "global_sentence_id": 35, "edu_l1_label": "EDU_O"}, {"txt": "目标1：", "language": "chinese", "position": {"atoms": [{"position_id": 603, "txt": "目标1：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[20]/span/span"}]}, "tags": [], "label": "content", "web_segment_id": 52, "global_sentence_id": 36, "edu_l1_label": "IOS"}, {"txt": "衡量我们的进展", "language": "chinese", "position": {"atoms": [{"position_id": 604, "txt": "衡量我们的进展", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[20]/span/span"}]}, "tags": [], "label": "content", "web_segment_id": 52, "global_sentence_id": 37, "edu_l1_label": "IOS"}, {"txt": "目标2：", "language": "chinese", "position": {"atoms": [{"position_id": 606, "txt": "目标2：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[20]/span/span/br[2]"}]}, "tags": ["br"], "label": "content", "web_segment_id": 53, "global_sentence_id": 38, "edu_l1_label": "IOS"}, {"txt": "打造一个家用机器人", "language": "chinese", "position": {"atoms": [{"position_id": 607, "txt": "打造一个家用机器人", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[20]/span/span/br[2]"}]}, "tags": ["br"], "label": "content", "web_segment_id": 53, "global_sentence_id": 39, "edu_l1_label": "IOS"}, {"txt": "目标3：", "language": "chinese", "position": {"atoms": [{"position_id": 609, "txt": "目标3：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[20]/span/span/br[4]"}]}, "tags": ["br"], "label": "content", "web_segment_id": 54, "global_sentence_id": 40, "edu_l1_label": "IOS"}, {"txt": "构建一个具有实用自然语言理解能力的智能体", "language": "chinese", "position": {"atoms": [{"position_id": 610, "txt": "构建一个具有实用自然语言理解能力的智能体", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[20]/span/span/br[4]"}]}, "tags": ["br"], "label": "content", "web_segment_id": 54, "global_sentence_id": 41, "edu_l1_label": "IOS"}, {"txt": "目标4：", "language": "chinese", "position": {"atoms": [{"position_id": 612, "txt": "目标4：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[20]/span/span/br[6]"}]}, "tags": ["br"], "label": "content", "web_segment_id": 55, "global_sentence_id": 42, "edu_l1_label": "IOS"}, {"txt": "使用单一智能体解决多种游戏", "language": "chinese", "position": {"atoms": [{"position_id": 613, "txt": "使用单一智能体解决多种游戏", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[20]/span/span/br[6]"}]}, "tags": ["br"], "label": "content", "web_segment_id": 55, "global_sentence_id": 43, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/4iigMNCLsYz2de0qk17pyoc.jpeg", "language": "chinese", "position": {"atoms": [{"position_id": 133, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/4iigMNCLsYz2de0qk17pyoc.jpeg", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[5]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 56, "global_sentence_id": 44, "edu_l1_label": "EDU_O"}, {"txt": "o1模型为何如此重要？", "language": "chinese", "position": {"atoms": [{"position_id": 615, "txt": "o1模型为何如此重要？", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[23]/span"}]}, "tags": [], "label": "content", "web_segment_id": 57, "global_sentence_id": 45, "edu_l1_label": "IOS"}, {"txt": "Fixie创始人、AI研究员Matt Welsh认为原因就在于它将AI模型中的「思维链推理」能力带给大众。", "language": "chinese", "position": {"atoms": [{"position_id": 616, "txt": "Fixie创始人、AI研究员Matt Welsh认为原因就在于它将AI模型中的「思维链推理」能力带给大众。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[23]/span"}]}, "tags": [], "label": "content", "web_segment_id": 57, "global_sentence_id": 46, "edu_l1_label": "IOS"}, {"txt": "推理能力直接内置模型中，无需借助额外工具就能达到类似效果。", "language": "chinese", "position": {"atoms": [{"position_id": 617, "txt": "推理能力直接内置模型中，无需借助额外工具就能达到类似效果。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[23]/span"}]}, "tags": [], "label": "content", "web_segment_id": 57, "global_sentence_id": 47, "edu_l1_label": "IOS"}, {"txt": "他预计这将大幅提高人们对AI模型能力的期望。", "language": "chinese", "position": {"atoms": [{"position_id": 618, "txt": "他预计这将大幅提高人们对AI模型能力的期望。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[23]/span"}]}, "tags": [], "label": "content", "web_segment_id": 57, "global_sentence_id": 48, "edu_l1_label": "IOS"}, {"txt": "然而大家很快发现「华点」：", "language": "chinese", "position": {"atoms": [{"position_id": 619, "txt": "然而大家很快发现「华点」：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[23]/span"}]}, "tags": [], "label": "content", "web_segment_id": 57, "global_sentence_id": 49, "edu_l1_label": "IOS"}, {"txt": "一旦向o1询问CoT过程，就会收到「封号」警告。", "language": "chinese", "position": {"atoms": [{"position_id": 620, "txt": "一旦向o1询问CoT过程，就会收到「封号」警告。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[23]/span"}]}, "tags": [], "label": "content", "web_segment_id": 57, "global_sentence_id": 50, "edu_l1_label": "IOS"}, {"txt": "为什么？", "language": "chinese", "position": {"atoms": [{"position_id": 622, "txt": "为什么？", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[24]"}]}, "tags": [], "label": "content", "web_segment_id": 58, "global_sentence_id": 51, "edu_l1_label": "IOS"}, {"txt": "网友由此猜测 o1可能并不是一个新模型，而是更小的模型与gpt协同工作，亦或只是提示工程。", "language": "chinese", "position": {"atoms": [{"position_id": 624, "txt": "网友由此猜测 o1可能并不是一个新模型，而是更小的模型与gpt协同工作，亦或只是提示工程。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[24]/span[1]"}]}, "tags": [], "label": "content", "web_segment_id": 58, "global_sentence_id": 52, "edu_l1_label": "IOS"}, {"txt": "如果公布完整的思维链，可能就会有人根据模型在思考时产生的推理痕迹进行训练，从而得到更好的开源模型。", "language": "chinese", "position": {"atoms": [{"position_id": 626, "txt": "如果公布完整的思维链，可能就会有人根据模型在思考时产生的推理痕迹进行训练，从而得到更好的开源模型。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[24]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 58, "global_sentence_id": 53, "edu_l1_label": "IOS"}, {"txt": "还有人发现o1背后的技术原理，谷歌也早就发现了，但OpenAI更快。", "language": "chinese", "position": {"atoms": [{"position_id": 627, "txt": "还", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[24]/span[2]"}, {"position_id": 629, "txt": "有人发现o1背后的技术原理，谷歌也早就发现了，", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[24]/span[3]/span"}, {"position_id": 631, "txt": "但OpenAI更快。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[24]/span[3]/span/span"}]}, "tags": [], "label": "content", "web_segment_id": 58, "global_sentence_id": 54, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/27e0hgIlrFq3QRRX844talL.jpeg", "language": "chinese", "position": {"atoms": [{"position_id": 150, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/27e0hgIlrFq3QRRX844talL.jpeg", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[6]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 59, "global_sentence_id": 55, "edu_l1_label": "EDU_O"}, {"txt": "1.", "language": "chinese", "position": {"atoms": [{"position_id": 633, "txt": "1.", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[27]/span/span"}]}, "tags": [], "label": "title1", "web_segment_id": 60, "global_sentence_id": 56, "edu_l1_label": "BOS"}, {"txt": "o1模型核心原理", "language": "chinese", "position": {"atoms": [{"position_id": 635, "txt": "o1模型", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[28]/span/span[1]"}, {"position_id": 637, "txt": "核心原理", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[28]/span/span[2]"}]}, "tags": [], "label": "title1", "web_segment_id": 61, "global_sentence_id": 57, "edu_l1_label": "IOS"}, {"txt": "让我们一起看看o1模型的这项突破性技术的核心原理，这也是ICLR 2024 论文的核心内容。", "language": "chinese", "position": {"atoms": [{"position_id": 639, "txt": "让我们一起看看", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[30]"}, {"position_id": 641, "txt": "o1模型的", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[30]/span[1]"}, {"position_id": 643, "txt": "这项突破性技术的核心原理，这也是ICLR 2024 论文的核心内容。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[30]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 62, "global_sentence_id": 58, "edu_l1_label": "IOS"}, {"txt": "详细分析如下：", "language": "chinese", "position": {"atoms": [{"position_id": 644, "txt": "详细分析如下：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[30]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 62, "global_sentence_id": 59, "edu_l1_label": "IOS"}, {"txt": "★强化学习", "language": "chinese", "position": {"atoms": [{"position_id": 646, "txt": "★强化学习", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[32]/span"}]}, "tags": [], "label": "title2", "web_segment_id": 63, "global_sentence_id": 60, "edu_l1_label": "IOS"}, {"txt": "强化学习是o1模型提升推理能力的重要手段之一。", "language": "chinese", "position": {"atoms": [{"position_id": 648, "txt": "强化学习是o1模型提升推理能力的重要手段之一。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[34]"}]}, "tags": [], "label": "content", "web_segment_id": 64, "global_sentence_id": 61, "edu_l1_label": "IOS"}, {"txt": "通过强化学习，模型学会在探索环境的过程中，根据获得的奖励或惩罚来调整自己的策略。", "language": "chinese", "position": {"atoms": [{"position_id": 649, "txt": "通过强化学习，模型学会在探索环境的过程中，根据获得的奖励或惩罚来调整自己的策略。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[34]"}]}, "tags": [], "label": "content", "web_segment_id": 64, "global_sentence_id": 62, "edu_l1_label": "IOS"}, {"txt": "在o1模型中，这种机制使得模型在回答问题之前，能够产生一系列的内部思维链，通过试错来优化推理路径，从而显著提高了解答复杂问题的准确性。", "language": "chinese", "position": {"atoms": [{"position_id": 650, "txt": "在o1模型中，这种机制使得模型在回答问题之前，能够产生一系列的内部思维链，通过试错来优化推理路径，从而显著提高了解答复杂问题的准确性。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[34]"}]}, "tags": [], "label": "content", "web_segment_id": 64, "global_sentence_id": 63, "edu_l1_label": "IOS"}, {"txt": "★思维链（Chain of Thought, CoT）", "language": "chinese", "position": {"atoms": [{"position_id": 652, "txt": "★思维链（Chain of Thought, CoT）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[36]/span"}]}, "tags": [], "label": "title2", "web_segment_id": 65, "global_sentence_id": 64, "edu_l1_label": "IOS"}, {"txt": "思维链是o1模型的另一大创新点。", "language": "chinese", "position": {"atoms": [{"position_id": 654, "txt": "思维链是o1模型的另一大创新点。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[38]"}]}, "tags": [], "label": "content", "web_segment_id": 66, "global_sentence_id": 65, "edu_l1_label": "IOS"}, {"txt": "它通过将复杂问题分解成一系列简单的、逻辑连贯的步骤来解决，类似于人类通过逐步推理来解决问题。", "language": "chinese", "position": {"atoms": [{"position_id": 655, "txt": "它通过将复杂问题分解成一系列简单的、逻辑连贯的步骤来解决，类似于人类通过逐步推理来解决问题。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[38]"}]}, "tags": [], "label": "content", "web_segment_id": 66, "global_sentence_id": 66, "edu_l1_label": "IOS"}, {"txt": "这种“链式思考”机制是o1模型的核心创新之一，它让模型在给出答案之前能够进行深思熟虑，从而显著提高了解答复杂问题的准确性。", "language": "chinese", "position": {"atoms": [{"position_id": 656, "txt": "这种“链式思考”机制是o1模型的核心创新之一，它让模型在给出答案之前能够进行深思熟虑，从而显著提高了解答复杂问题的准确性。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[38]"}]}, "tags": [], "label": "content", "web_segment_id": 66, "global_sentence_id": 67, "edu_l1_label": "IOS"}, {"txt": "传统的 Transformer 模型虽然在自然语言处理领域取得了巨大成功，但它有一个致命弱点：", "language": "chinese", "position": {"atoms": [{"position_id": 658, "txt": "传统的 Transformer 模型虽然在自然语言处理领域取得了巨大成功，但它有一个致命弱点：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[40]/span[1]/span[1]"}]}, "tags": [], "label": "content", "web_segment_id": 67, "global_sentence_id": 68, "edu_l1_label": "IOS"}, {"txt": "擅长并行计算，但不擅长串行推理。", "language": "chinese", "position": {"atoms": [{"position_id": 660, "txt": "擅长并行计算，但不擅长串行推理。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[40]/span[1]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 67, "global_sentence_id": 69, "edu_l1_label": "IOS"}, {"txt": " 这就像一个超级聪明的孩子，能快速完成大量的计算题，但却无法理解简单的逻辑推理。", "language": "chinese", "position": {"atoms": [{"position_id": 662, "txt": " 这就像一个超级聪明的孩子，能快速完成大量的计算题，但却无法理解简单的逻辑推理。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[40]/span[1]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 67, "global_sentence_id": 70, "edu_l1_label": "IOS"}, {"txt": "而 CoT (Chain of Thought，思维链) 技术就是为了解决这个问题而诞生的。", "language": "chinese", "position": {"atoms": [{"position_id": 664, "txt": "而 CoT (Chain of Thought，思维链) 技术就是为了解决这个问题而诞生的。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[40]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 67, "global_sentence_id": 71, "edu_l1_label": "IOS"}, {"txt": "♥思维链（CoT）让Transformer更强大", "language": "chinese", "position": {"atoms": [{"position_id": 666, "txt": "♥思维链（CoT）让Transformer更强大", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h3[1]/strong"}]}, "tags": ["h3", "strong"], "label": "title2", "web_segment_id": 68, "global_sentence_id": 72, "edu_l1_label": "IOS"}, {"txt": "首先，需要明确的是“可以解决任何问题”是一个通俗化的说法。", "language": "chinese", "position": {"atoms": [{"position_id": 668, "txt": "首先，需要明确的是“可以解决任何问题”是一个通俗化的说法。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[43]"}]}, "tags": [], "label": "content", "web_segment_id": 69, "global_sentence_id": 73, "edu_l1_label": "IOS"}, {"txt": "严格来说，论文的核心结论是思维链（CoT）能够显著提升Transformer的表达能力。", "language": "chinese", "position": {"atoms": [{"position_id": 669, "txt": "严格来说，论文的核心结论是思维链（CoT）能够显著提升Transformer的表达能力。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[43]"}]}, "tags": [], "label": "content", "web_segment_id": 69, "global_sentence_id": 74, "edu_l1_label": "IOS"}, {"txt": "作者首先通过理论分析指出，对于固定深度、多项式宽度、常数精度的Transformer模型，如果不使用CoT，其表达能力将受限于AC0问题类别。", "language": "chinese", "position": {"atoms": [{"position_id": 671, "txt": "作者首先通过理论分析指出，对于固定深度、多项式宽度、常数精度的Transformer模型，如果不使用CoT，其表达能力将受限于AC0问题类别。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[45]"}]}, "tags": [], "label": "content", "web_segment_id": 70, "global_sentence_id": 75, "edu_l1_label": "IOS"}, {"txt": "（AC0是一类可以在并行计算中高效解决的问题，但不包括需要复杂序列化计算的问题。", "language": "chinese", "position": {"atoms": [{"position_id": 672, "txt": "（AC0是一类可以在并行计算中高效解决的问题，但不包括需要复杂序列化计算的问题。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[45]"}]}, "tags": [], "label": "content", "web_segment_id": 70, "global_sentence_id": 76, "edu_l1_label": "IOS"}, {"txt": "）", "language": "chinese", "position": {"atoms": [{"position_id": 673, "txt": "）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[45]"}]}, "tags": [], "label": "content", "web_segment_id": 70, "global_sentence_id": 77, "edu_l1_label": "IOS"}, {"txt": "在固定指数位的情况下，即使引入了舍入操作，固定深度、对数精度的Transformer模型也只能处理TC0问题类别。", "language": "chinese", "position": {"atoms": [{"position_id": 675, "txt": "在固定指数位的情况下，即使引入了舍入操作，固定深度、对数精度的Transformer模型也只能处理TC0问题类别。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[47]"}]}, "tags": [], "label": "content", "web_segment_id": 71, "global_sentence_id": 78, "edu_l1_label": "IOS"}, {"txt": "然而，一旦引入CoT，固定深度、常数精度的Transformer模型就可以解决任何由大小为T的布尔电路所解决的问题。", "language": "chinese", "position": {"atoms": [{"position_id": 677, "txt": "然而，一旦引入CoT，固定深度、常数精度的Transformer模型就可以解决任何由大小为T的布尔电路所解决的问题。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[49]"}]}, "tags": [], "label": "content", "web_segment_id": 72, "global_sentence_id": 79, "edu_l1_label": "IOS"}, {"txt": "这表明CoT显著扩展了模型的表达能力，使其能够处理更复杂的问题。", "language": "chinese", "position": {"atoms": [{"position_id": 679, "txt": "这表明CoT显著扩展了模型的表达能力，使其能够处理更复杂的问题。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[49]/span"}]}, "tags": [], "label": "content", "web_segment_id": 72, "global_sentence_id": 80, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1Zb6mk2b4bv1WPN8W1G4WbS.jpeg", "language": "chinese", "position": {"atoms": [{"position_id": 213, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1Zb6mk2b4bv1WPN8W1G4WbS.jpeg", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[7]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 73, "global_sentence_id": 81, "edu_l1_label": "EDU_O"}, {"txt": "♥CoT 的实验验证：", "language": "chinese", "position": {"atoms": [{"position_id": 681, "txt": "♥CoT 的实验验证：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h3[2]/strong"}]}, "tags": ["h3", "strong"], "label": "title2", "web_segment_id": 74, "global_sentence_id": 82, "edu_l1_label": "IOS"}, {"txt": "4个核心问题，CoT 全面胜出！", "language": "chinese", "position": {"atoms": [{"position_id": 682, "txt": "4个核心问题，CoT 全面胜出！", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h3[2]/strong"}]}, "tags": ["strong", "h3"], "label": "title2", "web_segment_id": 74, "global_sentence_id": 83, "edu_l1_label": "IOS"}, {"txt": "为了验证理论分析，论文在四个核心问题上进行了实验，考虑了基础（base）、CoT和提示（hint）三种不同的训练设置：", "language": "chinese", "position": {"atoms": [{"position_id": 684, "txt": "为了验证理论分析，论文在四个核心问题上进行了实验，考虑了基础（base）、CoT和提示（hint）三种不同的训练设置：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[53]"}]}, "tags": [], "label": "content", "web_segment_id": 75, "global_sentence_id": 84, "edu_l1_label": "IOS"}, {"txt": "模运算（Modular Addition）：", "language": "chinese", "position": {"atoms": [{"position_id": 686, "txt": "模运算（Modular Addition）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ol/li[1]/p/strong"}, {"position_id": 688, "txt": "：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ol/li[1]/p/strong"}]}, "tags": ["li", "strong"], "label": "content", "web_segment_id": 76, "global_sentence_id": 85, "edu_l1_label": "IOS"}, {"txt": "并行计算问题，验证CoT在提升模型准确性方面的效果；", "language": "chinese", "position": {"atoms": [{"position_id": 689, "txt": "并行计算问题，验证CoT在提升模型准确性方面的效果；", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ol/li[1]/p/strong"}]}, "tags": ["li", "strong"], "label": "content", "web_segment_id": 76, "global_sentence_id": 86, "edu_l1_label": "IOS"}, {"txt": "置换群组合（Permutation Composition）：", "language": "chinese", "position": {"atoms": [{"position_id": 691, "txt": "置换群组合（Permutation Composition）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ol/li[2]/p/strong"}, {"position_id": 693, "txt": "：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ol/li[2]/p/strong"}]}, "tags": ["li", "strong"], "label": "content", "web_segment_id": 77, "global_sentence_id": 87, "edu_l1_label": "IOS"}, {"txt": "序列化计算问题，验证CoT在处理这类任务上的有效性；", "language": "chinese", "position": {"atoms": [{"position_id": 694, "txt": "序列化计算问题，验证CoT在处理这类任务上的有效性；", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ol/li[2]/p/strong"}]}, "tags": ["li", "strong"], "label": "content", "web_segment_id": 77, "global_sentence_id": 88, "edu_l1_label": "IOS"}, {"txt": "迭代平方（Iterated Squaring）：", "language": "chinese", "position": {"atoms": [{"position_id": 696, "txt": "迭代平方（Iterated Squaring）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ol/li[3]/p/strong"}, {"position_id": 698, "txt": "：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ol/li[3]/p/strong"}]}, "tags": ["li", "strong"], "label": "content", "web_segment_id": 78, "global_sentence_id": 89, "edu_l1_label": "IOS"}, {"txt": "典型的序列化计算问题，展示CoT如何使模型有效求解；", "language": "chinese", "position": {"atoms": [{"position_id": 699, "txt": "典型的序列化计算问题，展示CoT如何使模型有效求解；", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ol/li[3]/p/strong"}]}, "tags": ["li", "strong"], "label": "content", "web_segment_id": 78, "global_sentence_id": 90, "edu_l1_label": "IOS"}, {"txt": "电路值问题（Circuit Value Problem）：", "language": "chinese", "position": {"atoms": [{"position_id": 701, "txt": "电路值问题（Circuit Value Problem）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ol/li[4]/p/strong"}, {"position_id": 703, "txt": "：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ol/li[4]/p/strong"}]}, "tags": ["strong", "li"], "label": "content", "web_segment_id": 79, "global_sentence_id": 91, "edu_l1_label": "IOS"}, {"txt": "一个P完全问题，验证CoT在模型深度较低时的有效性。", "language": "chinese", "position": {"atoms": [{"position_id": 704, "txt": "一个P完全问题，验证CoT在模型深度较低时的有效性。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ol/li[4]/p/strong"}]}, "tags": ["li", "strong"], "label": "content", "web_segment_id": 79, "global_sentence_id": 92, "edu_l1_label": "IOS"}, {"txt": "在模运算问题上，实验结果表明，所有设置下的Transformer都能学习模加；", "language": "chinese", "position": {"atoms": [{"position_id": 706, "txt": "在", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[56]"}, {"position_id": 708, "txt": "模运算问题", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[56]/strong"}, {"position_id": 710, "txt": "上，实验结果表明，所有设置下的Transformer都能学习模加；", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[56]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 80, "global_sentence_id": 93, "edu_l1_label": "IOS"}, {"txt": "但在较长序列（如n=16）上，CoT展现出明显优势。", "language": "chinese", "position": {"atoms": [{"position_id": 711, "txt": "但在较长序列（如n=16）上，CoT展现出明显优势。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[56]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 80, "global_sentence_id": 94, "edu_l1_label": "IOS"}, {"txt": "这说明即使是并行问题，CoT也能提升效率。", "language": "chinese", "position": {"atoms": [{"position_id": 712, "txt": "这说明即使是并行问题，CoT也能提升效率。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[56]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 80, "global_sentence_id": 95, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/4lBkFo1jCrCtwiqegOACsF.jpeg", "language": "chinese", "position": {"atoms": [{"position_id": 244, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/4lBkFo1jCrCtwiqegOACsF.jpeg", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[8]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 81, "global_sentence_id": 96, "edu_l1_label": "EDU_O"}, {"txt": "在置换群复合任务中，输入是S_5置换群中的若干个置换，输出是它们的复合结果。", "language": "chinese", "position": {"atoms": [{"position_id": 714, "txt": "在", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[59]"}, {"position_id": 716, "txt": "置换群复合任务", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[59]/strong"}, {"position_id": 718, "txt": "中，输入是S_5置换群中的若干个置换，输出是它们的复合结果。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[59]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 82, "global_sentence_id": 97, "edu_l1_label": "IOS"}, {"txt": "结果显示，CoT显著提高了低深度模型的准确性。", "language": "chinese", "position": {"atoms": [{"position_id": 719, "txt": "结果显示，CoT显著提高了低深度模型的准确性。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[59]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 82, "global_sentence_id": 98, "edu_l1_label": "IOS"}, {"txt": "未使用CoT的Transformer即使深度较大，准确率也只有约20%；", "language": "chinese", "position": {"atoms": [{"position_id": 720, "txt": "未使用CoT的Transformer即使深度较大，准确率也只有约20%；", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[59]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 82, "global_sentence_id": 99, "edu_l1_label": "IOS"}, {"txt": "而使用CoT后，即使只有1层Transformer，准确率也达到了100%。", "language": "chinese", "position": {"atoms": [{"position_id": 721, "txt": "而使用CoT后，即使只有1层Transformer，准确率也达到了100%。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[59]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 82, "global_sentence_id": 100, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2GaCZn1EctOC1F56oePBXl2.jpeg", "language": "chinese", "position": {"atoms": [{"position_id": 254, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2GaCZn1EctOC1F56oePBXl2.jpeg", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[9]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 83, "global_sentence_id": 101, "edu_l1_label": "EDU_O"}, {"txt": "对于迭代平方任务，输入是一个质数p、一个整数r和若干个“^2”符号，输出是r^(2^k) mod p。", "language": "chinese", "position": {"atoms": [{"position_id": 723, "txt": "对于迭代平方任务，输入是一个质数p、一个整数r和若干个“^2”符号，输出是r^(2^k) mod p。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[62]/span"}]}, "tags": [], "label": "content", "web_segment_id": 84, "global_sentence_id": 102, "edu_l1_label": "IOS"}, {"txt": "实验结果与置换群复合任务类似：", "language": "chinese", "position": {"atoms": [{"position_id": 724, "txt": "实验结果与置换群复合任务类似：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[62]/span"}]}, "tags": [], "label": "content", "web_segment_id": 84, "global_sentence_id": 103, "edu_l1_label": "IOS"}, {"txt": "未使用CoT的情况下，即使是16层Transformer也难以学习；", "language": "chinese", "position": {"atoms": [{"position_id": 725, "txt": "未使用CoT的情况下，即使是16层Transformer也难以学习；", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[62]/span"}]}, "tags": [], "label": "content", "web_segment_id": 84, "global_sentence_id": 104, "edu_l1_label": "IOS"}, {"txt": "而使用CoT后，1层Transformer就能完美求解。", "language": "chinese", "position": {"atoms": [{"position_id": 726, "txt": "而使用CoT后，1层Transformer就能完美求解。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[62]/span"}]}, "tags": [], "label": "content", "web_segment_id": 84, "global_sentence_id": 105, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/3DR35A4pvh3X4jRu5n27HioR.jpeg", "language": "chinese", "position": {"atoms": [{"position_id": 264, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/3DR35A4pvh3X4jRu5n27HioR.jpeg", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[10]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 85, "global_sentence_id": 106, "edu_l1_label": "EDU_O"}, {"txt": "电路值问题的实验结果表明，在基准设置下，4层Transformer的准确率约为50%，8层约为90%，16层接近100%；", "language": "chinese", "position": {"atoms": [{"position_id": 728, "txt": "电路值问题", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[65]/strong"}, {"position_id": 730, "txt": "的实验结果表明，在基准设置下，4层Transformer的准确率约为50%，8层约为90%，16层接近100%；", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[65]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 86, "global_sentence_id": 107, "edu_l1_label": "IOS"}, {"txt": "而使用CoT后，1层Transformer即可达到接近100%的准确率。", "language": "chinese", "position": {"atoms": [{"position_id": 731, "txt": "而使用CoT后，1层Transformer即可达到接近100%的准确率。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[65]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 86, "global_sentence_id": 108, "edu_l1_label": "IOS"}, {"txt": "这验证了CoT赋予了Transformer模拟任意电路的能力，使其能够解决电路值问题这一P完全问题。", "language": "chinese", "position": {"atoms": [{"position_id": 732, "txt": "这验证了CoT赋予了Transformer模拟任意电路的能力，使其能够解决电路值问题这一P完全问题。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[65]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 86, "global_sentence_id": 109, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1awler1CZjVj1ehzgx17uBNr.jpeg", "language": "chinese", "position": {"atoms": [{"position_id": 275, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1awler1CZjVj1ehzgx17uBNr.jpeg", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[11]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 87, "global_sentence_id": 110, "edu_l1_label": "EDU_O"}, {"txt": "♥CoT+Transformer模拟门电路", "language": "chinese", "position": {"atoms": [{"position_id": 734, "txt": "♥CoT+Transformer模拟门电路", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h3[4]/strong"}]}, "tags": ["h3", "strong"], "label": "title2", "web_segment_id": 88, "global_sentence_id": 111, "edu_l1_label": "IOS"}, {"txt": "除上述实验，作者还进行了理论证明：", "language": "chinese", "position": {"atoms": [{"position_id": 736, "txt": "除上述实验，作者还进行了理论证明：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[68]"}]}, "tags": [], "label": "content", "web_segment_id": 89, "global_sentence_id": 112, "edu_l1_label": "IOS"}, {"txt": "对于任何可以用多项式大小的布尔电路计算的函数，都存在一个仅有常数层数的Transformer，可以通过足够长的思维链（CoT）来模拟电路的计算过程，从而计算出这个函数。", "language": "chinese", "position": {"atoms": [{"position_id": 738, "txt": "对于任何可以用多项式大小的布尔电路计算的函数，都存在一个仅有常数层数的Transformer，可以通过足够长的思维链（CoT）来模拟电路的计算过程，从而计算出这个函数。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[70]"}]}, "tags": [], "label": "content", "web_segment_id": 90, "global_sentence_id": 113, "edu_l1_label": "IOS"}, {"txt": "证明的思路是先将布尔电路视为一系列逻辑门的组合，然后利用Transformer中的位置编码为每个逻辑门及其状态分配一个独特的表示，通过逐步计算来模拟整个电路的执行过程。", "language": "chinese", "position": {"atoms": [{"position_id": 740, "txt": "证明的思路是先将布尔电路视为一系列逻辑门的组合，然后利用Transformer中的位置编码为每个逻辑门及其状态分配一个独特的表示，通过逐步计算来模拟整个电路的执行过程。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[72]"}]}, "tags": [], "label": "content", "web_segment_id": 91, "global_sentence_id": 114, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/34Xgaa2NCQyA4zZCYH4xkpZ2.jpeg", "language": "chinese", "position": {"atoms": [{"position_id": 295, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/34Xgaa2NCQyA4zZCYH4xkpZ2.jpeg", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[12]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 92, "global_sentence_id": 115, "edu_l1_label": "EDU_O"}, {"txt": "具体而言，对于一个有T(n)个门的电路，作者设计了一个4T(n)个token的输入序列。", "language": "chinese", "position": {"atoms": [{"position_id": 742, "txt": "具体而言，对于一个有T(n)个门的电路，作者设计了一个4T(n)个token的输入序列。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[75]"}]}, "tags": [], "label": "content", "web_segment_id": 93, "global_sentence_id": 116, "edu_l1_label": "IOS"}, {"txt": "这个序列包含了电路的完整描述，每个门用4个连续的token表示：", "language": "chinese", "position": {"atoms": [{"position_id": 743, "txt": "这个序列包含了电路的完整描述，每个门用4个连续的token表示：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[75]"}]}, "tags": [], "label": "content", "web_segment_id": 93, "global_sentence_id": 117, "edu_l1_label": "IOS"}, {"txt": "门类型、两个输入门的索引和当前门的索引，并用输入序列中的第一个token指示电路的输入值。", "language": "chinese", "position": {"atoms": [{"position_id": 744, "txt": "门类型、两个输入门的索引和当前门的索引，并用输入序列中的第一个token指示电路的输入值。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[75]"}]}, "tags": [], "label": "content", "web_segment_id": 93, "global_sentence_id": 118, "edu_l1_label": "IOS"}, {"txt": "作者构造了一个常数深度的Transformer，该Transformer的嵌入维度只需要O(log n)，就足以对T(n)个门进行编码。", "language": "chinese", "position": {"atoms": [{"position_id": 746, "txt": "作者构造了一个常数深度的Transformer，该Transformer的嵌入维度只需要O(log n)，就足以对T(n)个门进行编码。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[77]"}]}, "tags": [], "label": "content", "web_segment_id": 94, "global_sentence_id": 119, "edu_l1_label": "IOS"}, {"txt": "通过将电路“展开”为一个长度为O(T(n))的思维链，Transformer逐步执行电路中的计算，并将中间结果存储在思维链中。", "language": "chinese", "position": {"atoms": [{"position_id": 747, "txt": "通过将电路“展开”为一个长度为O(T(n))的思维链，Transformer逐步执行电路中的计算，并将中间结果存储在思维链中。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[77]"}]}, "tags": [], "label": "content", "web_segment_id": 94, "global_sentence_id": 120, "edu_l1_label": "IOS"}, {"txt": "最终，最后一个门的输出就对应了电路的最终输出。", "language": "chinese", "position": {"atoms": [{"position_id": 748, "txt": "最终，最后一个门的输出就对应了电路的最终输出。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[77]"}]}, "tags": [], "label": "content", "web_segment_id": 94, "global_sentence_id": 121, "edu_l1_label": "IOS"}, {"txt": "在此基础上，作者进一步证明，具有O(T(n))长度CoT的常数深度Transformer，可以模拟任意T(n)大小的电路，因此其计算能力等价于多项式大小的电路。", "language": "chinese", "position": {"atoms": [{"position_id": 750, "txt": "在此基础上，作者进一步证明，具有O(T(n))长度CoT的常数深度Transformer，可以模拟任意T(n)大小的电路，因此其计算能力等价于多项式大小的电路。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[79]"}]}, "tags": [], "label": "content", "web_segment_id": 95, "global_sentence_id": 122, "edu_l1_label": "IOS"}, {"txt": "♥理论打通，实际可行？", "language": "chinese", "position": {"atoms": [{"position_id": 752, "txt": "♥理论打通，实际可行？", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h3[5]/strong"}]}, "tags": ["h3", "strong"], "label": "title2", "web_segment_id": 96, "global_sentence_id": 123, "edu_l1_label": "IOS"}, {"txt": "能够模拟电路的计算过程，意味着CoT+Transformer能够解决可计算问题。", "language": "chinese", "position": {"atoms": [{"position_id": 754, "txt": "能够模拟电路的计算过程，意味着CoT+Transformer能够解决可计算问题。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[82]"}]}, "tags": [], "label": "content", "web_segment_id": 97, "global_sentence_id": 124, "edu_l1_label": "IOS"}, {"txt": "这也说明，只要有足够的CoT思考时间，大模型无需扩展尺寸也能解决复杂问题。", "language": "chinese", "position": {"atoms": [{"position_id": 755, "txt": "这也说明，只要有足够的CoT思考时间，大模型无需扩展尺寸也能解决复杂问题。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[82]"}]}, "tags": [], "label": "content", "web_segment_id": 97, "global_sentence_id": 125, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/35OBH52qedM8DCwqh2ZvHQr.jpeg", "language": "chinese", "position": {"atoms": [{"position_id": 317, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/35OBH52qedM8DCwqh2ZvHQr.jpeg", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[13]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 98, "global_sentence_id": 126, "edu_l1_label": "EDU_O"}, {"txt": "有专业人士用一篇长文解释CoT和图灵完备性之间的关系：", "language": "chinese", "position": {"atoms": [{"position_id": 757, "txt": "有专业人士用一篇长文解释CoT和图灵完备性之间的关系：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[85]"}]}, "tags": [], "label": "content", "web_segment_id": 99, "global_sentence_id": 127, "edu_l1_label": "IOS"}, {"txt": "如果没有CoT，Transformer仅限于执行AC0复杂度类中的并行任务；", "language": "chinese", "position": {"atoms": [{"position_id": 758, "txt": "如果没有CoT，Transformer仅限于执行AC0复杂度类中的并行任务；", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[85]"}]}, "tags": [], "label": "content", "web_segment_id": 99, "global_sentence_id": 128, "edu_l1_label": "IOS"}, {"txt": "而CoT推理从根本上改变了这一格局，使Transformer能够通过中间推理token处理串行计算，进入P/poly领域。", "language": "chinese", "position": {"atoms": [{"position_id": 759, "txt": "而CoT推理从根本上改变了这一格局，使Transformer能够通过中间推理token处理串行计算，进入P/poly领域。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[85]"}]}, "tags": [], "label": "content", "web_segment_id": 99, "global_sentence_id": 129, "edu_l1_label": "IOS"}, {"txt": "理论上只要有足够的CoT步骤，Transformer就能模拟多项式大小电路可以执行的任何计算，缩小与图灵机之间的差距。", "language": "chinese", "position": {"atoms": [{"position_id": 761, "txt": "理论上只要有足够的CoT步骤，Transformer就能模拟多项式大小电路可以执行的任何计算，缩小与图灵机之间的差距。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[87]"}]}, "tags": [], "label": "content", "web_segment_id": 100, "global_sentence_id": 130, "edu_l1_label": "IOS"}, {"txt": "然而，实际应用的限制仍存在，例如有限的上下文窗口和计算资源。", "language": "chinese", "position": {"atoms": [{"position_id": 763, "txt": "然而，实际应用的限制仍存在，例如有限的上下文窗口和计算资源。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[87]/span"}]}, "tags": [], "label": "content", "web_segment_id": 100, "global_sentence_id": 131, "edu_l1_label": "IOS"}, {"txt": "要充分利用这一潜力，需要精细的模型设计和优化。", "language": "chinese", "position": {"atoms": [{"position_id": 764, "txt": "要充分利用这一潜力，需要精细的模型设计和优化。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[87]/span"}]}, "tags": [], "label": "content", "web_segment_id": 100, "global_sentence_id": 132, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1RUcTX48mBtPHyWnz3GB4c3.jpeg", "language": "chinese", "position": {"atoms": [{"position_id": 329, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1RUcTX48mBtPHyWnz3GB4c3.jpeg", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[14]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 101, "global_sentence_id": 133, "edu_l1_label": "EDU_O"}, {"txt": "有人将这项成果与OpenAI的“草莓”模型o1联系到了一起:", "language": "chinese", "position": {"atoms": [{"position_id": 766, "txt": "有人将这项成果与OpenAI的“草莓”模型o1联系到了一起:", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[90]"}]}, "tags": [], "label": "content", "web_segment_id": 102, "global_sentence_id": 134, "edu_l1_label": "IOS"}, {"txt": "草莓同样是思考时间越长，准确性越高。", "language": "chinese", "position": {"atoms": [{"position_id": 767, "txt": "草莓同样是思考时间越长，准确性越高。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[90]"}]}, "tags": [], "label": "content", "web_segment_id": 102, "global_sentence_id": 135, "edu_l1_label": "IOS"}, {"txt": "按照这个思路，只要有好的模型就有可能解决人类面临的一系列难题。", "language": "chinese", "position": {"atoms": [{"position_id": 768, "txt": "按照这个思路，只要有好的模型就有可能解决人类面临的一系列难题。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[90]"}]}, "tags": [], "label": "content", "web_segment_id": 102, "global_sentence_id": 136, "edu_l1_label": "IOS"}, {"txt": "甚至有人表示如果这项研究是真的，那么AGI（通用人工智能）就已经在到来的路上了。", "language": "chinese", "position": {"atoms": [{"position_id": 769, "txt": "甚至", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[90]"}, {"position_id": 771, "txt": "有人表示如果这项研究是真的，那么AGI（通用人工智能）就已经在到来的路上了。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[90]/span[1]"}]}, "tags": [], "label": "content", "web_segment_id": 102, "global_sentence_id": 137, "edu_l1_label": "IOS"}, {"txt": "然而，也有观点认为这只是一个理论结果，与实际应用还有较大差距。", "language": "chinese", "position": {"atoms": [{"position_id": 772, "txt": "然而，也有观点认为这只是一个理论结果，与实际应用还有较大差距。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[90]/span[1]"}]}, "tags": [], "label": "content", "web_segment_id": 102, "global_sentence_id": 138, "edu_l1_label": "IOS"}, {"txt": "即使忽略理论与实际条件的不同，时间和成本问题也是重要的限制因素。", "language": "chinese", "position": {"atoms": [{"position_id": 773, "txt": "即使忽略理论与实际条件的不同，时间和成本问题也是重要的限制因素。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[90]/span[1]"}]}, "tags": [], "label": "content", "web_segment_id": 102, "global_sentence_id": 139, "edu_l1_label": "IOS"}, {"txt": "同时，实验假设模型权重已正确设置，但实际模型的训练很难达到这一程度。", "language": "chinese", "position": {"atoms": [{"position_id": 775, "txt": "同时，实验假设模型权重已正确设置，但实际模型的训练很难达到这一程度。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[90]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 102, "global_sentence_id": 140, "edu_l1_label": "IOS"}, {"txt": "此外，这种模拟门电路运算并不是大模型实际学习和工作的方式。", "language": "chinese", "position": {"atoms": [{"position_id": 776, "txt": "此外，这种模拟门电路运算并不是大模型实际学习和工作的方式。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[90]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 102, "global_sentence_id": 141, "edu_l1_label": "IOS"}, {"txt": "如何将实际问题用布尔电路表示，是Transformer从能解决运算问题到实际问题的关键。", "language": "chinese", "position": {"atoms": [{"position_id": 777, "txt": "如何将实际问题用布尔电路表示，是Transformer从能解决运算问题到实际问题的关键。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[90]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 102, "global_sentence_id": 142, "edu_l1_label": "IOS"}, {"txt": "而现实中，诸如“如何治疗癌症”这类问题，很难以电路的形式去描述。", "language": "chinese", "position": {"atoms": [{"position_id": 778, "txt": "而现实中，诸如“如何治疗癌症”这类问题，很难以电路的形式去描述。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[90]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 102, "global_sentence_id": 143, "edu_l1_label": "IOS"}, {"txt": "2.", "language": "chinese", "position": {"atoms": [{"position_id": 780, "txt": "2.", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[92]/span"}]}, "tags": [], "label": "title1", "web_segment_id": 103, "global_sentence_id": 144, "edu_l1_label": "BOS"}, {"txt": "o1模型的优势与应用", "language": "chinese", "position": {"atoms": [{"position_id": 782, "txt": "o1模型的优势与应用", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[93]/span"}]}, "tags": [], "label": "title1", "web_segment_id": 104, "global_sentence_id": 145, "edu_l1_label": "IOS"}, {"txt": "性能优势", "language": "chinese", "position": {"atoms": [{"position_id": 784, "txt": "性能优势", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[95]/span"}]}, "tags": [], "label": "title2", "web_segment_id": 105, "global_sentence_id": 146, "edu_l1_label": "IOS"}, {"txt": "o1模型在多个基准测试中展现出了卓越的推理能力。", "language": "chinese", "position": {"atoms": [{"position_id": 786, "txt": "o1模型在多个基准测试中展现出了卓越的推理能力。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[97]"}]}, "tags": [], "label": "content", "web_segment_id": 106, "global_sentence_id": 147, "edu_l1_label": "IOS"}, {"txt": "例如，在国际数学奥林匹克选拔考试（AIME）中，o1模型的正确率远高于GPT-4o模型；", "language": "chinese", "position": {"atoms": [{"position_id": 787, "txt": "例如，在国际数学奥林匹克选拔考试（AIME）中，o1模型的正确率远高于GPT-4o模型；", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[97]"}]}, "tags": [], "label": "content", "web_segment_id": 106, "global_sentence_id": 148, "edu_l1_label": "IOS"}, {"txt": "在编程能力比赛Codeforces中，o1模型也获得了高分，超越了大多数人类竞争者。", "language": "chinese", "position": {"atoms": [{"position_id": 788, "txt": "在编程能力比赛Codeforces中，o1模型也获得了高分，超越了大多数人类竞争者。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[97]"}]}, "tags": [], "label": "content", "web_segment_id": 106, "global_sentence_id": 149, "edu_l1_label": "IOS"}, {"txt": "应用场景广泛", "language": "chinese", "position": {"atoms": [{"position_id": 790, "txt": "应用场景广泛", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[99]/span"}]}, "tags": [], "label": "title2", "web_segment_id": 107, "global_sentence_id": 150, "edu_l1_label": "IOS"}, {"txt": "o1模型在科学研究和教育领域具有广泛的应用潜力。", "language": "chinese", "position": {"atoms": [{"position_id": 792, "txt": "o1模型在科学研究和教育领域具有广泛的应用潜力。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[101]"}]}, "tags": [], "label": "content", "web_segment_id": 108, "global_sentence_id": 151, "edu_l1_label": "IOS"}, {"txt": "医疗研究人员可以利用o1模型来标注细胞测序数据，物理学家可以借助o1模型生成量子光学所需的复杂数学公式。", "language": "chinese", "position": {"atoms": [{"position_id": 793, "txt": "医疗研究人员可以利用o1模型来标注细胞测序数据，物理学家可以借助o1模型生成量子光学所需的复杂数学公式。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[101]"}]}, "tags": [], "label": "content", "web_segment_id": 108, "global_sentence_id": 152, "edu_l1_label": "IOS"}, {"txt": "此外，o1模型还可以在教育领域作为学生的虚拟导师，辅助解答复杂的科学、数学和编程问题。", "language": "chinese", "position": {"atoms": [{"position_id": 794, "txt": "此外，o1模型还可以在教育领域作为学生的虚拟导师，辅助解答复杂的科学、数学和编程问题。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[101]"}]}, "tags": [], "label": "content", "web_segment_id": 108, "global_sentence_id": 153, "edu_l1_label": "IOS"}, {"txt": "未来展望", "language": "chinese", "position": {"atoms": [{"position_id": 796, "txt": "未来展望", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[103]/span"}]}, "tags": [], "label": "title2", "web_segment_id": 109, "global_sentence_id": 154, "edu_l1_label": "IOS"}, {"txt": "论文作者认为这项工作从表现力的角度提供了对纯解码器 Transformer 的 CoT 威力的理论理解，CoT 技术为训练更强大的 LLM 推理模型提供了一种全新的思路，并预测 CoT 将成为未来 LLM 发展的重要方向。", "language": "chinese", "position": {"atoms": [{"position_id": 798, "txt": "论文作者认为", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[105]/span/span[1]"}, {"position_id": 800, "txt": "这项工作从表现力的角度提供了对纯解码器 Transformer 的 CoT 威力的理论理解，", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[105]/span/span[2]"}, {"position_id": 802, "txt": "CoT 技术为训练更强大的 LLM 推理模型提供了一种全新的思路，并预测 CoT 将成为未来 LLM 发展的重要方向。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[105]/span/span[3]"}]}, "tags": [], "label": "content", "web_segment_id": 110, "global_sentence_id": 155, "edu_l1_label": "IOS"}, {"txt": "随着技术的不断进步和完善，o1模型的推理能力和应用场景有望进一步拓展。", "language": "chinese", "position": {"atoms": [{"position_id": 803, "txt": "随着技术的不断进步和完善，o1模型的推理能力和应用场景有望进一步拓展。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[105]/span/span[3]"}]}, "tags": [], "label": "content", "web_segment_id": 110, "global_sentence_id": 156, "edu_l1_label": "IOS"}, {"txt": "未来，我们有理由相信o1模型将在更多领域发挥重要作用，推动AI技术的创新与发展。", "language": "chinese", "position": {"atoms": [{"position_id": 804, "txt": "未来，我们有理由相信o1模型将在更多领域发挥重要作用，推动AI技术的创新与发展。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[105]/span/span[3]"}]}, "tags": [], "label": "content", "web_segment_id": 110, "global_sentence_id": 157, "edu_l1_label": "IOS"}, {"txt": "3.", "language": "chinese", "position": {"atoms": [{"position_id": 806, "txt": "3.", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[107]/span"}]}, "tags": [], "label": "title1", "web_segment_id": 111, "global_sentence_id": 158, "edu_l1_label": "BOS"}, {"txt": "o1 背后4位华人作者", "language": "chinese", "position": {"atoms": [{"position_id": 808, "txt": "o1 背后4位", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[108]/span[1]"}, {"position_id": 810, "txt": "华人作者", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[108]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 112, "global_sentence_id": 159, "edu_l1_label": "IOS"}, {"txt": "OpenAI o1 模型的成功，正是对《思维链赋能Transformer解决本质上的串行问题。", "language": "chinese", "position": {"atoms": [{"position_id": 812, "txt": "OpenAI o1 模型的成功，正是对《思维链赋能Transformer解决本质上的串行问题。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[110]/span"}]}, "tags": [], "label": "content", "web_segment_id": 113, "global_sentence_id": 160, "edu_l1_label": "IOS"}, {"txt": "》这篇论文最好的证明。", "language": "chinese", "position": {"atoms": [{"position_id": 813, "txt": "》这篇论文最好的证明。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[110]/span"}]}, "tags": [], "label": "content", "web_segment_id": 113, "global_sentence_id": 161, "edu_l1_label": "IOS"}, {"txt": "它不仅验证了 CoT 技术的可行性和有效性，也让我们看到了 AI 推理领域的巨大潜力。", "language": "chinese", "position": {"atoms": [{"position_id": 814, "txt": "它不仅验证了 CoT 技术的可行性和有效性，也让我们看到了 AI 推理领域的巨大潜力。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[110]/span"}]}, "tags": [], "label": "content", "web_segment_id": 113, "global_sentence_id": 162, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2lNYZu4AurTh35alGg1zWNu.png", "language": "chinese", "position": {"atoms": [{"position_id": 384, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2lNYZu4AurTh35alGg1zWNu.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[15]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 114, "global_sentence_id": 163, "edu_l1_label": "EDU_O"}, {"txt": "该论文的四位作者全是华人：", "language": "chinese", "position": {"atoms": [{"position_id": 816, "txt": "该论文的四位作者全是华人：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[113]"}]}, "tags": [], "label": "content", "web_segment_id": 115, "global_sentence_id": 164, "edu_l1_label": "IOS"}, {"txt": "Zhiyuan Li，本科毕业于清华大学姚班，并于2022年在普林斯顿大学获得计算机科学博士学位，博士后师从马腾宇。", "language": "chinese", "position": {"atoms": [{"position_id": 818, "txt": "Zhiyuan Li", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[115]/strong"}, {"position_id": 820, "txt": "，本科毕业于清华大学姚班，并于2022年在普林斯顿大学获得计算机科学博士学位，博士后师从马腾宇。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[115]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 116, "global_sentence_id": 165, "edu_l1_label": "IOS"}, {"txt": "芝加哥丰田技术学院 (TTIC) 的终身制助理教授，他的研究重点是机器学习和优化，尤其是深度学习理论", "language": "chinese", "position": {"atoms": [{"position_id": 821, "txt": "芝加哥丰田技术学院 (TTIC) 的终身制助理教授，他的研究重点是机器学习和优化，尤其是深度学习理论", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[115]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 116, "global_sentence_id": 166, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1LdFG7tre9wcsuYT1hj6tO.png", "language": "chinese", "position": {"atoms": [{"position_id": 396, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1LdFG7tre9wcsuYT1hj6tO.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[16]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 117, "global_sentence_id": 167, "edu_l1_label": "EDU_O"}, {"txt": "Hong Liu，本科毕业于清华大学电子工程系，斯坦福大学计算机科学专业的博士生，师从 Tengyu Ma 教授，目前的研究兴趣主要集中在大语言模型上，尤其是它们的优化和适应性", "language": "chinese", "position": {"atoms": [{"position_id": 823, "txt": "Hong Liu", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[117]/strong"}, {"position_id": 825, "txt": "，本科毕业于清华大学电子工程系，斯坦福大学计算机科学专业的博士生，师从 Tengyu Ma 教授，目前的研究兴趣主要集中在大语言模型上，尤其是它们的优化和适应性", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[117]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 118, "global_sentence_id": 168, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2WOBS53ejkEe2a93MQ4se9mR.png", "language": "chinese", "position": {"atoms": [{"position_id": 404, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2WOBS53ejkEe2a93MQ4se9mR.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[18]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 119, "global_sentence_id": 169, "edu_l1_label": "EDU_O"}, {"txt": "Denny Zhou，Google Brain推理团队创建者Denny Zhou，2017年加入Google前在微软担任了11年的高级研究员。", "language": "chinese", "position": {"atoms": [{"position_id": 827, "txt": "Denny Zhou", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[120]/strong"}, {"position_id": 829, "txt": "，Google Brain推理团队创建者Denny Zhou，2017年加入Google前在微软担任了11年的高级研究员。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[120]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 120, "global_sentence_id": 170, "edu_l1_label": "IOS"}, {"txt": "拥有中国科学院的人工智能博士学位。", "language": "chinese", "position": {"atoms": [{"position_id": 830, "txt": "拥有中国科学院的人工智能博士学位。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[120]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 120, "global_sentence_id": 171, "edu_l1_label": "IOS"}, {"txt": "谷歌 DeepMind 的首席科学家/研究主管，领导着 LLM 推理团队，致力于构建和教授大型语言模型 (LLM) 以实现完美的泛化。", "language": "chinese", "position": {"atoms": [{"position_id": 831, "txt": "谷歌 DeepMind 的首席科学家/研究主管，领导着 LLM 推理团队，致力于构建和教授大型语言模型 (LLM) 以实现完美的泛化。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[120]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 120, "global_sentence_id": 172, "edu_l1_label": "IOS"}, {"txt": "他们的主要研究成果包括：", "language": "chinese", "position": {"atoms": [{"position_id": 832, "txt": "他们的主要研究成果包括：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[120]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 120, "global_sentence_id": 173, "edu_l1_label": "IOS"}, {"txt": "思维链提示、自洽性、从少到多提示、自调试、思维链解码、类比推理、指令微调、组合泛化、少样本提示和推理的数学理论。", "language": "chinese", "position": {"atoms": [{"position_id": 833, "txt": "思维链提示、自洽性、从少到多提示、自调试、思维链解码、类比推理、指令微调、组合泛化、少样本提示和推理的数学理论。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[120]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 120, "global_sentence_id": 174, "edu_l1_label": "IOS"}, {"txt": "他获得了 2022 年谷歌研究技术影响力奖和 2022 年 WSDM 时间检验奖", "language": "chinese", "position": {"atoms": [{"position_id": 834, "txt": "他获得了 2022 年谷歌研究技术影响力奖和 2022 年 WSDM 时间检验奖", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[120]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 120, "global_sentence_id": 175, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/4uARKN4rjRcCUETdX4DJQ67.png", "language": "chinese", "position": {"atoms": [{"position_id": 415, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/4uARKN4rjRcCUETdX4DJQ67.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[19]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 121, "global_sentence_id": 176, "edu_l1_label": "EDU_O"}, {"txt": "Tengyu Ma，本科毕业于清华大学姚班，于2017年在美国普林斯顿大学获得计算机科学博士学位。", "language": "chinese", "position": {"atoms": [{"position_id": 836, "txt": "Tengyu Ma", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[122]/strong"}, {"position_id": 838, "txt": "，本科毕业于清华大学姚班，于2017年在美国普林斯顿大学获得计算机科学博士学位。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[122]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 122, "global_sentence_id": 177, "edu_l1_label": "IOS"}, {"txt": "斯坦福大学计算机科学与统计学助理教授，主要研究方向包括机器学习、算法及其理论，如深度学习、（深度）强化学习、预训练/基础模型、鲁棒性、非凸优化、分布式优化和高维统计，2021年斯隆奖得主，他是姚班校友、陈丹琦的同班同学", "language": "chinese", "position": {"atoms": [{"position_id": 839, "txt": "斯坦福大学计算机科学与统计学助理教授，主要研究方向包括机器学习、算法及其理论，如深度学习、（深度）强化学习、预训练/基础模型、鲁棒性、非凸优化、分布式优化和高维统计，2021年斯隆奖得主，他是姚班校友、陈丹琦的同班同学", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[122]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 122, "global_sentence_id": 178, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/3jzm9us6Mmo2zk3J53l12BW.png", "language": "chinese", "position": {"atoms": [{"position_id": 423, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/3jzm9us6Mmo2zk3J53l12BW.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[21]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 123, "global_sentence_id": 179, "edu_l1_label": "EDU_O"}, {"txt": "OpenAI新发布的o1推理模型通过强化学习和思维链等创新技术的应用，实现了AI推理能力的新突破。", "language": "chinese", "position": {"atoms": [{"position_id": 841, "txt": "OpenAI新发布的o1推理模型通过强化学习和思维链等创新技术的应用，实现了AI推理能力的新突破。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[125]"}]}, "tags": [], "label": "content", "web_segment_id": 124, "global_sentence_id": 180, "edu_l1_label": "IOS"}, {"txt": "这一成果不仅展示了OpenAI在AI领域的深厚积累，也为人工智能的未来发展提供了更多可能性。", "language": "chinese", "position": {"atoms": [{"position_id": 842, "txt": "这一成果不仅展示了OpenAI在AI领域的深厚积累，也为人工智能的未来发展提供了更多可能性。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[125]"}]}, "tags": [], "label": "content", "web_segment_id": 124, "global_sentence_id": 181, "edu_l1_label": "IOS"}, {"txt": "OpenAI新发布的o1推理模型确实在AI领域引起了巨大关注。", "language": "chinese", "position": {"atoms": [{"position_id": 843, "txt": "OpenAI新发布的o1推理模型确实在AI领域引起了巨大关注。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[125]"}]}, "tags": [], "label": "content", "web_segment_id": 124, "global_sentence_id": 182, "edu_l1_label": "IOS"}, {"txt": "o1模型的核心在于其强化学习的搜索与学习机制，这使得模型在处理数学、代码、长程规划等问题上取得了显著进步。", "language": "chinese", "position": {"atoms": [{"position_id": 844, "txt": "o1模型的核心在于其强化学习的搜索与学习机制，这使得模型在处理数学、代码、长程规划等问题上取得了显著进步。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[125]"}]}, "tags": [], "label": "content", "web_segment_id": 124, "global_sentence_id": 183, "edu_l1_label": "IOS"}, {"txt": "o1模型的训练不仅关注于产生合理推理的过程，而且还利用蒙特卡洛树搜索（MCTS）来诱导这些合理推理过程的产生，形成细粒度的奖励信号。", "language": "chinese", "position": {"atoms": [{"position_id": 845, "txt": "o1模型的训练不仅关注于产生合理推理的过程，而且还利用蒙特卡洛树搜索（MCTS）来诱导这些合理推理过程的产生，形成细粒度的奖励信号。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[125]"}]}, "tags": [], "label": "content", "web_segment_id": 124, "global_sentence_id": 184, "edu_l1_label": "IOS"}, {"txt": "这种方法与Deepmind的AlphaGo中使用的Tree Search技术有相似之处，都是通过强化学习来提升模型的推理能力 。", "language": "chinese", "position": {"atoms": [{"position_id": 846, "txt": "这种方法与Deepmind的AlphaGo中使用的Tree Search技术有相似之处，都是通过强化学习来提升模型的推理能力 。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[125]"}]}, "tags": [], "label": "content", "web_segment_id": 124, "global_sentence_id": 185, "edu_l1_label": "IOS"}, {"txt": "o1模型的一个重要特点是它实现真正的通用推理能力。", "language": "chinese", "position": {"atoms": [{"position_id": 848, "txt": "o1模型的一个重要特点是它实现真正的通用推理能力。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[125]/br[2]"}]}, "tags": ["br"], "label": "content", "web_segment_id": 125, "global_sentence_id": 186, "edu_l1_label": "IOS"}, {"txt": "在一系列高难度的基准测试中，o1模型展现出了比GPT-4o更强的实力，甚至能在博士级别的科学问答环节上超越人类专家。", "language": "chinese", "position": {"atoms": [{"position_id": 849, "txt": "在一系列高难度的基准测试中，o1模型展现出了比GPT-4o更强的实力，甚至能在博士级别的科学问答环节上超越人类专家。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[125]/br[2]"}]}, "tags": ["br"], "label": "content", "web_segment_id": 125, "global_sentence_id": 187, "edu_l1_label": "IOS"}, {"txt": "此外，o1模型还采用了后训练扩展律（Post-Training Scaling Laws），这为模型在训练后的性能提升提供了强有力的支持 。", "language": "chinese", "position": {"atoms": [{"position_id": 850, "txt": "此外，o1模型还采用了后训练扩展律（Post-Training Scaling Laws），这为模型在训练后的性能提升提供了强有力的支持 。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[125]/br[2]"}]}, "tags": ["br"], "label": "content", "web_segment_id": 125, "global_sentence_id": 188, "edu_l1_label": "IOS"}, {"txt": "从技术角度来看，o1模型结合了强化学习和思维链（Chain-of-Thought, COT）技术，使大模型能够采用一种“缓慢且逐步”的解决问题方式。", "language": "chinese", "position": {"atoms": [{"position_id": 852, "txt": "从技术角度来看，o1模型结合了强化学习和思维链（Chain-of-Thought, COT）技术，使大模型能够采用一种“缓慢且逐步”的解决问题方式。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[125]/br[4]"}]}, "tags": ["br"], "label": "content", "web_segment_id": 126, "global_sentence_id": 189, "edu_l1_label": "IOS"}, {"txt": "这种结合不仅提高了模型在处理复杂推理任务时的能力，而且还赋予了模型自我学习与进化的能力，从而实现了从“炼大模型”到“精炼大模型”的转变。", "language": "chinese", "position": {"atoms": [{"position_id": 853, "txt": "这种结合不仅提高了模型在处理复杂推理任务时的能力，而且还赋予了模型自我学习与进化的能力，从而实现了从“炼大模型”到“精炼大模型”的转变。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[125]/br[4]"}]}, "tags": ["br"], "label": "content", "web_segment_id": 126, "global_sentence_id": 190, "edu_l1_label": "IOS"}, {"txt": "此外，这种精炼过程还有助于减少模型的参数数量，提高模型的安全性 。", "language": "chinese", "position": {"atoms": [{"position_id": 854, "txt": "此外，这种精炼过程还有助于减少模型的参数数量，提高模型的安全性 。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[125]/br[4]"}]}, "tags": ["br"], "label": "content", "web_segment_id": 126, "global_sentence_id": 191, "edu_l1_label": "IOS"}, {"txt": "o1模型的发布，标志着大模型领域的一次重大突破，它不仅解决了模型在处理复杂问题时的局限性，还为未来的AI研究和发展提供了新的方向。", "language": "chinese", "position": {"atoms": [{"position_id": 855, "txt": "o1模型的发布，标志着大模型领域的一次重大突破，它不仅解决了模型在处理复杂问题时的局限性，还为未来的AI研究和发展提供了新的方向。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[125]/br[4]"}]}, "tags": ["br"], "label": "content", "web_segment_id": 126, "global_sentence_id": 192, "edu_l1_label": "IOS"}, {"txt": "若感兴趣：", "language": "chinese", "position": {"atoms": [{"position_id": 857, "txt": "若感兴趣：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[127]/span[1]"}]}, "tags": [], "label": "content", "web_segment_id": 127, "global_sentence_id": 193, "edu_l1_label": "IOS"}, {"txt": "私有化部署多模态视频理解模型，视频数据标注，围绕国内外上市公司，头部企业视频下游任务做基于开源多模态视频理解模型精度和性能优化，AI解说，短剧剧本AI生成，拍摄脚本AI生成，多模态视频理解培训咨询，融合主流模型接口，GraphRAG，AI法律应用，智能制造、人形机器人、AI大模型+人形机器人及智能制造培训可私信深入交流。", "language": "chinese", "position": {"atoms": [{"position_id": 858, "txt": "私有化部署多模态视频理解模型，视频数据标注，围绕国内外上市公司，头部企业视频下游任务做基于开源多模态视频理解模型精度和性能优化，AI解说，短剧剧本AI生成，拍摄脚本AI生成，多模态视频理解培训咨询，融合主流模型接口，GraphRAG，AI法律应用，智能制造、人形机器人、AI大模型+人形机器人及智能制造培训可私信深入交流。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[127]/span[1]"}]}, "tags": [], "label": "content", "web_segment_id": 127, "global_sentence_id": 194, "edu_l1_label": "IOS"}, {"txt": "如需OpenAI、谷歌、英伟达、智谱、阿里、快手、百度等AI头部企业及全球头部大厂工程师、AI科学家等交流合作，可联系亚太人工智能学会。", "language": "chinese", "position": {"atoms": [{"position_id": 860, "txt": "如需OpenAI、谷歌、英伟达、智谱、阿里、快手、百度等AI头部企业及全球头部大厂工程师、AI科学家等交流合作，可联系亚太人工智能学会。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[127]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 127, "global_sentence_id": 195, "edu_l1_label": "IOS"}, {"txt": "我们最近链接到中国、美国、加拿大等大量AI工程师，如果有明确预算，需要大模型培训、AI咨询、技术支持或资本支持都欢迎联系我们。", "language": "chinese", "position": {"atoms": [{"position_id": 861, "txt": "我们最近链接到中国、美国、加拿大等大量AI工程师，如果有明确预算，需要大模型培训、AI咨询、技术支持或资本支持都欢迎联系我们。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[127]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 127, "global_sentence_id": 196, "edu_l1_label": "IOS"}, {"txt": "微信搜索“全球智能体Agent产业加速服务”或扫二维码，可关注邱维明秘书长的视频号，微信AIGC@AAIA可预约AI咨询和合作。", "language": "chinese", "position": {"atoms": [{"position_id": 862, "txt": "微信搜索“全球智能体Agent产业加速服务”或扫二维码，可关注邱维明秘书长的视频号，微信AIGC@AAIA可预约AI咨询和合作。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[127]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 127, "global_sentence_id": 197, "edu_l1_label": "IOS"}, {"txt": "我们有专业会员社群，欢迎联系加入。", "language": "chinese", "position": {"atoms": [{"position_id": 863, "txt": "我们有专业会员社群，欢迎联系加入。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[127]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 127, "global_sentence_id": 198, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1YljaX3vX9PQ2gRyYL2ZMKnF.jpeg", "language": "chinese", "position": {"atoms": [{"position_id": 441, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1YljaX3vX9PQ2gRyYL2ZMKnF.jpeg", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/section[1]/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 128, "global_sentence_id": 199, "edu_l1_label": "EDU_O"}, {"txt": "亚太人工智能学会(Asia-Pacific Artificial Intelligence Association)于2021年在香港注册成立。", "language": "chinese", "position": {"atoms": [{"position_id": 865, "txt": "亚太人工智能学会(Asia-Pacific Artificial Intelligence Association)于2021年在香港注册成立。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/p[3]/span"}]}, "tags": [], "label": "O", "web_segment_id": 129, "global_sentence_id": 200, "edu_l1_label": "EDU_O"}, {"txt": "亚太人工智能学会(AAIA)是由全球1890位院士自愿组成的学术性、非营利性、非政府性组织。", "language": "chinese", "position": {"atoms": [{"position_id": 866, "txt": "亚太人工智能学会(AAIA)是由全球1890位院士自愿组成的学术性、非营利性、非政府性组织。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/p[3]/span"}]}, "tags": [], "label": "O", "web_segment_id": 129, "global_sentence_id": 201, "edu_l1_label": "EDU_O"}, {"txt": "经过3年发展，亚太人工智能学会（AAIA）已成为全球顶尖AI学会。", "language": "chinese", "position": {"atoms": [{"position_id": 867, "txt": "经过3年发展，亚太人工智能学会（AAIA）已成为全球顶尖AI学会。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/p[3]/span"}]}, "tags": [], "label": "O", "web_segment_id": 129, "global_sentence_id": 202, "edu_l1_label": "EDU_O"}, {"txt": "通过对全球主流人工智能学会官网数据的统计分析发现，与同级别的国际人工智能组织相比，亚太人工智能学会（AAIA）的院士数量和质量都非常领先。", "language": "chinese", "position": {"atoms": [{"position_id": 868, "txt": "通过对全球主流人工智能学会官网数据的统计分析发现，与同级别的国际人工智能组织相比，亚太人工智能学会（AAIA）的院士数量和质量都非常领先。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/p[3]/span"}]}, "tags": [], "label": "O", "web_segment_id": 129, "global_sentence_id": 203, "edu_l1_label": "EDU_O"}, {"txt": "欢迎更多了解我们！", "language": "chinese", "position": {"atoms": [{"position_id": 869, "txt": "欢迎更多了解我们！", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/p[3]/span"}]}, "tags": [], "label": "O", "web_segment_id": 129, "global_sentence_id": 204, "edu_l1_label": "EDU_O"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2SZllC1ZjSeB3bJEMV1QG0gS.jpeg", "language": "chinese", "position": {"atoms": [{"position_id": 456, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2SZllC1ZjSeB3bJEMV1QG0gS.jpeg", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/section[2]/section/section/section/section/section/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 130, "global_sentence_id": 205, "edu_l1_label": "EDU_O"}, {"txt": "【亚太人工智能学会_百度百科】", "language": "chinese", "position": {"atoms": [{"position_id": 871, "txt": "【亚太人工智能学会_百度百科】", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/section[2]/section/div/div/section[1]/section[1]/section/section[2]/span"}]}, "tags": [], "label": "O", "web_segment_id": 131, "global_sentence_id": 206, "edu_l1_label": "EDU_O"}, {"txt": "https://mbd.baidu.com/ma/s/8MoJVYnJ", "language": "chinese", "position": {"atoms": [{"position_id": 873, "txt": "https://mbd.baidu.com/ma/s/8MoJVYnJ", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/section[2]/section/div/div/section[1]/section[2]/span"}]}, "tags": [], "label": "reference", "web_segment_id": 132, "global_sentence_id": 207, "edu_l1_label": "EDU_O"}, {"txt": "【亚太人工智能学会官网网址】", "language": "chinese", "position": {"atoms": [{"position_id": 875, "txt": "【亚太人工智能学会官网网址】", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/section[2]/section/div/div/section[1]/p[2]/span/span"}]}, "tags": [], "label": "O", "web_segment_id": 133, "global_sentence_id": 208, "edu_l1_label": "EDU_O"}, {"txt": "www.aaia-ai.org ", "language": "chinese", "position": {"atoms": [{"position_id": 877, "txt": "www.aaia-ai.org ", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/section[2]/section/div/div/section[1]/p[3]/span/span"}]}, "tags": [], "label": "O", "web_segment_id": 134, "global_sentence_id": 209, "edu_l1_label": "EDU_O"}, {"txt": "<img https://mmbiz.qpic.cn/sz_mmbiz_jpg/OIxkCft4Jh38Mfc9ggp1WfWCXxHmNWz8HmjEKqNVuDb7QicaXbURpVluFl14mXXwib3ODiaHxbSPZ2txeWia9eC7qg/640?wx_fmt=jpeg", "language": "chinese", "position": {"atoms": [{"position_id": 481, "txt": "<img https://mmbiz.qpic.cn/sz_mmbiz_jpg/OIxkCft4Jh38Mfc9ggp1WfWCXxHmNWz8HmjEKqNVuDb7QicaXbURpVluFl14mXXwib3ODiaHxbSPZ2txeWia9eC7qg/640?wx_fmt=jpeg", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/section[2]/section/div/div/section[1]/section[3]/section/img"}]}, "tags": ["img"], "label": "O", "web_segment_id": 135, "global_sentence_id": 210, "edu_l1_label": "EDU_O"}, {"txt": "本文旨在知识分享和交流，欢迎大家批评指正。", "language": "chinese", "position": {"atoms": [{"position_id": 879, "txt": "本文旨在知识分享和交流，欢迎大家批评指正。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/section[2]/section/div/div/section[1]/p[5]/span"}]}, "tags": [], "label": "O", "web_segment_id": 136, "global_sentence_id": 211, "edu_l1_label": "EDU_O"}, {"txt": "ps：", "language": "chinese", "position": {"atoms": [{"position_id": 881, "txt": "ps：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/section[2]/section/div/div/section[2]/span/span[1]/strong/strong"}]}, "tags": ["strong"], "label": "O", "web_segment_id": 137, "global_sentence_id": 212, "edu_l1_label": "EDU_O"}, {"txt": "感谢4连支持", "language": "chinese", "position": {"atoms": [{"position_id": 882, "txt": "感谢", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/section[2]/section/div/div/section[2]/span/span[1]/strong/strong"}, {"position_id": 884, "txt": "4连支持", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/section[2]/section/div/div/section[2]/span/span[2]/strong/strong"}]}, "tags": ["strong"], "label": "O", "web_segment_id": 137, "global_sentence_id": 213, "edu_l1_label": "EDU_O"}, {"txt": "让更多小伙伴看到哦！", "language": "chinese", "position": {"atoms": [{"position_id": 886, "txt": "让更多小伙伴看到哦！", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/section[2]/section/div/div/section[3]/span/strong/strong"}]}, "tags": ["strong"], "label": "O", "web_segment_id": 138, "global_sentence_id": 214, "edu_l1_label": "EDU_O"}, {"txt": "<img https://mmbiz.qpic.cn/sz_mmbiz_gif/OIxkCft4Jh3BiaLaeyedic45TONZFMeJnibzWTNvyD4XPeHcgOYicSiaaSadSmzWrDSy5QsPfW7JaZ5p5FlfVQtJezw/640?wx_fmt=gif", "language": "chinese", "position": {"atoms": [{"position_id": 503, "txt": "<img https://mmbiz.qpic.cn/sz_mmbiz_gif/OIxkCft4Jh3BiaLaeyedic45TONZFMeJnibzWTNvyD4XPeHcgOYicSiaaSadSmzWrDSy5QsPfW7JaZ5p5FlfVQtJezw/640?wx_fmt=gif", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section[22]/section[2]/section/div/div/section[4]/section/img"}]}, "tags": ["img"], "label": "O", "web_segment_id": 139, "global_sentence_id": 215, "edu_l1_label": "EDU_O"}, {"txt": "                        AAIA亚太人工智能学会 AIGC                      ", "language": "chinese", "position": {"atoms": [{"position_id": 888, "txt": "\n                        AAIA亚太人工智能学会 AIGC                      ", "x": "/html/body/div[4]/div[2]/div[2]/div[1]/div[1]/div/div/div/div/div[2]/div/div"}]}, "tags": [], "label": "O", "web_segment_id": 157, "global_sentence_id": 216, "edu_l1_label": "EDU_O"}], "type": "WEB"}
#             ICLR 2024重磅论文！华人团队揭开OpenAI o1模型核心技术成功秘诀          
## 1.o1模型核心原理
### ★强化学习
### ★思维链（Chain of Thought, CoT）
#### ♥思维链（CoT）让Transformer更强大
#### ♥CoT 的实验验证：4个核心问题，CoT 全面胜出！
#### ♥CoT+Transformer模拟门电路
#### ♥理论打通，实际可行？
## 2.o1模型的优势与应用
### 性能优势
### 应用场景广泛
### 未来展望
## 3.o1 背后4位华人作者
