{"entry_id": "8856e20b-576d-43e0-a8ff-c33eb934c2ef", "infos": [{"txt": "扩散模型低位量化突破！", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 0, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "扩散模型低位量化突破！", "x": ""}]}, "tags": [], "label": "O", "web_segment_id": 0, "global_sentence_id": 0, "edu_l1_label": "EDU_O"}, {"txt": "有效扩散量化的极限推向2-4位，W2A4位宽下FID降低58%，超越SOTA方法", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 0, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "有效扩散量化的极限推向2-4位，W2A4位宽下FID降低58%，超越SOTA方法", "x": ""}]}, "tags": [], "label": "O", "web_segment_id": 0, "global_sentence_id": 1, "edu_l1_label": "EDU_O"}, {"txt": "            扩散模型低位量化突破！", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 388, "size": 0, "start": 0, "tags": ["h1"], "tail": 0, "txt": "\n            \n扩散模型低位量化突破！", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/h1"}]}, "tags": ["h1"], "label": "article_title", "web_segment_id": 7, "global_sentence_id": 2, "edu_l1_label": "BOT"}, {"txt": "有效扩散量化的极限推向2-4位，W2A4位宽下FID降低58%，超越SOTA方法          ", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 389, "size": 0, "start": 0, "tags": ["h1"], "tail": 0, "txt": "有效扩散量化的极限推向2-4位，W2A4位宽下FID降低58%，超越SOTA方法\n          ", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/h1"}]}, "tags": ["h1"], "label": "article_title", "web_segment_id": 7, "global_sentence_id": 3, "edu_l1_label": "BOT"}, {"txt": "MPQ-DM团队 投稿", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 391, "size": 0, "start": 0, "tags": ["h5"], "tail": 0, "txt": "MPQ-DM团队 投稿", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h5"}]}, "tags": ["h5"], "label": "author", "web_segment_id": 9, "global_sentence_id": 4, "edu_l1_label": "EDU_O"}, {"txt": "量子位 | 公众号 QbitAI", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 393, "size": 0, "start": 0, "tags": ["br", "h5"], "tail": 0, "txt": "量子位 | 公众号 QbitAI", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h5/br"}]}, "tags": ["br", "h5"], "label": "author", "web_segment_id": 10, "global_sentence_id": 5, "edu_l1_label": "EDU_O"}, {"txt": "降低扩散模型生成的计算成本，性能还保持在高水平！", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 395, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "降低扩散模型生成的计算成本，性能还保持在高水平！", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[1]"}]}, "tags": [], "label": "content", "web_segment_id": 11, "global_sentence_id": 6, "edu_l1_label": "BOS"}, {"txt": "最新研究提出一种用于极低位差分量化的混合精度量化方法。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 397, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "最新研究提出一种用于极低位差分量化的", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[2]"}, {"immutable": false, "orig_start": 0, "position_id": 399, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "混合精度量化", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[2]/strong"}, {"immutable": false, "orig_start": 0, "position_id": 401, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "方法。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[2]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 12, "global_sentence_id": 7, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/4iISNN4do3A4upRe3qf5X6.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 57, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/4iISNN4do3A4upRe3qf5X6.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[3]/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 13, "global_sentence_id": 8, "edu_l1_label": "EDU_O"}, {"txt": "△图1 W2A6位宽下基线和MPQ-DM生成的样本可视化", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 403, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "△", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[3]/strong"}, {"immutable": false, "orig_start": 0, "position_id": 405, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "图1 W2A6位宽下基线和MPQ-DM生成的样本可视化", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[3]/span"}]}, "tags": ["strong"], "label": "figure_title", "web_segment_id": 13, "global_sentence_id": 9, "edu_l1_label": "EDU_O"}, {"txt": "目前，扩散模型在生成任务中受到了广泛关注。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 407, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "目前，扩散模型在生成任务中受到了广泛关注。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[4]"}]}, "tags": [], "label": "content", "web_segment_id": 14, "global_sentence_id": 10, "edu_l1_label": "IOS"}, {"txt": "然而，昂贵的计算成本阻碍了扩散模型在资源受限场景中的应用。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 408, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "然而，昂贵的计算成本阻碍了扩散模型在资源受限场景中的应用。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[4]"}]}, "tags": [], "label": "content", "web_segment_id": 14, "global_sentence_id": 11, "edu_l1_label": "IOS"}, {"txt": "量化是一种实用的解决方案，通过减少参数的位宽来显著节省存储和计算。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 410, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "量化是一种实用的解决方案，通过减少参数的位宽来显著节省存储和计算。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[5]"}]}, "tags": [], "label": "content", "web_segment_id": 15, "global_sentence_id": 12, "edu_l1_label": "IOS"}, {"txt": "然而，现有的扩散模型量化方法仍然会导致性能严重下降，特别是在极低的位宽（2-4位）下。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 411, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "然而，现有的扩散模型量化方法仍然会导致性能严重下降，特别是在极低的位宽", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[5]"}, {"immutable": false, "orig_start": 0, "position_id": 413, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "（2-4位）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[5]/span"}, {"immutable": false, "orig_start": 0, "position_id": 415, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "下。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[5]/span"}]}, "tags": [], "label": "content", "web_segment_id": 15, "global_sentence_id": 13, "edu_l1_label": "IOS"}, {"txt": "性能的主要下降来自低位量化时激活值的显著离散化。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 417, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "性能的主要下降来自", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[6]"}, {"immutable": false, "orig_start": 0, "position_id": 419, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "低位量化时激活值的显著离散化", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[6]/strong"}, {"immutable": false, "orig_start": 0, "position_id": 421, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[6]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 16, "global_sentence_id": 14, "edu_l1_label": "IOS"}, {"txt": "太少的激活候选对离群值显著权重通道量化不友好，离散特征阻碍了扩散模型在不同时间步长上的稳定学习。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 422, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "太少的激活候选对离群值显著权重通道量化不友好，离散特征阻碍了扩散模型在不同时间步长上的稳定学习。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[6]/strong"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 16, "global_sentence_id": 15, "edu_l1_label": "IOS"}, {"txt": "为此，来自中国科学院计算技术研究所、苏黎世联邦理工学院、北京交通大学的研究人员提出了由离群值驱动的混合量化（OMD）和时间平滑关系蒸馏（TRD）组成的极低位扩散模型（MPQ-DM）的混合精度量化。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 424, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "为此，来自中国科学院计算技术研究所、苏黎世联邦理工学院、北京交通大学的研究人员提出了由离群值驱动的混合量化", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[7]"}, {"immutable": false, "orig_start": 0, "position_id": 426, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "（OMD）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[7]/span[1]"}, {"immutable": false, "orig_start": 0, "position_id": 428, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "和时间平滑关系蒸馏", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[7]/span[1]"}, {"immutable": false, "orig_start": 0, "position_id": 430, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "（TRD）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[7]/span[2]"}, {"immutable": false, "orig_start": 0, "position_id": 432, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "组成的", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[7]/span[2]"}, {"immutable": false, "orig_start": 0, "position_id": 434, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "极低位扩散模型", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[7]/strong"}, {"immutable": false, "orig_start": 0, "position_id": 436, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "（MPQ-DM）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[7]/span[3]"}, {"immutable": false, "orig_start": 0, "position_id": 438, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "的混合精度量化。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[7]/span[3]"}]}, "tags": ["strong"], "label": "content", "web_segment_id": 17, "global_sentence_id": 16, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/18EbMX3PdgQ2Mih6v1VFgVC.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 73, "size": 0, "start": 0, "tags": ["h6", "img", "strong"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/18EbMX3PdgQ2Mih6v1VFgVC.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[1]/strong/img"}]}, "tags": ["h6", "img", "strong"], "label": "figure", "web_segment_id": 18, "global_sentence_id": 17, "edu_l1_label": "EDU_O"}, {"txt": "△图2 MPQ-DM概述", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 440, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "△", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[2]/strong"}, {"immutable": false, "orig_start": 0, "position_id": 442, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "图2 MPQ-DM概述", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[2]/strong"}]}, "tags": ["h6", "strong"], "label": "figure_title", "web_segment_id": 19, "global_sentence_id": 18, "edu_l1_label": "EDU_O"}, {"txt": "MPQ-DM主要依赖于两种技术：", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 444, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "MPQ-DM主要依赖于两种技术：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[8]"}]}, "tags": [], "label": "content", "web_segment_id": 20, "global_sentence_id": 19, "edu_l1_label": "IOS"}, {"txt": "为减轻异常值权重信道引起的量化误差，团队提出了一种异常值驱动的混合量化（OMQ）技术，该技术使用峰度来量化异常值显著信道，并应用优化的层内混合精度比特宽度分配，以在目标效率范围内恢复精度性能。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 446, "size": 0, "start": 0, "tags": ["li"], "tail": 0, "txt": "为减轻异常值权重信道引起的量化误差，团队提出了一种异常值驱动的混合量化", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ul/li[1]/p"}, {"immutable": false, "orig_start": 0, "position_id": 448, "size": 0, "start": 0, "tags": ["li"], "tail": 0, "txt": "（OMQ）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ul/li[1]/p/span"}, {"immutable": false, "orig_start": 0, "position_id": 450, "size": 0, "start": 0, "tags": ["li"], "tail": 0, "txt": "技术，该技术使用峰度来量化异常值显著信道，并应用优化的层内混合精度比特宽度分配，以在目标效率范围内恢复精度性能。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ul/li[1]/p/span"}]}, "tags": ["li"], "label": "content", "web_segment_id": 21, "global_sentence_id": 20, "edu_l1_label": "IOS"}, {"txt": "为了鲁棒地学习跨越时间步长的表示，团队在量化扩散模型与其全精度对应物之间构建了一个时间平滑关系蒸馏（TRD）方案，将离散和连续的潜势转移到统一的关系空间，以减少表示的不一致性。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 452, "size": 0, "start": 0, "tags": ["li"], "tail": 0, "txt": "为了鲁棒地学习跨越时间步长的表示，团队在量化扩散模型与其全精度对应物之间构建了一个时间平滑关系蒸馏", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ul/li[2]/p"}, {"immutable": false, "orig_start": 0, "position_id": 454, "size": 0, "start": 0, "tags": ["li"], "tail": 0, "txt": "（TRD）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ul/li[2]/p/span"}, {"immutable": false, "orig_start": 0, "position_id": 456, "size": 0, "start": 0, "tags": ["li"], "tail": 0, "txt": "方案，将离散和连续的潜势转移到统一的关系空间，以减少表示的不一致性。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/ul/li[2]/p/span"}]}, "tags": ["li"], "label": "content", "web_segment_id": 22, "global_sentence_id": 21, "edu_l1_label": "IOS"}, {"txt": "综合实验表明，与SOTA量化方法相比，MPQ-DM在极低的比特宽度下实现了显著的精度增益。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 458, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "综合实验表明，与SOTA量化方法相比，MPQ-DM在极低的比特宽度下实现了显著的精度增益。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[9]"}]}, "tags": [], "label": "content", "web_segment_id": 23, "global_sentence_id": 22, "edu_l1_label": "IOS"}, {"txt": "与基线相比，在W2A4设置下，MPQ-DM的FID降低了58%，而所有其他方法甚至无法生成正常的图像。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 459, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "与基线相比，在W2A4设置下，MPQ-DM的FID降低了58%，而所有其他方法甚至无法生成正常的图像。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[9]"}]}, "tags": [], "label": "content", "web_segment_id": 23, "global_sentence_id": 23, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/4sDVg1cGPhD2chQIt1aNgZM.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 86, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/4sDVg1cGPhD2chQIt1aNgZM.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[10]/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 24, "global_sentence_id": 24, "edu_l1_label": "EDU_O"}, {"txt": "相关工作", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 461, "size": 0, "start": 0, "tags": ["h2"], "tail": 0, "txt": "相关工作", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h2[1]"}]}, "tags": ["h2"], "label": "title1", "web_segment_id": 25, "global_sentence_id": 25, "edu_l1_label": "BOS"}, {"txt": "扩散模型", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 463, "size": 0, "start": 0, "tags": ["h4"], "tail": 0, "txt": "扩散模型", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h4[1]"}]}, "tags": ["h4"], "label": "title2", "web_segment_id": 26, "global_sentence_id": 26, "edu_l1_label": "IOS"}, {"txt": "扩散模型通过逐步向数据分布x0∼q（x）添加噪声来执行前向采样过程。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 465, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "扩散模型通过逐步向数据分布x0∼q（x）添加噪声来执行前向采样过程。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[11]"}]}, "tags": [], "label": "content", "web_segment_id": 27, "global_sentence_id": 27, "edu_l1_label": "IOS"}, {"txt": "在DDPM中，扩散模型的前向噪声添加过程是马尔可夫链，其形式为：", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 466, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "在DDPM中，扩散模型的前向噪声添加过程是马尔可夫链，其形式为：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[11]"}]}, "tags": [], "label": "content", "web_segment_id": 27, "global_sentence_id": 28, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/3PhLpv3hxAll4iQ7F243Herd.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 91, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/3PhLpv3hxAll4iQ7F243Herd.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[12]/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 28, "global_sentence_id": 29, "edu_l1_label": "EDU_O"}, {"txt": "其中αt=1−βt , βt 是时间相关的时间表。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 468, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "其中α", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[13]"}, {"immutable": false, "orig_start": 0, "position_id": 470, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "t", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[13]/sub[1]"}, {"immutable": false, "orig_start": 0, "position_id": 472, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "=1−β", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[13]/sub[1]"}, {"immutable": false, "orig_start": 0, "position_id": 474, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "t", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[13]/sub[2]"}, {"immutable": false, "orig_start": 0, "position_id": 476, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": " , β", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[13]/sub[2]"}, {"immutable": false, "orig_start": 0, "position_id": 478, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "t", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[13]/sub[3]"}, {"immutable": false, "orig_start": 0, "position_id": 480, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": " 是时间相关的时间表。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[13]/sub[3]"}]}, "tags": [], "label": "content", "web_segment_id": 29, "global_sentence_id": 30, "edu_l1_label": "IOS"}, {"txt": "扩散模型通过对随机采样的高斯噪声 xT∼N(0, I)应用去噪过程来生成高质量图像，形式如下：", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 481, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "扩散模型通过对随机采样的高斯噪声 x", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[13]/sub[3]"}, {"immutable": false, "orig_start": 0, "position_id": 483, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "T", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[13]/sub[4]"}, {"immutable": false, "orig_start": 0, "position_id": 485, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "∼N(0, I)应用去噪过程来生成高质量图像，形式如下：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[13]/sub[4]"}]}, "tags": [], "label": "content", "web_segment_id": 29, "global_sentence_id": 31, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/3rdXAC1uGv8b1lSoJUkp1iP.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 98, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/3rdXAC1uGv8b1lSoJUkp1iP.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[14]/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 30, "global_sentence_id": 32, "edu_l1_label": "EDU_O"}, {"txt": "扩散模型量化", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 487, "size": 0, "start": 0, "tags": ["h4"], "tail": 0, "txt": "扩散模型量化", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h4[2]"}]}, "tags": ["h4"], "label": "title2", "web_segment_id": 31, "global_sentence_id": 33, "edu_l1_label": "IOS"}, {"txt": "训练后量化（PTQ）和量化感知训练（QAT）是模型量化的两种主要方法。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 489, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "训练后量化", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[15]"}, {"immutable": false, "orig_start": 0, "position_id": 491, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "（PTQ）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[15]/span[1]"}, {"immutable": false, "orig_start": 0, "position_id": 493, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "和量化感知训练", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[15]/span[1]"}, {"immutable": false, "orig_start": 0, "position_id": 495, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "（QAT）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[15]/span[2]"}, {"immutable": false, "orig_start": 0, "position_id": 497, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "是模型量化的两种主要方法。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[15]/span[2]"}]}, "tags": [], "label": "content", "web_segment_id": 32, "global_sentence_id": 34, "edu_l1_label": "IOS"}, {"txt": "常用的QAT方法，如LSQ和扩散模型Q-dm和Binarydm的方法，确保了模型在极低比特宽度甚至二进制量化下的性能，但与PTQ方法相比，它们需要大量额外的训练时间，从而导致更大的训练负担。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 499, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "常用的QAT方法，如LSQ和扩散模型Q-dm和Binarydm的方法，确保了模型在极低比特宽度甚至二进制量化下的性能，但与PTQ方法相比，它们需要大量额外的训练时间，从而导致更大的训练负担。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[16]"}]}, "tags": [], "label": "content", "web_segment_id": 33, "global_sentence_id": 35, "edu_l1_label": "IOS"}, {"txt": "对扩散模型PTQ4DM和Q-diffusion的PTQ方法进行了初步探索。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 500, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "对扩散模型PTQ4DM和Q-diffusion的PTQ方法进行了初步探索。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[16]"}]}, "tags": [], "label": "content", "web_segment_id": 33, "global_sentence_id": 36, "edu_l1_label": "IOS"}, {"txt": "以下工作PTQ-D，TFMQ-DM，APQ-DM和QuEST在量化误差方向、瞬态特征、校准数据和校准模块方面进行了改进。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 502, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "以下工作PTQ-D，TFMQ-DM，APQ-DM和QuEST在量化误差方向、瞬态特征、校准数据和校准模块方面进行了改进。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[17]"}]}, "tags": [], "label": "content", "web_segment_id": 34, "global_sentence_id": 37, "edu_l1_label": "IOS"}, {"txt": "量化后的扩散模型的性能得到了进一步的提升。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 503, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "量化后的扩散模型的性能得到了进一步的提升。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[17]"}]}, "tags": [], "label": "content", "web_segment_id": 34, "global_sentence_id": 38, "edu_l1_label": "IOS"}, {"txt": "然而，基于PTQ的方法在极低的比特宽度下性能严重下降。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 505, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "然而，基于PTQ的方法在极低的比特宽度下性能严重下降。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[18]"}]}, "tags": [], "label": "content", "web_segment_id": 35, "global_sentence_id": 39, "edu_l1_label": "IOS"}, {"txt": "为了结合QAT的优点并减少所需的训练时间，EfficientDM使用LoRA方法对量化扩散模型进行微调。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 506, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "为了结合QAT的优点并减少所需的训练时间，EfficientDM使用LoRA方法对量化扩散模型进行微调。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[18]"}]}, "tags": [], "label": "content", "web_segment_id": 35, "global_sentence_id": 40, "edu_l1_label": "IOS"}, {"txt": "然而，这两种有效的量化方法都不能保证差分模型在低位下的性能。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 507, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "然而，这两种有效的量化方法都不能保证差分模型在低位下的性能。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[18]"}]}, "tags": [], "label": "content", "web_segment_id": 35, "global_sentence_id": 41, "edu_l1_label": "IOS"}, {"txt": "因此，本文的重点是最大限度地提高极低位量化扩散模型的性能。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 508, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "因此，本文的重点是最大限度地提高极低位量化扩散模型的性能。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[18]"}]}, "tags": [], "label": "content", "web_segment_id": 35, "global_sentence_id": 42, "edu_l1_label": "IOS"}, {"txt": "方法", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 510, "size": 0, "start": 0, "tags": ["h2"], "tail": 0, "txt": "方法", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h2[2]"}]}, "tags": ["h2"], "label": "title1", "web_segment_id": 36, "global_sentence_id": 43, "edu_l1_label": "BOS"}, {"txt": "模型量化", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 512, "size": 0, "start": 0, "tags": ["h4"], "tail": 0, "txt": "模型量化", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h4[3]"}]}, "tags": ["h4"], "label": "title2", "web_segment_id": 37, "global_sentence_id": 44, "edu_l1_label": "IOS"}, {"txt": "模型量化将模型权重和激活映射到低位整数值，以减少内存占用并加速推理。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 514, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "模型量化将模型权重和激活映射到低位整数值，以减少内存占用并加速推理。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[19]"}]}, "tags": [], "label": "content", "web_segment_id": 38, "global_sentence_id": 45, "edu_l1_label": "IOS"}, {"txt": "对于浮动向量xf，量化过程可以公式化为：", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 515, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "对于浮动向量x", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[19]"}, {"immutable": false, "orig_start": 0, "position_id": 517, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "f", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[19]/sub"}, {"immutable": false, "orig_start": 0, "position_id": 519, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "，量化过程可以公式化为：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[19]/sub"}]}, "tags": [], "label": "content", "web_segment_id": 38, "global_sentence_id": 46, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/4zMJ6M2F1vAJjEX463AYKdf.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 111, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/4zMJ6M2F1vAJjEX463AYKdf.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[20]/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 39, "global_sentence_id": 47, "edu_l1_label": "EDU_O"}, {"txt": "其中", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 521, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "其中", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[21]"}]}, "tags": [], "label": "content", "web_segment_id": 40, "global_sentence_id": 48, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/nmYK62TyOSt1vb2wT1lkJzU.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 113, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/nmYK62TyOSt1vb2wT1lkJzU.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[21]/img[1]"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 40, "global_sentence_id": 49, "edu_l1_label": "IOS"}, {"txt": "表示整数中的量化向量，⌊·⌉是舍入函数，clip(·)是将值限制在[0，2N−1]范围内的函数，s是比例因子，z是量化零点。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 523, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "表示整数中的量化向量，⌊·⌉是舍入函数，clip(·)是将值限制在[0，2N−1]范围内的函数，s是比例因子，z是量化零点。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[21]/img[1]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 40, "global_sentence_id": 50, "edu_l1_label": "IOS"}, {"txt": "l和u分别是量化阈值的下限和上限。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 524, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "l和u分别是量化阈值的下限和上限。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[21]/img[1]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 40, "global_sentence_id": 51, "edu_l1_label": "IOS"}, {"txt": "它们由xf和目标位宽决定。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 525, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "它们由x", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[21]/img[1]"}, {"immutable": false, "orig_start": 0, "position_id": 527, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "f", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[21]/sub"}, {"immutable": false, "orig_start": 0, "position_id": 529, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "和目标位宽决定。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[21]/sub"}]}, "tags": ["img"], "label": "content", "web_segment_id": 40, "global_sentence_id": 52, "edu_l1_label": "IOS"}, {"txt": "相反，为了将低位整数量化向量", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 530, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "相反，为了将低位整数量化向量", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[21]/sub"}]}, "tags": [], "label": "content", "web_segment_id": 40, "global_sentence_id": 53, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/nmYK62TyOSt1vb2wT1lkJzU.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 115, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/nmYK62TyOSt1vb2wT1lkJzU.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[21]/img[2]"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 40, "global_sentence_id": 54, "edu_l1_label": "IOS"}, {"txt": "恢复到全精度表示，反量化过程公式为：", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 532, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "恢复到全精度表示，反量化过程公式为：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[21]/img[2]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 40, "global_sentence_id": 55, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/15gXBr2MN4S52luNpd3fytM4.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 117, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/15gXBr2MN4S52luNpd3fytM4.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[22]/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 41, "global_sentence_id": 56, "edu_l1_label": "EDU_O"}, {"txt": "其中", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 534, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "其中", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[23]"}]}, "tags": [], "label": "content", "web_segment_id": 42, "global_sentence_id": 57, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1obdLq2m1b8CI6XeCOSuy9.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 119, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1obdLq2m1b8CI6XeCOSuy9.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[23]/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 42, "global_sentence_id": 58, "edu_l1_label": "IOS"}, {"txt": "是用于正向处理的去量化向量。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 536, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "是用于正向处理的去量化向量。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[23]/img"}]}, "tags": ["img"], "label": "content", "web_segment_id": 42, "global_sentence_id": 59, "edu_l1_label": "IOS"}, {"txt": "离群值指导的混合精度量化", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 538, "size": 0, "start": 0, "tags": ["h4"], "tail": 0, "txt": "离群值指导的混合精度量化", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h4[4]"}]}, "tags": ["h4"], "label": "title2", "web_segment_id": 43, "global_sentence_id": 60, "edu_l1_label": "IOS"}, {"txt": "扩散模型的一些研究发现，存在一些具有显著权重值的通道，这些通道对量化误差和模型性能也至关重要。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 540, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "扩散模型的一些研究发现，存在一些具有显著权重值的通道，这些通道对量化误差和模型性能也至关重要。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[24]"}]}, "tags": [], "label": "content", "web_segment_id": 44, "global_sentence_id": 61, "edu_l1_label": "IOS"}, {"txt": "团队在图3a中可视化了扩散模型的一层权重分布，在图3b中可视化了其对应的异常显著通道分布。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 542, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "团队在图3a中可视化了扩散模型的一层权重分布，在图3b中可视化了其对应的异常显著通道分布。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[25]"}]}, "tags": [], "label": "content", "web_segment_id": 45, "global_sentence_id": 62, "edu_l1_label": "IOS"}, {"txt": "可以发现，不仅不同通道的权重在数值范围内存在较大差距，而且一些权重通道也存在严重的异常值。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 543, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "可以发现，不仅不同通道的权重在数值范围内存在较大差距，而且一些权重通道也存在严重的异常值。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[25]"}]}, "tags": [], "label": "content", "web_segment_id": 45, "global_sentence_id": 63, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/IBNkE25uL4k1Lb8Ht1zyXVs.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 125, "size": 0, "start": 0, "tags": ["h6", "img", "strong"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/IBNkE25uL4k1Lb8Ht1zyXVs.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[3]/strong/img"}]}, "tags": ["h6", "img", "strong"], "label": "figure", "web_segment_id": 46, "global_sentence_id": 64, "edu_l1_label": "EDU_O"}, {"txt": "△图3 LDM-4 ImageNet 256x256的权重分布", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 545, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "△", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[4]/strong"}, {"immutable": false, "orig_start": 0, "position_id": 547, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "图3 LDM-4 ImageNet 256x256的权重分布", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[4]/strong"}]}, "tags": ["strong", "h6"], "label": "figure_title", "web_segment_id": 47, "global_sentence_id": 65, "edu_l1_label": "EDU_O"}, {"txt": "在图3c和图3d中，团队可视化了两个通道的权重分布。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 549, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "在图3c和图3d中，团队可视化了两个通道的权重分布。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[26]"}]}, "tags": [], "label": "content", "web_segment_id": 48, "global_sentence_id": 66, "edu_l1_label": "IOS"}, {"txt": "总体权重分布可以被视为正态分布加上异常值分布。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 551, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "总体权重分布可以被视为正态分布加上异常值分布。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[27]"}]}, "tags": [], "label": "content", "web_segment_id": 49, "global_sentence_id": 67, "edu_l1_label": "IOS"}, {"txt": "对于模型量化，正态分布的直接量化得到了很好的研究，但少量异常值的存在可能会导致一些异常值被箝位或占据部分比特宽度，从而难以量化主正态分布，导致量化误差。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 552, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "对于模型量化，正态分布的直接量化得到了很好的研究，但少量异常值的存在可能会导致一些异常值被箝位或占据部分比特宽度，从而难以量化主正态分布，导致量化误差。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[27]"}]}, "tags": [], "label": "content", "web_segment_id": 49, "global_sentence_id": 68, "edu_l1_label": "IOS"}, {"txt": "这种误差在极低的位宽（2-4位）下会大大放大，因此团队自然希望为这些通道分配更多的位宽，以确保它们的性能。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 554, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "这种误差在极低的位宽", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[28]"}, {"immutable": false, "orig_start": 0, "position_id": 556, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "（2-4位）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[28]/span"}, {"immutable": false, "orig_start": 0, "position_id": 558, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "下会大大放大，因此团队自然希望为这些通道分配更多的位宽，以确保它们的性能。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[28]/span"}]}, "tags": [], "label": "content", "web_segment_id": 50, "global_sentence_id": 69, "edu_l1_label": "IOS"}, {"txt": "然而，在特定通道中的这种异常现象可能发生在模型的各个层。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 559, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "然而，在特定通道中的这种异常现象可能发生在模型的各个层。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[28]/span"}]}, "tags": [], "label": "content", "web_segment_id": 50, "global_sentence_id": 70, "edu_l1_label": "IOS"}, {"txt": "因此，使用传统方法将不同的比特分配给不同的模型层进行混合精度量化显然不是一个好的选择。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 561, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "因此，使用传统方法将不同的比特分配给不同的模型层进行混合精度量化显然不是一个好的选择。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[29]"}]}, "tags": [], "label": "content", "web_segment_id": 51, "global_sentence_id": 71, "edu_l1_label": "IOS"}, {"txt": "但是由于权重的量化是逐信道的，团队可以在层内的不同信道之间重新分配量化比特宽度来解决这个问题，即层内混合精度量化。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 562, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "但是由于权重的量化是逐信道的，团队可以在层内的不同信道之间重新分配量化比特宽度来解决这个问题，即层内混合精度量化。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[29]"}]}, "tags": [], "label": "content", "web_segment_id": 51, "global_sentence_id": 72, "edu_l1_label": "IOS"}, {"txt": "为了确定具体的比特宽度分配方法，需要量化输出的重要性。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 564, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "为了确定具体的比特宽度分配方法，需要量化输出的重要性。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[30]"}]}, "tags": [], "label": "content", "web_segment_id": 52, "global_sentence_id": 73, "edu_l1_label": "IOS"}, {"txt": "峰度κ可用于量化实值变量概率分布的“尾性”。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 566, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "峰度κ可用于量化实值变量概率分布的“尾性”。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[31]"}]}, "tags": [], "label": "content", "web_segment_id": 53, "global_sentence_id": 74, "edu_l1_label": "IOS"}, {"txt": "这自然与团队的目标相一致，因为异常值将异常的长尾添加到正态分布中，如上所述。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 567, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "这自然与团队的目标相一致，因为异常值将异常的长尾添加到正态分布中，如上所述。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[31]"}]}, "tags": [], "label": "content", "web_segment_id": 53, "global_sentence_id": 75, "edu_l1_label": "IOS"}, {"txt": "如图3c和图3d所示，与没有异常值的正态分布相比，具有更显著异常值现象的通道具有更高的κ值。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 568, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "如图3c和图3d所示，与没有异常值的正态分布相比，具有更显著异常值现象的通道具有更高的κ值。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[31]"}]}, "tags": [], "label": "content", "web_segment_id": 53, "global_sentence_id": 76, "edu_l1_label": "IOS"}, {"txt": "因此，团队使用峰度κ作为量化不同权重通道难度的指标，为每层权重Wf找到最佳比特分配方法。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 569, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "因此，团队使用峰度κ作为量化不同权重通道难度的指标，为每层权重W", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[31]"}, {"immutable": false, "orig_start": 0, "position_id": 571, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "f", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[31]/sub"}, {"immutable": false, "orig_start": 0, "position_id": 573, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "找到最佳比特分配方法。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[31]/sub"}]}, "tags": [], "label": "content", "web_segment_id": 53, "global_sentence_id": 77, "edu_l1_label": "IOS"}, {"txt": "团队希望在混合比特宽度分配量化后，模型输出尽可能与全精度模型保持一致。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 575, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "团队希望在混合比特宽度分配量化后，模型输出尽可能与全精度模型保持一致。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[32]"}]}, "tags": [], "label": "content", "web_segment_id": 54, "global_sentence_id": 78, "edu_l1_label": "IOS"}, {"txt": "由于团队的目标是模型输出Y=XWT，并且异常值是权重中的最大值或最小值，因此团队可以在量化之前使用矩阵乘法的特性来降低异常值的显著程度，而不会造成损失，如下所示：", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 576, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "由于团队的目标是模型输出Y=XW", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[32]"}, {"immutable": false, "orig_start": 0, "position_id": 578, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "T", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[32]/sub"}, {"immutable": false, "orig_start": 0, "position_id": 580, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "，并且异常值是权重中的最大值或最小值，因此团队可以在量化之前使用矩阵乘法的特性来降低异常值的显著程度，而不会造成损失，如下所示：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[32]/sub"}]}, "tags": [], "label": "content", "web_segment_id": 54, "global_sentence_id": 79, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/KQ7bA1w0lfD3GAavOiTJWl.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 139, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/KQ7bA1w0lfD3GAavOiTJWl.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[33]/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 55, "global_sentence_id": 80, "edu_l1_label": "EDU_O"}, {"txt": "其中Y、X和W表示输出激活、输入激活和模型权重。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 582, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "其中Y、X和W表示输出激活、输入激活和模型权重。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[34]"}]}, "tags": [], "label": "content", "web_segment_id": 56, "global_sentence_id": 81, "edu_l1_label": "IOS"}, {"txt": "δ是一个通道平滑因子，通过将异常值缩放到更接近正态分布来平衡权重和激活的量化难度。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 583, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "δ是一个通道平滑因子，通过将异常值缩放到更接近正态分布来平衡权重和激活的量化难度。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[34]"}]}, "tags": [], "label": "content", "web_segment_id": 56, "global_sentence_id": 82, "edu_l1_label": "IOS"}, {"txt": "经过预缩放后，离群显著通道更平滑以进行量化。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 584, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "经过预缩放后，离群显著通道更平滑以进行量化。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[34]"}]}, "tags": [], "label": "content", "web_segment_id": 56, "global_sentence_id": 83, "edu_l1_label": "IOS"}, {"txt": "团队为每个权重通道计算κ，并相应地对其进行排序。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 585, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "团队为每个权重通道计算κ，并相应地对其进行排序。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[34]"}]}, "tags": [], "label": "content", "web_segment_id": 56, "global_sentence_id": 84, "edu_l1_label": "IOS"}, {"txt": "然后，团队使用以下优化公式来确定异常突出和非客户端通道，如下所示：", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 586, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "然后，团队使用以下优化公式来确定异常突出和非客户端通道，如下所示：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[34]"}]}, "tags": [], "label": "content", "web_segment_id": 56, "global_sentence_id": 85, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/ZxGui3fHvZA3he5ZW1qXZBh.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 142, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/ZxGui3fHvZA3he5ZW1qXZBh.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[35]/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 57, "global_sentence_id": 86, "edu_l1_label": "EDU_O"}, {"txt": "其中N是目标平均比特宽度，n是权重中的通道数。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 588, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "其中N是目标平均比特宽度，n是权重中的通道数。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[36]"}]}, "tags": [], "label": "content", "web_segment_id": 58, "global_sentence_id": 87, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2XzBz9h5HnBYTQVG1ylNle.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 144, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2XzBz9h5HnBYTQVG1ylNle.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[36]/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 58, "global_sentence_id": 88, "edu_l1_label": "IOS"}, {"txt": "表示量化和去量化过程。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 590, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "表示量化和去量化过程。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[36]/img"}]}, "tags": ["img"], "label": "content", "web_segment_id": 58, "global_sentence_id": 89, "edu_l1_label": "IOS"}, {"txt": "团队采用通道混合比特量化为", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 592, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "团队采用通道混合比特量化为", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[37]"}]}, "tags": [], "label": "content", "web_segment_id": 59, "global_sentence_id": 90, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/13slXC1KSMTS4cjAYQ1TxmcF.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 146, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/13slXC1KSMTS4cjAYQ1TxmcF.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[37]/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 59, "global_sentence_id": 91, "edu_l1_label": "IOS"}, {"txt": "，其中ci表示第i个信道的比特宽度。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 594, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "，其中c", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[37]/img"}, {"immutable": false, "orig_start": 0, "position_id": 596, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "i", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[37]/sub"}, {"immutable": false, "orig_start": 0, "position_id": 598, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "表示第i个信道的比特宽度。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[37]/sub"}]}, "tags": ["img"], "label": "content", "web_segment_id": 59, "global_sentence_id": 92, "edu_l1_label": "IOS"}, {"txt": "C表示信道共享相同位宽的集合，|C|表示集合C中的信道数量。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 599, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "C表示信道共享相同位宽的集合，|C|表示集合C中的信道数量。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[37]/sub"}]}, "tags": [], "label": "content", "web_segment_id": 59, "global_sentence_id": 93, "edu_l1_label": "IOS"}, {"txt": "例如，对于3位量化，团队将一些异常显著信道分配给4位，并将相同数量的异常非客户端信道重新分配给2位。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 600, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "例如，对于3位量化，团队将一些异常显著信道分配给4位，并将相同数量的异常非客户端信道重新分配给2位。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[37]/sub"}]}, "tags": [], "label": "content", "web_segment_id": 59, "global_sentence_id": 94, "edu_l1_label": "IOS"}, {"txt": "这样，层权重的平均总位宽仍然是3位，而不添加任何额外参数。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 601, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "这样，层权重的平均总位宽仍然是3位，而不添加任何额外参数。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[37]/sub"}]}, "tags": [], "label": "content", "web_segment_id": 59, "global_sentence_id": 95, "edu_l1_label": "IOS"}, {"txt": "为了加速优化过程，团队将k个通道设置为一个搜索组，离群显著通道的搜索区域约束在", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 603, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "为了加速优化过程，团队将k个通道设置为一个搜索组，离群显著通道的搜索区域约束在", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[38]"}]}, "tags": [], "label": "content", "web_segment_id": 60, "global_sentence_id": 96, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2s0IFZ3wxY9P1vusiI27w0qN.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 149, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2s0IFZ3wxY9P1vusiI27w0qN.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[38]/img[1]"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 60, "global_sentence_id": 97, "edu_l1_label": "IOS"}, {"txt": "中。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 605, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "中。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[38]/img[1]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 60, "global_sentence_id": 98, "edu_l1_label": "IOS"}, {"txt": "团队根据经验将k设置为", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 606, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "团队根据经验将k设置为", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[38]/img[1]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 60, "global_sentence_id": 99, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/15RYKM1AUE1X3k4LMewKK5u.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 150, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/15RYKM1AUE1X3k4LMewKK5u.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[38]/img[2]"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 60, "global_sentence_id": 100, "edu_l1_label": "IOS"}, {"txt": "，因此搜索时间是5倍，这对于层比特分配来说足够有效。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 608, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "，因此搜索时间是5倍，这对于层比特分配来说足够有效。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[38]/img[2]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 60, "global_sentence_id": 101, "edu_l1_label": "IOS"}, {"txt": "时间步平滑的关系蒸馏", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 610, "size": 0, "start": 0, "tags": ["h4"], "tail": 0, "txt": "时间步平滑的关系蒸馏", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h4[5]"}]}, "tags": ["h4"], "label": "title2", "web_segment_id": 61, "global_sentence_id": 102, "edu_l1_label": "IOS"}, {"txt": "对于扩散优化，现有的方法，如EfficientDM，通过对齐全精度（FP）模型和量化模型的输出来优化量化模型的训练参数:", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 612, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "对于扩散优化，现有的方法，如EfficientDM，通过对齐全精度（FP）模型和量化模型的输出来优化量化模型的训练参数:", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[39]"}]}, "tags": [], "label": "content", "web_segment_id": 62, "global_sentence_id": 103, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/14edIv1NIPdFXlKfu2gCaH2.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 154, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/14edIv1NIPdFXlKfu2gCaH2.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[40]/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 63, "global_sentence_id": 104, "edu_l1_label": "EDU_O"}, {"txt": "其中θf和θq分别表示FP模型和量化模型，xt是通过用FP模型迭代T−t步对高斯噪声xT∼N(0, I)进行去噪而获得的。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 614, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "其中θ", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[41]"}, {"immutable": false, "orig_start": 0, "position_id": 616, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "f", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[41]/sub[1]"}, {"immutable": false, "orig_start": 0, "position_id": 618, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "和θ", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[41]/sub[1]"}, {"immutable": false, "orig_start": 0, "position_id": 620, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "q", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[41]/sub[2]"}, {"immutable": false, "orig_start": 0, "position_id": 622, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "分别表示FP模型和量化模型，x", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[41]/sub[2]"}, {"immutable": false, "orig_start": 0, "position_id": 624, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "t", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[41]/sub[3]"}, {"immutable": false, "orig_start": 0, "position_id": 626, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "是通过用FP模型迭代T−t步对高斯噪声x", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[41]/sub[3]"}, {"immutable": false, "orig_start": 0, "position_id": 628, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "T", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[41]/sub[4]"}, {"immutable": false, "orig_start": 0, "position_id": 630, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "∼N(0, I)进行去噪而获得的。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[41]/sub[4]"}]}, "tags": [], "label": "content", "web_segment_id": 64, "global_sentence_id": 105, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2Xw6dGsvlll3UOYPKyrSqh.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 162, "size": 0, "start": 0, "tags": ["h6", "img", "strong"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2Xw6dGsvlll3UOYPKyrSqh.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[5]/strong/img"}]}, "tags": ["h6", "img", "strong"], "label": "figure", "web_segment_id": 65, "global_sentence_id": 106, "edu_l1_label": "EDU_O"}, {"txt": "△图4 从timesetp（左）T、（左中）T-1、（右中）T-2、（右）T-10的特征图可视化", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 632, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "△", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[6]/strong"}, {"immutable": false, "orig_start": 0, "position_id": 634, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "图4 从timesetp（左）T、（左中）T-1、（右中）T-2、（右）T-10的特征图可视化", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[6]/strong"}]}, "tags": ["h6", "strong"], "label": "figure_title", "web_segment_id": 66, "global_sentence_id": 107, "edu_l1_label": "EDU_O"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1XuTkb17xQPs1CZdNe3fvSHo.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 167, "size": 0, "start": 0, "tags": ["h6", "img", "strong"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1XuTkb17xQPs1CZdNe3fvSHo.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[7]/strong/img"}]}, "tags": ["h6", "img", "strong"], "label": "figure", "web_segment_id": 67, "global_sentence_id": 108, "edu_l1_label": "EDU_O"}, {"txt": "△图5 （左）FP模型、（中）训练好的量化模型、（右）未训练量化模型的不同激活图的可视化", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 636, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "△", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[8]/strong"}, {"immutable": false, "orig_start": 0, "position_id": 638, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "图5 （左）FP模型、（中）训练好的量化模型、（右）未训练量化模型的不同激活图的可视化", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[8]/strong"}]}, "tags": ["strong", "h6"], "label": "figure_title", "web_segment_id": 68, "global_sentence_id": 109, "edu_l1_label": "EDU_O"}, {"txt": "在极低位量化中，仅对齐模型的最终输出是不够的，因为量化模型的表达能力严重不足。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 640, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "在极低位量化中，仅对齐模型的最终输出是不够的，因为量化模型的表达能力严重不足。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[42]"}]}, "tags": [], "label": "content", "web_segment_id": 69, "global_sentence_id": 110, "edu_l1_label": "IOS"}, {"txt": "团队通常将量化模型的最终投影层设置为8位，并将投影层之前的层设置为低位。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 641, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "团队通常将量化模型的最终投影层设置为8位，并将投影层之前的层设置为低位。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[42]"}]}, "tags": [], "label": "content", "web_segment_id": 69, "global_sentence_id": 111, "edu_l1_label": "IOS"}, {"txt": "这样，团队就不会直接感知到量化信息严重缺失的部分。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 642, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "这样，团队就不会直接感知到量化信息严重缺失的部分。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[42]"}]}, "tags": [], "label": "content", "web_segment_id": 69, "global_sentence_id": 112, "edu_l1_label": "IOS"}, {"txt": "因此，团队可以通过在最后一个项目层之前提取模型特征层，为极低位量化模型提供更细粒度的指导", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 643, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "因此，团队可以通过在最后一个项目层之前提取模型特征层，为极低位量化模型提供更细粒度的指导", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[42]"}]}, "tags": [], "label": "content", "web_segment_id": 69, "global_sentence_id": 113, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/4fjepw3ivwxq1UR0Gc4lBqcm.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 172, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/4fjepw3ivwxq1UR0Gc4lBqcm.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[43]/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 70, "global_sentence_id": 114, "edu_l1_label": "EDU_O"}, {"txt": "其中Ff和Fq分别表示FP模型和量化模型的最后一个项目层之前的特征图。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 645, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "其中F", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[44]"}, {"immutable": false, "orig_start": 0, "position_id": 647, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "f", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[44]/sub[1]"}, {"immutable": false, "orig_start": 0, "position_id": 649, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "和F", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[44]/sub[1]"}, {"immutable": false, "orig_start": 0, "position_id": 651, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "q", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[44]/sub[2]"}, {"immutable": false, "orig_start": 0, "position_id": 653, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "分别表示FP模型和量化模型的最后一个项目层之前的特征图。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[44]/sub[2]"}]}, "tags": [], "label": "content", "web_segment_id": 71, "global_sentence_id": 115, "edu_l1_label": "IOS"}, {"txt": "D是测量两个特征图距离的度量。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 654, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "D是测量两个特征图距离的度量。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[44]/sub[2]"}]}, "tags": [], "label": "content", "web_segment_id": 71, "global_sentence_id": 116, "edu_l1_label": "IOS"}, {"txt": "然而，极低位量化的特征呈现出高度的离散化（例如，4位激活量化只有16个值）。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 656, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "然而，极低位量化的特征呈现出高度的离散化", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[45]"}, {"immutable": false, "orig_start": 0, "position_id": 658, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "（例如，4位激活量化只有16个值）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[45]/span"}, {"immutable": false, "orig_start": 0, "position_id": 660, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[45]/span"}]}, "tags": [], "label": "content", "web_segment_id": 72, "global_sentence_id": 117, "edu_l1_label": "IOS"}, {"txt": "这种离散化特征在数值上显示出高度的不真实性，直接提取它效果不佳，甚至会干扰量化模型的正常训练。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 662, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "这种离散化特征在数值上显示出高度的不真实性，直接提取它效果不佳，甚至会干扰量化模型的正常训练。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[46]"}]}, "tags": [], "label": "content", "web_segment_id": 73, "global_sentence_id": 118, "edu_l1_label": "IOS"}, {"txt": "此外，由于扩散模型的独特迭代去噪过程，特征的输出将继续与去噪相加，进一步放大这种不真实性。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 663, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "此外，由于扩散模型的独特迭代去噪过程，特征的输出将继续与去噪相加，进一步放大这种不真实性。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[46]"}]}, "tags": [], "label": "content", "web_segment_id": 73, "global_sentence_id": 119, "edu_l1_label": "IOS"}, {"txt": "通常，团队可以使用额外的投影头将它们映射到均匀空间或对其进行数值正则化。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 665, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "通常，团队可以使用额外的投影头将它们映射到均匀空间或对其进行数值正则化。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[47]"}]}, "tags": [], "label": "content", "web_segment_id": 74, "global_sentence_id": 120, "edu_l1_label": "IOS"}, {"txt": "然而，投影头会带来额外的训练参数，进行正则化并不能解决迭代计算中的误差累积问题。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 666, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "然而，投影头会带来额外的训练参数，进行正则化并不能解决迭代计算中的误差累积问题。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[47]"}]}, "tags": [], "label": "content", "web_segment_id": 74, "global_sentence_id": 121, "edu_l1_label": "IOS"}, {"txt": "团队发现扩散模型的特征与时间步长高度相关，并在某些时间步长中表现出相似性。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 667, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "团队发现扩散模型的特征与时间步长高度相关，并在某些时间步长中表现出相似性。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[47]"}]}, "tags": [], "label": "content", "web_segment_id": 74, "global_sentence_id": 122, "edu_l1_label": "IOS"}, {"txt": "在图4中，团队发现连续时间步长上的特征高度相似，而相距甚远的时间步长则截然不同。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 669, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "在图4中，团队发现连续时间步长上的特征高度相似，而相距甚远的时间步长则截然不同。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[48]"}]}, "tags": [], "label": "content", "web_segment_id": 75, "global_sentence_id": 123, "edu_l1_label": "IOS"}, {"txt": "特征的相似性表明，去噪轨迹中连续时间步长的差异很小，因此团队可以通过融合多个连续步骤的中间特征来缓解不同时间步长的特征不真实性。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 670, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "特征的相似性表明，去噪轨迹中连续时间步长的差异很小，因此团队可以通过融合多个连续步骤的中间特征来缓解不同时间步长的特征不真实性。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[48]"}]}, "tags": [], "label": "content", "web_segment_id": 75, "global_sentence_id": 124, "edu_l1_label": "IOS"}, {"txt": "而不是强迫高度离散化的量化模型严格学习FP模型每一步的去噪轨迹，而是学习连续多步的去噪声轨迹。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 672, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "而不是强迫高度离散化的量化模型严格学习FP模型每一步的去噪轨迹，而是学习连续多步的去噪声轨迹。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[49]"}]}, "tags": [], "label": "content", "web_segment_id": 76, "global_sentence_id": 125, "edu_l1_label": "IOS"}, {"txt": "因此，团队使用N个连续步骤的中间特征作为平滑特征表示进行提取。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 674, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "因此，团队使用N个连续步骤的中间特征作为平滑特征表示进行提取。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[50]"}]}, "tags": [], "label": "content", "web_segment_id": 77, "global_sentence_id": 126, "edu_l1_label": "IOS"}, {"txt": "对于T时间步长优化，团队将蒸馏公式改写为", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 675, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "对于T时间步长优化，团队将蒸馏公式改写为", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[50]"}]}, "tags": [], "label": "content", "web_segment_id": 77, "global_sentence_id": 127, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/goati1Et1Wq3UHe1q4welX0.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 185, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/goati1Et1Wq3UHe1q4welX0.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[51]/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 78, "global_sentence_id": 128, "edu_l1_label": "EDU_O"}, {"txt": "其中FT−t,f 和FT−t,q 分别表示FP模型和量化模型在时间步长T-t中的最后一个特征图。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 677, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "其中F", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[52]"}, {"immutable": false, "orig_start": 0, "position_id": 679, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "T−t", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[52]/sub[1]"}, {"immutable": false, "orig_start": 0, "position_id": 681, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": ",f 和F", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[52]/sub[1]"}, {"immutable": false, "orig_start": 0, "position_id": 683, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "T−t", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[52]/sub[2]"}, {"immutable": false, "orig_start": 0, "position_id": 685, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": ",q 分别表示FP模型和量化模型在时间步长T-t中的最后一个特征图。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[52]/sub[2]"}]}, "tags": [], "label": "content", "web_segment_id": 79, "global_sentence_id": 129, "edu_l1_label": "IOS"}, {"txt": "在图5a中，团队可视化了FP模型、训练好的量化模型和未训练的量化模型之间的特征图。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 687, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "在图5a中，团队可视化了FP模型、训练好的量化模型和未训练的量化模型之间的特征图。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[53]"}]}, "tags": [], "label": "content", "web_segment_id": 80, "global_sentence_id": 130, "edu_l1_label": "IOS"}, {"txt": "尽管时间平滑特征提高了量化特征的鲁棒性，但训练有素的模型和FP模型之间的数值表达式仍然存在不匹配。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 689, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "尽管时间平滑特征提高了量化特征的鲁棒性，但训练有素的模型和FP模型之间的数值表达式仍然存在不匹配。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[54]"}]}, "tags": [], "label": "content", "web_segment_id": 81, "global_sentence_id": 131, "edu_l1_label": "IOS"}, {"txt": "这被归咎于量化特征的离散潜空间和FP特征的连续潜空间之间的差异。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 690, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "这被归咎于量化特征的离散潜空间和FP特征的连续潜空间之间的差异。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[54]"}]}, "tags": [], "label": "content", "web_segment_id": 81, "global_sentence_id": 132, "edu_l1_label": "IOS"}, {"txt": "因此，任何指标，如L2损耗数字对齐", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 691, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "因此，任何指标，如L2损耗数字对齐", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[54]"}]}, "tags": [], "label": "content", "web_segment_id": 81, "global_sentence_id": 133, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2ewT6J3tvfiz3ukv7V2Gt0q6.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 191, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2ewT6J3tvfiz3ukv7V2Gt0q6.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[54]/img[1]"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 81, "global_sentence_id": 134, "edu_l1_label": "IOS"}, {"txt": "和", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 693, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "和", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[54]/img[1]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 81, "global_sentence_id": 135, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2JGmpW1uBNae1dJujo4frNJE.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 192, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2JGmpW1uBNae1dJujo4frNJE.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[54]/img[2]"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 81, "global_sentence_id": 136, "edu_l1_label": "IOS"}, {"txt": "无法避免这种不同空间之间的差异。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 695, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "无法避免这种不同空间之间的差异。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[54]/img[2]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 81, "global_sentence_id": 137, "edu_l1_label": "IOS"}, {"txt": "因此，建议使用关系对齐来代替严格的学习数值对齐", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 697, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "因此，建议使用关系对齐来代替严格的学习数值对齐", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[55]"}]}, "tags": [], "label": "content", "web_segment_id": 82, "global_sentence_id": 138, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2ewT6J3tvfiz3ukv7V2Gt0q6.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 194, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2ewT6J3tvfiz3ukv7V2Gt0q6.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[55]/img[1]"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 82, "global_sentence_id": 139, "edu_l1_label": "IOS"}, {"txt": "和", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 699, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "和", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[55]/img[1]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 82, "global_sentence_id": 140, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2JGmpW1uBNae1dJujo4frNJE.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 195, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2JGmpW1uBNae1dJujo4frNJE.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[55]/img[2]"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 82, "global_sentence_id": 141, "edu_l1_label": "IOS"}, {"txt": "之间的特征相似关系。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 701, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "之间的特征相似关系。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[55]/img[2]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 82, "global_sentence_id": 142, "edu_l1_label": "IOS"}, {"txt": "在图5b，团队将离散潜空间和连续潜空间之间的数值关系转化为每个空间内的特征相似关系，将蒸馏目标统一到特征相似空间中。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 703, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "在图5b，团队将离散潜空间和连续潜空间之间的数值关系转化为每个空间内的特征相似关系，将蒸馏目标统一到特征相似空间中。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[56]"}]}, "tags": [], "label": "content", "web_segment_id": 83, "global_sentence_id": 143, "edu_l1_label": "IOS"}, {"txt": "这成功地解决了数值不匹配的问题。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 705, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "这成功地解决了数值不匹配的问题。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[57]"}]}, "tags": [], "label": "content", "web_segment_id": 84, "global_sentence_id": 144, "edu_l1_label": "IOS"}, {"txt": "形式上说，对于", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 707, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "形式上说，对于", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[58]"}]}, "tags": [], "label": "content", "web_segment_id": 85, "global_sentence_id": 145, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1TRgf93i9k3D2J9bSU2tkBDi.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 199, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1TRgf93i9k3D2J9bSU2tkBDi.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[58]/img[1]"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 85, "global_sentence_id": 146, "edu_l1_label": "IOS"}, {"txt": "，为了简化写作，团队对其进行了重写", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 709, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "，为了简化写作，团队对其进行了重写", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[58]/img[1]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 85, "global_sentence_id": 147, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1eau5m2EiyrVuvYoZn3Pp1.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 200, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/1eau5m2EiyrVuvYoZn3Pp1.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[58]/img[2]"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 85, "global_sentence_id": 148, "edu_l1_label": "IOS"}, {"txt": "其中s=h×w。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 711, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "其中s=h×w。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[58]/img[2]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 85, "global_sentence_id": 149, "edu_l1_label": "IOS"}, {"txt": "对于第i个特征表示", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 712, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "对于第i个特征表示", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[58]/img[2]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 85, "global_sentence_id": 150, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/24CpBk4eOPvl3rl6AV3gGGqZ.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 201, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/24CpBk4eOPvl3rl6AV3gGGqZ.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[58]/img[3]"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 85, "global_sentence_id": 151, "edu_l1_label": "IOS"}, {"txt": "，团队可以计算它的余弦相似性分布", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 714, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "，团队可以计算它的余弦相似性分布", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[58]/img[3]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 85, "global_sentence_id": 152, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/3Dg4QmHKU5i30mA4a41LLeC.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 202, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/3Dg4QmHKU5i30mA4a41LLeC.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[58]/img[4]"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 85, "global_sentence_id": 153, "edu_l1_label": "IOS"}, {"txt": "因此，关系蒸馏度量为", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 716, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "因此，关系蒸馏度量为", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[58]/img[4]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 85, "global_sentence_id": 154, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2pkYwA1Znme11GmiqC1yp1Yp.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 204, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2pkYwA1Znme11GmiqC1yp1Yp.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[59]/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 86, "global_sentence_id": 155, "edu_l1_label": "EDU_O"}, {"txt": "其中", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 718, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "其中", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[60]"}]}, "tags": [], "label": "content", "web_segment_id": 87, "global_sentence_id": 156, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2cWyug1xWfgE2bAKm51uD5Vu.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 206, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2cWyug1xWfgE2bAKm51uD5Vu.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[60]/img[1]"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 87, "global_sentence_id": 157, "edu_l1_label": "IOS"}, {"txt": "和", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 720, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "和", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[60]/img[1]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 87, "global_sentence_id": 158, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/20ucV93gX0cC27diQf2IHQbZ.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 207, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/20ucV93gX0cC27diQf2IHQbZ.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[60]/img[2]"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 87, "global_sentence_id": 159, "edu_l1_label": "IOS"}, {"txt": "表示时间平滑特征相似度分布分别来自FP模型和量化模型。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 722, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "表示时间平滑特征相似度分布分别来自FP模型和量化模型。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[60]/img[2]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 87, "global_sentence_id": 160, "edu_l1_label": "IOS"}, {"txt": "Dkl(·||·)代表两个分布之间的Kullback-Leibler（KL）散度。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 723, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "D", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[60]/img[2]"}, {"immutable": false, "orig_start": 0, "position_id": 725, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "kl", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[60]/sub"}, {"immutable": false, "orig_start": 0, "position_id": 727, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "(·||·)代表两个分布之间的Kullback-Leibler", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[60]/sub"}, {"immutable": false, "orig_start": 0, "position_id": 729, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "（KL）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[60]/span"}, {"immutable": false, "orig_start": 0, "position_id": 731, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "散度。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[60]/span"}]}, "tags": ["img"], "label": "content", "web_segment_id": 87, "global_sentence_id": 161, "edu_l1_label": "IOS"}, {"txt": "团队在这里使用KL散度而不是L2损失。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 733, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "团队在这里使用KL散度而不是L2损失。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[61]"}]}, "tags": [], "label": "content", "web_segment_id": 88, "global_sentence_id": 162, "edu_l1_label": "IOS"}, {"txt": "因为L2损失只能感知单个表示，而KL散度可以感知整个特征图的信息。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 734, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "因为L2损失只能感知单个表示，而KL散度可以感知整个特征图的信息。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[61]"}]}, "tags": [], "label": "content", "web_segment_id": 88, "global_sentence_id": 163, "edu_l1_label": "IOS"}, {"txt": "总体优化目标为", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 735, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "总体优化目标为", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[61]"}]}, "tags": [], "label": "content", "web_segment_id": 88, "global_sentence_id": 164, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/3kyHm07fCBZ3JVhkRpCua5.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 212, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/3kyHm07fCBZ3JVhkRpCua5.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[62]/img"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 89, "global_sentence_id": 165, "edu_l1_label": "EDU_O"}, {"txt": "实验", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 737, "size": 0, "start": 0, "tags": ["h2"], "tail": 0, "txt": "实验", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h2[3]"}]}, "tags": ["h2"], "label": "title1", "web_segment_id": 90, "global_sentence_id": 166, "edu_l1_label": "BOS"}, {"txt": "实验设置", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 739, "size": 0, "start": 0, "tags": ["h4"], "tail": 0, "txt": "实验设置", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h4[6]"}]}, "tags": ["h4"], "label": "title2", "web_segment_id": 91, "global_sentence_id": 167, "edu_l1_label": "IOS"}, {"txt": "团队在常用的数据集LSUN-Bedrooms 256×256、LSUN-Churchs 256×256和ImageNet 256×256上进行了LDM模型上无条件和有条件图像生成任务的实验。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 741, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "团队在常用的数据集LSUN-Bedrooms 256×256、LSUN-Churchs 256×256", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[63]"}, {"immutable": false, "orig_start": 0, "position_id": 743, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "和ImageNet 256×256上进行了LDM模型上无条件和有条件图像生成任务的实验。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[63]/span"}]}, "tags": [], "label": "content", "web_segment_id": 92, "global_sentence_id": 168, "edu_l1_label": "IOS"}, {"txt": "还对Stable Diffusion进行了文本到图像的生成任务，使用IS、FID、sFID和Precision来评估LDM的性能。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 745, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "还对Stable Diffusion进行了文本到图像的生成任务，使用IS、FID、sFID和Precision来评估LDM的性能。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[64]"}]}, "tags": [], "label": "content", "web_segment_id": 93, "global_sentence_id": 169, "edu_l1_label": "IOS"}, {"txt": "对于Stable Diffusion，团队使用CLIP评分进行评估。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 746, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "对于Stable Diffusion，团队使用CLIP评分进行评估。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[64]"}]}, "tags": [], "label": "content", "web_segment_id": 93, "global_sentence_id": 170, "edu_l1_label": "IOS"}, {"txt": "为了应对2bit量化下的极端压缩性能下降，团队在OMQ的搜索过程中为2bit额外分配了10%的信道，称为MPQ-DM+。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 748, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "为了应对2bit量化下的极端压缩性能下降，团队在OMQ的搜索过程中为2bit额外分配了10%的信道，称为MPQ-DM+。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[65]"}]}, "tags": [], "label": "content", "web_segment_id": 94, "global_sentence_id": 171, "edu_l1_label": "IOS"}, {"txt": "与FP模型相比，模型尺寸仅增加了0.6%。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 750, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "与FP模型相比，模型尺寸仅增加了0.6%。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[66]"}]}, "tags": [], "label": "content", "web_segment_id": 95, "global_sentence_id": 172, "edu_l1_label": "IOS"}, {"txt": "团队将MPQ-DM与基线EfficientDM和分层混合精度HAWQ-v3以及其他具有相似耗时的基于PTQ的方法进行了比较。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 751, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "团队将MPQ-DM与基线EfficientDM和分层混合精度HAWQ-v3以及其他具有相似耗时的基于PTQ的方法进行了比较。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[66]"}]}, "tags": [], "label": "content", "web_segment_id": 95, "global_sentence_id": 173, "edu_l1_label": "IOS"}, {"txt": "实验结果", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 753, "size": 0, "start": 0, "tags": ["h4"], "tail": 0, "txt": "实验结果", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h4[7]"}]}, "tags": ["h4"], "label": "title2", "web_segment_id": 96, "global_sentence_id": 174, "edu_l1_label": "IOS"}, {"txt": "ImageNet 256×256上全量化LDM-4模型的性能比较：", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 755, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "ImageNet 256×256上全量化LDM-4模型的性能比较：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[67]"}]}, "tags": [], "label": "content", "web_segment_id": 97, "global_sentence_id": 175, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/20Ggms3OYErMd6Ty2FUMCj.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 224, "size": 0, "start": 0, "tags": ["h6", "img", "strong"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/20Ggms3OYErMd6Ty2FUMCj.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[9]/strong/img"}]}, "tags": ["h6", "img", "strong"], "label": "figure", "web_segment_id": 98, "global_sentence_id": 176, "edu_l1_label": "EDU_O"}, {"txt": "△表1 最佳结果以粗体显示，次佳结果以下划线显示", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 757, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "△", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[10]/strong"}, {"immutable": false, "orig_start": 0, "position_id": 759, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "表1 最佳结果以粗体显示，次佳结果以下划线显示", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[10]/strong"}]}, "tags": ["h6", "strong"], "label": "figure_title", "web_segment_id": 99, "global_sentence_id": 177, "edu_l1_label": "EDU_O"}, {"txt": "LDM-4模型在LSUN卧室256×256上的无条件图像生成结果：", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 761, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "LDM-4模型在LSUN卧室256×256上的无条件图像生成结果：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[68]"}]}, "tags": [], "label": "content", "web_segment_id": 100, "global_sentence_id": 178, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/3L9EDC3wSOWy3pOMs026Syrl.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 232, "size": 0, "start": 0, "tags": ["h6", "img", "strong"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/3L9EDC3wSOWy3pOMs026Syrl.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[11]/strong/strong/img"}]}, "tags": ["h6", "img", "strong"], "label": "figure", "web_segment_id": 101, "global_sentence_id": 179, "edu_l1_label": "EDU_O"}, {"txt": "△表 2", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 763, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "△", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[12]/strong"}, {"immutable": false, "orig_start": 0, "position_id": 765, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "表 2", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[12]/strong"}]}, "tags": ["h6", "strong"], "label": "figure_title", "web_segment_id": 102, "global_sentence_id": 180, "edu_l1_label": "EDU_O"}, {"txt": "LDM-8模型在LSUN Churches 256×256上的无条件图像生成结果：", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 767, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "LDM-8模型在LSUN Churches 256×256上的无条件图像生成结果：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[69]"}]}, "tags": [], "label": "content", "web_segment_id": 103, "global_sentence_id": 181, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/T2Paj4tcb621AfVz62t9ja3.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 238, "size": 0, "start": 0, "tags": ["h6", "img", "strong"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/T2Paj4tcb621AfVz62t9ja3.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[13]/strong/img"}]}, "tags": ["h6", "img", "strong"], "label": "figure", "web_segment_id": 104, "global_sentence_id": 182, "edu_l1_label": "EDU_O"}, {"txt": "△表 3", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 769, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "△", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[14]/strong"}, {"immutable": false, "orig_start": 0, "position_id": 771, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "表 3", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[14]/strong"}]}, "tags": ["h6", "strong"], "label": "figure_title", "web_segment_id": 105, "global_sentence_id": 183, "edu_l1_label": "EDU_O"}, {"txt": "类条件生成", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 773, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "类条件生成", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[70]/strong"}]}, "tags": ["strong"], "label": "title2", "web_segment_id": 106, "global_sentence_id": 184, "edu_l1_label": "IOS"}, {"txt": "团队以LDM-4为重点，在ImageNet 256×256数据集上进行了条件生成实验。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 775, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "团队以LDM-4为重点，在ImageNet 256×256数据集上进行了条件生成实验。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[71]"}]}, "tags": [], "label": "content", "web_segment_id": 107, "global_sentence_id": 185, "edu_l1_label": "IOS"}, {"txt": "表1中的结果显示，MPQ-DM在所有比特设置上都大大优于现有方法。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 777, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "表1中的结果显示，MPQ-DM在所有比特设置上都大大优于现有方法。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[72]"}]}, "tags": [], "label": "content", "web_segment_id": 108, "global_sentence_id": 186, "edu_l1_label": "IOS"}, {"txt": "MPQ-DM通常比分层方法HAWQ-v3表现更好，这证明了在层内进行混合精度量化的必要性。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 778, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "MPQ-DM通常比分层方法HAWQ-v3表现更好，这证明了在层内进行混合精度量化的必要性。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[72]"}]}, "tags": [], "label": "content", "web_segment_id": 108, "global_sentence_id": 187, "edu_l1_label": "IOS"}, {"txt": "MPQ-DM W3A4型号在FID上甚至超过了FP型号。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 780, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "MPQ-DM W3A4型号在FID上甚至超过了FP型号。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[73]"}]}, "tags": [], "label": "content", "web_segment_id": 109, "global_sentence_id": 188, "edu_l1_label": "IOS"}, {"txt": "在W2A4设置中，基于PTQ的方法无法生成图像，而EfficientDM的性能较差。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 781, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "在W2A4设置中，基于PTQ的方法无法生成图像，而EfficientDM的性能较差。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[73]"}]}, "tags": [], "label": "content", "web_segment_id": 109, "global_sentence_id": 189, "edu_l1_label": "IOS"}, {"txt": "MPQ-DM大大改善了基线，FID显著降低了27.86。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 782, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "MPQ-DM大大改善了基线，FID显著降低了27.86。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[73]"}]}, "tags": [], "label": "content", "web_segment_id": 109, "global_sentence_id": 190, "edu_l1_label": "IOS"}, {"txt": "MPQ-DM+仅使用4.8 MB的额外模型大小，就进一步导致FID减少9.48。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 783, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "MPQ-DM+仅使用4.8 MB的额外模型大小，就进一步导致FID减少9.48。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[73]"}]}, "tags": [], "label": "content", "web_segment_id": 109, "global_sentence_id": 191, "edu_l1_label": "IOS"}, {"txt": "使用10k COCO2014验证集提示的Stable Diffusion v1.4的文本到图像生成结果（512×512）：", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 785, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "使用10k COCO2014验证集提示的Stable Diffusion v1.4的文本到图像生成结果", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[74]"}, {"immutable": false, "orig_start": 0, "position_id": 787, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "（512×512）", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[74]/span"}, {"immutable": false, "orig_start": 0, "position_id": 789, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[74]/span"}]}, "tags": [], "label": "content", "web_segment_id": 110, "global_sentence_id": 192, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/26hr7j1SEwOu3fkQxHCDSt6.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 250, "size": 0, "start": 0, "tags": ["h6", "img", "strong"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/26hr7j1SEwOu3fkQxHCDSt6.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[15]/strong/img"}]}, "tags": ["h6", "img", "strong"], "label": "figure", "web_segment_id": 111, "global_sentence_id": 193, "edu_l1_label": "EDU_O"}, {"txt": "△表4", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 791, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "△", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[16]/strong"}, {"immutable": false, "orig_start": 0, "position_id": 793, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "表4", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[16]/strong"}]}, "tags": ["h6", "strong"], "label": "figure_title", "web_segment_id": 112, "global_sentence_id": 194, "edu_l1_label": "EDU_O"}, {"txt": "无条件的生成", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 795, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "无条件的生成", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[75]/strong"}]}, "tags": ["strong"], "label": "title2", "web_segment_id": 113, "global_sentence_id": 195, "edu_l1_label": "IOS"}, {"txt": "团队在LDM-4的LSUN卧室数据集和LDM-8的LSUN教堂数据集上进行了无条件生成实验，分辨率为256×256。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 797, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "团队在LDM-4的LSUN卧室数据集和LDM-8的LSUN教堂数据集上进行了无条件生成实验，分辨率为256×256。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[76]"}]}, "tags": [], "label": "content", "web_segment_id": 114, "global_sentence_id": 196, "edu_l1_label": "IOS"}, {"txt": "在表2和表3中，MPQ-DM在所有比特设置下仍然优于所有其他现有方法。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 798, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "在表2和表3中，MPQ-DM在所有比特设置下仍然优于所有其他现有方法。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[76]"}]}, "tags": [], "label": "content", "web_segment_id": 114, "global_sentence_id": 197, "edu_l1_label": "IOS"}, {"txt": "对于LSUN卧室数据集，与基线相比，W3A4的FID降低了5.59，W2A6降低了8.53，W2A4甚至降低了12.81。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 800, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "对于LSUN卧室数据集，与基线相比，W3A4的FID降低了5.59，W2A6降低了8.53，W2A4甚至降低了12.81。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[77]"}]}, "tags": [], "label": "content", "web_segment_id": 115, "global_sentence_id": 198, "edu_l1_label": "IOS"}, {"txt": "在W2A4设置下，团队是第一种将sFID降至20以下的方法，与基线相比，sFID降低了6.12。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 801, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "在W2A4设置下，团队是第一种将sFID降至20以下的方法，与基线相比，sFID降低了6.12。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[77]"}]}, "tags": [], "label": "content", "web_segment_id": 115, "global_sentence_id": 199, "edu_l1_label": "IOS"}, {"txt": "文本到图像生成", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 803, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "文本到图像生成", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[78]/strong"}]}, "tags": ["strong"], "label": "title2", "web_segment_id": 116, "global_sentence_id": 200, "edu_l1_label": "IOS"}, {"txt": "团队在512×512分辨率的Stable Diffusion v1.4模型上，对随机选择的10k COCO2014验证集提示进行了文本到图像生成实验。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 805, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "团队在512×512分辨率的Stable Diffusion v1.4模型上，对随机选择的10k COCO2014验证集提示进行了文本到图像生成实验。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[79]"}]}, "tags": [], "label": "content", "web_segment_id": 117, "global_sentence_id": 201, "edu_l1_label": "IOS"}, {"txt": "在表4中，团队的方法比基线和SOTA PTQ方法具有更好的性能。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 806, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "在表4中，团队的方法比基线和SOTA PTQ方法具有更好的性能。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[79]"}]}, "tags": [], "label": "content", "web_segment_id": 117, "global_sentence_id": 202, "edu_l1_label": "IOS"}, {"txt": "在W3A4和W2A6设置中，团队实现了超过0.3的CLIP评分改善。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 807, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "在W3A4和W2A6设置中，团队实现了超过0.3的CLIP评分改善。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[79]"}]}, "tags": [], "label": "content", "web_segment_id": 117, "global_sentence_id": 203, "edu_l1_label": "IOS"}, {"txt": "MPQ-DM+在CLIP评分上进一步提高了1.79，只增加了10.2 MB的模型大小。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 808, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "MPQ-DM+在CLIP评分上进一步提高了1.79，只增加了10.2 MB的模型大小。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[79]"}]}, "tags": [], "label": "content", "web_segment_id": 117, "global_sentence_id": 204, "edu_l1_label": "IOS"}, {"txt": "消融实验", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 810, "size": 0, "start": 0, "tags": ["h4"], "tail": 0, "txt": "消融实验", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h4[8]"}]}, "tags": ["h4"], "label": "title2", "web_segment_id": 118, "global_sentence_id": 205, "edu_l1_label": "IOS"}, {"txt": "组件研究", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 812, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "组件研究", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[80]/strong"}]}, "tags": ["strong"], "label": "title2", "web_segment_id": 119, "global_sentence_id": 206, "edu_l1_label": "IOS"}, {"txt": "在表5中，团队对LDM-4 ImageNet 256×256模型进行了全面的消融研究，以评估每个拟议组件的有效性。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 814, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "在表5中，团队对LDM-4 ImageNet 256×256模型进行了全面的消融研究，以评估每个拟议组件的有效性。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[81]"}]}, "tags": [], "label": "content", "web_segment_id": 120, "global_sentence_id": 207, "edu_l1_label": "IOS"}, {"txt": "团队提出的OMQ从量化的角度解决了现有的逐层比特定位方法，在总平均比特宽度不变的情况下，将更多的比特宽度定位到层内具有显著异常现象的信道。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 816, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "团队提出的OMQ从量化的角度解决了现有的逐层比特定位方法，在总平均比特宽度不变的情况下，将更多的比特宽度定位到层内具有显著异常现象的信道。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[82]"}]}, "tags": [], "label": "content", "web_segment_id": 121, "global_sentence_id": 208, "edu_l1_label": "IOS"}, {"txt": "这种层内混合精度量化方法大大提高了基线的性能，增益IS增加了58.88。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 818, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "这种层内混合精度量化方法大大提高了基线的性能，增益IS增加了58.88。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[83]"}]}, "tags": [], "label": "content", "web_segment_id": 122, "global_sentence_id": 209, "edu_l1_label": "IOS"}, {"txt": "此外，TSD从模型优化的角度提高了蒸馏过程的鲁棒性，也取得了一定的改进。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 819, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "此外，TSD从模型优化的角度提高了蒸馏过程的鲁棒性，也取得了一定的改进。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[83]"}]}, "tags": [], "label": "content", "web_segment_id": 122, "global_sentence_id": 210, "edu_l1_label": "IOS"}, {"txt": "通过量化和优化两个方面的并行改进，MPQ-DM实现了最先进的量化性能。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 821, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "通过量化和优化两个方面的并行改进，MPQ-DM实现了最先进的量化性能。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[84]"}]}, "tags": [], "label": "content", "web_segment_id": 123, "global_sentence_id": 211, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/StAwu1BJYXl3mgFW73qnBXt.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 269, "size": 0, "start": 0, "tags": ["h6", "img", "strong"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/StAwu1BJYXl3mgFW73qnBXt.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[17]/strong/img"}]}, "tags": ["h6", "img", "strong"], "label": "figure", "web_segment_id": 124, "global_sentence_id": 212, "edu_l1_label": "EDU_O"}, {"txt": "△表5 对提出方法的消融研究", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 823, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "△", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[18]/strong"}, {"immutable": false, "orig_start": 0, "position_id": 825, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "表5 对提出方法的消融研究", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[18]/strong"}]}, "tags": ["h6", "strong"], "label": "figure_title", "web_segment_id": 125, "global_sentence_id": 213, "edu_l1_label": "EDU_O"}, {"txt": "异常值选择方法研究", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 827, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "异常值选择方法研究", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[85]/strong"}]}, "tags": ["strong"], "label": "title2", "web_segment_id": 126, "global_sentence_id": 214, "edu_l1_label": "IOS"}, {"txt": "在表6中，团队研究了LDM-4 ImageNet 256×256模型上混合精度量化中的不同异常显著信道选择方法。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 829, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "在表6中，团队研究了LDM-4 ImageNet 256×256模型上混合精度量化中的不同异常显著信道选择方法。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[86]"}]}, "tags": [], "label": "content", "web_segment_id": 127, "global_sentence_id": 215, "edu_l1_label": "IOS"}, {"txt": "团队发现，即使随机选择一些通道到更高或更低的比特，也会带来一定的性能提升。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 830, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "团队发现，即使随机选择一些通道到更高或更低的比特，也会带来一定的性能提升。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[86]"}]}, "tags": [], "label": "content", "web_segment_id": 127, "global_sentence_id": 216, "edu_l1_label": "IOS"}, {"txt": "这表明，在极低比特量化中，增加某些信道的比特带来的增益远远大于减少某些信道带来的影响，这证明了混合量化的必要性。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 832, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "这表明，在极低比特量化中，增加某些信道的比特带来的增益远远大于减少某些信道带来的影响，这证明了混合量化的必要性。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[87]"}]}, "tags": [], "label": "content", "web_segment_id": 128, "global_sentence_id": 217, "edu_l1_label": "IOS"}, {"txt": "虽然在随机或从权重的头部和尾部选择通道方面有一些收获，但基于峰度的异常值选择方法实现了最显著的性能提升。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 833, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "虽然在随机或从权重的头部和尾部选择通道方面有一些收获，但基于峰度的异常值选择方法实现了最显著的性能提升。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[87]"}]}, "tags": [], "label": "content", "web_segment_id": 128, "global_sentence_id": 218, "edu_l1_label": "IOS"}, {"txt": "这表明峰度选择了性能提高最显著的异常显著信道，这证明了基于峰度的信道选择方法的有效性。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 835, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "这表明峰度选择了性能提高最显著的异常显著信道，这证明了基于峰度的信道选择方法的有效性。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[88]"}]}, "tags": [], "label": "content", "web_segment_id": 129, "global_sentence_id": 219, "edu_l1_label": "IOS"}, {"txt": "异常值选择函数的消融研究：", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 837, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "异常值选择函数的消融研究：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[89]"}]}, "tags": [], "label": "content", "web_segment_id": 130, "global_sentence_id": 220, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/XYAaFHUm6AN4PTt1B3Bya.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 280, "size": 0, "start": 0, "tags": ["h6", "img", "strong"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/XYAaFHUm6AN4PTt1B3Bya.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[19]/strong/img"}]}, "tags": ["h6", "img", "strong"], "label": "figure", "web_segment_id": 131, "global_sentence_id": 221, "edu_l1_label": "EDU_O"}, {"txt": "△表6 抽取10k个样本进行评估", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 839, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "△", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[20]/strong"}, {"immutable": false, "orig_start": 0, "position_id": 841, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "表6 抽取10k个样本进行评估", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[20]/strong"}]}, "tags": ["h6", "strong"], "label": "table_title", "web_segment_id": 132, "global_sentence_id": 222, "edu_l1_label": "EDU_O"}, {"txt": "蒸馏指标研究", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 843, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "蒸馏指标研究", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[90]/strong"}]}, "tags": ["strong"], "label": "title2", "web_segment_id": 133, "global_sentence_id": 223, "edu_l1_label": "IOS"}, {"txt": "在表7中，团队研究了LDM-4 ImageNet模型上方程9中使用的不同蒸馏度量。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 845, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "在表7中，团队研究了LDM-4 ImageNet模型上方程9中使用的不同蒸馏度量。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[91]"}]}, "tags": [], "label": "content", "web_segment_id": 134, "global_sentence_id": 224, "edu_l1_label": "IOS"}, {"txt": "团队与未蒸馏的模型进行对比。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 847, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "团队与未蒸馏的模型进行对比。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[92]"}]}, "tags": [], "label": "content", "web_segment_id": 135, "global_sentence_id": 225, "edu_l1_label": "IOS"}, {"txt": "使用L2损耗来对齐", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 848, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "使用L2损耗来对齐", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[92]"}]}, "tags": [], "label": "content", "web_segment_id": 135, "global_sentence_id": 226, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2ewT6J3tvfiz3ukv7V2Gt0q6.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 287, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2ewT6J3tvfiz3ukv7V2Gt0q6.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[92]/img[1]"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 135, "global_sentence_id": 227, "edu_l1_label": "IOS"}, {"txt": "和", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 850, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "和", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[92]/img[1]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 135, "global_sentence_id": 228, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2JGmpW1uBNae1dJujo4frNJE.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 288, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/2JGmpW1uBNae1dJujo4frNJE.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[92]/img[2]"}]}, "tags": ["img"], "label": "figure", "web_segment_id": 135, "global_sentence_id": 229, "edu_l1_label": "IOS"}, {"txt": "仅显示sFID几乎没有改善，但降低了FID和精度。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 852, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "仅显示sFID几乎没有改善，但降低了FID和精度。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[92]/img[2]"}]}, "tags": ["img"], "label": "content", "web_segment_id": 135, "global_sentence_id": 230, "edu_l1_label": "IOS"}, {"txt": "这表明离散特征和连续特征不能直接通过数值很好地对齐，从而导致负优化。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 854, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "这表明离散特征和连续特征不能直接通过数值很好地对齐，从而导致负优化。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[93]"}]}, "tags": [], "label": "content", "web_segment_id": 136, "global_sentence_id": 231, "edu_l1_label": "IOS"}, {"txt": "然而，团队提出的关系蒸馏可以将所有特征转移到统一的相似性空间中。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 855, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "然而，团队提出的关系蒸馏可以将所有特征转移到统一的相似性空间中。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[93]"}]}, "tags": [], "label": "content", "web_segment_id": 136, "global_sentence_id": 232, "edu_l1_label": "IOS"}, {"txt": "这打破了两个潜在空间之间的差异，提高了模型性能。", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 856, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "这打破了两个潜在空间之间的差异，提高了模型性能。", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[93]"}]}, "tags": [], "label": "content", "web_segment_id": 136, "global_sentence_id": 233, "edu_l1_label": "IOS"}, {"txt": "蒸馏度量的消融研究：", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 858, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "蒸馏度量的消融研究：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/p[94]"}]}, "tags": [], "label": "content", "web_segment_id": 137, "global_sentence_id": 234, "edu_l1_label": "IOS"}, {"txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/E0TPM1dEpfp22YnCL4fu0ZQ.png", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 293, "size": 0, "start": 0, "tags": ["h6", "img", "strong"], "tail": 0, "txt": "<img https://wcd-image-bucket-test.oss-cn-zhangjiakou.aliyuncs.com/raw/E0TPM1dEpfp22YnCL4fu0ZQ.png", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[21]/strong/img"}]}, "tags": ["h6", "img", "strong"], "label": "figure", "web_segment_id": 138, "global_sentence_id": 235, "edu_l1_label": "EDU_O"}, {"txt": "△表7 抽取10k个样本进行评估", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 860, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "△", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[22]/strong"}, {"immutable": false, "orig_start": 0, "position_id": 862, "size": 0, "start": 0, "tags": ["h6", "strong"], "tail": 0, "txt": "表7 抽取10k个样本进行评估", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/h6[22]/strong"}]}, "tags": ["h6", "strong"], "label": "figure_title", "web_segment_id": 139, "global_sentence_id": 236, "edu_l1_label": "EDU_O"}, {"txt": "论文链接：", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 864, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "论文链接：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section/section[1]/span"}]}, "tags": [], "label": "content", "web_segment_id": 140, "global_sentence_id": 237, "edu_l1_label": "EDU_O"}, {"txt": "https://arxiv.org/pdf/2412.11549", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 865, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "https://arxiv.org/pdf/2412.11549", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section/section[1]/span"}]}, "tags": [], "label": "content", "web_segment_id": 140, "global_sentence_id": 238, "edu_l1_label": "EDU_O"}, {"txt": "— 完 —", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 867, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "— ", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section/section[2]/span/span[1]"}, {"immutable": false, "orig_start": 0, "position_id": 869, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "完", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section/section[2]/span/strong"}, {"immutable": false, "orig_start": 0, "position_id": 871, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": " —", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section/section[2]/span/span[2]"}]}, "tags": ["strong"], "label": "O", "web_segment_id": 141, "global_sentence_id": 239, "edu_l1_label": "EDU_O"}, {"txt": "投稿请发邮件到：", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 873, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "投稿请发邮件到：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section/section[3]/section/p[2]/span"}]}, "tags": [], "label": "O", "web_segment_id": 142, "global_sentence_id": 240, "edu_l1_label": "EDU_O"}, {"txt": "ai@qbitai.com", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 875, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "ai@qbitai.com", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section/section[3]/section/p[3]/span/strong"}]}, "tags": ["strong"], "label": "O", "web_segment_id": 143, "global_sentence_id": 241, "edu_l1_label": "EDU_O"}, {"txt": "标题注明【投稿】，告诉我们：", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 877, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "标题注明【投稿】，告诉我们：", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section/section[3]/section/p[4]"}]}, "tags": [], "label": "O", "web_segment_id": 144, "global_sentence_id": 242, "edu_l1_label": "EDU_O"}, {"txt": "你是谁，从哪来，投稿内容", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 879, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "你是谁，从哪来，投稿内容", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section/section[3]/section/p[5]"}]}, "tags": [], "label": "O", "web_segment_id": 145, "global_sentence_id": 243, "edu_l1_label": "EDU_O"}, {"txt": "附上论文/项目主页链接，以及联系方式哦", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 881, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "附上论文/项目主页链接，以及联系方式哦", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section/section[3]/section/p[6]"}]}, "tags": [], "label": "O", "web_segment_id": 146, "global_sentence_id": 244, "edu_l1_label": "EDU_O"}, {"txt": "我们会（尽量）及时回复你", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 883, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "我们会（尽量）及时回复你", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section/section[3]/section/p[7]"}]}, "tags": [], "label": "O", "web_segment_id": 147, "global_sentence_id": 245, "edu_l1_label": "EDU_O"}, {"txt": "<img https://mmbiz.qpic.cn/mmbiz_gif/YicUhk5aAGtC5nGy7YMGhQ0ZJeyibWyL0KVCtiaLEPMyd4Bszuo0bFIOxZOvdmqdxnOosYXyu5aI7MXpyUrUWfz6g/640?wx_fmt=gif&tp=webp&wxfrom=5&wx_lazy=1", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 319, "size": 0, "start": 0, "tags": ["img"], "tail": 0, "txt": "<img https://mmbiz.qpic.cn/mmbiz_gif/YicUhk5aAGtC5nGy7YMGhQ0ZJeyibWyL0KVCtiaLEPMyd4Bszuo0bFIOxZOvdmqdxnOosYXyu5aI7MXpyUrUWfz6g/640?wx_fmt=gif&tp=webp&wxfrom=5&wx_lazy=1", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section/section[3]/section/p[8]/img"}]}, "tags": ["img"], "label": "O", "web_segment_id": 148, "global_sentence_id": 246, "edu_l1_label": "EDU_O"}, {"txt": "一键关注 👇 点亮星标", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 885, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "一键关注 👇 点亮星标", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section/section[4]/section[1]/p/strong"}]}, "tags": ["strong"], "label": "O", "web_segment_id": 149, "global_sentence_id": 247, "edu_l1_label": "EDU_O"}, {"txt": "科技前沿进展每日见", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 887, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "科技前沿进展每日见", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section/section[4]/section[1]/section/strong"}]}, "tags": ["strong"], "label": "O", "web_segment_id": 150, "global_sentence_id": 248, "edu_l1_label": "EDU_O"}, {"txt": "「点赞」「转发」「小心心」", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 889, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "「点赞」「转发」「小心心」", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section/section[4]/section[3]/section/section/section/section/section/section[1]/p[1]/span/strong"}]}, "tags": ["strong"], "label": "O", "web_segment_id": 151, "global_sentence_id": 249, "edu_l1_label": "EDU_O"}, {"txt": "欢迎在评论区留下你的想法！", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 891, "size": 0, "start": 0, "tags": ["strong"], "tail": 0, "txt": "欢迎在评论区留下你的想法！", "x": "/html/body/div[2]/div[2]/div[2]/div/div[1]/div[2]/section/section[4]/section[3]/section/section/section/section/section/section[1]/p[2]/strong"}]}, "tags": ["strong"], "label": "O", "web_segment_id": 152, "global_sentence_id": 250, "edu_l1_label": "EDU_O"}, {"txt": "                        量子位                      ", "language": "chinese", "position": {"atoms": [{"immutable": false, "orig_start": 0, "position_id": 893, "size": 0, "start": 0, "tags": [], "tail": 0, "txt": "\n                        量子位                      ", "x": "/html/body/div[4]/div[2]/div[2]/div[1]/div[1]/div/div/div/div/div[2]/div/div"}]}, "tags": [], "label": "O", "web_segment_id": 166, "global_sentence_id": 251, "edu_l1_label": "EDU_O"}], "type": "WEB"}
#             扩散模型低位量化突破！有效扩散量化的极限推向2-4位，W2A4位宽下FID降低58%，超越SOTA方法          
## 相关工作
### 扩散模型
### 扩散模型量化
## 方法
### 模型量化
### 离群值指导的混合精度量化
### 时间步平滑的关系蒸馏
## 实验
### 实验设置
### 实验结果
#### 类条件生成
#### 无条件的生成
#### 文本到图像生成
### 消融实验
#### 组件研究
#### 异常值选择方法研究
#### 蒸馏指标研究
