• 三星:小米的1999在中国卖的这么好,我也要学!结局太尴尬了 2019-05-22
  • 陈凯歌张艺谋带动湖北影视基地热 2019-05-22
  • 你反来复去说1+1=2,真痴呆了?你应该讲点其他的吧,譬如,1+1=2,是客观事实还是规律,是真理还是谬误。 2019-05-15
  • 零关税后抗癌药降价为何“慢半拍”? 2019-05-15
  • 《中国新歌声》是个什么梗?-光明时评 2019-05-13
  • 国内首个室内空气自然生态再造系统研发获成功 2019-05-11
  • 冰岛队中场附近抛球入禁区 原来他以前打手球的 2019-05-11
  • 和创金服创始人兼CEO房平获第十二届人民企业社会责任奖年度人物奖 2019-05-05
  • 图解:习近平的《人民日报》情缘 2019-04-22
  • 马丁靴配短裤 让你酷到没朋友 2019-04-17
  • 中共台湾地下党为何覆灭 2019-04-17
  • 云阳神秘迷宫9月迎客 2019-04-12
  • C罗身材真棒,他就站在我身旁! 2019-04-12
  • 贾立平往期比赛精彩回顾 2019-04-07
  • 联合国安理会发表声明 强烈谴责阿富汗恐怖袭击 2019-04-07
  • 邮箱登录 | 所务办公 | 收藏本站 | English | 中国科学院
     
    首页 计算所概况 新闻动态 科研成果 研究队伍 国际交流 技术转移 研究生教育 学术出版物 党群园地 科学传播 信息公开
    国际交流
    学术活动
    交流动态
    现在位置:首页 > 国际交流 > 学术活动
    Distributed deep learning
    2018-11-09 | 【 【打印】【关闭】

      报告时间:2018年11月13日 14:30-16:00

      报告地点:446会议室

      主讲人:Dr. Wei Zhang         IBM T.J.Watson Research Center

      邀请人:包云岗

      报告摘要:

      Deep learning is a powerful machine learning tool that achieves promising results in image classification, natural language processing, speech recognition, and among many other application domains. Deep learning is particularly useful when the training data is abundant and training parameters are many, thus it demands massive computing resources (e.g., HPC clusters). How to efficiently use computation hardware at a large scale to solve deep learning optimization problem is a fundamental research topic. In this talk, I will first present the fundamentals of distributed deep learning algorithms, then I will present several lessons that we learned in the past three years of research into building large-scale deep learning systems. The covered topics include (i) our work in the study of tradeoff of model accuracy and runtime performance, (ii) how to build scale-up multi-GPU systems in a training as a service scenario on cloud, and (iii) how to build scale-out systems that run at the scale of hundreds of GPUs on HPCs. The resulting systems typically shorten the training time from weeks to hours and maintain or improve the baseline model accuracy. The lessons and experiences drew from several real-world systems -- IBM’s Natural Language Classifier (NLC), one of IBM’s most widely used cognitive services; IBM’s STT (Speech to Text) service, the key speech recognition technology behind IBM’s Jeopardy and the recent Debater project; and the experience of running our systems on CORAL machines (i.e., the precursor of IBM’s Summit super-computer, the fastest HPC machine in the world).

      主讲人简介:

      Dr. Wei Zhang (B.Eng’05, Beijing Unveristy of Technology; MSc’08, Technical University of Denmark; PhD’13, University of Wisconsin, Madison) is a research staff member at IBM T.J.Watson Research Center. Currently, he works in the machine learning acceleration department. His research interests include systems and large-scale optimization. His recent works in distributed deep learning are published in ICDM(2016,2017), IJCAI(2016,2017), MASCOT(2017), DAC(2017), AAAI (2018), NIPS (2017,2018) and ICML (2018). His work won the ICDM’16 best paper award runner-up and MASCOT’17 best paper nominee. His NIPS’17 paper are ICML’18 papers were both invited to present orally at a 20-min length in the conference. Prior to his IBM career, he studied under Prof. Shan Lu at UW-Madison, with a focus on concurrent software system reliability. While at Wisconsin, he published papers in ASPLOS (2010,2011,2013), PLDI(2011), OSDI(2012) and OOPSLA(2013). His PLDI’11 paper won the SIGPLAN Research Highlights Award.

     
    网站地图 | 联系我们 | 体彩11选五开奖结果 | 所长信箱
     
    京ICP备05002829号 京公网安备1101080060号
  • 三星:小米的1999在中国卖的这么好,我也要学!结局太尴尬了 2019-05-22
  • 陈凯歌张艺谋带动湖北影视基地热 2019-05-22
  • 你反来复去说1+1=2,真痴呆了?你应该讲点其他的吧,譬如,1+1=2,是客观事实还是规律,是真理还是谬误。 2019-05-15
  • 零关税后抗癌药降价为何“慢半拍”? 2019-05-15
  • 《中国新歌声》是个什么梗?-光明时评 2019-05-13
  • 国内首个室内空气自然生态再造系统研发获成功 2019-05-11
  • 冰岛队中场附近抛球入禁区 原来他以前打手球的 2019-05-11
  • 和创金服创始人兼CEO房平获第十二届人民企业社会责任奖年度人物奖 2019-05-05
  • 图解:习近平的《人民日报》情缘 2019-04-22
  • 马丁靴配短裤 让你酷到没朋友 2019-04-17
  • 中共台湾地下党为何覆灭 2019-04-17
  • 云阳神秘迷宫9月迎客 2019-04-12
  • C罗身材真棒,他就站在我身旁! 2019-04-12
  • 贾立平往期比赛精彩回顾 2019-04-07
  • 联合国安理会发表声明 强烈谴责阿富汗恐怖袭击 2019-04-07
  • 中国竞彩足球比分计算 搜狐足球彩票14场胜负 今天内蒙古时时彩开奖结果查询 刮刮乐5元票种大全 河南泳坛夺金120期查询 3d和值走势图 重庆时时彩开奖结果 11选5玩法 北京pk10走势图 雪缘园足彩胜负彩开奖 北京pk10如何买中间6码 时时彩全天计划那個准 二分彩是什么东西 福彩3d玩法 体彩p5综合走势图 河北时时彩走势图开奖结果查询