【记录】NLP培训教程 学习过程
期间:
![](https://www.crifan.com/files/pic/uploads/2021/03/729508ca72e341d69cecbdc7816e46aa.jpg)
- NLP发展现状
- 基于Deep Learning的NLP的最近趋势
- GPU计算性能提升
- 传统NLP方法面临的挑战
- Big Data和Deep Learning给NLP带来的变革和机遇
- NLP的发展趋势,以及各行各业中的应用
![](https://www.crifan.com/files/pic/uploads/2021/03/05dd0289100347948c341c6c9f815a75.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/9bde5841d7fa48b2905d83f9113c7a10.jpg)
- 数据挖掘Data Mining
- 文本挖掘Text Mining
- 文本分析Text Analytics
grouping
![](https://www.crifan.com/files/pic/uploads/2021/03/7927c5004c754c258257f8c09db555a1.jpg)
图像识别/分类
无监督的机器翻译
基于视频或图片的问答 visual question answering
![](https://www.crifan.com/files/pic/uploads/2021/03/1cd7bbf0ddda4be39b6c22e81e145845.jpg)
chatbot
![](https://www.crifan.com/files/pic/uploads/2021/03/6c7dec385eeb499080039f7acbcbda14.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/cbba7c249f484cefb8c4c17c2b297a1e.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/8ce7803108554abf8fab21b4ae5f54f1.jpg)
机器学习的一个问题:sparsity稀疏
一些Challenge:
![](https://www.crifan.com/files/pic/uploads/2021/03/1357c0d24f8b41fa9a672910b1d49882.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/d59aa1094872414f969552e1365930e3.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/517a5f4233244b0fa76e689e86a66a8c.jpg)
Co-Reference Resolution 指代消解
- StanfordCoreNlp
- FudanNlp
- OpenNlp
- LTP
![](https://www.crifan.com/files/pic/uploads/2021/03/4c634a3608484f5c9542912d8895df06.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/e50840ed89634094af7d075fddd29ba7.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/79b877f87be5465ab7d387b02c702679.jpg)
- 大数据= 大 + 数据
- Volume数量大
- Velocity速度
- 高效efficiency
- 即时realtime
- 动态dynamic
- 预测性predictive
- Variety类别多
普通大众:Big Data
学术界一般叫做:Large-Scale Data
![](https://www.crifan.com/files/pic/uploads/2021/03/6c1caa1255ca451494c063d503a239d9.jpg)
Deep NLP= Deep Learning + NLP
NLP用途之一:垃圾邮件过滤
![](https://www.crifan.com/files/pic/uploads/2021/03/0f717f78f22c4224bc5d273dfeea69e0.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/76f6a10648b54977a516fea8a2a0c230.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/583327840ed74236929ce600bbd934a7.jpg)
Representation 表现
Representation==features==code
![](https://www.crifan.com/files/pic/uploads/2021/03/097c602eb98b40609d95d2e570e028a4.jpg)
主要就两个:CNN RNN
其他改进很多
Differentiable Programming 微分编程?
![](https://www.crifan.com/files/pic/uploads/2021/03/87db6c1099e04201b1a346733d362fc5.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/e01681931c0045d1b5fd8ac1b53f795b.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/92a2e47ff458419b9a5310cc32413dc8.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/36b52ada1fbc46d0bb35b578536966d5.jpg)
- Caffee
- Pytorch
- TensorFLow
![](https://www.crifan.com/files/pic/uploads/2021/03/eaa7fda3864e4b5398269e1cc9b31b50.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/bd8d32312cca460baf3f2b17acd89129.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/fd43ced3674546318300172d05e6af2c.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/728e2b7ac3984a868692f625ed58ccaa.jpg)
深度网络的目标:学习到feature特征
![](https://www.crifan.com/files/pic/uploads/2021/03/20342a56316d421c82effe5f0ac9133c.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/2e20303a0865492690c917da9bdc7d51.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/f2ea0d1f57d2475ab647f3807b2607d9.jpg)
Discriminative vs Generative Models
尤其是 最近出现的对抗网络:GAN
- Generative
- 联合概率
- 用途:分类
- Discriminative
- 条件概率
- 用途:判别
![](https://www.crifan.com/files/pic/uploads/2021/03/511982a5baf54783a3fc10f832c63aa3.png)
![](https://www.crifan.com/files/pic/uploads/2021/03/77fa03bcf5b845b8985cd27be3f4efc2.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/55e51db9283e4369b24bb7539979306b.jpg)
大部分的都可以用这两种:
- RNN = Recurrent Neural Network
- 机器翻译
- QA问答系统
- 自动生成图像描述
- CNN=Convolutional Neural Network
- 句子/文本分类
- 关系提取和分类
- 垃圾邮件检测
- 查询分类?
- 语义关系提取
VQA=Visual QA=Visual question answering
![](https://www.crifan.com/files/pic/uploads/2021/03/4b9a3f69ba8648b782ac5f7e6ace4fee.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/0561cacdd0b4419683ce864ec3b2ec6b.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/ebc4647346e546e4878579aa3d4ae28b.jpg)
![](https://www.crifan.com/files/pic/uploads/2021/03/107947d91f9c411c93fcfb0f5a1eeed9.jpg)