Some concepts in Machine Learning
| Concept | Explanation |
| Logits | https://stackoverflow.com/questions/41455101/what-is-the-meaning-of-the-word-logits-in-tensorflow |
| Cross-entropy | |
| Softmax | |
| MSE | Mean Squared Error Loss |
| text corpus | |
| context variable | the encoder transforms an input sequence of variable length into a fixed-shape context variable c c, and encodes the input sequence information in this context variable |
| Ablation | https://en.wikipedia.org/wiki/Ablation_(artificial_intelligence) |
| pretext | task being solved is not of genuine interest, but is solved only for the true purpose of learning a good data representation |
| pretext task | the self-supervised learning task solved to learn visual representations, with the aim of using the learned representations or model weights obtained in the process, for the downstream task. |
Other terms and their explanations: https://developers.google.com/machine-learning/glossary/
发表评论