Some concepts in Machine Learning
Concept | Explanation |
Logits | https://stackoverflow.com/questions/41455101/what-is-the-meaning-of-the-word-logits-in-tensorflow |
Cross-entropy | |
Softmax | |
MSE | Mean Squared Error Loss |
text corpus | |
context variable | the encoder transforms an input sequence of variable length into a fixed-shape context variable c c, and encodes the input sequence information in this context variable |
Ablation | https://en.wikipedia.org/wiki/Ablation_(artificial_intelligence) |
pretext | task being solved is not of genuine interest, but is solved only for the true purpose of learning a good data representation |
pretext task | the self-supervised learning task solved to learn visual representations, with the aim of using the learned representations or model weights obtained in the process, for the downstream task. |
Other terms and their explanations: https://developers.google.com/machine-learning/glossary/
发表评论