Some concepts in Machine Learning

No Comments
ConceptExplanation
Logitshttps://stackoverflow.com/questions/41455101/what-is-the-meaning-of-the-word-logits-in-tensorflow
Cross-entropy
Softmax
MSEMean Squared Error Loss
text corpus
context variablethe encoder transforms an input sequence of variable length into a fixed-shape context variable c
c, and encodes the input sequence information in this context variable
Ablationhttps://en.wikipedia.org/wiki/Ablation_(artificial_intelligence)
pretexttask being solved is not
of genuine interest, but is solved only for the true purpose
of learning a good data representation
pretext taskthe self-supervised learning task solved to learn visual representations, with the aim of using the learned representations or model weights obtained in the process, for the downstream task.

Other terms and their explanations: https://developers.google.com/machine-learning/glossary/

Categories: 未分类

发表评论

邮箱地址不会被公开。 必填项已用*标注

*

code