Self-attention allows tokens to:
Answer options
A
Only attend to their immediate neighbor
B
Attend to all tokens in the sequence
C
Ignore other tokens
D
Compute ELBO directly
Correct answer: Attend to all tokens in the sequence
Explanation
Quick AnswerThe correct answer is Attend to all tokens in the sequence because it directly addresses the core logic of Generative AI.
The correct answer is: Attend to all tokens in the sequence.