Decoder-only models like GPT are trained to:
Answer options
A
Predict masked tokens bidirectionally
B
Predict next-token in an autoregressive fashion
C
Compute exact likelihoods always
D
Implement HMMs
Correct answer: Predict next-token in an autoregressive fashion
Explanation
Quick AnswerThe correct answer is Predict next-token in an autoregressive fashion because it directly addresses the core logic of Generative AI.
The correct answer is: Predict next-token in an autoregressive fashion.