@jxmnop: we didn't ever need to invent Masked Language Modeling, I don't think. it was a bit silly by constru...

we didn't ever need to invent Masked Language Modeling, I don't think. it was a bit silly by construction. in most alternate universes we probably skip straight to autoregressive, sorry BERT