Investigating the parameter gap!

In a previous investigation, Villalobos et al identified a “parameter gap” – that is, a surprising lack of notable ML models with sizes between 1e10 and 1e11 parameters. Investigate whether the proposed hypotheses in the paper are accurate or identify new hypotheses to explain the data.