Nvidia Reportedly Plans Late Fall Release for Trillion-Parameter AI Model Nemotron 4

According to media reports, Nvidia is developing a new generation of open-source large model series, Nemotron 4. The largest version in this series is expected to have at least 1 trillion parameters, approximately twice the size of the current Nemotron 3 Ultra model. It is said that while the training data and some model architecture for Nemotron 4 have been finalized, the actual training has not yet begun. If development proceeds as planned, it could be released as early as late fall this year.