github/GLM-130B

kopia lustrzana https://github.com/THUDM/GLM-130B.git

Sengxian f9276c6988 Fix conversion script		2 lat temu
..
__init__.py	0f02a4626d Add pre-tokenize scripts for pile	2 lat temu
convert_tp.py	f9276c6988 Fix conversion script	2 lat temu
tokenize_pile.py	0f02a4626d Add pre-tokenize scripts for pile	2 lat temu