Home Explore Help
Register Sign In
github
/
GLM-130B
mirror of https://github.com/THUDM/GLM-130B.git
2
0
Fork 0
Files Issues 0 Wiki
Tree: 6a6114ccbd
Branches Tags
GLM-130B
/
tools
Sengxian 0f02a4626d Add pre-tokenize scripts for pile 3 years ago
..
__init__.py 0f02a4626d Add pre-tokenize scripts for pile 3 years ago
convert_tp.py ec44cfe652 Update conversion script 3 years ago
tokenize_pile.py 0f02a4626d Add pre-tokenize scripts for pile 3 years ago