ComfyUI/comfy/text_encoders/hydit_clip_tokenizer/special_tokens_map.json

{
  "cls_token": "[CLS]",
  "mask_token": "[MASK]",
  "pad_token": "[PAD]",
  "sep_token": "[SEP]",
  "unk_token": "[UNK]"
}
Basic hunyuan dit implementation. (#4102) * Let tokenizers return weights to be stored in the saved checkpoint. * Basic hunyuan dit implementation. * Fix some resolutions not working. * Support hydit checkpoint save. * Init with right dtype. * Switch to optimized attention in pooler. * Fix black images on hunyuan dit. 2024-07-25 18:21:08 -04:00			`{`
			`"cls_token": "[CLS]",`
			`"mask_token": "[MASK]",`
			`"pad_token": "[PAD]",`
			`"sep_token": "[SEP]",`
			`"unk_token": "[UNK]"`
			`}`