>> DeepSpeed加载失败,回退到标准推理: No module named 'deepspeed'
GPT2InferenceModel has generative capabilities, as `prepare_inputs_for_generation` is explicitly overwritten. However, it doesn't directly inherit from `GenerationMixin`. From 👉v4.50👈 onwards, `PreTrainedModel` will NOT inherit from `GenerationMixin`, and this model will lose the ability to call `generate` and other related functions.
可以正常使用,但每次打开都会弹出来这个加载失败的提示,是什么原因呢? zf372050857 发表于 2025-9-10 11:05
> GPT weights restored from: checkpoints\gpt.pth
>> DeepSpeed加载失败,回退到标准推理: No module nam ...
不用管,正常的提示 这个怎么这么慢啊?字数越多,时间呈几何倍数上升,把我32G内存和12g显存都吃光了还没生出来? nevets 发表于 2025-9-10 22:32
这个怎么这么慢啊?字数越多,时间呈几何倍数上升,把我32G内存和12g显存都吃光了还没生出来? ...
这个理论是12G显存才满足推理条件,你字数多了,显卡受限,肯定快不了。
一次字数不要太多,等下个版本我看看能不能加速下
页:
1
[2]