yuehuayingxueluo d482922035 [Inference] Support the logic related to ignoring EOS token (#5693) ... * Adapt temperature processing logic * add ValueError for top_p and top_k * add GQA Test * fix except_msg * support ignore EOS token * change variable's name * fix annotation		2024-05-08 19:59:10 +08:00
..
_analyzer	[hotfix] Fix examples no pad token & auto parallel codegen bug; (#5606)	2024-04-18 18:15:50 +08:00
_C	[setup] support pre-build and jit-build of cuda kernels (#2374)	2023-01-06 20:50:26 +08:00
accelerator	[hotfix] fix typo change MoECheckpintIO to MoECheckpointIO (#5335)	2024-03-05 21:52:30 +08:00
amp	[npu] change device to accelerator api (#5239)	2024-01-09 10:20:05 +08:00
auto_parallel	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
autochunk	[hotfix] Fix examples no pad token & auto parallel codegen bug; (#5606)	2024-04-18 18:15:50 +08:00
booster	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
checkpoint_io	[lora] add lora APIs for booster, support lora for TorchDDP (#4981)	2024-04-28 10:51:27 +08:00
cli	[devops] fix extention building (#5427)	2024-03-05 15:35:54 +08:00
cluster	[devops] remove post commit ci (#5566)	2024-04-08 15:09:40 +08:00
context	[Fix]: implement thread-safety singleton to avoid deadlock for very large-scale training scenarios (#5625)	2024-04-25 14:45:52 +08:00
device	[npu] add npu support for hybrid plugin and llama (#5090)	2023-11-22 19:23:21 +08:00
fx	[hotfix] Fix examples no pad token & auto parallel codegen bug; (#5606)	2024-04-18 18:15:50 +08:00
inference	[Inference] Support the logic related to ignoring EOS token (#5693)	2024-05-08 19:59:10 +08:00
interface	[lazy] support from_pretrained (#4801)	2023-09-26 11:04:11 +08:00
kernel	[sync] resolve conflicts of merging main	2024-05-05 05:14:00 +00:00
lazy	[doc] add lazy init docs (#4808)	2023-09-27 10:24:04 +08:00
legacy	[sync] resolve conflicts of merging main	2024-05-05 05:14:00 +00:00
logging	[misc] update pre-commit and run all files (#4752)	2023-09-19 14:20:26 +08:00
moe	[hotfix] fix typo change MoECheckpintIO to MoECheckpointIO (#5335)	2024-03-05 21:52:30 +08:00
nn	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
pipeline	[LowLevelZero] low level zero support lora (#5153)	2024-04-28 10:51:27 +08:00
quantization	[Feature] qlora support (#5586)	2024-04-28 10:51:27 +08:00
shardformer	[hotfix] Fix KV Heads Number Assignment in KVCacheManager (#5695)	2024-05-07 23:13:14 +08:00
tensor	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00
testing	[shardformer] refactor embedding resize (#5603)	2024-04-18 16:10:18 +08:00
utils	Merge pull request #5310 from hpcaitech/feature/npu	2024-01-29 13:49:39 +08:00
zero	[Feature] qlora support (#5586)	2024-04-28 10:51:27 +08:00
__init__.py	[devops] remove post commit ci (#5566)	2024-04-08 15:09:40 +08:00
initialize.py	[misc] refactor launch API and tensor constructor (#5666)	2024-04-29 10:40:11 +08:00