digger yu 16c96d4d8c [hotfix] fix typo change _descrption to _description (#5331)

2024-03-05 21:47:48 +08:00

..

modeling

[Kernels]added flash-decoidng of triton (#5063)

2023-11-20 13:58:29 +08:00

policies

[inference] Refactor inference architecture (#5057)

2023-11-19 21:05:05 +08:00

__init__.py

[inference] update examples and engine (#5073)

2023-11-20 19:44:52 +08:00

engine.py

[inference] refactor examples and fix schedule (#5077)

2023-11-21 10:46:03 +08:00

microbatch_manager.py

[hotfix] fix typo change _descrption to _description (#5331)

2024-03-05 21:47:48 +08:00