[Fix] Fix Inference Example, Tests, and Requirements (#5688)

* clean requirements

* modify example inference struct

* add test ci scripts

* mark test_infer as submodule

* rm deprecated cls & deps

* import of HAS_FLASH_ATTN

* prune inference tests to be run

* prune triton kernel tests

* increment pytest timeout mins

* revert import path in openmoe

requirements/requirements-infer.txt

@@ -1,2 +0,0 @@
-ordered_set
-transformers==4.36.2

requirements/requirements-test.txt

@@ -1,6 +1,4 @@
 diffusers
-fbgemm-gpu==0.2.0
-ordered_set
 pytest
 coverage==7.2.3
 git+https://github.com/hpcaitech/pytest-testmon