 AlpinDale
|
ad68d149d8
chore: refactor and decouple phi3v image embedding
|
hace 5 meses |
|
AlpinDale
|
e26a4ac698
chore: avoid loading the unused layers and init the VLM up to the required feature space
|
hace 6 meses |
|
AlpinDale
|
7e99578712
fix: cleanup validation and update docs for vlm
|
hace 6 meses |
|
AlpinDale
|
526163003d
fix: improve consistency between feature size calc and dummy data for profiling
|
hace 6 meses |
|
AlpinDale
|
c11a8bdaad
fix: calculate max number of multi-modal tokens automatically
|
hace 6 meses |
|
AlpinDale
|
4f7d212b70
feat: remove vision language config
|
hace 6 meses |
|
AlpinDale
|
4599c98f99
feat: dynamic image size support for VLMs
|
hace 6 meses |
 AlpinDale
|
0f4a9ee77b
quantized lm_head (#582)
|
hace 6 meses |
|
AlpinDale
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
hace 6 meses |
|
AlpinDale
|
3a0fdf7b9b
chore: remove `image_input_type` from VLM config
|
hace 6 meses |
|
AlpinDale
|
4cdc810b1c
fix: minor TP issues with vision models
|
hace 6 meses |
|
AlpinDale
|
c0c336aaa3
refactor: registry for processing model inputs; quick_gelu; clip model support
|
hace 6 meses |
|
AlpinDale
|
c5d8028668
fix: no need to redefine supports_vision and supports_lora in model class
|
hace 6 meses |
|
AlpinDale
|
b81966c0da
fix: missed phi3v
|
hace 6 meses |
|
AlpinDale
|
5974495461
chore: phi3v resize for dynamic shape
|
hace 6 meses |
|
AlpinDale
|
79b1c0b861
fix: do not error our if two processes do not agree on p2p capability
|
hace 6 meses |
|
AlpinDale
|
e6d70101b3
feat: add support for phi-3 vision model
|
hace 6 meses |
