Update

Finish analysis and update Open CLIP to smaller model
MM RAG presentation cookbook
2026-02-04 16:20:16 +00:00 · 2023-12-01 14:44:16 -08:00 · 2023-12-01 12:14:18 -08:00 · 2023-11-30 21:45:24 -08:00
2 changed files with 894 additions and 2 deletions
--- a/cookbook/Multi_Modal_RAG_presentation.ipynb
+++ b/cookbook/Multi_Modal_RAG_presentation.ipynb
--- a/libs/experimental/langchain_experimental/open_clip/open_clip.py
+++ b/libs/experimental/langchain_experimental/open_clip/open_clip.py
@@ -19,8 +19,8 @@ class OpenCLIPEmbeddings(BaseModel, Embeddings):
            # model_name = "ViT-B-32"
            # checkpoint = "laion2b_s34b_b79k"
            ### Larger, more performant
-            model_name = "ViT-g-14"
-            checkpoint = "laion2b_s34b_b88k"
+            model_name = "ViT-H-14"
+            checkpoint = "laion2b_s32b_b79k"
            model, _, preprocess = open_clip.create_model_and_transforms(
                model_name=model_name, pretrained=checkpoint
            )
Author	SHA1	Message	Date
Lance Martin	4b7499eff8	Update	2023-12-01 14:44:16 -08:00
Lance Martin	e1108be3d7	Finish analysis and update Open CLIP to smaller model	2023-12-01 12:14:18 -08:00
Lance Martin	1656505ac4	MM RAG presentation cookbook	2023-11-30 21:45:24 -08:00