285 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Zach Nussbaum	c20379f7e9	refactor: clean up prep index	2023-04-25 20:34:38 +00:00
Zach Nussbaum	f2161f7e59	docs: prep index barebones	2023-04-25 20:34:26 +00:00
Zach Nussbaum	586a8abc06	fix: allow for print for fns that are used in both dist and single	2023-04-25 20:34:12 +00:00
Zach Nussbaum	7832707c37	fix: index -> id	2023-04-25 20:33:49 +00:00
Zach Nussbaum	869829a065	nearly have the neighbor caching working, but combinging info into final dataset is challenging	2023-04-23 22:28:57 +00:00
Zach Nussbaum	cc3cc3f7e9	we now get the neighbors embeddings from the disk index	2023-04-23 21:04:43 +00:00
Zach Nussbaum	240feae277	added initial files for dataset prep and ingestion for gpt4all jr	2023-04-23 20:02:22 +00:00
Zach Nussbaum	84acbc8225	chore: ignore swp files	2023-04-23 17:34:49 +00:00
Zach Nussbaum	9bc88fb33d	feat: add options to specify different datasets	2023-04-22 19:53:47 +00:00
Zach Nussbaum	8cb3c8de35	chore: reqs, ignore, readme	2023-04-22 19:40:06 +00:00
Zach Nussbaum	4eeab60306	feat: build knn index	2023-04-22 19:39:46 +00:00
Zach Nussbaum	a2b1f99838	feat: distributed eval of embedder	2023-04-22 19:39:30 +00:00
Zach Nussbaum	4fb19d67b5	feat: tokenize texts into chunks	2023-04-22 19:38:51 +00:00
Zach Nussbaum	2dae153c68	feat: sbert abstractor	2023-04-22 19:38:34 +00:00
Zach Nussbaum	4671f4e82f	chore: pull out common dist print fn	2023-04-22 19:37:30 +00:00
Zach Nussbaum	e255e0a805	fix: batched xattn	2023-04-21 21:54:47 +00:00
Zach Nussbaum	ca66d12d89	fix: remove causal cross attn mask	2023-04-21 14:23:33 +00:00
Zach Nussbaum	e62baf87f8	fix: seed	2023-04-21 04:19:37 +00:00
Zach Nussbaum	aa814757fc	fix: testing works	2023-04-21 04:18:16 +00:00
Zach Nussbaum	df79fd64b0	fix: forward works!	2023-04-21 02:50:27 +00:00
zanussbaum	09cddbedc0	feat: models wip	2023-04-20 16:04:41 -04:00
zanussbaum	97a1cd0539	chore: delete unused	2023-04-19 18:13:24 -04:00
zanussbaum	29c7ac7f73	refactor: clean up directory structure	2023-04-19 18:12:03 -04:00
zanussbaum	a514492d52	chore: ignore ds store	2023-04-19 18:11:02 -04:00
AT	bc1395da6c	Update README.md	2023-04-17 18:14:42 -04:00
Zach Nussbaum	0b4d45e57d	link update	2023-04-15 06:41:55 -07:00
Zach Nussbaum	f6d3d2a2ed	Update README.md	2023-04-13 19:04:42 -07:00
Zach Nussbaum	b744df7605	Update finetune.yaml	2023-04-13 18:04:30 -07:00
Zach Nussbaum	8325767c50	Update finetune_lora.yaml	2023-04-13 18:04:02 -07:00
Andriy Mulyar	707d8ab559	Update README.md	2023-04-13 18:22:53 -04:00
Zach Nussbaum	79652d079a	Update README.md	2023-04-13 15:22:03 -07:00
Zach Nussbaum	0bc092e602	Update README.md	2023-04-13 14:56:24 -07:00
Benjamin Schmidt	a6556f4100	Update README.md ... Correct link	2023-04-13 17:42:01 -04:00
Zach Nussbaum	a2df931658	Merge pull request #334 from nomic-ai/main ... Update expired discord link	2023-04-13 17:39:19 -04:00
Zach Nussbaum	d6962aa130	Update README.md	2023-04-13 14:20:19 -07:00
Zach Nussbaum	b034d25999	Update README.md	2023-04-13 14:19:49 -07:00
Zach Nussbaum	0571e4c489	Update README.md	2023-04-13 14:02:19 -07:00
Benjamin Schmidt	51264f5eac	Merge pull request #335 from nomic-ai/gptj ... GPT-J	2023-04-13 16:59:09 -04:00
Zach Nussbaum	a0fe480d7e	fix: rename	2023-04-13 20:58:27 +00:00
Zach Nussbaum	d19cf6e50b	fix naming	2023-04-13 20:56:45 +00:00
Zach Nussbaum	4deadfb891	fix: readme	2023-04-13 20:55:49 +00:00
Zach Nussbaum	c64a23d51d	Merge branch 'main' into gptj	2023-04-13 20:42:46 +00:00
Andriy Mulyar	edb4727057	Update README.md	2023-04-13 16:34:14 -04:00
Zach Nussbaum	4dd5df1b6f	fix: format	2023-04-13 20:30:45 +00:00
Zach Nussbaum	9cf38e0ad9	Merge branch 'gptj' of github.com:nomic-ai/gpt4all into gptj	2023-04-13 20:30:10 +00:00
Zach Nussbaum	bbd22b6d25	chore: remove transformers submodule	2023-04-13 20:30:01 +00:00
Andriy Mulyar	ab2662d802	Update README.md	2023-04-13 16:23:26 -04:00
Andriy Mulyar	58710335e4	Update README.md	2023-04-13 16:06:12 -04:00
Andriy Mulyar	416a1fac8d	GPT4All Website	2023-04-13 16:05:43 -04:00
Yuvanesh-ux	f9ed54fef9	Update README.md	2023-04-13 15:48:52 -04:00