python: improve handling of incomplete downloads (#2152)

* make sure encoding is identity for Range requests
* use a .part file for partial downloads
* verify using file size and MD5 from models3.json

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
This commit is contained in:
Jared Van Bortel
2024-03-21 11:33:41 -04:00
committed by GitHub
parent b4bcc5b37c
commit 71d7f34d1a
3 changed files with 92 additions and 33 deletions

View File

@@ -102,7 +102,8 @@ setup(
'mkdocstrings[python]',
'mkdocs-jupyter',
'black',
'isort'
'isort',
'typing-extensions>=3.10',
]
},
package_data={'llmodel': [os.path.join(DEST_CLIB_DIRECTORY, "*")]},