[i ddlmZddlmZmZmZmZddlZddl m Z ddl m Z ddl mZddlmZeGdd ZGd d ee Zy) ) dataclass)IterableOptionalUnionAnyN)NDArray)SparseModelDescription) NumpyArray)ModelManagementceZdZUeed<eeejeejfed<de e effdZ de e effdZede e efddfdZy) SparseEmbeddingvaluesindicesreturnc4|j|jdS)Nrrr)selfs b/mnt/e/genesis-system/.venv/lib/python3.12/site-packages/fastembed/sparse/sparse_embedding_base.py as_objectzSparseEmbedding.as_objectskk||  ct|j|jDcic]\}}t|t |c}}Scc}}wN)ziprrintfloat)rivs ras_dictzSparseEmbedding.as_dicts6-0t{{-KLTQAa LLLsAdatact|dk(r0|tjgtjgSt|j \}}|tj|tj|S)Nrr)lennparrayritems)clsrrrs r from_dictzSparseEmbedding.from_dicts] t9>bhhrlBHHRLA Atzz|,"((6*BHHW4EFFrN)__name__ __module__ __qualname__r __annotations__rrr"int64int32dictstrrrrr classmethodr&rrr r s  7288$gbhh&77 88 4Z0 Mc5j)MGT#u*-G2CGGrr c eZdZ ddedeedeedefdZ ddeee efded eeded e e f d Z d e eded e e fd Z deee efded e e fdZ d eee efded efdZy)SparseTextEmbeddingBaseN model_name cache_dirthreadskwargsc \||_||_||_|jdd|_y)Nlocal_files_onlyF)r3r4r5pop_local_files_only)rr3r4r5r6s r__init__z SparseTextEmbeddingBase.__init__#s-%" !',>!Fr documents batch_sizeparallelrc trNotImplementedError)rr<r=r>r6s rembedzSparseTextEmbeddingBase.embed/s "##rtextsc+FK|j|fi|Ed{y7w)a7 Embeds a list of text passages into a list of embeddings. Args: texts (Iterable[str]): The list of texts to embed. **kwargs: Additional keyword argument to pass to the embed method. Yields: Iterable[SparseEmbedding]: The sparse embeddings. N)rBrrCr6s r passage_embedz%SparseTextEmbeddingBase.passage_embed8s!4::e.v...s !!queryc+Kt|tr|j|gfi|Ed{y|j|fi|Ed{y7!7w)z Embeds queries Args: query (Union[str, Iterable[str]]): The query to embed, or an iterable e.g. list of queries. Returns: Iterable[SparseEmbedding]: The sparse embeddings. N) isinstancer.rB)rrGr6s r query_embedz#SparseTextEmbeddingBase.query_embedGsO eS !!tzz5'4V4 4 4!tzz%262 2 2 5 2s!(AA AAAAc td)z*Returns the number of tokens in the texts.z%Subclasses must implement this methodr@rEs r token_countz#SparseTextEmbeddingBase.token_countZs!"IJJr)NN)N)r'r(r)r.rrrr;rrr rBrFrJrLr0rrr2r2"s$(!% G GC= G# G  G"& $hsm+,$$3- $  $ / " $ /8C= /C /H_D] /33 -.3:=3 / "3&KsHSM'9!:KcKcKrr2) dataclassesrtypingrrrrnumpyr" numpy.typingr"fastembed.common.model_descriptionr fastembed.common.typesr !fastembed.common.model_managementr r r2r0rrrUsM!11 E-= GG G*:Ko.DE:Kr