iDdZddlmZmZmZddlZddlmZGddZ y)z Embedding utilities - Generate vector embeddings using SentenceTransformers Supports Qwen3 Embedding models through SentenceTransformers interface )ListOptionalAnyN) get_configcBeZdZdZddeedefdZddZddZ dd Z dd e ed ede jfd Zdd ed ede jfdZde ede jfdZde ede jfdZd e ede jfdZd e ede jfdZy)EmbeddingModelzV Embedding model using SentenceTransformers (supports Qwen3 and other models) N model_nameuse_optimizationcLt}|xs |j|_||_d|_d|_d|_d|_td|j|jjjdr|jy|jy)NrFzLoading embedding model: qwen3) rembedding_modelr r model dimension model_typesupports_query_promptprintlower startswith _init_qwen3_sentence_transformer#_init_standard_sentence_transformer)selfr r configs U/mnt/e/genesis-system/.venv/lib/python3.12/site-packages/simplemem/utils/embedding.py__init__zEmbeddingModel.__init__s$>(>(> 0 !+0" )$//):;< ?? " - -g 6  1 1 3  4 4 6returnc ddlm}dddd}|j|j|j}t d||j r# ||dd d d d id |_t dn||d |_|j j|_ d|_ t|j dxrdt|j div|_ t d|j|jr t dyy#t$r(}t d|d||d |_Yd}~d}~wwxYw#t$r3}t d|t d|jYd}~yd}~wwxYw)z1Initialize Qwen3 model using SentenceTransformersrSentenceTransformerzQwen/Qwen3-Embedding-0.6BzQwen/Qwen3-Embedding-4BzQwen/Qwen3-Embedding-8B)z qwen3-0.6bzqwen3-4bzqwen3-8bz.Loading Qwen3 model via SentenceTransformers: flash_attention_2auto)attn_implementation device_map padding_sideleftT) model_kwargstokenizer_kwargstrust_remote_codez0Qwen3 loaded with flash_attention_2 optimizationzFlash attention failed (z), using standard loading...r)Nqwen3_sentence_transformerpromptsqueryz0Qwen3 model loaded successfully with dimension: zQuery prompt support detectedzFailed to load Qwen3 model: z5Falling back to default SentenceTransformers model...)sentence_transformersr getr rr r Exception get_sentence_embedding_dimensionrrhasattrgetattrr!_fallback_to_sentence_transformer)rr qwen3_models model_pathes rrz/EmbeddingModel._init_qwen3_sentence_transformer!s0 5 A:55L &))$//4??KJ B:,O P$$Y!4"3F*0&+9&)A*."DJLM 1tT !ZZHHJDN:DO*1Y)G*GW^ IrXMD & DT^^DTU V))56*!Y4QC7STU!4ZSW!XDJJY$ 5 04 5 I J  2 2 4 4 5sCA E!D 0BE D>D94E9D>>E E= )E88E=c ddlm}||jd|_|jj |_d|_d|_td|j y #t$r}td|d }~wwxYw) z-Initialize standard SentenceTransformer modelrrTr*sentence_transformerFz1SentenceTransformer model loaded with dimension: z*Failed to load SentenceTransformer model: N) r.r r rr1rrrrr0)rr r7s rrz2EmbeddingModel._init_standard_sentence_transformerUsx  A,T__PTUDJ!ZZHHJDN4DO).D & EdnnEUV W  >qcB C  sA$A'' B0A??BcRd}td|||_|jy)z-Fallback to default SentenceTransformer modelz&sentence-transformers/all-MiniLM-L6-v2zUsing fallback model: N)rr r)rfallback_models rr4z0EmbeddingModel._fallback_to_sentence_transformercs+A &~&678( 002rtextsis_queryct|tr|g}|jdk(r|jr|r|j |S|j |S)z Encode list of texts to vectors Args: - texts: List of texts to encode - is_query: Whether these are query texts (for Qwen3 prompt optimization) r+) isinstancestrrr_encode_with_query_prompt_encode_standard)rr<r=s rencodezEmbeddingModel.encodejsR eS !GE OO; ;**11%8 8((/ /rtextc0|j|g|dS)z Encode single text Args: - text: Text to encode - is_query: Whether this is a query text (for Qwen3 prompt optimization) r=rrC)rrDr=s r encode_singlezEmbeddingModel.encode_singles{{D6H{5a88rqueriesc(|j|dS)z@ Encode queries with optimal settings for Qwen3 TrFrG)rrIs r encode_queryzEmbeddingModel.encode_querys{{7T{22r documentsc(|j|dS)z4 Encode documents (no query prompt) FrFrG)rrLs rencode_documentszEmbeddingModel.encode_documentss{{9u{55rc |jj|ddd}|S#t$r*}td|d|j |cYd}~Sd}~wwxYw)z%Encode texts using Qwen3 query promptr-FT) prompt_nameshow_progress_barnormalize_embeddingszQuery prompt encoding failed: z#, falling back to standard encodingN)rrCr0rrB)rr< embeddingsr7s rrAz(EmbeddingModel._encode_with_query_promptsh 0**#"'%) +J   0 21#5XY Z((/ / 0s # AA AAcB|jj|dd}|S)z"Encode texts using standard methodFT)rQrR)rrC)rr<rSs rrBzEmbeddingModel._encode_standards,ZZ&& #!%' r)NT)rN)F)__name__ __module__ __qualname____doc__rr@boolrrrr4rnpndarrayrCrHrKrNrArBrrrr s78C=747"25h 30DI00"**0*9#99"**93DI3"**3 6$s)6 6 0tCy 0RZZ 0d3iBJJrr) rXtypingrrrnumpyrZsimplemem.configrrr\rrr`s$'&'__r