ci0dZddlZddlZddlZddlZddlmZmZddlZ ddl m Z ddl m Z ejeZdefdZd edefd Zd ee j(dee j(fd Zd edefdZdedefdZdedefdZdedefdZdedeeeffdZ dde j:deeeddfdZde j@ddfdZ!ddedeedefdZ"d dZ#y)!z1Visualization utilities for GenAI Evaluation SDK.N)AnyOptional)errors)typesreturnc@ ddlm}|duS#t$rYywxYw)z8Checks if the code is running in an IPython environment.r get_ipythonNF)IPythonr ImportErrorr s K/tmp/pip-target-z3e9_cxr/lib/python/vertexai/_genai/_evals_visualization.py_is_ipython_envr s)'}D(( s  objct|dr|jdStd|jjd)z&Custom serializer for Pydantic models. model_dumpjsonmodezObject of type z is not JSON serializable)hasattrr TypeError __class____name__)rs r_pydantic_serializerr*s=sL!~~6~** ocmm&<&<%==VW XXdfc|y|j}|jD]f}||jdk(s$||jdj s9dt dt tfd}||j|||<h|S)zUPrepares a DataFrame for JSON serialization by converting complex objects to strings.Nobjectc.t|ttfSN) isinstancedictlist)xs rz)_preprocess_df_for_json..:sJq4,,Grcellrct|ttfr tj|dt Stj|ryt|ttttfs>t|dr'tj|jddSt|St|S#t $rt|cYSwxYw)NF ensure_asciidefaultrrr)r))r!r"r#rdumpsrrstrpdisnaintfloatboolrr)r&s rstringify_cellz/_preprocess_df_for_json..stringify_cell=sdT4L1)#zz u>R  WWT]#D3UD*ABt\2#zz OOO8u t9$4y %)"4y()sB33C  C )copycolumnsdtypeapplyanyrrr,)rdf_copycolr2s r_preprocess_df_for_jsonr:1s zggiG> CL  ( *s|!!"GHLLN !S !Xc] !$#3<--n=GCL1>2 Nrdatachtj|jdjdS)z-Encodes a string to a web-safe Base64 string.zutf-8)base64 b64encodeencodedecode)r;s r_encode_to_base64rASs'   DKK0 1 8 8 AAreval_result_jsoncJt|}tjd|dS)zBReturns a self-contained HTML for single evaluation visualization.uu Evaluation Report

Evaluation Report

<
rAtextwrapdedentrB payload_b64s r_get_evaluation_htmlrIXs@#$45K ??m aZbm`min[V X XrcJt|}tjd|dS)zAReturns a self-contained HTML for a side-by-side eval comparison.u Eval Comparison Report

Eval Comparison Report

<
rDrGs r_get_comparison_htmlrK6s?#$45K ??; avbm`mKnwF H Hrdataframe_jsoncJt|}tjd|dS)z?Returns a self-contained HTML for displaying inference results.u Evaluation Dataset <

Evaluation Dataset

rD)rLrHs r_get_inference_htmlrNs>#N3K ??2 adbm`mKne}  rcontentc t|ttfst|xsdddS t|trtj|n|}t|tst|ddStj |dd}d|vr`t|j dtrA|dr<|ddj digd}|j d t|}||dSd |vr\t|j d tr=|d r8|d dj d i}|j d t|}||dSd |vrqt|j d trR|d rM|d Dcgc](}|j ddk(r|j d d*}}|r|dn t|}||dSt||dScc}w#tjttf$rt|ddcYSwxYw)a{Extracts display text and raw JSON from a content object. This function handles raw strings, Gemini's `contents` format, and OpenAI's `messages` format. Args: content: The content from a 'prompt', 'request', or 'response' column. Returns: A dictionary with 'display_text' for direct rendering and 'raw_json' for an expandable view. ) display_textraw_jsonF)indentr)contentsrpartstextchoicesmessagerOmessagesroleuser) r!r,r"rloadsr+getr#JSONDecodeErrorr IndexError)rOr; pretty_json first_partrRrZ user_messagess r_extract_text_and_raw_jsonrfIs gT{ + #GMr 2CC.>&0#&>tzz'"G$%$'LbA AjjaeD  $ 488J/6Z j)!,002$?BJ%>>&#d)=,3t9L$0kJ J%(LkJ J  )Z 8> #G "==>s>AG/A;G+AG /G:-G'G GG,HHeval_result_objcandidate_namesc tstjdyddlm} |j dddh}|j}|xrt|d kD}|jd i}|xs|jd|d<|r|r|dr|djt|dj}g} |l|jD]T\} } d| vrdnd} t!| j| } | d| d| jddd}| j#|V| |d<d|vr|dD]}t%|jdgD]\}}|t|ks|||j(t||j}|jd}|T|W|t|ksf|j&|jd}t!|}|d|d<|d|d<|j(r |j(ni}d|vr5|dD]-}|jd|vs|j+||d/||d <t-t/j0|}nq|r|dnd}g} |@t3|t4j6r%|jt|j}||jD]\} } d| vrdnd} t!| j| } t!| jd}| d| d| jdd|d|d| jddd}| j#|| |d<d|vr^| r\|dD]T}|jd}||t| ks&|jds8| |}|dd}|d|d<|d |d<V||d <t9t/j0|}|j |j;|y#t j$r }tjd |Yd}~yd}~wt$r}tjd |d d}~wwxYw)!z5Displays evaluation result in an IPython environment.0Skipping display: not in an IPython environment.NrdisplayrTevaluation_dataset)r exclude_noneexcludezSerialization Error: %s Could not display the evaluation result due to a data serialization issue. Please check the content of the EvaluationResult object.z(Failed to serialize EvaluationResult: %s)exc_informetadatarhrequestpromptrRrS referencerQ)prompt_display_textprompt_raw_jsonrtdataseteval_case_resultsresponse_candidate_resultseval_case_indexresponsesummary_metrics metric_nameintermediate_events)rurvrtresponse_display_textresponse_raw_jsonr~rr)rloggerwarningr rlrrPydanticSerializationErrorerror Exceptionrmlenr`eval_dataset_dfr:iterrowsrfappend enumerateiloc win_ratesupdaterKrr+r!rEvaluationDatasetrIHTML)rgrhrl result_dumpeinput_dataset_list is_comparisonmetadata_payloadbase_dfprocessed_rows_row prompt_key prompt_info processed_rowcase_resresp_idxcand_resrcase_idxresponse_content display_inforsummary html_contentsingle_dataset processed_df response_info original_cases rdisplay_evaluation_resultrs  IJ#%00d5I4J1 );;&F3/A+BQ+FM"z26*9+=M=Q=Q>&' "1%"1%55A-.@.C.S.STG35N"%..09FAs.73.>HJ"/J+6z+B%(WW["%=%M #))-89/= + + -'(;< L*3LL!=rB+L&Hh!3'9#::.:.x8HHT4.x8HH$,<<0A#BN ( 4 (3r7 2/1wwx/@/D/DZ/P,+EFV+WL7CN7SH^43? 3KHZ0)L L.2A1J1JO--PR  +&'89 F;;}-:NN9W]-C#DE F#3 J+DJJ{,CD 2D+A.$  &>5+B+BC..:2>3Q3QRL'*335 9FAs.73.>HJ"swwz?R$SM/:>/J+6z+B%(WW["%=1>~1N-::-F/2ww7Ld/S %M#))-8 9+9 Y '"k1n +,? @ RH'||,=>H ,$s>'::$LL)EF(6x(@ #+,H#I!#L3@3400==P/Q, R#3 J+DJJ{,CD  OOGLL./g  , ,  6     ?T R s#O::Q P(( Q4Q  Qeval_dataset_objctstjdyddlm}|j |j j rtjdyg}|j }|jD]\}}i}|jD]\}}|dvrt|||<|dk(rlt|trV|jD cic]4\} } | | D cgc]"} t| dr| jd n| $c} 6c} } } ||<|||<t|ttfr tj |d t" ||<|||<|j%|tj |d t& } t)| } |j |j+| ycc} wcc} } } w) z9Displays an evaluation dataset in an IPython environment.rjNrrkzNo inference data to display.)rsrrr{ rubric_groupsrrrFr()rrrr rlremptyritemsrfr!r"rrr#rr+rrr,rNr)rrlrrrrrcol_name cell_valuekvv_itemdataframe_json_stringrs rdisplay_evaluation_datasetrs  IJ# ((0  + + 1 167N  ) )B++--3 $'IIK 9 Hj<<*DZ*P h'_,j$/%/$4$4$6 / /!Aq +,  !'$+6<#@!' 1 1v 1 >%+!, /M(+/9M(+j4,7.2jj"@T/M(+/9M(+3 94 m,9-<!JJ~ESVW&'<=L OOGLL.// /s F< $'F7 F< 7F< status error_messagecNd}|rd|d}tjd|d|dS)zHReturns a simple HTML string for displaying a status and optional error.rQzn

Error: 

z

z%

Status: z

z
)rErF)rr error_htmls r_get_status_htmlrDsWJHIVW   ?? !(#    rc6tstjdyddlm}|j r|j j nd}|jrt|jnd}t||}|j |j|y)zCDisplays the status of an evaluation run in an IPython environment.rjNrrkUNKNOWN) rrrr rlstatenamerr,rr) eval_run_objrlrrrs rdisplay_evaluation_run_statusrYsq  IJ#(4(:(:\   $ $ F/;/A/AC **+tM#FM:L OOGLL./rr )rztypes.EvaluationRunrN)$__doc__r=rloggingrEtypingrrpandasr-pydanticrrQr getLoggerrrr1rr DataFramer:r,rArIrKrNr"rfEvaluationResultr#rrrrrrrrsj8     8 $YcYcY 68BLL;QDBCBCB [3[3[|K3K3K\BBBJ>>>>S#X>>F,0B0++B0d3i(B0 B0J201H1H20T20jS##* 0r