ci; UddlZddlZddlZddlZddlZddlZddlZddlmZmZm Z m Z m Z m Z m Z mZmZmZmZddlmZddlZddlmZddlmZddlmZddlmZ ddlZej>j@jBZ! ddl#Z#e#jHjJZ% ejNZ(ee)e*d< ejVZ,e-e*d < ej\Z/e e)ee)fe*d < dd l0m1Z1e1jdZ3 dd l4m5Z5e5jlZ7 ddl8Z8e8jrZ9e e)efZ:Gd deZ;GddeZ<GddeZ=ej|dZ?e@e(eAe,zZBe-ddgZCdZDdZEdZFdZGdZHdZI dPdee:ejfde ejdejfdZKdejde:fd ZLdede:fd!ZMde7de:fd"ZNdee3e7fde:fd#ZOd$ejde efd%ZQd&ee)de e)d'ffd(ZRe?fded)e e)d*ej|de e)e)ffd+ZSdd,d)e e)e)fd&eee)e e)d'ffd-e ee)de e)e e)efffd.ZT dQded/e ee)d0e e e)ee)fd1e e e)efde e)e)ff d2ZUd3ejdeWfd4ZXdigd5d6ed7efd8e e)d9e e)e)fd:ee)de:f d;ZYdeWfd<ZZd=e9de e)effd>Z[dejfd?Z]dejfd@Z^dejfdAZ_dejfdBZ`dejfdCZade ejfdDZbde ejfdEZcde ejfdFZdde ejfdGZede ejfdHZfde ejfdIZgde ejfdJZhdKee)dLee)fdMZidNeje)e)fddfdOZky#e"$reZ!YCwxYw#e&$reZ%Y6wxYw#e&$rgZ(ee)e*d<Y7wxYw#e&$re-Z,e-e*d <Y=wxYw#e&$riZ/e e)ee)fe*d <Y9wxYw#e"$reZ3Y4wxYw#e"$reZ7Y/wxYw#e"$reZ9Y,wxYw)RN) AnyCallableDictIterableListMappingOptionalSequenceSet TypedDictUnion)metadata)base) httpbody_pb2) struct_pb2) json_format_BUILTIN_MODULE_NAMES_STDLIB_MODULE_NAMES_PACKAGE_DISTRIBUTIONS)chat) run_responseceZdZUeeed<y)_RequirementsValidationActionsappendN__name__ __module__ __qualname__r str__annotations__D/tmp/pip-target-z3e9_cxr/lib/python/vertexai/agent_engines/_utils.pyrris Hr"rc.eZdZUeeed<eeed<y)_RequirementsValidationWarningsmissing incompatibleNrr!r"r#r%r%ms Xc(r"r%c"eZdZUeed<eed<y)_RequirementsValidationResultwarningsactionsN)rrrr%r rr!r"r#r)r)rs-- ++r"r)zvertexai.agent_engines cloudpicklepydanticr+rr*r&r'installation_scriptsobjmessagereturnc|tj}t|tjtjfr|S t j ||j|S#t$rt j ||Y|SwxYw)a<Parses a JSON-like object into a message. If the object is already a message, this will return the object as-is. If the object is a JSON Dict, this will parse and merge the object into the message. Args: obj (Union[dict[str, Any], proto.Message]): Required. The object to convert to a proto message. message (proto.Message): Optional. A protocol buffer message to merge the obj into. It defaults to Struct() if unspecified. Returns: proto.Message: The same message passed as argument. ) rStruct isinstanceprotoMessager ParseDict_pbAttributeError)r/r0s r#to_protor:s{(##%# z'8'89: ,c7;;/ N ,c7+ N,s A&&B B c tjtj|jd}|S#t $r.tjtj|d}Y|SwxYw)aConverts the contents of the protobuf message to JSON format. Args: message (proto.Message): Required. The proto message to be converted to a JSON dictionary. Returns: dict[str, Any]: A dictionary containing the contents of the proto. T)preserving_proto_field_name)jsonloadsr MessageToJsonr8r9)r0results r#to_dictrAsn ::  % % ,0   M  ::  % %,0   M s483A/.A/ctj|std|tjtj tj |S)a6Converts a dataclass to a JSON dictionary. Args: obj (Any): Required. The dataclass to be converted to a JSON dictionary. Returns: dict[str, Any]: A dictionary containing the contents of the dataclass. Raises: TypeError: If the object is not a dataclass. zObject is not a dataclass: ) dataclasses is_dataclass TypeErrorr=r>dumpsasdictr/s r#_dataclass_to_dict_or_raiserIsH  # #C (5cU;<< ::djj!3!3C!89 ::r"c:t|dr|jd}t|dd/t|jddt|jddd}d}t|ddYt|jdr.t j |jj}nt|j}t|d dtt|d gt|d d||d }t j t j|S) aConverts an AutogenRunResponse object into a JSON-serializable dictionary. This function takes a `RunResponseProtocol` object and transforms its relevant attributes into a dictionary format suitable for JSON conversion. The `RunResponseProtocol` defines the structure of the response object, which typically includes: * **summary** (`Optional[str]`): A textual summary of the run. * **messages** (`Iterable[Message]`): A sequence of messages exchanged during the run. Each message is expected to be a JSON-serializable dictionary (`Dict[str, Any]`). * **events** (`Iterable[BaseEvent]`): A sequence of events that occurred during the run. Note: The `process()` method, if present, is called before conversion, which typically clears this event queue. * **context_variables** (`Optional[dict[str, Any]]`): A dictionary containing contextual variables from the run. * **last_speaker** (`Optional[Agent]`): The agent that produced the last message. The `Agent` object has attributes like `name` (Optional[str]) and `description` (Optional[str]). * **cost** (`Optional[Cost]`): Information about the computational cost of the run. The `Cost` object inherits from `pydantic.BaseModel` and is converted to JSON using its `model_dump_json()` method. * **process** (`Optional[Callable[[], None]]`): An optional function (like a console event processor) that is called before the conversion takes place. Executing this method often clears the `events` queue. For a detailed definition of `RunResponseProtocol` and its components, refer to: https://github.com/ag2ai/ag2/blob/main/autogen/io/run_response.py Args: obj (AutogenRunResponse): The AutogenRunResponse object to convert. This object must conform to the `RunResponseProtocol`. Returns: JsonDict: A dictionary representation of the AutogenRunResponse, ready to be serialized into JSON. The dictionary includes keys like 'summary', 'messages', 'context_variables', 'last_speaker_name', and 'cost'. processN last_speakername description)rMrNcostmodel_dump_jsonsummarymessagescontext_variables)rQrRrSrLrO) hasattrrKgetattrrLrOr=r>rPrlistrF)r/rLrOr@s r#&_autogen_run_response_protocol_to_dictrWsbsI LsND)5C,,fd;"3#3#3]DI DsFD!- 388. /::chh6689Dsxx=D3 40j"56$S*=tD$ F ::djj( ))r"cNt|tr t|St|S)aConverts an Autogen object to a JSON serializable object. In `ag2<=0.8.4`, `.run()` will return a `ChatResult` object. In `ag2>=0.8.5`, `.run()` will return a `RunResponse` object. Args: obj (Union[AutogenChatResult, AutogenRunResponse]): Required. The Autogen object to be converted to a JSON serializable object. Returns: JsonDict: A JSON serializable object. )r4AutogenChatResultrIrWrHs r##to_json_serializable_autogen_objectrZs%&#()*3// 1# 66r"bodyc#Kt|dd}t|dd}||d|vr|y |jd}|sdy|j dD]}|s t j|}|!y#t$r)}tj d|d||Yd}~yd}~wwxYw#t$r%}tj d |d|Yd}~ed}~wwxYww) aConverts the contents of the httpbody message to JSON format. Args: body (httpbody_pb2.HttpBody): Required. The httpbody body to be converted to a JSON. Yields: Any: A JSON object or the original body if it is not JSON or None. content_typeNdatazapplication/jsonzutf-8zFailed to decode data: . Exception:  zfailed to parse json: )rUdecode ExceptionLOGGERwarningsplitr=r>)r[r]r^ utf8_dataelines r#yield_parsed_jsonri4s46L 4 &Dt|/A/U KK(  %  Pzz$'J  0mA3GH  P!7v]1#NOO PsW(CA7CB,0C7 B)B$C$B))C, C5CCCC constraints SpecifierSetcLt}i}|D]a} |jdrtjj |}|j |}|jxsd||j<c|S#t $r%}tjd|d|Yd}~d}~wwxYw)aAParses a list of constraints into a dict of requirements. Args: constraints (list[str]): Required. The list of package requirements to parse. This is assumed to come from the `requirements.txt` file. Returns: dict[str, SpecifierSet]: The specifiers for each package. z.whlzFailed to parse constraint: r_N) '_import_packaging_requirements_or_raiseendswithospathbasename Requirementrbrcrd specifierrM)rj requirementsr@ constraint requirementrgs r#parse_constraintsrwZs;K$/#8#8#@D{ A M   NN9*]STRUV W  sAA55 B#>BB#rtloggercB|j} t|}|jd|t|}t ||}|j t ijD]\}}|s |jd|d|!|j tijD]>\}} | s |tk(s| D]} |j| |jd| @ |S#t$r} |jd| Yd} ~ |Sd} ~ wwxYw)z6Compiles the requirements into a list of requirements.z'Identified the following requirements: zThe following requirements are z: z)The following requirements are appended: z Failed to compile requirements: N) copyscan_requirementsinforwcompare_requirementsget _WARNINGS_KEYitemsrd _ACTIONS_KEY_ACTION_APPENDrrb) r/rtrxcurrent_requirementsrjmissing_requirements warning_typer* action_typer+actionrgs r#validate_requirements_or_warnrus<  $$&L?05 =>R=STU' 5 34H+V&:&>&> 2' %'  "L(5l^2hZP  %9$<$<\2$N$T$T$V S K;.8%0F ''/0 GyQR  S  ?9!=>> ?s+A"C65AC6; C6.C66 D?DD)required_packagesrc <t}|t}ttt t t t }t |tr t|}|jD]\}}||vrH|ttj|||vr$|ttj|d|R|sU||}|s]|j||vsq|tt j|d|dt#|d|S)aCompares the requirements with the constraints. Args: requirements (Mapping[str, str]): Required. The packages (and their versions) to compare with the constraints. This is assumed to be the result of `scan_requirements`. constraints (Union[Sequence[str], Mapping[str, SpecifierSet]]): Required. The package constraints to compare against. This is assumed to be the result of `parse_constraints`. required_packages (Sequence[str]): Optional. The set of packages that are required to be in the constraints. It defaults to the set of packages that are required for deployment on Agent Engine. Returns: dict[str, dict[str, Any]]: The comparison result as a dictionary containing: * warnings: * missing: The set of packages that are not in the constraints. * incompatible: The set of packages that are in the constraints but have versions that are not in the constraint specifier. * actions: * append: The set of packages that are not in the constraints but should be appended to the constraints. )r&r')r)r*r+z==z (required: ))"_import_packaging_version_or_raise_DEFAULT_REQUIRED_PACKAGESr)r%setrr4rVrwrr_WARNING_MISSINGaddrrVersion_WARNING_INCOMPATIBLEr)rtrjrpackaging_versionr@packagepackage_versionpackage_specifiers r#r}r}s+<;< 6 *0SUS.ce<F+t$' 4 $0$6$6$8  + % = !"2 3 7 7 @++|$^488ir/!23   +G 4 $ ((9ARR}%&;<@@ir/!2,sCT?U>VVWX Mr"ignore_modulespackage_distributionsinspect_getmembers_kwargsc|t}|t}tt}|xsi}t j |fi|D]{\}}|r!t j |s t|ds*|jxsdjdd}|sO||vsT|j|gD]}|j|}|Dcic]}|tj|c}Scc}w)aScans the object for modules and returns the requirements discovered. This is not a comprehensive scan of the object, and only detects for common cases based on the members of the object returned by `dir(obj)`. Args: obj (Any): Required. The object to scan for package requirements. ignore_modules (Sequence[str]): Optional. The set of modules to ignore. It defaults to the set of built-in and stdlib modules. package_distributions (Mapping[str, Sequence[str]]): Optional. The mapping of module names to the set of packages that contain them. It defaults to the set of packages from `importlib_metadata.packages_distributions()`. inspect_getmembers_kwargs (Mapping[str, Any]): Optional. The keyword arguments to pass to `inspect.getmembers`. It defaults to an empty dictionary. Returns: Sequence[str]: The list of requirements that were discovered. r.r) _BASE_MODULESrrrinspect getmembers isbuiltinrTrrer~rimportlib_metadataversion) r/rrr modules_found_attr module_namemodules r#r{r{s8&$ 623M 9 ?R%%cG-FG*4w((.gdL6Q ,"33C8; ;n</33KD *!!&) * *FS S6F&..v6 6 SS Ss>Cparamc|jtjjk(ryt |jt ryt } |j|jy#t$rYywxYw)z1Checks if the parameter is pydantic serializable.TF) annotationr Parameteremptyr4r_import_pydantic_or_raise TypeAdapterrb)rr-s r#_is_pydantic_serializablersl 7,,222%""C((*HU--. sA,, A87A8) schema_name descriptionsrequiredf.rrrc t}ttj|j}|j Dcic]\}}|j tjjtjjtjjfvrht|r]||jtjjk7r |jnt|j|j!|df}}}|j"|j$fi|j'} | j)dd| j!dij D]\}} | j)dd||j} t+j,| t.usCt1dt+j2| vsd| j)dgD]"} | j!d} | s| dk7s| | d<nd | d <|r|| d <n|Dcgc]}||j4tjjk(r^||j tjjtjjtjjfvr|c}| d <t|j$|j6| } |r|| d <| Scc}}wcc}w)a/Generates the OpenAPI Schema for a callable object. Only positional and keyword arguments of the function `f` will be supported in the OpenAPI Schema that is generated. I.e. `*args` and `**kwargs` will not be present in the OpenAPI schema returned from this function. For those cases, you can either include it in the docstring for `f`, or modify the OpenAPI schema returned from this function to include additional arguments. Args: f (Callable): Required. The function to generate an OpenAPI Schema for. schema_name (str): Optional. The name for the OpenAPI schema. If unspecified, the name of the Callable will be used. descriptions (Mapping[str, str]): Optional. A `{name: description}` mapping for annotating input arguments of the function with user-provided descriptions. It defaults to an empty dictionary (i.e. there will not be any description for any of the inputs). required (Sequence[str]): Optional. For the user to specify the set of required arguments in function calls to `f`. If specified, it will be automatically inferred from `f`. Returns: dict[str, Any]: The OpenAPI Schema for the function `f` in JSON format. N)rNtitler propertiesanyOftypenullTnullabler)rMrN parametersrM)rdictr signaturerrkindrPOSITIONAL_OR_KEYWORD KEYWORD_ONLYPOSITIONAL_ONLYrrrrFieldr~ create_modelrschemapoptyping get_originr rget_argsdefault__doc__)rrrrr-defaultsrMr fields_dictr function_argrr schema_typeks r#generate_schemarsD)*HG%%a(334H $>>+ D% ::    3 3    * *    - -  &e ,- "'!1!1W5F5F5L5L!LU  RU HNN),,T48   K2'&&qzzA[AHHJJ NN7B(nn\2>DDF,l"%d^..   Z (E 1d4jFOO E 7 '**7B7 $jj0 ;+6L(   (,L $',*!) :  "  ##w'8'8'>'>>QK$$%%;;%%22%%55  " :qzzqyyZ PF$v MSr " sC KBK%ct}|jj}|jj}t |||fS)z5Returns True if the tracer_provider is Proxy or NoOp.)_import_opentelemetry_or_warntraceProxyTracerProviderNoOpTracerProviderr4)tracer_provider opentelemetryrrs r# is_noop_or_proxy_tracer_providerrxsB13M'--AA&,,?? o(:rP)rs r#dump_event_for_jsonrs ::e+++> ??r"cN ddlm}|S#t$r}td|d}~wwxYw)z)Tries to import the Cloud Storage module.r)storagezaCloud Storage is not installed. Please call 'pip install google-cloud-aiplatform[agent_engines]'.N) google.cloudr ImportError)rrgs r#_import_cloud_storage_or_raisers;( N  D   $ $cJ ddl}|S#t$r}td|d}~wwxYw)z'Tries to import the cloudpickle module.rNz_cloudpickle is not installed. Please call 'pip install google-cloud-aiplatform[agent_engines]'.)r,r)r,rgs r#_import_cloudpickle_or_raisers<   D  s " "c ddl}|j}|S#t$r ddlm}Y|St$r}t d|d}~wwxYw)z$Tries to import the pydantic module.rN)v1z\pydantic is not installed. Please call 'pip install google-cloud-aiplatform[agent_engines]'.)r-rr9rr)r-rrgs r#rrsX  NN O ,+ O  D  s?? :?cN ddlm}|S#t$r}td|d}~wwxYw)2Tries to import the packaging.requirements module.r)rtzjpackaging.requirements is not installed. Please call 'pip install google-cloud-aiplatform[agent_engines]'.N) packagingrtr)rtrgs r#rmrms<*   D  rcN ddlm}|S#t$r}td|d}~wwxYw)rr)rzepackaging.version is not installed. Please call 'pip install google-cloud-aiplatform[agent_engines]'.N)rrr)rrgs r#rrs;% N  D  rcX ddl}|S#t$rtjdYywxYw)z)Tries to import the opentelemetry module.rNeopentelemetry-sdk is not installed. Please call 'pip install google-cloud-aiplatform[agent_engines]'.)rrrcrdrs r#rrs6    D    s ))c ddl}|jjS#t$rtj dYywxYw)z3Tries to import the opentelemetry.sdk.trace module.rNr)opentelemetry.sdk.tracesdkrrrcrdrs r#'_import_opentelemetry_sdk_trace_or_warnrsB &  &&&   D    ==c ddl}|jjS#t$rtj dYywxYw)z1Tries to import the google.cloud.trace_v2 module.rNzfgoogle-cloud-trace is not installed. Please call 'pip install google-cloud-aiplatform[agent_engines]'.)google.cloud.trace_v2cloudtrace_v2rrcrd)googles r#_import_cloud_trace_v2_or_warnrs@ $||$$$   D    rc ddl}|jjS#t$rtj dYywxYw)z>Tries to import the opentelemetry.exporter.cloud_trace module.rNztopentelemetry-exporter-gcp-trace is not installed. Please call 'pip install google-cloud-aiplatform[agent_engines]'.)"opentelemetry.exporter.cloud_traceexporter cloud_tracerrcrdrs r#$_import_cloud_trace_exporter_or_warnrsB 1%%111   I    rc ddl}|jjS#t$rtj dYywxYw)zCTries to import the openinference.instrumentation.langchain module.rNzwopeninference-instrumentation-langchain is not installed. Please call 'pip install google-cloud-aiplatform[langchain]'.)'openinference.instrumentation.langchaininstrumentation langchainrrcrd openinferences r#'_import_openinference_langchain_or_warnrsB 6,,666   E    rc ddl}|jjS#t$rtj dYywxYw)zATries to import the openinference.instrumentation.autogen module.rNzoopeninference-instrumentation-autogen is not installed. Please call 'pip install google-cloud-aiplatform[ag2]'.)%openinference.instrumentation.autogenrautogenrrcrdrs r#%_import_openinference_autogen_or_warnr sA 4,,444   ?    rc\ ddlm}|S#t$rtj dYywxYw)z)Tries to import the autogen.tools module.rtoolszWautogen.tools is not installed. Please call `pip install google-cloud-aiplatform[ag2]`.N)rr rrcrdr s r#_import_autogen_tools_or_warnr s4 !   ?    s  ++ script_pathsextra_packagesc |D]}|jts=tjd|dtdtdt d|dtd||vsZtjd|dt d|d |D]D}|jts||vstjd |d t d |d y )a2Validates the installation scripts' path explicitly provided by the user. Args: script_paths (Sequence[str]): Required. The paths to the installation scripts. extra_packages (Sequence[str]): Required. The extra packages to be updated. Raises: ValueError: If a user-defined script is not under the expected subdirectory, or not in `extra_packages`, or if an extra package is in the installation scripts subdirectory, but is not specified as an installation script. z"User-defined installation script 'z' is not in the expected 'z(' subdirectory. Ensure it is placed in 'z' within your `extra_packages`.zRequired installation script 'z' is not under ''zC' is not in extra_packages. Ensure it is added to `extra_packages`.z$' does not exist in `extra_packages`zExtra package 'z' is in the installation scripts subdirectory, but is not specified as an installation script in `build_options`. Ensure it is added to installation_scripts for automatic execution.zq' is in the installation scripts subdirectory, but is not specified as an installation script in `build_options`.N) startswith_INSTALLATION_SUBDIRrcrd ValueError)r r script_path extra_packages r#&validate_installation_scripts_or_raiser's4$$ %%&:; NN4[MB!!5 67++?*@A$%  0 >!!5 6a9  n , NN4[MBJK 4[MB56 %.(  $ $%9 :\1 NN!-1'' !-1-- " r"resource_limitsct|tstdt|d|vsd|vr t dt |d}|d}|dvrt d|t|tr|jdst d| t |d d }|d kDrt d|d|dkDrd}n|dkDrd}n|dkDrd}n |dkDrd}nd}||krt d|d|d|y #t $rt d |d wxYw)ayValidates the resource limits. Checks that the resource limits are a dict with 'cpu' and 'memory' keys. Checks that the 'cpu' value is one of 1, 2, 4, 6, 8. Checks that the 'memory' value is a string ending with 'Gi'. Checks that the memory size is smaller than 32Gi. Checks that the memory size requires at least the specified number of CPUs. Args: resource_limits: The resource limits to be validated. Raises: TypeError: If the resource limits are not a dict. KeyError: If the resource limits do not contain 'cpu' and 'memory' keys. ValueError: If the 'cpu' value is not one of 1, 2, 4, 6, 8. ValueError: If the 'memory' value is not a string ending with 'Gi'. ValueError: If the memory size is too large. ValueError: If the memory size requires more CPUs than the specified 'cpu' value. z$resource_limits must be a dict. Got cpumemoryz5resource_limits must contain 'cpu' and 'memory' keys.)z9resource_limits['cpu'] must be one of 1, 2, 4, 6, 8. Got GizAresource_limits['memory'] must be a string ending with 'Gi'. Got NzInvalid memory value: z&. Must be an integer followed by 'Gi'. zMemory size of z) is too large. Must be smaller than 32Gi.rrrrrz requires at least z CPUs. Got ) r4rrErKeyErrorintrrrn)rr memory_str memory_gbmin_cpus r#"_validate_resource_limits_or_raiser*ds* ot ,>tO?T>UVWW O#x'FNOO oe$ %C *J /! J3% P   j# &j.A.A$.G < !    3B( 2~j\)R S  2~ R Q Q W}j\)rGs_      5 (#&'+#--44CCN''44L.+.+C+C8C=C2&)&=&=)==1113GC#$67&'%11""I S>Yi ,I, - .)E2F,GGH & z'BC  &- (, x& ' emm $ ]]>U]]x8;S;X;$I* I* I*X7   7  70#L11#hsm#L# S. !<! s) KK S#X B26 7#s(#7x}gc>.A&BBC7  . 7  S'#s(# #$ 7x/3CG=A )T )TXc]+)T$GC#,>$?@)T (S(9: )T  S#X )TX W%6%6 4 &"&&( mSm#m#s(# m sm m  m`RR@y@T#s(^@ (8(8  e&6&6  5#3#3  1A1A  E,<,<  x0@0@'A  %:J:J1K  1A1A(B  hu7G7G.H  %:J:J1K  x8H8H/I  x0@0@'A : 3-: SM: zD S#XD 4D aNL .+-8C=-. 2&/k)12=:<GC#$67<=Is$N8OO0O*P!P4P+P98OOOOO'&O'*O?>O?PPP('P(+P65P69QQ