ciddlZddlZddlZddlmZmZddlmZddlm Z ddl m Z ddl Z ddlZejeZdZGddZy) N)AnyUnion)storage) blob_from_uri) BaseApiClientzgs://c eZdZdZdefdZdedeeeffdZdededd fd Z dd d d ededd fdZ de ee fd edd fdZ dde ee fdededefdZdedeee ffdZdededd fdZy )GcsUtilsz;Handles File I/O operations with Google Cloud Storage (GCS) api_clientc||_tj|jj|jj|_y)N)project credentials)r rClientr _credentialsstorage_client)selfr s A/tmp/pip-target-z3e9_cxr/lib/python/vertexai/_genai/_gcs_utils.py__init__zGcsUtils.__init__%s4$%nnOO++44 gcs_pathreturnc|jtstd|dtd|ttd}d|vr|dfS|j dd\}}||fS)z?Helper to parse gs://bucket/path into (bucket_name, blob_path).zInvalid GCS path: 'z'. It must start with ''.N/) startswith GCS_PREFIX ValueErrorlensplit)rrpath_without_prefix bucket_name blob_paths rparse_gcs_pathzGcsUtils.parse_gcs_path,s{"":.%hZ/FzlRTU 's:'89 ) )&* *!4!:!:3!B YI%%rupload_gcs_pathfilenameNcPt||jj|y)z=Uploads the provided file to a Google Cloud Storage location.)uriclientN)rrupload_from_filename)rr%r&s rupload_file_to_gcszGcsUtils.upload_file_to_gcs8s" (;(;  x (rdfz pd.DataFramegcs_destination_blob_path file_typec|j|\}}|std|d|jj|}|j |}t j }|dk(r|j|dd} n+|dk(r|j|dd d } ntd |d |j|j| tjd|jd|jy)azUploads a Pandas DataFrame to a Google Cloud Storage location. Args: df: The Pandas DataFrame to upload. gcs_destination_blob_path: The full GCS path for the destination blob (e.g., 'gs://bucket/data/my_dataframe.jsonl'). file_type: The format to save the DataFrame ('jsonl' or 'csv'). Defaults to 'jsonl'. Invalid GCS path for blob: 'z@'. It must include the object name (e.g., gs://bucket/file.csv).csvF)indexztext/csvjsonlrecordsT)orientlineszapplication/jsonlUnsupported file type: '#'. Please provide 'jsonl' or 'csv'. content_typez)DataFrame successfully uploaded to: gs://rN)r$rrbucketblobioStringIOto_csvto_jsonupload_from_stringgetvalueloggerinfoname) rr,r-r.r" blob_namer;r<bufferr:s rupload_dataframezGcsUtils.upload_dataframe?s "&!4!45N!O Y./H.IJPP $$++K8{{9%   IIfEI *%L ' ! JJvitJ <.L*9+633   1 M 7 }Adii[ Q rdatac0|j|\}}|std|d|jj|}|j |}t j |d}|j|dtjd|d|y ) z read_jsonr)rr^r. file_contentss rread_gcs_file_to_dataframez#GcsUtils.read_gcs_file_to_dataframesv// =  ;;r{{=9GL L ' !<< M :$G G*9+6 r)r3)rI)__name__ __module__ __qualname____doc__rrstrtupler$r+rHdictrrPr]rrerlrrr r "s E =  &s &uS#X &)#)))! ( ( $'(  (  ( T S#X 3 SW , & '38n'' ' 'R s uS#X   ,/   rr )r=rMloggingtypingrr google.cloudr'google.cloud.aiplatform.utils.gcs_utilsrgoogle.genai._api_clientrpandasrhrW getLoggerrmrCrr rtrrr|sI   A2    8 $ ^^r