笜i; dZddlZddlZddlmZddlmZejeZ GddejZ Gdd Z Gd d Z dd edzd edzdedzdedzfdZdZy)zACollection of utils to be used by backbones and their components.N) repo_exists)loggingceZdZdZdZy) BackboneTypetimm transformersN)__name__ __module__ __qualname__TIMM TRANSFORMERSW/mnt/e/genesis-system/.venv/lib/python3.12/site-packages/transformers/backbone_utils.pyrrs D!LrrceZdZdZdedzdedzfdZdZedZejdee fdZed Z e jde e d fee zfd Z fd ZxZS) BackboneConfigMixinzv A Mixin to support handling the `out_features` and `out_indices` attributes for the backbone configurations. out_featuresN out_indicesc||_t|tr t|n||_|j |j|j}}|,|*t |jdz g}|jdg}nM|+|)|Dcgc]}|jj|}}n |||Dcgc]}|j|}}||c|_|_|j ycc}wcc}w)ap Sets output indices and features to new values and aligns them with the given `stage_names`. If one of the inputs is not given, find the corresponding `out_features` or `out_indices` for the given `stage_names`. Args: out_features (`list[str]`, *optional*): The names of the features for the backbone to output. Defaults to `config._out_features` if not provided. out_indices (`list[int]` or `tuple[int]`, *optional*): The indices of the features for the backbone to output. Defaults to `config._out_indices` if not provided. Nr) _out_features isinstancetuplelist _out_indicesverify_out_features_out_indiceslen stage_namesindex)selfrrlayeridxs r"set_output_features_output_indicesz6BackboneConfigMixin.set_output_features_output_indices&s *1;K1OD-U` ,,.%)$6$68I8Ik  <#7t//0145K ,,R01L  \%=FRSU4++11%8SKS  !k&==HIcD,,S1ILI1=k-D- ,,. TIs "C-5C2czj tdjtjtfs!tdt jt fdjDr%tdjdjtjttjk7rtdjjjDcgc]}|jvs|c}x}k7rtd|djjLtjts!td t jtfd jD}t fd |Dr%td jd jt|tt|k7r4dj}||jk7rd|dndz }t||tt|k7rOtt|jdDcgc]\}}| }}}td|djjjvtjtjk7r tdjjDcgc]}j|c}k7r tdyyycc}wcc}}wcc}w)z_ Verify that out_indices and out_features are valid for the given stage_names. Nz2Stage_names must be set for transformers backbonesz out_features must be a list got c3:K|]}|jvywN)r).0featr!s r zFBackboneConfigMixin.verify_out_features_out_indices..TsOD4t///Osz.out_features must be a subset of stage_names: z got z2out_features must not contain any duplicates, got z@out_features must be in the same order as stage_names, expected z out_indices must be a list, got c3\K|]#}|dkr|tjzn|%yw)rN)rrr(r#r!s rr*zFBackboneConfigMixin.verify_out_features_out_indices..es.$rY\C!GS3t/?/?+@%@QT%T$rs),c3dK|]'}|ttjvs$|)ywr')rangerrr,s rr*zFBackboneConfigMixin.verify_out_features_out_indices..fs(^3cs4K[K[G\A]6]3^s%00z2out_indices must be valid indices for stage_names z, got z1out_indices must not contain any duplicates, got z(equivalent to z))c |dS)Nrr)xs rzEBackboneConfigMixin.verify_out_features_out_indices..ps efgheir)keyz?out_indices must be in the same order as stage_names, expected zHout_features and out_indices should have the same length if both are setzQout_features and out_indices should correspond to the same stages if both are set) r ValueErrorrrrtypeanyrsetrrsortedzip)r!r) sorted_featspositive_indicesmsg_r#sorted_negatives` rrz3BackboneConfigMixin.verify_out_features_out_indicesJs3    #QR R    )d004': #CDI[I[D\C]!^__OD4 @} r)r r r __doc__rr$rpropertyrsetterstrrrintrK __classcell__rNs@rrr!s"/Tk"/D["/H0vd""]c]] !!\uS#Xc'B\\rrc4eZdZUdZedzed<dZeed<dfd ZddZ ddZ e dZ e jd eefd Z e d Zejd eeeezfd Ze dZe dZdZ ddedzdedzdedzfdZxZS) BackboneMixinN backbone_typeThas_attentionsct||i||jdd}|tj|_ntj |_|j tjk(r|j|y|j tj k(r|jytd|j d)z Method to initialize the backbone. This method is called by the constructor of the base class after the pretrained model weights have been loaded. timm_backboneN)backbonezbackbone_type z not supported.) rJ__init__rLrr rXr_init_timm_backbone_init_transformers_backboner4)r!argskwargsr[rNs rr]zBackboneMixin.__init__s $)&) ?D9  $!-!2!2D !-!:!:D    !2!2 2  $ $m $ <   <#<#< <  , , .~d.@.@-AQR Rrcpt|jdd}t|jdd}|jjDcgc]}|d c}|_|jjDcgc]}|d c}|_t |jj}|jj}|||k7rtd|d|||jk7rtd|d |j|j_|jj||ycc}wcc}w) zj Initialize the backbone model from timm. The backbone must already be loaded to backbone rNrmodulenum_chsz!Config has `out_features` set to z which doesn't match `out_features` from backbone's feature_info. Please check if your checkpoint has correct out features/indices saved.z Config has `stage_names` set to z which doesn't match `stage_names` from backbone's feature_info. Please check if your checkpoint has correct `stage_names` saved.) getattrconfig feature_infoinfor num_featuresrr module_namer4r$)r!r\out_features_from_configstage_names_from_configstagerrs rr^z!BackboneMixin._init_timm_backbones: $+4;;#M ")$++}d"K :B9N9N9S9STE(OT;C;P;P;U;UV%U9-V800<<= ,,88: # /4LP\4\34L3MNxx  # .3JdN^N^3^23J2KLqq  #'"2"2  66|[Q)UVs  D.3 D3c||jj|_|jjd|_yr')rfrrrir@s rr_z)BackboneMixin._init_transformers_backbones,;;22 335 rc.|jjSr')rfrr@s rrzBackboneMixin.out_featuress{{(((rrc&||j_y)rBN)rfrrDs rrzBackboneMixin.out_featuress $0  rc.|jjSr')rfrr@s rrzBackboneMixin.out_indicess{{'''rrc&||j_y)rGN)rfrrHs rrzBackboneMixin.out_indicess #. rczt|jDcic]\}}||j|c}}Scc}}wr') enumeraterri)r!irms rout_feature_channelsz"BackboneMixin.out_feature_channelss8=FdFVFVn_=cxcSbcO F ""  %8%D UViUjjz { !6 ;=.)<=V@UV F "" OT *-11,?%&9: &00A F ""rc|ddlm}t|dd}||j|}|S|j|}|S)a> Loads the backbone model from a config object. If the config is from the backbone model itself, then we return a backbone model with randomly initialized weights. If the config is from the parent model of the backbone model itself, then we load the pretrained backbone weights if specified. r) AutoBackbonerN)rf)r rre from_config)rfrrr\s r load_backbonerCsP*f&7>O++6+: O ++?+C Or)NNNN)rOenumr}huggingface_hubrutilsr get_loggerr rEnumrrrWrRr|rrrrrrsH '   H %"499" zzzp]p]j$(&*)-'+ /#Dj/#t/# $; /#  /#dr