qiQDSrSSKrSSKrSSKrSSKJr SSKJrJr SSK J r J r SSK J r SSK JrJrJrJrJr SSKJr "S S \5r\"S S 55r\"S S55r\"SS55r\"SS55r"SS5rSr\S:Xa\"5 gg)a GENESIS GEMINI RATE MAXIMIZER ============================== Intelligent rate limit tracking and request scheduling to maximize utilization of Gemini API credits while staying just under limits. Features: - Multi-model load balancing based on current utilization - Sliding window tracking for RPM/TPM/RPD - Predictive scheduling to hit 90-95% of limits - Automatic failover when models hit limits - Burst detection and proactive throttling Usage: maximizer = GeminiRateMaximizer() # Get best available model model = maximizer.get_best_model(token_estimate=1000) # Record usage after request maximizer.record_usage(model, input_tokens=500, output_tokens=1000) # Get utilization report report = maximizer.get_utilization_report() Ndeque) dataclassfield)datetime timedelta)Path)DictListOptionalAnyTuple)Enumc8\rSrSrSrSrSrSrSrSr Sr S r S r S r g ) TaskType'z#Task types for intelligent routing.researchcode_generation code_review architecturesimple_extractionclassification summarizationgeneralN)__name__ __module__ __qualname____firstlineno____doc__RESEARCHCODE_GENERATION CODE_REVIEW ARCHITECTURESIMPLE_EXTRACTIONCLASSIFICATION SUMMARIZATIONGENERAL__static_attributes__r/E:\genesis-system\core\gemini_rate_maximizer.pyrr's.-H'OK!L+%N#MGr*rcr\rSrSr%Sr\\S'\\S'\\S'\\S'\\S'\\S'\"\ S 9r \ \ \S 'S r g ) ModelLimits3zRate limits for a single model.rpmtpmrpdprioritycost_per_million_inputcost_per_million_outputdefault_factory use_casesrN)rrrrr int__annotations__floatrlistr7r strr)rr*r+r-r-3s8) H H HM!!"" 6ItCy6r*r-c\rSrSr%Sr\"SS9r\\S'\"SS9r \\S'Sr \ \S 'Sr \ \S '\"\ RS9r\\S 'S rS rS\ 4SjrS\ 4SjrS\ 4SjrSrg) UsageWindow?z"Sliding window for tracking usage.c[SS9$N')maxlenrrr*r+UsageWindow.Bs E4Gr*r5requestsc[SS9$rArrr*r+rDrECs %u2Er*tokensrdaily_requests daily_tokenslast_daily_resetc[R"5S- nUR(aYURSSU:aCURR5 UR(aURSSU:aMCUR(a\URSSU:aEURR5 UR(aURSSU:aMCgggg)z#Remove entries older than 1 minute.<rN)timerFpopleftrH)selfcutoffs r+cleanup_minute_window!UsageWindow.cleanup_minute_windowHsr!mm a 0 3f < MM ! ! #mm a 0 3f <kkdkk!nQ/&8 KK   !kkdkk!nQ/&8k8kr*c|[R"5nXR- S:aSUlSUlXlgg)z)Reset daily counters at midnight Pacific.iQrN)rNrKrIrJ)rPnows r+check_daily_resetUsageWindow.check_daily_resetPs9iik && & ."#D  !D $' ! /r*returncLUR5 [UR5$)z Get current requests per minute.)rRlenrFrPs r+get_rpmUsageWindow.get_rpmYs ""$4==!!r*cZUR5 [SUR55$)zGet current tokens per minute.c3*# UH oSv M g7f)Nr).0ts r+ &UsageWindow.get_tpm..as-AQ4s)rRsumrHr[s r+get_tpmUsageWindow.get_tpm^s# ""$----r*c[R"5nURRU45 URRX!45 U=RS- slU=R U- slUR 5 g)z"Record a request with token count.r`N)rNrFappendrHrIrJrV)rPrHrUs r+recordUsageWindow.recordcsciik cV$ C=) q  V#  r*)rIrJrKN)rrrrr rrFrr9rHrIr8rJrNrKr:rRrVr\rfrjr)rr*r+r>r>?s{,,GHHeH*EFFEFNCL##DII>e>"("" .. !S!r*r>cB\rSrSr%Sr\\S'\\S'\\S'\\S'Srg) ScheduledRequestmz"A request scheduled for execution.model delay_secondsreason utilizationrN) rrrrr r<r9r:r)rr*r+rmrmms, J Kr*rmcf\rSrSr%Sr\\S'\\\\\44\S'\\S'\ \S'\ \\S'Sr g ) UtilizationReportvz"Utilization report for all models. timestampmodels best_modeltotal_capacity_usedrecommendationsrN) rrrrr r<r9r r r:r r)rr*r+rtrtvs7,N d38n$ %%O#Yr*rtc \rSrSrSr\"S5r\"S5rSS\4SjjrS\ 4S jr S\ 4S jr S r S \ S\ \ \44S jrS \ S\ \ \44SjrS\R&4S\S\S\ 4SjjrS S \ S\S\S\4SjjrS \ S\S\S\4SjrS\R&S4S\S\S\S\4SjjrS\4SjrS\\\ 44SjrS\ \ \44SjrSrg)!GeminiRateMaximizerz Intelligent Gemini API rate limit maximizer. Tracks usage across all models and routes requests to maximize throughput while staying within limits. z0E:/genesis-system/config/gemini_rate_limits.jsonz1E:/genesis-system/data/rate_maximizer_usage.jsonlN config_pathcU=(d URUlUR5Ul0Ul0Ul[ R"5UlUR5 gN) CONFIG_PATHr~ _load_configconfigrw usage_windows threadingRLock_lock_initialize_models)rPr~s r+__init__GeminiRateMaximizer.__init__sN&:$*:*:'') .0 57__&  !r*rXc URR5(a5[UR5n[R"U5sSSS5 $UR 5$!,(df  UR 5$=f)z"Load configuration from JSON file.N)r~existsopenjsonload_default_config)rPfs r+r GeminiRateMaximizer._load_configsa    " " $ $d&&'1yy|('##%%('##%%s A%% Bc(SSSSSSS.SSS S S.S .S .$) z(Default configuration if file not found.?g?i@Bir`)r/r0r1r2)gemini-2.5-flashzgemini-2.5-pro)target_utilization safety_marginrwrr[s r+r#GeminiRateMaximizer._default_configs3#'!,/Z[$\*-gdXY"Z  r*c URRS05R5Hup[URSS5URSS5URSS5URSS 5URS S 5URS S 5URSS/5S9URU'[ 5UR U'M g)z$Initialize model limits from config.rwr/dr0ir1r2 r3g?r4g?r7r)r/r0r1r2r3r4r7N)rgetitemsr-rwr>r)rP model_name model_configs r+r&GeminiRateMaximizer._initialize_modelss(, "(E(K(K(M $J&1 $$UC0 $$UF3 $$UB/%))*b9'3'7'78PRV'W(4(8(89RTX(Y&**; D'DKK #.9]D  z *)Nr*roc RUR XR;aSSSSS.sSSS5 $URUnURUnURS:aUR 5UR- OSnUR S:aUR 5UR - OSnURS:aURUR- nOSnUUU[XEU5UR 5UR 5URS.sSSS5 $!,(df  g=f)zs Get current utilization percentages for a model. Returns: Dict with rpm_util, tpm_util, rpd_util percentages r)rpm_utiltpm_utilrpd_utilmax_utilN)rrrr current_rpm current_tpmrI) rrwrr/r\r0rfr1rImax)rProlimitswindowrrrs r+get_model_utilization)GeminiRateMaximizer.get_model_utilizationsZZKK'$%1!QRSZ[['F''.F8> Qv~~'&**4AH8> Qv~~'&**4AHzzA~!006::=%$$H=%~~/%~~/"("7"7ZZsDC!D D&c UR XR;aSSSS.sSSS5 $URUnURUnURR SS5n[ UR U-5UR5- n[ URU-5UR5- nURS:a&[ URU-5UR- nO [S5n[SU5[SU5U[S5:wa[S[ U55OSS.sSSS5 $!,(df  g=f)za Get available capacity for a model. Returns remaining RPM, TPM, and RPD before hitting limits. r) rpm_available tpm_available rpd_availableNrrinfr)rrwrrrr8r/r\r0rfr1rIr:r)rProrrtargetrrrs r+get_available_capacity*GeminiRateMaximizer.get_available_capacitys ZZKK')*QQRSZ[['F''.F[[__%94@F V 34v~~7GGM V 34v~~7GGMzzA~ #FJJ$7 86;P;P P %e "%Q !6!$Q !6?LPUV[P\?\QM(:!;bd!ZZsED E Ertoken_estimate task_typecUR URRS05RS05nURU;a<X2RnUR U5nUSS:aUSU:a UsSSS5 $SnSn[ UR R5SS 9nUHupUR U 5nUSS::aM!USU:aM,US S:XaM7S U R- S -n USS -USS- S--US S:aUS OSS--n X-n X:dM|U nU nM Uc,URRS05RSS5nUsSSS5 $!,(df  g=f)z Select the best available model based on current utilization. Args: token_estimate: Estimated tokens for the request task_type: Type of task for intelligent routing Returns: Model name with most available capacity routing_rules task_routingrrrNrc USR$)Nr`)r2)xs r+rD4GeminiRateMaximizer.get_best_model..s admmr*)keyrrr?r333333?rB皙? default_modelr) rrrvaluersortedrwrr2)rPrrr preferredcapacityrx best_score sorted_modelsrrpriority_bonuscapacity_scorescores r+get_best_model"GeminiRateMaximizer.get_best_modelsZZ;;???B?CCNTVWL,.(9 66yAO,q0Xo5NR`5`$ZJJ# !!#+M '4" 66zBO,1O,~=O,1#%v"6#!=_-3_-4s:;2:?2Ka2OXo.UZ^aab '7%!&J!+J1'46!![[___bAEE#%7 gZZsA/E-B!E-+8E-- E; input_tokens output_tokenssuccesscUR XR;a[5URU'X#-nURURU5 UR XX45 SSS5 g!,(df  g=f)z Record API usage for a model. Args: model: Model name input_tokens: Number of input tokens output_tokens: Number of output tokens success: Whether the request succeeded N)rrr>rj _log_usage)rProrrr total_tokenss r+ record_usage GeminiRateMaximizer.record_usage4sd ZZ...,7M""5)'7L   u % , ,\ : OOE HZZs AA11 A?c tURRRSSS9 [R"5R 5UUUX#-UUR U5S.n[URS5nUR[R"U5S-5 SSS5 g!,(df  g=f)zLog usage to JSONL file.T)parentsexist_ok)rvrorrrrrra N) USAGE_LOG_PATHparentmkdirrrU isoformatrrwriterdumps)rProrrrentryrs r+rGeminiRateMaximizer._log_usageNs ""(((E"113(*(855e< $%%s +q GGDJJu%, -, + +s 7)B)) B7r2cUR URX5nURU5nURU5nSnSnUSS::aSURUR - nSnOWUSU:a'SXS- -URUR - nSnO'US URRS S 5:aS nS n[UUUUS S9sSSS5 $!,(df  g=f)a Schedule a request with optimal timing and model selection. Args: token_estimate: Estimated tokens for the request task_type: Type of task priority: Request priority (1-10, lower = higher priority) Returns: ScheduledRequest with model, delay, and reason g immediaterrgN@ rpm_throttler tpm_throttlerburst_detection_thresholdg333333?rburst_prevention)rorprqrrN) rrrrrwr/r0rrrm) rPrrr2rxrrrdelayrqs r+schedule_request$GeminiRateMaximizer.schedule_requestes"ZZ,,^GJ22:>H44Z@KE F(A-t{{:6:::'/*^;/1J JKdkkZdNeNiNii'Z(4;;??;VX\+]]+# #' 3 -ZZs CC C*c \UR 0nSnSnURH~nURU5nURU5nURUnUUURUR UR S.URS.X'X'R- nX5S- nM /nUR5H2upIU SSS:dMURSUS U SSS S 35 M4 UR5H2upIU SSS :dMURSUS U SSS S35 M4 US:aX2- OSn U S:aURSU S S35 [[R"5R5UUR5U US9sSSS5 $!,(df  g=f)zu Generate comprehensive utilization report. Returns: UtilizationReport with all model stats and recommendations r)r/r0r1)rrrrr2rrrrrzModel z is underutilized (.1%z'). Consider routing more requests here.gffffff?z is near capacity (z+). Consider load balancing to other models.zOverall utilization is low (z/). Enable research tasks to fill idle capacity.)rvrwrxryrzN)rrwrrr/r0r1r2rrirtrrUrr) rP models_reporttotal_capacity total_usedrutilrrrzreport overall_utils r+get_utilization_report*GeminiRateMaximizer.get_utilization_reportsZZMNJ"kk 11*=66zBZ0$( (%zz%zz%zz !' - )**,=11 %**!O'4&9&9&;" -(4s:#**  ,?}@UV`@abe?fg?@'<'4&9&9&;" -(4t;#**  ,?}@UV`@abe?fgCD'<;I1:L:6RSLc!&&2<2DECD %",,.224$..0$0 / iZZsB6FAF BF F+c URRS05nURSS5(dgURSS5nUR5nURU5nSUS- nXR:aSS US 34$S S US 34$) zS Check if there's capacity for research tasks. Returns: (can_execute, reason) research_configenabledT)Fresearch_disabledmin_capacity_for_researchrg?rcapacity_available_rFinsufficient_capacity_)rrrr)rPr min_capacityrxr availables r+can_execute_research(GeminiRateMaximizer.can_execute_researchs++//*;R@""9d33-&**+FM ((* ))*5$z**  $.yo>> >29S/BB Br*cURRS05nURSS5nUR[RS9nUR U5nU[ USU-5[ USU-5S.$)zs Calculate how many research requests can be made. Returns: Dict with requests_available and tokens_available rmax_research_percentager)rrr)rorequests_availabletokens_available)rrrrr!rr8)rPrmax_percentagerxrs r+get_research_budget'GeminiRateMaximizer.get_research_budgets++//*;R@(,,-FM((83D3D(E ..z: "%h&?.&P"Q #H_$=$N O  r*)rrr~rwrr)T) rrrrr r rrrr rrrr<r:rr8rrr(rboolrrrmrrtrrrr r)rr*r+r|r|sIJKMNN"D"&d&     ;34U 3C@CDcN<#&..BBB BR III I  I4... .  .2#&.. ,,, ,  ,\A(9AFCeD#I&6C0 T#s(^ r*r|c  SSKnURSS9nURS/SQS9 URS[S S S 9 URS [S SS 9 UR 5n[ 5nURS:XGauUR5n[SS35 [SUR35 [SS35 [SUR35 [SURSS35 [S5 [S5 URR5HupVUSn[SUS35 [SUSSUSSS US!SS"35 [S#US$SUSS%S US&SS"35 [S'US(SUSS)35 [5 M UR(a8[S*5 [S5 URHn[S+U35 M ggURS,:XaUR S :wa[#UR 5O["R$n UR'UR(U 5nUR+U5n [S-UR(S.UR S/35 [S0U35 [S1U S235 [S3U S435 gURS5:XasUR-5upUR/5n [S65 [S7U S U S"35 [S0U S835 [S9U S:35 [S;U S<35 gURS=:Xa[S>5 [S?5 [1S@5HgnUR3SASB9n[SCUSD-SEUR4SFUR6SGSHUR8S"3 5 UR;UR4SISJSK9 Mi [SL5 UR5n[SMURS35 gg)NzCLI for rate maximizer.rNzGemini Rate Maximizer) descriptioncommand)statusbestrdemo)choicesz--tokensrzToken estimate)typedefaulthelpz--taskrz Task typerrz<============================================================zGEMINI RATE MAXIMIZER STATUS - z Best Model: zTotal Capacity Used: rzModel Utilization:z(----------------------------------------rrz :z RPM: r/rr/z (r)z TPM: rr0rz RPD: rIr1zRecommendations:z - rz Best Model for z tokens (z):z Model: z Available RPM: rz Available TPM: rrz Research Capacity:z Can Execute: roz Requests Available: rz Tokens Available: r rz === RATE MAXIMIZER DEMO === zSimulating 10 requests...ri)rz Request r`z: z (delay: z.2fz s, reason: ri,)rrz) ========================================zFinal utilization: )argparseArgumentParser add_argumentr8r< parse_argsr|rrprintrvrxryrwrrztaskrr(rrHrrr rangerrorprqr)rparserargs maximizerrrodatarrecrr can_executerqbudgeti scheduleds r+mainr+s  $ $1H $ IF  +QR  dAQR sIKP    D#%I ||x113 6(m /0@0@/ABC m V../01 %f&@&@%ERHI "# h!==..0KE &D BugQ- Id=12!DN54I3J"TR\M]^aLbbcd e Id=12!DN54I3J"TR\M]^aLbbcd e Id#345QtH~e7L6MN O G 1  ! ! $ % (O--SEl#. "  +/99 +AHTYY'xGWGW ((i@33E: !$++i {"EF %!" !(?";!<=> !(?";!<=>  #'<<> ..0 $&  }Bvha89 &/*+, &v.B'C&DEF $V,>%?$@AB   /0 )*rA!22#2FI Jqse2ioo%6i @W@WX[?\\ghqhxhxgyyz{ |  " "9??TW " X  m113 #F$>$>s#CDE r*__main__)r rrNr collectionsr dataclassesrrrrpathlibr typingr r r r renumrrr-r>rmrtr|r+rrr*r+r2s4 ((33 t  77 7 *!*! *!Z      D GFT zFr*