^iI SrSSKrSSKrSSKrSSKrSSKrSSKrSSKJrJr SSK J r SSK r \ "S5r \ S- S- r \ S- S - r\ S - S - r\S - r\S - r\R$"\R&S\R("\R*5/S9 \R,"S5rSSSSSS.rSrSr1Skr1Skr1Skr1Skr1Sk1Sk1Sk1Sk1SkS.rS\ S \ 4S!jr!S \"4S"jr#S#\ S$\$S \ 4S%jr%S&\&S \'\(\&44S'jr)S&\&S(\(S)\ S*\&S \&4 S+jr*S&\&S(\(S)\ S \&4S,jr+S-\ S.\&S S4S/jr,S0\&S S4S1jr-S9S&\&S2\.S \&4S3jjr/S\ S \&4S4jr0S:S5\(S S4S6jjr1S7r2\3S8:Xa\2"5 gg);u Memory Competitor Intelligence Scout — Webhook Processor ========================================================= Receives POST requests from n8n when new memory tools/frameworks are discovered. Classifies, scores, deduplicates, and routes discoveries into the Genesis KG and RWL task loop. Webhook endpoint: POST /memory-scout-ingest Check endpoint: POST /memory-scout-check Run as a lightweight Flask service: python process_discovery.py --serve --port 8765 Or import and call process_discovery() directly from other scripts. N)datetimetimezone)PathzE:/genesis-systemKNOWLEDGE_GRAPHentitiesloopz tasks.jsonn8nmemory_competitor_scoutzdiscovery_log.jsonlzknown_memory_systems.jsonlz'%(asctime)s [%(levelname)s] %(message)s)levelformathandlers memory_scout) open_sourcepython_support graph_supporttemporal_supportactive_maintenance>pypippypipythonpytorch langchain llamaindex>rdfgraphneo4jcypherfalkordbgraphitiontologyknowledge-graph>timehistoryepisodictemporaltimeline versioned chronological>bsdgplmitapache opensource open-source>rag retrieval document-qaretrieval-augmented>kgrr r"r#r$graph-dbr%>lettamemgptrecallr(session-memoryconversation-memory>faisschromaqdrantvectorlancedbpineconeweaviate embedding>r) time-awaretimeline-memoryversioned-memory)RAGKnowledgeGraphEpisodicMemory VectorStoreTemporalMemoryurlreturnc[R"UR5R5R 55R 5SS$)u4Stable short ID from URL — used for deduplication.N )hashlibmd5lowerstripencode hexdigest)rNs BE:/genesis-system/n8n/memory_competitor_scout/process_discovery.py url_to_idrYWs9 ;;syy{((*113 4 > > @" EEcd[5n[[4HnUR5(dMUR SSS9nUHnUR 5nU(dM[ R"U5nURSS5nU(aUR[U55 URSS5R5R 5nU(aURU5 MM SSS5 M U$![ Ra Mf=f!,(df  GM=f)z}Load all known system URLs (as md5 IDs) from known_memory_systems.jsonl and discovery_log.jsonl to enable fast deduplication.rutf-8encodingrNnameN) setKNOWN_SYSTEMS_FILE DISCOVERY_LOGexistsopenrUjsonloadsgetaddrYrTJSONDecodeError)knownfpathflineentryrNras rXload_known_idsrq\s EE$m4 <<>>C'2aD::# UH oT;v M g7fN).0k license_texts rX "score_relevance..sA*@QL *@)Nr` NOASSERTIONrxrc3,># UH oT;v M g7frrrrr}s rXrrs81$Yrrc3,># UH oT;v M g7frrrs rXrrs6~!I~rrc3,># UH oT;v M g7frrrs rXrrs<*;QDy*;rrFZNz+00:00)tzinfor)riryrTanyOPEN_SOURCE_INDICATORSSCORING_WEIGHTSPYTHON_KEYWORDSGRAPH_KEYWORDSTEMPORAL_KEYWORDSendswithr fromisoformatrreplacerutcnowdays ValueError TypeErrorsumvalues) rr breakdownis_open has_python has_graph has_temporal is_active pushed_dtdays_agototalrr}s @@rXscore_relevancers\ - &B   ((488H%+ , -   88F  !r  #  eg  HHY'-2446L%E,)?E2II 4' I A*@A A I 88I &H H BI}=aIm888JGQ/2B"CWXI6~66IEN!ATUIo<*;<DDH BIPYo6J&K^_I"#    " #E   I&   s BJJ! J!scorer~rc *0SS[URSS553_SURSS5_SURSS5_SU_SURSS 5S :_S S _S [R"[R 5R 5_S U_SU_SURSS5_SURSS 5_SURS5=(d SSS_SURS5=(d /_SURSS5_SS _SS_$)z(Build a KG entity dict from a discovery.idmemory_competitor_rNr`raUnknowntyperrgenesis_integratedFdiscovered_daterelevance_scorescore_breakdownsourceunknownstarsrrNirsnotes evaluatedevaluation_task_id)rYrirrrr isoformat)rrr~rs rXbuild_kg_entityrsa  "9TXXeR-@#A"BC +  txxr"     y}}]A6:   e   8<< 5??A  5  9  $((8Y/  '1%  /52t<  $((8$*  '2&  U  d! rZcURSS5nURSS5nS[U5S[R"[R 5R S53nUSS US 3UUUUS US :aS OS[R"[R 5R5SS USUS3URS5=(d SSSURSS5URSS5S.$)z:Build an RWL evaluation task for a high-scoring discovery.raz Unknown ToolrNr`eval__z%Y%m%dmemory_tool_evaluationz Evaluate z for Genesis integrationpending highmediumr z (u5) for potential Genesis memory stack integration. Steps: 1. Clone/install the repo and review architecture (README, src structure) 2. Identify unique capabilities vs Genesis's current 5-tier stack (PostgreSQL + Qdrant + Redis + FalkorDB/Graphiti) 3. Test Python API with a simple 10-message conversation memory test 4. Assess: integration effort (hours), unique value-add, overlap with existing 5. Recommend: Integrate / Monitor / Skip — with justification 6. Update known_memory_systems.jsonl with evaluation results 7. If Integrate: create implementation PRDrrNi,rrrr)rrtitle tool_nametool_urlr~rstatuspriority created_at created_by instructionsrrrr)rirYrrrrstrftimer)rrr~rrtask_ids rXbuild_evaluation_taskrs0Ixxr"Hi)*!HLL,F,O,OPX,Y+Z[G(YK'?@ #qjFhll8<<0::</ {"XJ /9 9/52t<'1%((8Y/5 rZrmrecordclURRSSS9 URSSS9nUR[R "USS9S-5 S S S 5 [ RS URURS 5=(d URS S 55 g !,(df  NX=f)z@Append a JSON record to a .jsonl file (creates file if missing).Tparentsexist_okar]r^F) ensure_ascii NzWrote to %s: %srrar`) parentmkdirrfwritergdumpsloginforari)rmrrns rXappend_to_jsonlrs LLtd3 C' *a  66=> +HH  FJJt,<,V 6SU@VW + *s (B%% B3taskc[RRSSS9 /n[R5(a4[R SSS9n[ R "U5nSSS5 URSS5n[U5VVs0sHupEURSS5U_M nnnX6;a&[RS URS 55 gURU5 [R S SS9n[ R"XS S S9 SSS5 [RSUS5 g!,(df  N=f![ R[4a /nNf=fs snnf!,(df  Na=f)z(Add or update a task in loop/tasks.json.Trr\r]r^Nrr`u5Task for %s already exists in tasks.json — skippingrwrF)indentrz'Added evaluation task to tasks.json: %sr) TASKS_FILErrrerfrgloadrkIOErrorri enumeraterrappenddump)rtasksrntask_urlit existing_idss rXupsert_tasks_jsonrs4D48 E w71 ! 8 xx B'H9B59IJ9IAEE*b)1,9ILJ H$((S^J_` LL w /1 %159 0HH 6T C87$$g. E  K 0 /sAE D9&E E,E29 EE E E)(E)2 Fdry_runc fURSS5nURSS5n[RSX#5 [5n[ U5nUR 5R 5nXT;dXd;a[RSU5 SX#S.$[URS S5URS 5=(d /5n[U5up[RS X(Xy5 UUUUU S S S S.n [R"[R5R5UUUUURSS5URS 5=(d SS SURSS5SS. n U[:aS[XXy5n U SU S'SU S'SU S'U(d[ S- n [#X5 O[RSU S5 U RSS5S:nU[$:axU(aq['XU5nUSU S'SU S'SU S'U(d3[)U5 U S(a[RS USU S5 O[RS!US5 U(dU SU S'[#[*U 5 O[RS"U 5 [RS#X*SX5 U $)$aV Process a single discovery item from n8n or the cron scout. Args: item: Dict with keys: name, url, description, topics, stars, license, pushed_at, source, open_source (optional) dry_run: If True, print actions without writing any files Returns: Result dict with: score, tool_type, action_taken, kg_entity_id, task_id rarrNr`uProcessing: %s — %szSKIP (already known): %sskipped_duplicate) action_takenrarNrrrsz)Scored %s: %d/10 | type=%s | breakdown=%s logged_onlyN)rarNrr~rr kg_entity_idrrrrrr) timestamprarNrr~rrrractionrrkg_entity_writtenrrz#memory_competitors_discovered.jsonlz#[DRY RUN] Would write KG entity: %srrevaluation_task_createdz)Evaluation task %s linked to KG entity %sz*[DRY RUN] Would create evaluation task: %sz[DRY RUN] Would log: %sz)Result for %s: action=%s score=%d type=%s)rirrrqrYrTrUrrrrrrrSCORE_KG_THRESHOLDrKG_ENTITIES_DIRrSCORE_EVAL_THRESHOLDrrrd)rrrarN known_idsitem_iditem_name_lowerr~rrresult log_entry kg_entitykg_output_fileis_open_sourcers rXprocess_discoveryrs 88FI &D ((5" CHH $d0 InGjjl((*O; +T2 3TNN# #  bI't,EHH3 Y % F\\(,,/99;((8Y//52t<'1% I ""#DF !*4~1 (!4~,/TTN N 6 HH:IdO L]]=!4q8N $$$T)< Jy7 (!:~ d #n%Dd4jRXYgRhi HHA4: N $^4 ( y1 *I6HH3 ^$e MrZc[5n[U5nX!;nUU[R"[R 5R 5S.$)zc Check if a URL is already in the Genesis KG. Returns JSON-serialisable dict for webhook response. )rNrl checked_at)rqrYrrrrr)rNrris_knowns rXcheck_if_knownrsF  InG#Hll8<<0::< rZportc^^SSKJnJmJm W"S5nURSS/S9UU4S j5nURS S/S9UU4S j5nURS S /S9U4Sj5n[ RSU5 URSUSS9 g![a. [ R S5 [R"S5 Nf=f)z9Start a minimal Flask webhook server for n8n integration.r)Flaskjsonifyrequestz4Flask not installed. Install with: pip install flaskrvrz/memory-scout-checkPOST)methodsc>TRSS9=(d 0nURSS5nU(d T"SS05S4$T"[U55$)NTforcerNr`error url required)get_jsonrir)datarNrrs rXcheck_endpoint"run_server..check_endpointsSd+1rhhub!G^45s: :~c*++rZz/memory-scout-ingestc>TRSS9=(d 0nURS5(d T"SS05S4$[U5nT"U5$)NTrrNrrr )r!rir)r"r rrs rXingest_endpoint#run_server..ingest_endpointsQd+1rxxG^45s: :"4(vrZz/healthGETc>T"SSS.5$)Nokr )rservicer)rsrXhealthrun_server..healths$3LMNNrZz/Starting memory scout webhook server on port %dz0.0.0.0F)hostrdebugN) flaskrrr ImportErrorrrsysexitrouterrun)rrappr#r&r,rrs @@rX run_serverr7s11  CYY$vhY7,8, YY%xY89 YYy5'Y*O+OHH >EGGUG37  HI  s B5CCc [R"SS9nURSS9nURSSS9nUR S[ S S 9 URS S S9nUR S SSS9 UR SSSS9 UR SSSS9 UR S[ SS 9 UR SSS9 URSSS9nUR S SS9 UR 5nURS:Xa[UR5 gURS :XaURURURURS/S [R"[ R"5R%5S!.n['XeR(S"9n[+[,R."US#S$95 gURS:Xa4[1UR5n[+[,R."US#S$95 gUR35 g)%Nu:Memory Competitor Intelligence Scout — webhook processor)rrcommand)destservezStart webhook server)helpz--port=")rdefaulttestzTest process a single discoveryz--urlTzRepository/article URL)requiredr<z--namez Tool namez --descriptionr`zDescription text)r>r<z--starsrz --dry-run store_true)rcheckzCheck if a URL is already known)r@ manual_testMIT)rarNrrrrrsrr)rr)r)argparseArgumentParseradd_subparsers add_parser add_argumentint parse_argsr9r7rrarNrrrrrrrrrrprintrgrr print_help)parser subparsers serve_parser test_parser check_parserargsrr s rXmainrTs  $ $PF&&I&6J((7M(NLhS$?''5V'WKWt:RSX;G_b?QRYS!<[>((7X(YLg5    D ||w499  II88++ZZ#!hll3==?  #4> djj*+  ) djj*+rZ__main__)F)r=)4__doc__rErRrgloggingosr2rrpathlibrrequestsBASE_DIRrr SCOUT_DIRrdrc basicConfigINFO StreamHandlerstdout getLoggerrrrrrrrrrzstrrYrbrqlistrdicttuplerJrrrrrboolrrr7rT__name__rrZrXrhsM   ' # $..;   - u 8 8 11 !==  ,, 4cjj)' XkiU FohjW  F3F3F 2 C  # 8$85d#38v$sstPT,!!S!S!T!HX4XX$XDDDTD8eDe4eDeX   &4S4D4L+\ zFrZ