f2iudZddlmZdZ ddlZddlmZddlmZdZ dd l m Z gd Z Gd d e ZGd dZGddZy#e $rdZ Y3wxYw)z@Lexical analysis of formal languages (i.e. code) using Pygments.) annotationsreStructuredTextN)get_lexer_by_name)_get_ttype_classTF)ApplicationError)tokentextc eZdZy) LexerErrorN)__name__ __module__ __qualname__f/mnt/e/genesis-system/.venvs/voice-bridge/lib/python3.12/site-packages/docutils/utils/code_analyzer.pyr r srr c&eZdZdZdddZdZdZy)LexeraParse `code` lines and yield "classified" tokens. Arguments code -- string of source code to parse, language -- formal language the code is written in, tokennames -- either 'long', 'short', or 'none' (see below). Merge subsequent tokens of the same token-type. Iterating over an instance yields the tokens as ``(tokentype, value)`` tuples. The value of `tokennames` configures the naming of the tokentype: 'long': downcased full token type name, 'short': short name defined by pygments.token.STANDARD_TYPES (= class argument used in pygments html output), 'none': skip lexical analysis. c||_||_||_d|_|dvs|dk(ryts t d t |j|_y#tjj$rt d|zwxYw)zE Set up a lexical analyzer for `code` in `language`. N)r r nonez0Cannot analyze code. Pygments package not found.z6Cannot analyze code. No Pygments lexer found for "%s".) codelanguage tokennameslexer with_pygmentsr rpygmentsutil ClassNotFound)selfrrrs r__init__zLexer.__init__4s   $ | #zV'; ;< < M*4==9DJ}}** MACKLM M Ms A,Bc#Kt|}t|\}}|D]\}}||ur||z }||f||}}|jd}|r||fyyw)zrMerge subsequent tokens of same token-type. Also strip the final newline (added by pygments).  N)iternext removesuffix)rtokenslasttypelastvalttypevalues rmergez Lexer.mergeOs} f"6l7" 5LE5 5 ''',e7  5 &&t, G# # sAAc#K|jg|jfytj|j|j}|j |D]g\}}|j dk(r)t |jjd}n t|g}|Dcgc] }|tvs |}}||fiycc}ww)z7Parse self.code and yield "classified" tokens. Nlong.) rrrlexr+rstrlowersplitrunstyled_tokens)rr& tokentyper*classesclss r__iter__zLexer.__iter__`s :: dii-  dii4 $ 6 2 ! Iu&(i...066s;+I67&-LsO1KsLGL5.  ! MsB'C ) C7C;C N)shortreturnNone)r rr__doc__r r+r7rrrrr s&M6$" !rrceZdZdZddZdZy) NumberLinesaqInsert linenumber-tokens at the start of every code line. Arguments tokens -- iterable of ``(classes, value)`` tuples startline -- first line number endline -- last line number Iterating over an instance yields the tokens with a ``(['ln'], '')`` token added for every code line. Multi-line tokens are split.cZ||_||_dtt|d|_y)N%zd )r& startlinelenr0fmt_str)rr&rAendlines rr zNumberLines.__init__}s* "3s7|,-R0 rc#K|j}dg|j|zf|jD]K\}}|jd}|ddD]$}||dzf|dz }dg|j|zf&||dfMyw)Nlnr")rArCr&r2)rlinenor)r*lineslines rr7zNumberLines.__iter__sfdllV+++ KK #LE5KK%Ecr  4TD[((! fdllV333 4r" "  #sANr9)r rrr<r r7rrrr>r>ps $1 #rr>)r< __future__r __docformat__rpygments.lexersrpygments.formatters.htmlrr ImportErrordocutilsrr3r rr>rrrrRsm G"" 19M&  ! M!M!`##AMsAAA