o 8f] @s&ddlZddlZddlmZmZddlmZmZmZm Z m Z m Z m Z m Z mZmZddlmZmZmZddlmZmZddlmZmZmZmZmZmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(ddl)m*Z*ddl+m,Z,dd l-m.Z.m/Z/e d Z0e1Z2e1Z3ee.e/fZ4eGd d d Z5eGd ddZ6eGdddZ7eGdddZ8de e0dee e2e0ffddZ9 d3de5de5de e.de:ddf ddZ;ddd e5d!ed"ed'e6d(e1de:fd)d*Z?d e5d+e.d(e1de:fd,d-Z@d e5d.e.d(e1de:fd/d0ZAd e5deZ/d?e defd@dAZ0dBe defdCdDZ1de de e fdEdFZ2dVdGdHZ3de defdIdJZ4 dUdKede5e6e7e e ffdLdMZ8dWdNdOZ9de:fdPdQZ;defdRdSZ z&Line.is_stub_class..)rZr/rangerSrJrJrK is_stub_classszLine.is_stub_classcCsz|jd}Wn tyYdSwz|jd}Wn ty$d}Ynw|jtjkr0|jdkpD|jtjkoD|duoD|jtjkoD|jdkS)zBIs this a function definition? (Also returns True for async defs.)rFrQNdef)r/ IndexErrorr;r%rYr=ASYNC)rH first_leaf second_leafrJrJrKis_defs$    z Line.is_defcCs4|jo|jddttjdgddtdDkS)zHIs this line a function definition with a body consisting only of "..."?N:cSr\r]r_rarJrJrKrdrez$Line.is_stub_def..rf)rnr/r&r%r?rgrSrJrJrK is_stub_defs$ zLine.is_stub_defcCs`t|o/t|jdko/|jo/|jdjtjko/|jdjdko/|jdjtjko/|jdjdkS)zzIs this a class with no base classes but using parentheses? Those are unnecessary and should be removed. (rf)) r<rRr/rZr;r%LPARr=RPARrSrJrJrKr@s zLine.is_class_paren_emptycCsF|r |jdjtjkr dS|jdj}|drdS|dr!dSdS)z#Is the line a triple quoted string?rF)z"""z'''T)zr'''zr"""zR'''zR""")r/r;r%STRINGr= startswith)rHr=rJrJrK_is_triple_quoted_strings   zLine._is_triple_quoted_stringcCs,tj|jvr |jSt|ot|jd|jS)zIs the line a docstring?r)runify_docstring_detectionr+rzr<rr/rSrJrJrKrs zLine.is_docstringcCsdd|jDtjdkS)z Is the line a chained assignmentcSsg|]}|jqSrJr;rbr5rJrJrKrdsz.Line.is_chained_assignment..rQ)r/countr%EQUALrSrJrJrKis_chained_assignmentszLine.is_chained_assignmentcCs$t|jdkr dS|jdjtjkS)z/Does this line open a new level of indentation.rF)rRr/r;r%r?rSrJrJrK opens_blockszLine.opens_blockfirst_leaf_matchesrcCsFt|jdkr dS|jd}|jtks|jdurdS|dup"||jS)zIs this line converted from fmt off/skip code? If first_leaf_matches is not None, it only returns True if the first leaf of converted code matches. rQFrN)rRr/r;rfmt_pass_converted_first_leaf)rHrr5rJrJrKis_fmt_pass_converteds    zLine.is_fmt_pass_convertedcCs |jD] }|jtkr dSqdS)z)If so, needs to be split before emitting.TF)r/r;rrHr5rJrJrKcontains_standalone_commentss  z!Line.contains_standalone_commentscCs^t|jddD]#\}}|tjkrq t|}t|dkrq |D] }||r+dSq q dS)zFChck if we have an implicit multiline string with comments on the linecSs|jSNr|)r5rJrJrKszGLine.contains_implicit_multiline_string_with_comments..rQTF) itertoolsgroupbyr/r%rxlistrRcomments_after)rH leaf_typeleaf_group_iterator leaf_listr5rJrJrK0contains_implicit_multiline_string_with_commentss    z5Line.contains_implicit_multiline_string_with_commentscCst}z)|jd}|t||jtjks|jtjkr+|js+|jd}|t|Wn t y6YdSwd}|j D]\}}|D]}t |rX|sTt |sX||vrXdSd}qDq>dS)Nrr9FT)setr/addidr;r%COMMArwr=rjr0itemsrr)rH ignored_ids last_leaf comment_seenleaf_idr0commentrJrJrK$contains_uncollapsable_type_commentss0     z)Line.contains_uncollapsable_type_commentscCs|jsdStdd|jDd}tddt|jDd}||kr?|jddD]}|jt|gD] }t|r=dSq3q(dS)NFcs |] }|jdkr|jVqdSrNlinenor}rJrJrK Dz9Line.contains_unsplittable_type_ignore..rcsrrrr}rJrJrKrFrr9T)r/nextreversedr0getrr)rH first_line last_linenoderrJrJrK!contains_unsplittable_type_ignore3sz&Line.contains_unsplittable_type_ignorecCstdd|jDS)Ncss|]}t|VqdSr)rr}rJrJrKrUz2Line.contains_multiline_strings..)anyr/rSrJrJrKcontains_multiline_stringsTszLine.contains_multiline_stringsclosingcCs|jtvr|jr|jdjtjksdS|jtjkrdS|jtjkrT|jdurR|jjtj krR|j durRt |j ||jtj tjfdrR|j dusGJ|j jtjksPJdSdS|jrYdS|j durht |j ||jshdSdS)zReturn True if we have a magic trailing comma, that is when: - there's a trailing comma here - it's not from single-element square bracket indexing - it's not a one-tuple rFTN)brackets)r;rr/r%rRBRACERSQBparentr"traileropening_bracketrLSQB prev_sibling subscriptlistr)rHrrJrJrKrDWs:        zLine.has_magic_trailing_commarcCs|jtkr|jrd|_dS|jtjkrdS|js"t|_d|_dS|jd}|jtjkrV|j sV|j rVt t |j dkrVt |sVt |jdkrQt|_d|_dS|jd}|jt|g|dS)z0Add an inline or standalone comment to the line.Frrfrsr9T)r;rr1any_open_bracketsrAr%COMMENTr/rwr=rrRrrr0 setdefaultrrG)rHrrrJrJrKrFs6     zLine.append_commentcCs|jt|gS)z;Generate comments that should appear directly after `leaf`.)r0rrrrJrJrKrszLine.comments_aftercCs>|j}|jt|g}|jt|jdg|dS)z@Remove the trailing comma and moves the comments attached to it.rN)r/popr0rrextend)rHtrailing_commatrailing_comma_commentsrJrJrKrEs zLine.remove_trailing_commacCsj|j}|dur dS|j}t|tr&|jtjkrdS|jtjkr&t ||}|duo4t dd| DS)zAReturn True iff `leaf` is part of a slice with non-trivial exprs.NFcss|]}|jtvVqdSr)r;r)rbnrJrJrKrs  z,Line.is_complex_subscript..) r1 get_open_lsqb next_sibling isinstancer'r;r" listmakerrrr pre_order)rHr5 open_lsqbsubscript_startrJrJrKrBs     zLine.is_complex_subscript is_reversedccsttttgttttff|rtnt}||j D]+\}}t |j t |j }d|j vr2dS| |D] }|t |j 7}q7|||fVqdS)zReturn an enumeration of leaves with their length. Stops prematurely on multiline strings and standalone comments.  N)r rr r&rr Indexenumerate_reversed enumerater/rRrAr=r)rHropindexr5lengthrrJrJrKenumerate_with_lengths  zLine.enumerate_with_lengthcCst|j|j|j|j|jdS)N)r+r,r2r3r4)r)r+r,r2r3r4rSrJrJrKclonesz Line.clonecCsz|sdSd|j}t|j}t|}|j||j}|D]}|t|7}qtj |j D]}|t|7}q0|dS)zRender the line.rz ) r,iterr/rrAr=strrchain from_iterabler0values)rHindentr/firstresr5rrJrJrK__str__s  z Line.__str__cCst|jp|jS)z/Return True if the line has leaves or comments.)r<r/r0rSrJrJrK__bool__sz Line.__bool__)FFF)r8N)r8r))=__name__ __module__ __qualname____doc__rr+r__annotations__r,intrr/rr&dictr0rLeafIDrr1r2r<r3r4rrGrPpropertyrNrUrrrZrhrnrqr@rzrrrrrrrrrrrDrFrrErBrr rrrrrrrJrJrJrKr)1s     $  $!,%   r)c@s:eZdZUdZeed<eed<eed<eed<eed<dS) RHSResultz2Intermediate split result from a right hand split.headbodytailrclosing_bracketN)rrrrr)rr&rJrJrJrKrs  rc@szeZdZUdZeed<eded<eed<dZe ed<e e dZ e eed<dZe ed <d Zeed <d e efd dZdS) LinesBlockzClass that holds information about a block of formatted lines. This is introduced so that the EmptyLineTracker can look behind the standalone comments and adjust their empty lines for class or def lines. r+previous_block original_linerbeforer- content_linesafterF form_feedr8cCs8tt|jd}t|j|j|}|g|j||jgS)N)r+)rr)r+r rrrr)rH empty_linerArJrJrK all_linesszLinesBlock.all_linesN)rrrrrrrr)rrrrrrrrrr<rrJrJrJrKrs     rc @seZdZUdZeed<dZeeed<dZ ee ed<e e dZ eeed<dZee ed<d ed e fd d Zd ed eeeffd dZd ededed eeeffddZdS)EmptyLineTrackera{Provides a stateful method that returns the number of potential extra empty lines needed before and after the currently processed line. Note: this tracker works on lines that haven't been split yet. It assumes the prefix of the first leaf consists of optional newlines. Those newlines are consumed by `maybe_empty_lines()` and included in the computation. r+N previous_linerr- previous_defssemantic_leading_comment current_liner8cCs|jdkot|jod|jdjv}||\}}|jr |jjnd}td||}|jrH|jjdurHt|jj jdkrH|jj j rH|j sH|j sHd}t |j|j||||d}|jrq|jdusm|jjsp|jjrf|rp|jdusm|rp||_n|jrv|ryd|_||_||_|S)zReturn the number of extra empty lines before and after the `current_line`. This is for separating `def`, `async def` and `class` with extra empty lines (two on module-level). rz NrQ)r+rrrrr)r,r<r/rA_maybe_empty_linesrrmaxrRrrrZrnrr+rNrrUr)rHrrrrprevious_afterblockrJrJrKmaybe_empty_lines+sV    z"EmptyLineTracker.maybe_empty_linescCsd}|jdkr|jjr dnd}|jr&|jd}|jd}t||}d|_nd}t|}|j}d}|jrL|jdj|krL|j }|jrL|jdj|ks<|j sR|j rX|j ||j dur_dS|jrr|j j rhdS|j jrr|j j rrdS|dur|j dus}J|jjr|j r|jsd}n8|r|j s|j j r|rdnd}n(|rd}n#d}n |rd}n|s|jr|jdjtjkr|jdjd vrd}nd}|js|j s|j r||||S|j jr|js|jtd s||j jkr|pddfS|dfS) NrQrrsrrrrrrrQ)withtryforwhileifmatchr)r,r+is_pyir/rAr~minr<rrrnrZrGrrrrhr;r%r?r=rU#_maybe_empty_lines_for_class_or_defrr)rHr max_allowedrlruser_had_newliner, previous_defrJrJrKr]sv              z#EmptyLineTracker._maybe_empty_linesrr cCs|jdusJ|jjr|jjr|jrdSdS|jj|jkr5|jjs%|jjr5|jjr+dS|r1ddfSddfSd}|jjrf|jj|jkrf|dkrf|j }|durd|j durd|j j jsd|j j j sd|j dkrd|}ndS|jjr|jsq|jjr|jj|jkr{d}nI|jj|jkrd}n?|jr|jjrd}n5d}n2|jj|jkrd}n(|js|jr|jjs|jrtd|}nd}nd}n|jrdnd}|jjr|sd}|dur|j }|durt|j ||j|_ d}|dfS)NrrrQrrs)rrUr+rrhr,rZrnrNrrrrrrrqrr)rHrrr comment_to_add_newlinesslcnewlinesrrJrJrKrsv    z4EmptyLineTracker._maybe_empty_lines_for_class_or_def)rrrrrrrrr)rrrrrrrrr rrr<rrJrJrJrKrs$ 2T rsequencer8ccs2t|d}t|D] }||fV|d8}q dS)z;Like `reversed(enumerate(sequence))` if that were possible.rQN)rRr)rrelementrJrJrKrs     rFnew_lineold_liner/r6cCsR|D]$}t|j|j}t|||j||d||D] }|j|ddqqdS)a Append leaves (taken from @old_line) to @new_line, making sure to fix the underlying Node structure where appropriate. All of the leaves in @leaves are duplicated. The duplicates are then appended to @new_line and used to replace their originals in the underlying Node structure. Any comments attached to the old leaves are reattached to the new leaves. Pre-conditions: set(@leaves) is a subset of set(@old_line.leaves). rLTN)r&r;r=r!rGr)rrr/r6old_leafnew_leaf comment_leafrJrJrK append_leaves s rr)line_strliner+rcCs |st|}tj|vrt||jkod|vo| S|r!dSd|vr,t||jkS|d^}}}t||jksCt||jkrEdSg}d}g}tj} t |j D]\} } | tjkrd} | j dt |krm| dn | j dt |krz|} | dur|dur|j | j dkr| j } | dkrdS| j | kr| jtjkrdg} | |7} | j| vr| t |j dks|| j d7<| tjkrt| | j } t| rt |dkrdS| }| }t||vr| ||jdurn |j}t||vsqSt |dkrdStdd|DS) aFor non-multiline strings, return True if `line` is no longer than `line_length`. For multiline strings, looks at the context around `line` to determine if it should be inlined or split up. Uses the provided `line_str` rendering, if any, otherwise computes a new one. rFNrQrTcss|]}|dkVqdSrrJ)rbvalrJrJrKrxrz'is_line_short_enough..)line_to_stringrmultiline_string_handlingr$ line_lengthrsplitmathinfrr/ bracket_depthrRrGrr;r%rrrrrrall)rr+rrrclastcommasmultiline_stringmultiline_string_contextsmax_level_to_updateir5 had_comma ignore_ctxsctxrJrJrKis_line_short_enough"sl           r+cCs|j}t|dkr dS|djtjkrr|djtjkrrd}d}|d}|dddD]G}|jtvr>|jtvr9dS|d7}n(|jtjkrI|d7}n|jtjkr^|jtjks]|jtvs]dSn|jtvrfdS|dkrq|dkrqdSq*dS) zReturn False if the line cannot be split *for sure*. This is not an exhaustive search but a cheap heuristic that we can use to avoid some unfortunate formattings (mostly around wrapping unsplittable code in unnecessary parentheses). rsFrrQrr9NT) r/rRr;r%rxr`rrrY)rr/ call_count dot_countrr5rJrJrK can_be_split{s0         r.rhsrc Cs|j}d}t|jD]'}|r||jurd}|jtkr|sdS|s1|jtvr1|j|jvr1|jr1|}q |j}|j s:dS| }| |}|dkrIdS|dkrW|t krW|j jrWdS|tkr]dSt|jdkshJd|jd}|jd} |jtvr| jtvrt|||drdS|jd } |jd } | jtjks| jtjks| jtjkr| jr| jjtjkr| jtvrdSt|rdSt|| |d rdSdS) aDoes `rhs.body` have a shape safe to reformat without optional parens around it? Returns True for only a subset of potentially nice looking formattings but the point is to not return false positives that end up producing lines that are too long. NFTrQrszStranded delimiterr)rrr9r)r"r)rrr/rr;rrr=r1 delimitersmax_delimiter_prioritydelimiter_count_with_priorityrrrrrRr_can_omit_opening_parenr%rwrrrr"rr_can_omit_closing_paren) r/rrrr5bt max_prioritydelimiter_countrsecond penultimater"rJrJrKcan_omit_invisible_parenss`            r:rcCsd}d|j}d}|D]%\}}}|jtvr|j|urd}|r2||7}||kr+dS|jtvr2d}q t|j|dkr>dSdS) See `can_omit_invisible_parens`.FrrrTrQ)r,rr;rrrrRr/)rrr remainderr_indexr5 leaf_lengthrJrJrKr3s"  r3r"cCsZd|j}d}|D]\}}}||7}||jur#|s||kr"dSq |jtvr*d}q dS)r;rrFT)r,rrr;r)rr"rrseen_other_bracketsr=r5r>rJrJrKr4s    r4cCst|dS)zmReturns the string representation of @line. WARNING: This is known to be computationally expensive. r)rr>)rrJrJrKr*srr)Crr dataclassesrrtypingrrrrrr r r r r black.bracketsrrr black.moderr black.nodesrrrrrrrrrrrrrr r!r"r# black.stringsr$blib2to3.pgen2r%blib2to3.pytreer&r'r(rrrLNr)rrrrr<rrr+r.r:r3r4rrJrJrJrKsx0 L   K "g   Y$ a