*j!'UdZddlmZddlZddlZddlZddlZddlZddlm Z ddl m Z dZ ej dZiZded <ejZhd Zd Zd Zd Zd?dZd@dZdAdBdZdCdZdDdZdEd ZdFd#ZdGd$ZdHd'ZdId)Z dAdddd*dJd0Z!Gd1d2Z"ddd3dKd5Z#dLd8Z$dd9dMd:Z%dd9dNd<Z&dd=dOd>Z'dS)PzAppend-only WebUI run event journal helpers. This is the first #1925 journal/replay slice. It mirrors SSE events emitted by the existing in-process streaming path without changing execution ownership. ) annotationsN)Path)Iterable _run_journalz^[A-Za-z0-9_.-]+$z*dict[tuple[str, str, str], threading.Lock] _WRITER_LOCKS>doneerrorcancelapperror stream_endHERMES_WEBUI_RUN_JOURNAL_FSYNCeagerz terminal-onlyreturnrc,ddlm}t|S)Nr SESSION_DIR) api.modelsrrrs 2/Users/bertmahoney/hermes-webui/api/run_journal.py_default_session_dirrs"&&&&&&   valuestrfieldct|pd}|r"d|vsd|vst|st d||S)N/\zinvalid )rstrip _SAFE_ID_RE fullmatch ValueError)rrcleaneds r _validate_idr# sf%+2$$&&G -cWnn{?T?TU\?]?]+E++,,, Nr session_idrun_id session_dir Path | Nonect|d}t|d}|t|n t}|tz |z |dz S)Nr$r%.jsonl)r#rrRUN_JOURNAL_DIR_NAME)r$r%r&sidridroots r _run_pathr.'sZ z< 0 0C vx ( (C + 74   =Q=S=SD & & ,#~~~ ==rpaththreading.Lockc.t|j|jttjf}t 5t |}|tj }|t |<|cdddS#1swxYwYdSN) rparentnameosgetpid_WRITER_LOCKS_GUARDrget threadingLock)r/keylocks r _lock_forr=.s t{  TYBIKK(8(8 9C   %% <>##D!%M#  s;B  BBtuple[list[dict], list[dict]]cg}g} |d}n#t$r||fcYSwxYwt|dD]\}}|s t j|}n-#t j$r|||dYYwxYwt|tr|||||d||fS)Nutf-8encoding)start)lineraw) read_text splitlinesFileNotFoundError enumeraterjsonloadsJSONDecodeErrorappend isinstancedict)r/events malformedlinesline_norFparseds r _read_jsonlrV8s7FI!00;;== !!!y    !!%q111 < < yy{{   Z__FF#      gc:: ; ; ; H  fd # # < MM& ! ! ! !   gc:: ; ; ; ; 9 s (/AA/B'B.-B.intcjt|\}}d|D}|rt|dzndS)Ncg|]N}t|dt*t|dpdOSseqr)rOr8rW.0events r z_next_seq..PsN ` ` `5jSXIYIY[^>_>_ `C %  %A & & ` ` `rrC)rVmax)r/rQ _malformedseqss r _next_seqrcNs@$T**FJ ` `F ` ` `D" )CIIMM)r event_name str | Nonec>t|pd}|dks|dkrdS|dkrdS|dvrqt|trJt|pidpdnd}|d vrdS|d krd Sd SdS) Nrrr completedr zinterrupted-by-user>r r type>canceled cancelled interruptedzinterrupted-by-crasherrored)rrOrPr8rlower)rdpayloadr4err_types r_terminal_state_for_eventrpTs zR D v~~--{ x$$ $$$MWX_aeMfMfn3 2**6228b99??AAGGIIIln 0 0 0(( } $ $))y 4rctjtt}t |pd}|tthvr|StS)Nr) r5environr8_FSYNC_MODE_ENV_FSYNC_MODE_TERMINAL_ONLYrrrm_FSYNC_MODE_EAGER)rFmodes r_run_journal_fsync_moderwds\ *..*C D DC syb>>   ! ! ' ' ) )D !#<=== $$rterminal_stateboolcRttkrdSt|S)NT)rwrury)rxs r_should_fsync_eventr{ls'  $555t   rNonec  tj|jttdd} tj|tj|dS#tj|wxYw#t $rYdSwxYw)N O_DIRECTORYr)r5openr3getattrfsynccloseOSError)r/dir_fds r_fsync_parent_dirrrs gb-&C&CDD  HV    HV     BHV          s(.A4AA4A11A44 BB)r&r[ created_atr[ int | Noner float | NonerPc Nt|||}||ni}t|pd}|stdt |5|t |nt |}t||} d|d||t|t|||t||ntj t| | |d } |j dd | } tj| d d d z} t!j|t jt jzt jzd} t!j| dd5}|| |t1| r&t!j|dddn #1swxYwY| rt7|| cdddS#1swxYwYdS)zJAppend one durable run event and fsync it according to the journal policy.r&Nrzevent_name is requiredrC:) versionevent_idr[r%r$r^rhrterminalrxrnT)parentsexist_okF),r) ensure_ascii separators iar@rA)r.rrr!r=rWrcrpfloattimeryr3mkdirexistsrKdumpsr5rO_CREATO_APPENDO_WRONLYfdopenwriteflushr{rfilenor)r$r%rdrnr&r[rr/ assigned_seqrxr^ created_filerEfdfhs rappend_run_eventr}s Z[ A A AD ,gg"GZ%2&&,,..J 31222 4#&?s3xxx $ 2:wGG!22L22&kkj//j.D $)++VV^,,,    $666;;==( z%e KKKdR WT2: 3bkA5 I I Yr3 1 1 1 &R HHTNNN HHJJJ">22 &%%%  & & & & & & & & & & & & & & &  $ d # # #7s8D)HAG0$ H0G4 4H7G4 8HH!Hc*eZdZdZdddd Zddd ZdS)RunJournalWriterz)Stateful writer for one WebUI stream/run.Nrr$rr%r&r'czt|d|_t|d|_|t|nd|_t |j|j|j|_t|j|_|j5t|j|_ ddddS#1swxYwYdS)Nr$r%r) r#r$r%rr&r._pathr=_lockrc)selfr$r%r&s r__init__zRunJournalWriter.__init__s&z<@@"6844 0;0G4 ,,,Tt IYZZZ tz** Z 3 3&tz22DN 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3s B00B47B4rdrrPc|j5|j}|xjdz c_dddn #1swxYwYt|j|j||pi|j|S)NrC)r&r[)rrcrr$r%r&)rrdrnr[s rappend_sse_eventz!RunJournalWriter.append_sse_events Z  .C NNa NN                O K  Mr(     s ,00)r$rr%rr&r'r2)rdrrrP)__name__ __module__ __qualname____doc__rrrrrrsT33SW333333        rr) after_seqr&rct|||}t|\}}fd|D}t|t|||dS)Nrc~g|]9}t|dpdtk7|:SrZ)rWr8)r]r^rs rr_z#read_run_events..sC[[[Es599U3C3C3Hq/I/ICPYNN/Z/Z%/Z/Z/Zr)r$r%rQrR)r.rVr)r$r%rr&r/rQrRs ` rread_run_eventsrsq Z[ A A AD#D))FI[[[[V[[[*oof++   rrQIterable[dict]c d|D}|r|dnd}d|D}tdt|D|r|dnd}|r|dn|rdnd}t|t|t|t |t |pidpd |pid t |||pid d S) Nc<g|]}t|t|Sr)rOrPr\s rr_z(_summary_from_events..s'DDDJud,C,CDuDDDrc<g|]}|d|S)rr8r\s rr_z(_summary_from_events..s)KKKUYYz5J5JKuKKKrc3LK|]}|ddk|V dS)r^r Nrr\s r z'_summary_from_events..s8\\579K9K|9[9[9[9[9[9[\\rrxrunningunknownr[rrr^) r$r% stream_id event_countlast_seq last_event_idrrx last_event)nextreversedr8rlenrWry)r$r%rQorderedlastterminal_eventsrstatuss r_summary_from_eventsrs'DD&DDDG! +72;;tDKK'KKKO\\H_55\\\.8DH08 bX\\* + + +7>aiiXaF*oof++[[7||((//4155*"))*55NN zr&&w//   rrcrt|||}t|||dpgS)NrrQ)rrr8)r$r%r&journals rlatest_run_summaryrs9j&kJJJG  FGKK4I4I4OR P PPr dict | Nonec8t|d}|t|n t}|tz }|d|dD]F}|jj}t|\}}t|||} t|| d<| cSdS)Nr%z*/r)r/) r#rrr*globr3r4rVrr) r%r&r,r- journal_rootr/r$rQrasummarys rfind_run_summaryrs vx ( (C + 74   =Q=S=SD..L!!"2s"2"2"233[% (.. &z3??d)) 4r)rc xt||}|ds|dsdSt|dpddz}||t|krdSddd|||dd }d|d ||||d d tjd d |d d S)NrrrrrCrkz1The live worker stopped before this run finished.zqThe transcript was restored to the last journaled event. Start a new turn if you still need the task to continue.)rhmessagehintr$rjournal_last_seqrr Tzlost-worker-bookkeeping) rrr[r%r$r^rhrrrxrn synthetic)rr8rWr)r$r%rrr[rns rstale_interrupted_eventrs V44G{{:gkk-&@&@t gkk*%%* + +a /CI!6!6tFD #KK 33 G%%%% ikk3   r)rr)rrrrrrr2)r$rr%rr&r'rr)r/rrr0)r/rrr>)r/rrrW)rdrrre)rr)rxrerry)r/rrr|)r$rr%rrdrr&r'r[rrrrrP) r$rr%rrrr&r'rrP)r$rr%rrQrrrP)r$rr%rr&r'rrP)r%rr&r'rr)r$rr%rrrrr)(r __future__rrKr5rer9rpathlibrtypingrr*compilerr__annotations__r:r7_TERMINAL_SSE_EVENTSrsrurtrr#r.r=rVrcrprwr{rrrrrrrrrrrrs #"""""  %bj-.. <> >>>>$in&&LLL2+ >>>>>,****     %%%%          + $#++++++\        <!# &,TXQQQQQQ AE      VZr