]ic9%SrSSKJr SSKJrJr SSKrSSKJr SSK r SSK J r SSK r SSKrSSKrSSKrSSKJrJrJr SS KJrJrJr SS KJr SS KJrJrJr SS KJ r J!r! SS K"J#r#J$r$J%r% SSK&r'\"\S5r\ RP\)/S4\*S'Sr+\"SS55r,Sr-S\ R\S\4Sjr/\"5S\,"54S\S\S\)S\S\ R`\S\,S\ Rb\ 4Sjjr2Sr3S\ Rb\)S\S\ Rb\ S\ Rb\ 4S jr4S\ R\S\S\S!\ Rb\ S"\ RPS\54 S#jr6g)$z This defines the `dora grid` action, and provides a `run_grid` API that can be used from a notebook or any other script. When using the API, you can provide the equivalent of the command line flags with the `RunGridArgs` dataclass. )ProcessPoolExecutor) dataclassfieldN)partial)Path) SlurmConfig SubmitRulesupdate_from_args)ExplorerLauncherHerd) DecoratedMain)colorize simple_logfatal)SheepShepherd)import_or_fatalreliable_rmtreetry_loadzGrid:logcgN)argskwargss F/mnt/rpi/tmp/demucs-venv-sys/lib/python3.13/site-packages/dora/grid.pyno_printr%sc\rSrSr%Sr\"\S9r\R\ \ S'Sr \ \ S'Sr\\ S'S r\R"\\ S 'S r\ \ S 'S r\ \ S 'S r\ \ S'S r\ \ S'S r\ \ S'S r\R"\ \ S'S r\ \ S'S r\R"\\ S'S r\R"\\ S'S r\R"\\ S'S r\ \ S'Srg ) RunGridArgs)a) Arguments to tune the behavior of the `run_grid` function. Args: patterns (list[str]): List of patterns used to filter by name the XPs. monitor (bool): if True, will monitor the advances of the XPs every `interval` minutes, stopping only when all runs completed or failed. interval (float): interval in minutes to wait between updates. trim (int or None): if provided, will trim all XP logs to the epoch of the XP with the provided index. Useful to compare XP started at different times. trim_last (bool): if True, will trim all XP to the least advanced XP. silent (bool): if True, do not print anything (e.g. API usage). dry_run (bool): if True, Dora will simulate the run of the grid, without scheduling or canceling any XP. cancel (bool): if True, will cancel all XPs in the grid. If `patterns` is provided, only XP matching the patterns will be canceled. clear (bool): This will cancel any previous job, clear the XP folder, and reschedule a new experiment. )default_factorypatternsTmonitorintervalNtrimF trim_lastsilentdry_runcancelclearinitjupyterfolderrtail_from_commandliner)__name__ __module__ __qualname____firstlineno____doc__rlistr%tpListstr__annotations__r&boolr(floatr)Optionalintr*r+r,r-r.r/r0r1rr2r3__static_attributes__rr rr"r")s.#48Hbggcl8GTHe!D"++c !ItFDGTFDE4#D"++d #GT $FBKK # CS  !D"++c !#t#r r"cURRnUcURS-n[U5nURbAURR SS5S-n[ UR5RU- nURbWR5(GdU/n[ UR5Rn[R"U5Hupn U Hn [ U5U - RU5n U RRS5(dMBU RRS5(aMdU RU R - n UR#[%U 5R SS55 M M URb'WR5(d['SWSUS35 ['S S R)U535 [*R,"S 5 US-UR-n [U 5nUR.n[5W[65(d[3US 35 U$![0a [3U S 35 N?f=f)Nz.grids./z.py_z No grid file z in package z. Maybe you made a typo?zPotential grids are: z, rz( has no exploration function `explorer`.z' must be an instance of `dora.Explorer`)dora grid_packagepackagergridreplacer__file__parentexistsoswalk relative_tonameendswith startswithstemappendr<rjoinsysexitexplorerAttributeErrorr isinstancer )rmainrHgrids grid_filename grid_file candidatespkg_rootrootfoldersfilesfilefullpath grid_namerJrZs r _get_exploreri[s99))L||h. L )E yy ))#s3e; (//-?  yy 0 0 2 2 '..$&GGH$5 D5 J-::8D==))%009Q9QRU9V9V'>H%%c(m&;&;C&EF %6 99 )9)9);); - l<.I)) * #DIIj$9#: ;<  s"TYY.I 9 %DF== h ) )  ABC O F  CDEFs I I$#I$rr]c[X5nUR5n[X05 [5n[X@5 [ 5nSUl[XP5 [ XURXCU5 g)NT)riget_slurm_configr r r"r3run_gridrJ)rr]rZslurmrules grid_argss r grid_actionrpsZD'H  ! ! #EU! MEU! I"&IY% TTYYi@r rZrhrnrmreturnc z[U[5(deUcUR5nURRURR - U- nUR SSS9 [5n[U[S9nUR(a7[S5n [XXyS9n U"U 5 UR5 SSS5 O[XU5n U"U 5 UR5 [UR R#55n [%UR&X 5n UR((Ga#UR*(a [-S5 [S[/U 5S US 35 UR0(a*[3S 5n U R55S :wa [-S 5 [S5 U H-n U R6cMUR9U R65 M/ UR;5 [S5 U HRn U R<R>RA5(a[CU R<R>5 SU lMT /n/nURE5HbnURFUR ;dMURIU5 URKURF5nUceURIU5 Md UR5 URV(dU V s0sHoR<RXU _M nn URZHnUVs/sHnUU;dM UUPM nnU(dM)USnUR\UR<RXn[/U5S:XaUR_UXC5 MtURaU5 UHn UR_XU5 M SSS5 M UHnURc5(aMUR6ceUR9UR65 UReUR<5n[SUR6RTSUR<RXSU35 M URV(aU Hn U Rc5(aMU R6ceUReU R<5n[SU R6RTSU R<RXSU35 UR9U R65 M UR*(dU Hn XmR<RX- nURA5(dURg5(aOURg5(a6URi5U R<R>Ri5:XdeMURkU R<R>5 M UR;5 UHnURm5 M URn(a$U Hn URqU R<5 M URV(aU $U (d [S5 U $UR>URURr4Vs/sH nUcMUPM nnU(GaWUR0(d [uS5e[/U5S:XdeUSnU Un UReW R<5nUR>b![yU R<R>5 U $URrb`U RRA5(d[-SU RS35 [zR|"SSS S!S"U R/5 U $U RRA5(d[-S#US35 [~R"[U R5[R5 U $UR(a[n O[xn U "S$U35 UR(a&UR(dSS%KHJIn! U!RSS&9 UR5 [XPXU 5(aU $UR(dU $[URS'-5n"U "5 [U"5H?n#S(U"U#- S)S*3n$U"U#- S+:a [U$S,5n$U "U$S-S.9 [R"S5 MA U "S/5 M!,(df  GNW=f![Lan[SURFSU35 UURRNRP- n[SU5nUbCUSn[SURTSURFS35 UR9U5 SnAGMaSnAGMhSnAff=fs sn fs snf!,(df  GM=fs snf![va [-SUR>35 GN1f=f![a U $f=f)0a Run a grid search, this is the API underlying the `dora grid` command, so that it can be used from a notebook. You can also provide patterns to filter out XPs to be displayed. Args: main (DecoratedMain): main training function, decorated with Dora. explorer (Explorer): explorer instance that will define the XPs to launch. grid_name (str): this must be a unique name for the grid. rules (SubmitRules): see `dora.conf.SubmitRules`, those defines the rules for rescheduling failed XP etc. slurm (SlurmConfig or None): if provided, this will override the default Slurm config defined my the `main` argument. Returns: A list of `dora.shep.Sheep`. NT)exist_okparents)r)poolz'--dry_run is incompatible with --clear.zYou are about to restart z experiments from the grid z' from scratch. This cannot be reverted.zConfirm [yN]: yzAbort...zCanceling all current jobs...zDeleting XP folders...z$Error when trying to load old sheep z: rzCanceling job z from unloadable sheep rDrz for no longer required sheep rEz for sheep zNo sheep to handle.zIThe folder, log, and tail flags are only supported from the command line.zInvalid index zLog z does not existr2z-n200z-fz"Log file does not exist for sheep zMonitoring Grid )display)wait<zNext update in z.0fz seconds 31 )endz< )Rr\r rkrGdir_gridsmkdirrrr_slowrr completeupdater9sheepsvalues_filter_grid_sheepsr%r.r,rlenr3inputlowerjob cancel_lazycommitxpr1rNriterdirrRrVget_sheep_from_sig Exceptionshepjob_filerjob_idr-sig job_arrays slurm_configsmaybe_submit_lazy job_arrayis_doneget_name is_symlinkresolve symlink_tounlinkr/init_xpr2 RuntimeError IndexErrorprintrOexecvpshutil copyfileobjopenrXstdoutBrokenPipeErrorr+rr0IPythonry clear_outputr&rAr(rangertimesleep)%r]rZrhrnrmr grid_folderherdshepherdrvlauncherrreplsheep to_unlink old_sheepschild old_sheeperrorrjobsr sheep_maprr array_sheepsfirstrRlinkactionactionsindex maybe_printryrelaouts% rrlrls<* h ) )) ) }%%'))--$))"2"22Y>KtT2 6D#&H zz  #tAH X  MMO$ # HT2 OO $++$$& 'F  =F zzz << ; < 'F }4OPY{[5 5 6  ! !)*Dzz|s"j! +,Eyy$$$UYY/  $%Exx%%''0EI IJ$$& ::T[[ (   U # -$77 C !,,,!!),!'$ OO ;;6<=fUXX\\5(f =I6?Tis3)CSNIcNiLT OE&&uxx||4E< A%**5%?''.!- 225G"./.)   ""==, ,,   /==.D .!5!5 67"))*!D63 4   {{E==??yy,,,}}UXX.nUYY%5%5$6k%((,,qQUPVWX$$UYY/  <<E((,,.D{{}} 1 1((T\\^uxx?V?V?X-XXX-X0  E LLN yyE LL " {{  !" %)[[$((DII$F]$F&&v$FG]%% QR R7|q     25ME}}UXX& ;; " %((// " YY "99##%%UYYK78 IIfvtUD%))D E 99##%%:4&BC ""4 ?CJJ?  {{  "9+./  << '  d + 4x = =  M||  MDMMB&' >#:#::)#q'C. 4KEJJT/.V^ 2 N4;;-0 1 2#   ss#d'"d9< g!1 g&? g&/g+$g>/g>2h8h,' d69 gBgg+ g; "h)(h), h:9h:cU(dgUHMnSnUSSS:XaUSSnSn[R"USU-S-5nU(a U(a gMDU(aMM g g)NTFr!*)fnmatch)rRr%patternnegresults r _match_namerPsi  2A;# abkGCsW}s':;  r r%rcz/n[U5H/nUR[U55 URU5 M1 /nUHAnUR UR 5n[Xp5(dM0URU5 MC U(aUVs/sHoUPM nnU$![a Mf=fs snfr)r9rVrAremove ValueErrorrrr) r%r]rindexesprrrRidxs rrrasG (^  NN3q6 " OOA   C}}UXX& t & & JJu #*+7C3x7+ J   ,sB'B8' B54B5rrcURUVs/sHoURPM sn5upgUVs/sHoQRUR5PM nnSn URb[ XR5n O#UR (a[ SU55n U bUV s/sHoSU PM nn /n Sn [[X8U55Hun up^nUR5nUR5(dSn UcSnOUSSnUU UR(aURROSURRUS.n0nUUS 'URX^5nUR#U5 U R%U5 M U(a U"S U5 [&R("S[&R*"S UR-55/UR/5-S 9nU"[&R0"U UUR35S 95 U $s snfs snfs sn f![a UR!U5nNf=f) z|Single iteration of monitoring of the jobs in a Grid. Returns `True` if all jobs are done or failed, and `False` otherwise. Nc38# UHn[U5v M g7fr)r).0metricss r monitor..s9yG3w<.# 6,,W5E 6s"H$H)HH$$II)7r8concurrent.futuresr dataclassesrrr functoolsrrOpathlibrtypingr:rrXrconfr r r explorer r rr]rrrrrrrrutilsrrrrrCallabler<r=rr"riAnyrpr@r;rlrrr>r&rr rrs3(  <<--,,!== ' G <R[[#<  .$.$ .$b#L Abff AM A#.-SW!,@=@H@@@8: K8P@@35775>@F""''#,m "35775>(4"&&4 44QV44)-4r