i0dZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z m Z ddl mZmZmZmZmZejeZd dZGdd e ZdS) zKSSH remote execution environment with ControlMaster connection persistence.N)Path)BaseEnvironment _popen_bash)FileSyncManageriter_sync_filesquoted_mkdir_commandquoted_rm_commandunique_parent_dirsreturnctjdstdtjdstddS)z@Fail fast with a clear error when the SSH client is unavailable.sshzWSSH is not installed or not in PATH. Install OpenSSH client: apt install openssh-clientscpzWSCP is not installed or not in PATH. Install OpenSSH client: apt install openssh-clientN)shutilwhich RuntimeError;/home/piyush/.hermes/hermes-agent/tools/environments/ssh.py_ensure_ssh_availablers\ <    e    <    e     rc $eZdZdZ d&dededed ed ed ef fd Zd'ded zdefdZdZ defdZ d(dZ dededd fdZ dee eefdd fdZdedd fdZdeedd fdZd(dZddd d d!ed"ed ed#ed zdejf d$Zd%ZxZS))SSHEnvironmentaRun commands on a remote machine over SSH. Spawn-per-call: every execute() spawns a fresh ``ssh ... bash -c`` process. Session snapshot preserves env vars across calls. CWD persists via in-band stdout markers. Uses SSH ControlMaster for connection reuse. ~<hostusercwdtimeoutportkey_pathc t|||_|_|_|_t tjdz _ j ddtj |d|d| dd}j |dz _t!_t+fd jjjj _jd dS) N)rrz hermes-sshT)parentsexist_ok@:z.sockc2tjdS)N/.hermes)r _remote_homeselfsrz)SSHEnvironment.__init__..IsD4E1O1O1O!P!Pr) get_files_fn upload_fn delete_fnbulk_upload_fnbulk_download_fn)force)super__init__rrr r!rtempfile gettempdir control_dirmkdirhashlibsha256encode hexdigestcontrol_socketr_establish_connection_detect_remote_homer*_ensure_remote_dirsr _scp_upload _ssh_delete_ssh_bulk_upload_ssh_bulk_download _sync_managersync init_session) r,rrrrr r! _socket_id __class__s ` rr5zSSHEnvironment.__init__-s S'222      3 5 566E td;;;^ # #d # #T # # * * , ,  )++crc #.J1E1E1EE ""$$$ 4466   """,PPPP&&0!4     d+++ rN extra_argsr cTdg}|dd|jg|ddg|ddg|ddg|ddg|ddg|jd kr)|d t|jg|jr|d |jg|r||||jd |j|S) Nr -o ControlPath=zControlMaster=autozControlPersist=300z BatchMode=yesz StrictHostKeyChecking=accept-newzConnectTimeout=10rz-p-ir%)extendr>r strr!appendrr)r,rKcmds r_build_ssh_commandz!SSHEnvironment._build_ssh_commandSs3g D>)<>>?@@@ D./000 D./000 D/*+++ D<=>>> D-./// 9?? JJc$)nn- . . . = . JJdm, - - -  # JJz " " " di--$)--... rc|}|d tj|ddd}|jdkrD|jp|j}td|dS#tj $r!td|j d|j d wxYw) Nz!echo 'SSH connection established'Tcapture_outputtextrrzSSH connection failed: zSSH connection to r%z timed out) rTrR subprocessrun returncodestderrstripstdoutrTimeoutExpiredrr)r,rSresult error_msgs rr?z$SSHEnvironment._establish_connectionds%%'' 6777 W^C4QSTTTF A%%"M//11JV]5H5H5J5J "#HY#H#HIII&%( W W WUDIUU UUUVV V Ws A'B0Cc\ |}|dtj|ddd}|j}|r(|jdkrtd||Sn#t$rYnwxYw|j dkrdSd |j S) z(Detect the remote user's home directory.z echo $HOMET rWrzSSH: remote home = %srootz/rootz/home/) rTrRrZr[r_r^r\loggerdebug Exceptionr)r,rSrahomes rr@z"SSHEnvironment._detect_remote_homeos ))++C JJ| $ $ $^C4QSTTTF=&&((D )Q.. 4d;;;     D  9  7# ###sBB BBc|jd}||d|d|dg}|}|t|t j|ddddS) z?Create base ~/.hermes directory tree on remote in one SSH call.r)z/skillsz /credentialsz/cacheTrdrWN)r*rTrRrrZr[)r,basedirsrSs rrAz"SSHEnvironment._ensure_remote_dirss#---&&&4(=(=(=$O%%'' '--...s4dBGGGGGGr host_path remote_pathctt|j}|}|dt j|tj|dddddd|j g}|j dkr)| d t|j g|j r| d |j g| ||j d |jd |gtj|ddd }|jdkr)t!d|jdS)z0Upload a single file via scp over ControlMaster.z mkdir -p TrdrWrrMrNrz-PrOr%r&rz scp failed: N)rQrparentrTrRshlexquoterZr[r>r rPr!rrr\rr]r^)r,rmrnrq mkdir_cmdscp_cmdras rrBzSSHEnvironment._scp_uploadsUT+&&-..++-- :U[%8%8::;;;yD"MMMM$ Dt/B D DE 9?? NND#di..1 2 2 2 = 2 NND$-0 1 1 1 di#K#K$)#K#Kk#K#KLMMM4QSTTT   ! !Efm.A.A.C.CEEFF F " !rfilesc |sdSt|}|r|}|t|t j|ddd}|jdkr)td|j tj d5}|D]\}}tj ||d }tjtj |d tjtj ||d d d d|dg} |} | dt j| tjtj} t j| | jtjtj} n7#t.$r*| | wxYw| j | d\} }d}| | d\} }n"| jr| jnd}nr#tj$r`| | | | tdwxYw| jdkr@td| jd|d | jdkr@td| jd|d  dddn #1swxYwYt@!dtE|dS)aUpload many files in a single tar-over-SSH stream. Pipes ``tar c`` on the local side through an SSH connection to ``tar x`` on the remote, transferring all files in one TCP stream instead of spawning a subprocess per file. Directory creation is batched into a single ``mkdir -p`` call beforehand. Typical improvement: ~580 files goes from O(N) scp round-trips to a single streaming transfer. NTrprWrzremote mkdir failed: zhermes-ssh-bulk-)prefix/)r$tarz-chf-z-C.z tar xf - --no-overwrite-dir -C /)r_r])stdinr_r]x)rrrdzSSH bulk upload timed outztar create failed (rc=z): replaceerrorsz tar extract over SSH failed (rc=z*SSH: bulk-uploaded %d file(s) via tar pipe)#r rTrRrrZr[r\rr]r^r6TemporaryDirectoryospathjoinlstripmakedirsdirnamesymlinkabspathPopenPIPEr_rhkillwaitclose communicatepollreadr`decoderfrglen)r,rvr#rSrastagingrmrnstagedtar_cmdssh_cmdtar_procssh_proc_ ssh_stderrtar_stderr_raws rrDzSSHEnvironment._ssh_bulk_uploads)  F$U++  T))++C JJ+G44 5 5 5^C4QSTTTF A%%"#R6=;N;N;P;P#R#RSSS (0B C C C7 w*/ ? ?& ;g{/A/A#/F/FGG BGOOF33dCCCC 27??955v>>>>fc4#>G--//G NN= > > >!'  H %+8?:?%?       O ! ! # # # @ ( 4 4S 4 A A :"%==??*(0(<(???  @"a''"IX-@II%,,I,>>DDFFII"a''"Ex7JEE!(( (::@@BBEE(g7 7 7 7 7 7 7 7 7 7 7 7 7 7 7 r  A3u::NNNNNsF-C=N/+1GN/4HN/.A+JN/A/L  BN//N36N3destc|jdd}|}|dt j|t |d5}tj||tj d}dddn #1swxYwY|j dkr=td |j d dS) z*Download remote .hermes/ as a tar archive.r)ryztar cf - -C / wbr~)r_r]rNrzSSH bulk download failed: rr)r*rrTrRrrrsopenrZr[rr\rr]rr^)r,rrel_baserfras rrEz!SSHEnvironment._ssh_bulk_downloads3'11188==))++? H(=(=??@@@ $   \^GAjoWZ[[[F \ \ \ \ \ \ \ \ \ \ \ \ \ \ \   ! !lFM ? ? ?3 +++rc|jr3td|j|jr ddd|jdd|jd|jg}tj |dd n#ttj f$rYnwxYw |j dS#t$rYdSwxYwdS) Nz"SSH: syncing files from sandbox...r rMrNz-Oexitr%T)rXr) rFrfinfo sync_backr>existsrrrZr[OSErrorSubprocessErrorunlink)r,rSs rcleanupzSSHEnvironment.cleanups   + KK< = = =   ( ( * * *   % % ' '  d$H43F$H$HV %?%?DI%?%?As4CCCCCZ78     #**,,,,,      s$6B B%$B%)C CC)rrrr)Nr N)__name__ __module__ __qualname____doc__rQintr5listrTr?r@rArBtuplerDrrErCrboolrZrrr __classcell__)rJs@rrr$s,9A$$$$$$LTD[D" W W W$S$$$$(HHHHGSGsGtGGGG"POd5c?&;POPOPOPOPOd nt n n n n nMS MdMMMM"""";@!$+/ , , ,C ,4 , ,!Dj ,4>4D , , , ,rrr)rr:loggingrrrrrZr6pathlibrtools.environments.baserrtools.environments.file_syncrrrr r getLoggerrrfrrrrrrs#QQ @@@@@@@@  8 $ $     CCCCC_CCCCCr