Difference between revisions of "MARS"

From oldwiki.scinet.utoronto.ca
Jump to navigation Jump to search
m
 
(217 intermediate revisions by 2 users not shown)
Line 1: Line 1:
−
=== Massive Archive and Restore System ===
+
{| style="border-spacing: 8px; width:100%"
 +
| valign="top" style="cellpadding:1em; padding:1em; border:2px solid; background-color:#f6f674; border-radius:5px"|
 +
'''WARNING: SciNet is in the process of replacing this wiki with a new documentation site. For current information, please go to [https://docs.scinet.utoronto.ca https://docs.scinet.utoronto.ca]'''
 +
|}
  
−
The '''MARS''' deployment at SciNet is a combination of 3 software components, HPSS, HSI and HTAR, plus some customization done to our environment.
+
MARS is not more. [https://support.scinet.utoronto.ca/wiki/index.php/HPSS Follow this link]
−
 
 
−
'''HPSS''': the main component, best described as a "blackbox" engine running in the background to support the Archive and Restore operations.
 
−
 
 
−
'''HSI''': it may be best understood as a supercharged ftp interface, specially designed to act as a front-end for HPSS, gathering some of the best features you would encounter on a shell, rsync or GridFTP for example. In general terms it enables user to transfer whole directory trees from our most active file systems, therefore freeing up space in /project and /scratch. HSI is most suitable when those directory trees do not contain too many small files to start with, or when you already have a series of tarballs.
 
−
 
 
−
'''HTAR''': similarly, htar is sort of a "super-tar" application, also specially designed to interact with HPSS, allowing users to auto-magically build and transfer larger tarballs to/from HPSS. HTAR is most suitable to aggregate whole directory trees, provided that no individual files exceed 68GB. The maximum size of any htar file should not exceed 1T either.
 

Latest revision as of 19:37, 31 August 2018

WARNING: SciNet is in the process of replacing this wiki with a new documentation site. For current information, please go to https://docs.scinet.utoronto.ca

MARS is not more. Follow this link

Retrieved from ‘https://oldwiki.scinet.utoronto.ca/index.php?title=MARS&oldid=9413’