Network Attached Storage: Difference between revisions

From Iskomunidad
 
(32 intermediate revisions by 4 users not shown)
Line 1: Line 1:
For its backup needs, DILC is initiating a network-attached storage (NAS) project. The goal of the project is to deploy inexpensive, reliable, robust, scalable backup system for DILC's use.  
For its backup needs, DILC is initiating a network-attached storage (NAS) project. The goal of the project is to deploy inexpensive, reliable, robust, scalable backup system for DILC's use. It only uses commodity, off-the-shelf parts and free and open source technologies.  
<br /><br />
<br /><br />
 
__NOTOC__
=Specs=
=Specs and Features=
The system
The system
* uses NAS4free.org
* uses [http://www.nas4free.org/ NAS4free]
* embedded installation (USB)
* embedded installation (USB)
* protocols deployed SFTP, NFS, Samba, AFP, RSYNC
* protocols deployed [http://en.wikipedia.org/wiki/SSH_File_Transfer_Protocol SFTP], [http://en.wikipedia.org/wiki/Network_File_System NFS], [http://en.wikipedia.org/wiki/Samba_(software) Samba], [http://en.wikipedia.org/wiki/Apple_Filing_Protocol AFP], [http://en.wikipedia.org/wiki/Rsync RSYNC]
* intranet only
* intranet only
* ZFS  
* [http://en.wikipedia.org/wiki/Zfs ZFS] (NAS1), [http://en.wikipedia.org/wiki/Unix_File_System UFS] (NAS2)
* Remote Site A: initial rollout: 4TB contiguous space, using 2x2TB commodity hard drives (expandable to 6x2TB; there appears to be a limit to hd size -2TB - before getting errors).
* "hot" expandable (additional 2TB hard drives can be added thereby expanding the current CONTIGUOUS volume; the limit of the number of drives is determined by the number of SATA slots available in the motherboard)
* NAS-to-NAS syncing
<br /><br />
==Deployment==
In April 2013, the initial NAS configuration for Remote Site B includes a 4TB contiguous space, using 2x2TB commodity hard drives. There appears to be a 2TB-limit to individual hard drive without getting errors. "Hot swap" addition of 2TB drive was done on 8 June 2013 bringing the total size of the contiguous drive to 6TB.
 
 
Remote Site B backup is meant to cope with backup requirements that now exceed the capacity of Remote Site A (as of 21 April 2013):<br /><br />
[[Image:Df_sh_of_remote_site_A.png]]
 
 
By far DILC storage requirements appear to grow at a rate of about 1TB a month.  
<br /><br />
 
=Reviews=
*[[Download/Upload Traffic Load using NFS, AFP, CIFS/SMB and SFTP]]
<br /><br />
<br /><br />


Line 17: Line 32:
* Don Cadavona
* Don Cadavona
* Thaniel Jay Duldulao
* Thaniel Jay Duldulao
* Nick Tunac  
* Dominick Tunac  
<br /><br />
 
=Components and Costs=
* old PC with a year or two expected life left
* commodity 2TB driveS: Php 4,935 per drive (x number of drives)
<br /><br />
<br /><br />


Line 24: Line 44:
* throughput optimization
* throughput optimization
* persistent automount
* persistent automount
 
* peer-to-peer syncing of files via direct private torrent
* NAS-to-NAS folder auto-syncing
<br /><br />




[[Category:DILC Matters]][[Category:DILC Projects]]
[[Category:DILC Matters]][[Category:DILC Projects]]

Latest revision as of 18:04, 26 July 2013

For its backup needs, DILC is initiating a network-attached storage (NAS) project. The goal of the project is to deploy inexpensive, reliable, robust, scalable backup system for DILC's use. It only uses commodity, off-the-shelf parts and free and open source technologies.

Specs and Features

The system

  • uses NAS4free
  • embedded installation (USB)
  • protocols deployed SFTP, NFS, Samba, AFP, RSYNC
  • intranet only
  • ZFS (NAS1), UFS (NAS2)
  • "hot" expandable (additional 2TB hard drives can be added thereby expanding the current CONTIGUOUS volume; the limit of the number of drives is determined by the number of SATA slots available in the motherboard)
  • NAS-to-NAS syncing



Deployment

In April 2013, the initial NAS configuration for Remote Site B includes a 4TB contiguous space, using 2x2TB commodity hard drives. There appears to be a 2TB-limit to individual hard drive without getting errors. "Hot swap" addition of 2TB drive was done on 8 June 2013 bringing the total size of the contiguous drive to 6TB.


Remote Site B backup is meant to cope with backup requirements that now exceed the capacity of Remote Site A (as of 21 April 2013):


By far DILC storage requirements appear to grow at a rate of about 1TB a month.

Reviews



Development Team

  • Ma. Cristina Dalupan - Team Leader
  • Raff Alimbuyuguen
  • Don Cadavona
  • Thaniel Jay Duldulao
  • Dominick Tunac



Components and Costs

  • old PC with a year or two expected life left
  • commodity 2TB driveS: Php 4,935 per drive (x number of drives)



To Dos

  • Webdav integration
  • throughput optimization
  • persistent automount
  • peer-to-peer syncing of files via direct private torrent
  • NAS-to-NAS folder auto-syncing