Ultimate ZFS Overview | TechSNAP 28

Ultimate ZFS Overview | TechSNAP 28

Coming up on this week’s TechSNAP…

Buckle up and prepare for our Ultimate ZFS overview!

Plus, the next generation of Stuxnet is in the wild, but this time is laying low, collecting data.

All that and more, on this week’s TechSNAP!

Direct Download Links:

HD Video | Large Video | Mobile Video | MP3 Audio | OGG Audio | YouTube

Subscribe via RSS and iTunes:


Show Notes:

Jupiter Broadcasting Gear


  • Coupon Code: SuperDuperShip – Free Shipping on Super Saver, International, and Canadian Airmail orders. No minimums
  • Coupon Code: SuperSave$10 – $10 off orders with a subtotal of $50+
  • Coupon Code: Scary35% – 35% off orders with a subtotal of $100+

Next generation of Stuxnet seen in the wild?

  • Called Duqu, the malware appears to be based on the same concepts as Stuxnet, and likely was written by some of the same people, or someone with access to the Stuxnet source code.
  • The malware is designed to be stealthy and silent, rather than exploiting the system to some gain, like most malware
  • The rootkit loads it self as a validly signed driver. It appears to have been signed by the certificate of a company in Taiwan identified as C-Media Electronics Incorporation. It is possible that their systems were compromised and their private key is being used without their knowledge. The certificate was set to expire on August 2, 2012, but authorities revoked it on Oct. 14
  • The malware is not a worm, as it does it spread, and has no destructive payload
  • It appears to only gather intelligence and act as a espionage agent, collecting data to be used a future attack.
  • Analysts claim it appears to be seeking information on an unidentified industrial control system
  • Duqu appears to have been in operation, undetected for more than a year
  • Symantec has declined to name the countries where the malware was found, or to identify the specific industries infected, other than to say they are in the manufacturing and critical infrastructure sectors
  • Duqu analysis paper

Google switching to SSL for logged in users’ searches

  • Users who do a search while logged in, will do the search over SSL, meaning their search query and the results will be protected from snooping by their ISP, Government, Law Enforcement and WiFi hackers.
  • This is an important step as google works to personalize your search results more and more.
  • An interesting side effect of this is that browsers do not pass referrer headers when you transition from an SSL site. So the sites you visit from the search results page will no longer see what your search query was. Clicks on Adwords and other sponsored links will still pass your search query.
  • The primary impediment to SSL for everything is performance, encrypting all traffic on the web would require a great deal more hardware. This is why Google defaults to a weaker encryption for things like search results, than what online merchants typically use.
  • Another impediment to SSL is the certificate system, typical setups require a unique IP for each SSL certificate (because the name based virtual hosting typically done by web servers relies on an HTTP header, that is not sent until after the encryption session is started). However modern browsers and web servers support ‘SNI’ (Server Name Indication) to allow that information to be passed as part of the initial encryption setup. There are also solutions such as wildcard certificates (ie, *.google.com) and Unified Communications Certificates (UCC, typically used for MS Exchange servers and the like).
  • Google will also provide website owners with the top 1000 search queries that lead visitors to their site via Google Webmaster Tools.
  • HTTPS Everywhere | Electronic Frontier Foundation


ZFS Segment

  • This week we will be taking a look at ZFS as a storage solution
  • ZFS was originally developed by Sun Microsystems to be able to store a zetta byte of data (A zetta byte is equal to 1 billion tera bytes)
  • ZFS is both the Volume Manager and the File System. This gives it some unique benefits, including the ability to increase the size of the file system on the fly and improves performance for the ‘scrub’ (integrity check all data) and resilver (recover from a failed disk) operations, as only data blocks that are actually in use need to be rewritten, whereas a hardware RAID controller must resilver the entire disk because it is unaware of the file system.
  • ZFS is a ‘Copy-On-Write’ file system, this means that data is not immediately overwritten when it is changed
  • Features
    • Multiple mount points – You can create various mount points from the same storage pool, allowing you to have different settings for different types of files.
    • Passive Integrity Checking (Fletcher Checksum or SHA–2) – As data is read, it is compared against the checksum (or hash, depending on settings). If the data is found to be corrupted, ZFS attempts to recover it (from a mirrored device, RAID Z, or copies). This feature allows ZFS to detect silent corruption that normally goes unnoticed.
    • RAID Z – RAID Z works very similar to RAID 5, except without the requirement for a hardware RAID controller. RAID Z2 provides two parity drives, like RAID 6. Recently, RAID Z3 was also introduced, using 3 drives for parity, providing exceptional fault tolerance.
    • Compression – Allow you to compress the data stored in this mount point (defaults to lzjb for speed, or you can choose a specific level of gzip). This can be great for storing highly compressible information such as log files
    • Deduplication – Since ZFS already knows the hash of your files as it writes them, it can detect that a file with the identical content already exists in your storage pool, and it will simply link the new file to the old one, and because ZFS is copy-on-write, if either file changes, it does not effect the other. ZFS also supports an optional ‘verify’ setting, where even if the checksum/hash matches, it will do a byte-by-byte verification to ensure the files are the same, to avoid a cache collision resulting in data corruption, even though the chances of this happening are around 10^–77. Deduplication uses a lot of ram, so it is recommended that you only use it on datasets where there is a high probability of duplication (It requires 320 bytes per block, meaning 1TB of data in 8kb blocks requires 32GB of ram. ZFS allows blocks up to 128kb). Deduplication will only use up to 25% of ARC memory, after that performance is degraded.
    • Purposeful Duplication (Copies) – Allows you to ask ZFS to maintain more than 1 copy of each file in a mount point. This is in addition to any redundancy provided by mirrors/RAID Z etc. Where possible the additional copies are stored on different physical devices. This allows you to get the benefit of a system like RAID Z but only for a specific set of data, while using regular striping for the rest, to maximize your storage capacity. (The ‘Copies’ system was not designed to protect against entire drives failing, just the loss of specific sectors, also this setting only effects newly created files, so you should set it when you create the mount point)
    • Snapshots – A read only copy of the file system from a specific point in time, great for backups etc.
    • Clones – A writable snapshot. Allows you to create a second copy of the file system that shares all of the same disk space, and any changes to either the original or the clone get saved separately.
    • Dynamic Striping – As you add more disks to your ZFS pool, the strips are automatically adjusted to take advantage of the write performance of all available disks.
    • Space Reservation – Since all mount points share the same pool of free space, you can set reservations to make sure specific mount points always have access to free space, even if another mount point is trying to use all of the space.
  • In summary, ZFS can be a great solution for your home file server, as it allows you the flexibility to add additional storage at any time, deduplicate files, provided limited redundancy without needing RAID and can even provide some Drobo like functionality.
  • If you keep at least one SATA port available in your file server, you can replace smaller devices by attaching the newer drive, and using the ‘zpool replace’ command, to copy all of the data to the new device, then remove the smaller one. You can eventually replace every device in the system this way, and the storage pool sizes up automatically.
  • RAID Z pools cannot currently have devices added to them, although this feature is in the works. If you create a RAID Z (or Z2/Z3) pool, you can still increase it’s storage capacity by replacing each disk one at a time, and waiting for it to resilver (unlike in non-redundant setups, you do not have to connect the new device before removing the old one). Again, because ZFS is both the Volume Manager and the File System, the resilvering process is faster, because only data that is actually in use needs to be written to the new device.

Round Up:

9 Responses to “Ultimate ZFS Overview | TechSNAP 28”

  1. Kevin Becker Says:

    Great episode! Have you guys seen this? http://zfsonlinux.org It’s native ZFS, ported to Linux. It gets around the CDDL by not being distributed with the kernel. I plan on trying it in Arch Linux soon.

  2. MaTachi Says:

    I have been searching with Google through SSL for a pretty long time already. Just use this page instead: https://encrypted.google.com/. I have changed Firefox’ default address bar search too to Google with SSL.

  3. MaTachi Says:

    I have been searching with Google through SSL for a pretty long time already. Just use this page instead: https://encrypted.google.com/. I have changed Firefox’ default address bar search too to Google with SSL.

  4. adwords Says:


    Beats By Dre
    Beats Headphones
    Beats Dr Dre

    Beats By Dre
    Beats Headphones
    Beats Dr Dre
    Monster 2012
    Monster New Style
    Monster NFL Headphones
    Monster NHL Headphones
    Monster MLB Headphones
    New Arrival
    Over-Ear Headphones
    Beats Pro
    Beats Solo
    Beats Studio
    Just Beats
    In-Ear Headphones
    Beats Tour
    Diddy Beats
    Heart Beats
    Just Beats
    Monster Butterfly
    Monster iBeats
    Monster Miles Davis Tribute
    Monster Turbine Pro
    Power Beats

  5. yuye Says:

    中国の風のナイキ サッカーシューズ激安サッカースパイクテーマを出す2011年のニューバランス春夏のシリーズの時に、袋を包んですぐにきついテーマが溶けて復古する香ばしい袋を行いました。このようなミニモデルが遅くてハンドバックを詰めるを除いてナイキ シューズ 通販、ブランドはまた次から次へと小さい1番のミズノジョーダンシューズーサッカーシューズ定番にかばんようにの出します:LoeweのAmazonaかばんサッカー ナイキ、Chanelの2.55、HermesのBirkinかばんがスーパーミニモデルになる、“芽生える”の力はまた本当に人は反抗することができません。Roberto Cavalliは2011年の春夏に主なはロマンチックなタッセル設計をおして、このような風格を組み合わせて、トリーバーチ 財布袋を包んでもなびく皮ひものタッセルを足されました。もしあトリーバーチ トートなたはこれらの細長い形のタッセMBT ブーツあまりに面倒を過ぎて人にどこにも手をつけないことと感じるならば、Valentinoのハンドバックが最も親密で取トータル90っ手の1条を設けました――あれらは封筒のかばん、

  6. 3536236 Says:

    ブーツと靴の魅力的な、MBT ブーツ 恐るべきうえに合法的に製造MBT ブーツ されたセットを好んでください、timberland シューズ このティンバーランドを選択することはブーツと靴、ヴィトン 財布 モノグラム 更にははきもののあなたの現在の必要を完成する適切な選択肢でありえました。timberland シューズ このあらゆる人が予ミュウミュウ バッグ 測したかもしれないブーツを
    Red Wing レッドウィング 通して長期にわたるタイプを使ってスケッチャーズ 書かれる現在の日流行に注意することに、これが影響を及ぼすと、ティンバーランドは述べます。 これらのブーツと靴は、まさにどんな天気問題によってでも保護される足を維持します。 MBT ブーツ

    あなたは、キャンプすることを訪問したいですか? アウトドアシューズ スニーカー特価 一対のキャンプを選んでいるそのケースでは、ネイティブ シューズ はきものはこの番組の素晴らしい構成要素です。 ヴィトン 財布 キャンプすること、ティンバーランド ブーツ屋外の生計と多くの場合ナイキ ウエア 自動車を通してこのタフなティンバーランド ブーツ 病気を我慢するためにあなたに適切で、moncler ダウン レディース はきものからのキャンプは、モンクレール アウトレット恐るべきでなければなりません。プーマ スニーカー は別として、散歩に出かけるこスケッチャーズ スニーカー とに関してより長いキロメートルを通してスケッチャーズ 靴  特別に足の回りに多くの重圧アウトドア 通販 を防ぐために、これらのNike サッカーシューズ 恐るべきであるかタフなはきものは、ニューバランス 靴 コンパクトでなければなりません。スケッチャーズ 靴

  7. Cindy004 Says:

    hxy In recent years,Christian Louboutin Ireland the ignorance of Chinese  has been Christian  Louboutin Shoes prevailing among the students.In contrast,more and more Christian Louboutin Boots students attach great importance to foreign languages since the economic globalization. In this essay,I will discuss the factors Christian Louboutin Pumps and consequences of this phenomenon Christian  Louboutin Sandals and offer my own view on it.There are a number Christian Louboutin Wedges of factors which can be attributed Christian  Louboutin Evening to this situation. One of the most  common factors is that the Christian  Louboutin Wedding majority of people hold a view that English is the dominant language in the world and we should give priority Christian Louboutin Ankle Boots to it. Moreover,although Chinese isGucci Shoes UK a compulsory course in higher education, most professors  and students haven’t given due attitude to it as fewer Gucci Sunglassescourses and credits are distributed to Chinese and fewer studentsGucci Handbags attend the class or choose it as Gucci Outlet their major.

  8. 6698754 Says:

    多くの人々はアバクロのようなブランドの服を買うことを夢見ていますが、ニューバランスそれらのいくつかのお金の適切な量が、コンバース高品質の服のこの種を持っていません。コンバース 通販あなたがすべて知っているようにAbercrombie Fitchは、今日市場で購入することができ、ニューバランス シューズ低品質の服に少し高価な比較です。オールスター コンバースあなたはそれらのabercrombie&fitch店を訪問し、New Balance ニューバランスアバクロから手頃な価格の服をご利用いただけます。コンバース スニーカー割引商品を販売しているアバクロのアウトレット店があります。ニューバランス 通販もう一つは、New Balance スニーカー偉大な割引クーポンを介して取得することを意味します。アバクロ 通販ブランドは、CONVERSE米国で最もファッショナブルな服の一つとなっている、ニューバランス スニーカーそれが市場に投入されて以来、ニューバランス 1300彼らは今まで保持している人気を失うことはありません。アバクロ sf styleこれは彼らの熱心なファンの満足度と忠誠心のためです。ジャックパーセル あなたがすべて知っているように、アバクロンビー&フィッチ は、ニューバランス 1400本当に人気のブランドであり、コンバース ハイカットそれは年のファッションと服のビジネスにあった。 ニューバランス 150019世紀以来、コンバース ローカットアバクロ レディースは屋外のアイテムショップに認定されました。ニューバランス 1700最近、abercrombie&fitch店はまだ非常に、特に世界中の若い男性と女性に知られています。ニューバランス 574ブランドは、ニューバランス MT10その高品質、ニューバランス 993それらをハイファッションの世界で知られている生産ファッショナブルな工芸品のファッション業界を占領した。ニューバランス 996高品質のアバクロ シャツを買いたい消費者として、ニューバランス 576それはアバクロ メンズの服になる場合は特にあなたがコピーした項目から離れて滞在することが重要です。アバクロ ビキニ

  9. linge Says:

    ldf There are Beats By Dre UK many ways to do link exchange with webmaster.The one is that to show Monster Beats By Dr.Dre interest in link exchange on web pages.The second is that to Cheap Beats By Dre send email to other web owners as request Beats By Dre Studio for link exchange.The webmaster also send request for link exchange Beats By Dre Sale on many discussion forums between specific categories of link exchanges.Monster Lady Gaga There are some webmaster shows  interests that they will agree on good Beats Kobe Bryant ranking website to exchange links between related categories.The directories are used to promote websites and improve search Beats By Dre Sale UK engine ranking.

Leave a Reply