churnd 0 Report post Posted December 1, 2014 (edited) Anyone had any experience using iXsystems TrueNAS, specifically in a clustered configuration? Not really seeing any reviews one way or the other & they seem like a pretty good company from what I can see, so just asking around. Edited December 1, 2014 by churnd Share this post Link to post Share on other sites
Brian 157 Report post Posted December 1, 2014 As we discussed on Twitter, we had experienced the Mini version. The platform is open, which is nice, but iX is the only one pushing this commercially I think. I could be wrong on that point however. In our experience though, when compared to other SDS solutions, is that FreeNAS is much more aligned with the admin who wants to get deep into the config and tinker a ton. With so many other options that are supported by a wider array of vendors, there may be other solutions for you to consider. Can you tell us more about what you're trying to do and what your budget constraints are? Share this post Link to post Share on other sites
churnd 0 Report post Posted December 1, 2014 (edited) As we discussed on Twitter, we had experienced the Mini version. The platform is open, which is nice, but iX is the only one pushing this commercially I think. I could be wrong aunthood point however. In our experience though, when compared to other SDS solutions, is that FreeNAS is much more aligned with the admin who wants to get deep into the config and tinker a ton. With so many other options that are supported by a wider array of vendors, there may be other solutions for you to consider. Can you tell us more about what you're trying to do and what your budget constraints are? I'm coming from a long Nexenta history (I have used it in prod), but the latest "feel" in the Solaris world is not very good in my opinion so I want to consider other options. I want ZFS in a commercially supported platform that is cluster-able. I don't know of any other "turnkey" appliances other than Nexenta or TrueNAS. EMC, no. Netapp is too expensive. Want to stay with ZFS. Won't touch Oracle with a 10' stick. Edited December 1, 2014 by churnd Share this post Link to post Share on other sites
Brian 157 Report post Posted December 1, 2014 Tegile? Share this post Link to post Share on other sites
Kevin OBrien 58 Report post Posted December 1, 2014 I think the problems you are running into are widespread in the SDS market at large. Yes you can get a huge feature-set for a very low cost, but it still comes up below where the tier1 storage vendors play. A huge part of the reason why NetApp, EMC, etc cost so much is the R/D that goes into making them nearly bulletproof and very high performance systems. Share this post Link to post Share on other sites
churnd 0 Report post Posted December 1, 2014 Tegile? Never heard of it. Looks Windows based. I've heard that TrueNAS is not the same feature-wise as FreeNAS. That TrueNAS is tweaked for enterprise SAN use already & engineered more towards production VM storage. FreeNAS is more for home or SMB NAS use. Share this post Link to post Share on other sites
Brian 157 Report post Posted December 1, 2014 It's FreeNAS for Business. Tegile is ZFS. http://www.tegile.com Netgear has ZFS solutions too if your needs are more modest. Share this post Link to post Share on other sites
churnd 0 Report post Posted December 1, 2014 It's FreeNAS for Business. Tegile is ZFS. http://www.tegile.com Netgear has ZFS solutions too if your needs are more modest. Never heard of Tegile either. Netgear ReadyNAS uses ZFS? Isn't that Linux? I'd pick FreeBSD over Linux for ZFS. Share this post Link to post Share on other sites
Kevin OBrien 58 Report post Posted December 1, 2014 What sort of budget are you working with? Share this post Link to post Share on other sites
churnd 0 Report post Posted December 1, 2014 What sort of budget are you working with? Under $50k. I won't go with EMC or NetApp. They are overpriced & not without their problems. I've been there. ZFS all the way. Share this post Link to post Share on other sites
Kevin OBrien 58 Report post Posted December 1, 2014 Which ZFS features are you going for? On the performance side ZFS seems to hold things back on everything we have tested with it compared to other systems. On the FreeNAS side, comparing the 4 bay NAS they have with a 4 bay Synology, random throughput is 4x higher on cheaper platforms with much less hardware thrown at the equation. What are your performance goals? What are your capacity needs? In that under 50k pricepoint, I would be looking at only a handful of systems, but it comes down to which features you really want to leverage. The EMC VNXe at 11k starting is probably the best piece of kit you can buy at that lower price band. As you start moving up the Nexenta platforms start to be competitive depending on overall needs. Heck you can even find some all-flash systems sub 35k now from 3PAR and Dell Storage. Share this post Link to post Share on other sites
churnd 0 Report post Posted December 1, 2014 (edited) Which ZFS features are you going for? On the performance side ZFS seems to hold things back on everything we have tested with it compared to other systems. On the FreeNAS side, comparing the 4 bay NAS they have with a 4 bay Synology, random throughput is 4x higher on cheaper platforms with much less hardware thrown at the equation. What are your performance goals? What are your capacity needs? In that under 50k pricepoint, I would be looking at only a handful of systems, but it comes down to which features you really want to leverage. The EMC VNXe at 11k starting is probably the best piece of kit you can buy at that lower price band. As you start moving up the Nexenta platforms start to be competitive depending on overall needs. Heck you can even find some all-flash systems sub 35k now from 3PAR and Dell Storage. Compression, checksumming, unlimited snapshots, etc, etc. Too many features to list. I want ZFS because I know ZFS & ZFS doesn't lock me into storage. The initial price point of EMC & NetApp is not too bad in some cases, agreed. It's the support contracts that get you. Like I said before twice, no thanks. Not interested in 3PAR or Dell Compellent or anything else like that either. Performance goals? Something ideal for running about 20 VMs. Fully plan on taking advantage of SSD cache ZIL/L2ARC. Capacity? 20TB raw should do it Plan right now is to share storage out to a Proxmox Cluster via NFS. Not touching iSCSI. The original post was simply "Anyone had any experience using iXsystems TrueNAS, specifically in a clustered configuration?". That's still the question. Edited December 1, 2014 by churnd Share this post Link to post Share on other sites
Brian 157 Report post Posted December 1, 2014 You clearly have your goals, that's great. We haven't done the work with iX per your initial question, that relationship cooled considerably after the Mini review we did...they didn't enjoy it and pulled back. It would be great if someone turns up to help you, I hope you find what you're looking for. Share this post Link to post Share on other sites
pjrobar 0 Report post Posted December 1, 2014 (edited) Never heard of it. Looks Windows based. I've heard that TrueNAS is not the same feature-wise as FreeNAS. That TrueNAS is tweaked for enterprise SAN use already & engineered more towards production VM storage. FreeNAS is more for home or SMB NAS use. I recently asked Dru Lavigne about this and she said that, feature wise, TrueNAS and FreeNAS are the same except for a couple of things: 1) TrueNAS doesn't have plugins and 2) TrueNAS has support for the features of the cases they use: things like intrusion detection and blinking lights. Otherwise they are the same. Edited December 1, 2014 by pjrobar Share this post Link to post Share on other sites
churnd 0 Report post Posted December 1, 2014 I recently asked Dru Lavigne about this and she said that, feature wise, TrueNAS and FreeNAS are the same except for a couple of things: 1) TrueNAS doesn't have plugins and 2) TrueNAS has support for the features of the cases they use: things like intrusion detection and blinking lights. Otherwise they are the same. That's interesting because TrueNAS supports clustering & FreeNAS does not, at least from within the GUI. I have also read that TrueNAS had extra tuning done tailored to SAN performance (more aggressive settings due to improved hardware & environment). Share this post Link to post Share on other sites
Brian 157 Report post Posted December 2, 2014 Have you seen this chart that compares the two? http://www.freenas.org/for-business/ Share this post Link to post Share on other sites
churnd 0 Report post Posted December 2, 2014 Have you seen this chart that compares the two? http://www.freenas.org/for-business/ I think that's what I must have seen before. "Performance Tuning". Share this post Link to post Share on other sites
dilidolo 0 Report post Posted December 5, 2014 (edited) Compression, checksumming, unlimited snapshots, etc, etc. Too many features to list. I want ZFS because I know ZFS & ZFS doesn't lock me into storage. The initial price point of EMC & NetApp is not too bad in some cases, agreed. It's the support contracts that get you. Like I said before twice, no thanks. Not interested in 3PAR or Dell Compellent or anything else like that either. Performance goals? Something ideal for running about 20 VMs. Fully plan on taking advantage of SSD cache ZIL/L2ARC. Capacity? 20TB raw should do it Plan right now is to share storage out to a Proxmox Cluster via NFS. Not touching iSCSI. The original post was simply "Anyone had any experience using iXsystems TrueNAS, specifically in a clustered configuration?". That's still the question. Can't answer your question about TrueNAS, but Tegile has everything you list here. I think you can get clustered config with 26TB raw space with a few SSDs cache, 10Gb nic, for $20000 list price. No, it's not Windows based, it's ZFS with working dedup, and SMB 3. I worked in a large university here and we used Tegile for our VDI environment with thousand VMs, performs very well. Edited December 5, 2014 by dilidolo Share this post Link to post Share on other sites
Brian 157 Report post Posted December 5, 2014 I already tried that dili and the OP declined to investigate Share this post Link to post Share on other sites
churnd 0 Report post Posted December 5, 2014 I already tried that dili and the OP declined to investigate Who said I declined to investigate? I just said my original question was about something else. Share this post Link to post Share on other sites
churnd 0 Report post Posted December 5, 2014 Can't answer your question about TrueNAS, but Tegile has everything you list here. I think you can get clustered config with 26TB raw space with a few SSDs cache, 10Gb nic, for $20000 list price. No, it's not Windows based, it's ZFS with working dedup, and SMB 3. I worked in a large university here and we used Tegile for our VDI environment with thousand VMs, performs very well. Who's your reseller? Share this post Link to post Share on other sites
Brian 157 Report post Posted December 5, 2014 Who said I declined to investigate? I just said my original question was about something else. LOL - okay, you didn't seem inclined to pursue even though it met many of your needs. That's probably more fair. Have you been able to drum up any info on your initial request? Share this post Link to post Share on other sites
dilidolo 0 Report post Posted December 5, 2014 Who's your reseller? I'm in Canada and we bought from Tegile directly. Share this post Link to post Share on other sites
jgould 0 Report post Posted February 9, 2015 (edited) I think people are missing the real reason (s) zfs is so interesting and popular in business. It has very little to do with the traditional sense of "performance". Performance means very little when the data isn't reliable. There are still only a handful on systems I would truly consider for real enterprise use where the integrity of your data is of up most importance. Many of them have their roots in zfs. For instance take a look at nimble storage. Or as mentioned Tegile, which is modified version of ZFS (mostly for effective dedup). Or GreenBytes which Oracle bought again primarily for their modified ZFS for dedup. I have to agree with OP, I wouldn't want to deal with EMC, NetApp, or other so called teir 1 providers. Unless you like being bent over a barrel. Ever need to add storage to a SAN years later? How much markup $/GB did that cost you? Reliability? Hah! Because they've never had controller failures, buggy firmware, and so on. I know people that have lost 100s of TB's of data on EMC because of an EMC fault. If your not looking for the fastest storage or the cheapest storage TrueNAS is more than capable. Personally I still prefer to roll my own though. Edited February 9, 2015 by jgould Share this post Link to post Share on other sites
Brian 157 Report post Posted February 10, 2015 If you don't require top-tier performance, then ZFS does offer a deep feature set. Really just depends on what you're after. Share this post Link to post Share on other sites