Sign in to follow this  
Followers 0
snahl

seeking MoBo to run 3 controllers PCIe (gen3) at 16x, 8x, 8x without b

17 posts in this topic

Hello,

I need to build a powerful Graphics-Workstation (Windows7-64 prof.) for Video editing.

WS shall be equipped with one professional graphics controller (PCIe 16x) and 2x LSI MegaRAID-9270-8i controllers (both at PCIe 8x) reuslting in two RAID5-Arrays consisting of 8 drives each.

The workload is as follows: Large files 2-6GB+ (sometimes several) are read from any of the 2 LSI MeagRAIDs while (often at the same time) Video-sequences are cut, pasted, rendered etc..

No other PCIe slots will be used.


I find it hard to find a suitable motherboard that supports PCIe Version 3 without bandwidth limitation on any of the PCIe-lanes or slots.


Which Motherboard(s) would conform to (or best meet) the setup described?


Chipset Z87 supports PCIe Ver 3, but most boards I've seen multiplex the lanes with a PEX8747 chip.

AFAIK Chipset X79 supports PCIe Ver 2.

However, I would think the primary bottleneck might be the disk-write-speed (despite an 8-drive RAID5-array). Therefore a MoBo with PCIe Ver 2 would probably do the job as well.

But which one?

Any other thoughts or suggestions?


Your advice is highly appreciated.

Thanks


Share this post


Link to post
Share on other sites

Have you considered infusing any flash into the rig? You're the target use case for many vendors who want to tap into the creative space.

Share this post


Link to post
Share on other sites

On the motherboard side, there are quite a few options available and honestly I wouldn't look any farther than Supermicro. This is one example that would work, although maybe not their best offering for this usecase:

http://www.storagereview.com/supermicro_superworkstation_5037ai_review

That particular board has some legacy attachments in it, but they do have other models more power-user driven with plenty of PCIe gen3 slots.

Share this post


Link to post
Share on other sites

@Brian

>> infusing any flash into the rig?

I don't quite understand. Dou you mean Flash-Memory like an SSD?

What exactly do you mean?

>> target use case for ... the creative space

Exactly -.You hit the nail on its head!

@cppguru

Yes, we do consider the ASUS P9X79E-WS.

Apparently this board does support PCIe Version 3.0!

In contrast to Intels specification of the Chipset X79: http://www.intel.com/content/www/us/en/chipsets/performance-chipsets/x79-express-chipset.html)

I find this rather confusing.

As of now I have not yet found a block diagram for this MoBo and wonder how ASUS actually implemented PCIe Version 3 into this MoBo.

I'd assume that ASUS (just like Gigabyte, ASRock, EVGA, MSI) are using the Processors Sandy-Bridge-E and/or the Ivy-Bridge (40-lanes PCIe 3.0) via a multiplexer like the PEX8747 Chip.

We're aiming at a Chipset that fully supports PCIe Version 3.0. But I am afraid that does not exist yet.

(hope we're missing something)

Share this post


Link to post
Share on other sites

@Kevin OBrien

You got a point for sure. Supermicro is really great.

Still, I am afraid the Chipset for that broad use case is not here yet.

Guess we have to wait.

Share this post


Link to post
Share on other sites

@Brian

>> infusing any flash into the rig?

I don't quite understand. Dou you mean Flash-Memory like an SSD?

What exactly do you mean?

Yes, flash storage.

Share this post


Link to post
Share on other sites

@SR Admin

Using Flash-Memory and/or storage would make this Graphics-WS even more expensive - but certainly worth to think about twice.

In this scenario PCIe Rev.3 would really take off - so YES, we will take this into more serious consideration.

But then funds are not unlimited.

So we have to propose solutions for 2 scenarios. One for 'current optimal' and one for 'low cost'.

What's your take?

Share this post


Link to post
Share on other sites

Well if you ask guys like Fusion-io or OCZ, they'd love to be selling you flash storage on PCIe to essentially use as your high-speed scratch disk. Depending on your workflow though, that may not solve your pain point. If you're issue is transferring to/from your permanent storage warehouse, then local flash isn't going to help. If your issues are waiting around for the PC to compile or do whatever it needs to do, flash can be a big help. Tell us more about your workflow and perhaps we can offer some suggestions as to where flash may help.

Share this post


Link to post
Share on other sites
We're aiming at a Chipset that fully supports PCIe Version 3.0. But I am afraid that does not exist yet.

Is there any specific reason you need PCIe Ver 3.0 X16 lanes? The reason I ask is because you are looking at tops 5% performance difference between PCIe Gen 2.0 x16 lane compared to a PCIe Gen 3.0 x16 lane. Unless you are working with very large datasets (> 4GB per gpGPU), I doubt you will notice much difference between the bandwidth from a practical application standpoint.

Share this post


Link to post
Share on other sites

I have an MSI board running as the head node of a GPGPU cluster built for doing some serious number cruching - not a pro set up mind you, just for some home research.

https://uk.msi.com/product/mb/X79AGD45_8D.html#/?div=Basic

A good value board and has been ultra stable for me so far.If you are using NVIDIA gpu's they have a PCIE 3.0 disclaimer that states its isnt supported with the X79 chipset. There's lots of threads on this on the internet. It should just be a case of getting the correct drivers and config.

Share this post


Link to post
Share on other sites

Areca pci-e 3.0 cards and LSI pci-e 3.0 hba`s works for me with:

Gigabyte x79 ud7 OC and 3930k

Asus Rampage Black x79 with 3930k and 4960x

Evga Dark with 4960x.

Yes I have pci-e 3.0 speeds:

Example: Areca 1883i

1883i8xm3pAnvil.png

1883i8xm3passd.png

Edited by Nizzen

Share this post


Link to post
Share on other sites

Nizzen, which SSD's, how many, and what RAID configuration?

Share this post


Link to post
Share on other sites

Nizzen, which SSD's, how many, and what RAID configuration?

It is 8x plextor m3p in r-0.

The result is high because of the 2gb of ddr3 cache onboard the controller.

Areca 1883ix - 24 8GB next B)

Areca is the best :)

Regards from Areca fanboy

Edited by Nizzen

Share this post


Link to post
Share on other sites

We have some new Areca cards in for testing, we'll see if it's best ;) Looks a lot like LSI.

1 person likes this

Share this post


Link to post
Share on other sites

I hope Areca gets more timely about firmware and driver updates, not to mention hardware compatibility testing-- that's one area we have found Areca severely lacking in timeliness compared to LSI and Adaptec.

Then again the only Areca I currently have in use is an old ARC-1680i, and I think that's going into the dust bin soon because it hasn't gotten a firmware update in 18 months, and the last couple of driver revisions for it never worked-- running a driver a few versions back that does work though, so not a huge deal on the driver. (of course for a card this old, not seeing firmware updates often doesn't surprise me either... time to upgrade!).

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!


Register a new account

Sign in

Already have an account? Sign in here.


Sign In Now
Sign in to follow this  
Followers 0