Hi there, I'm running esxi on my home server and I'm slowly coming to the conclusion that there are more discrete PCIe devices (low-power GPUs, USB-cards, SATA-controllers) that I'd like to pass through to individual VMs than my mainboard can provide PCIe slots for. How would esxi handle PCIe bifurcation or riser systems like this? Could I pass through all PCIe devices connected to these kinds of systems to individual VMs or could I only pass through the "original" slot on the motherboard? To clarify, I'm not worried about bandwidth here since I'm neither using high-power GPUs nor 10Gbit ethernet adapters nor NVMe-storage, so I'd be fine with having 16 PCIe x1 slots instead of one PCIe x16 slot. Thanks!
A story from a cloaky camper and an attempt to build a beast mode multi-boxing server.
21/04/2018 Hello Nerds!
Some of you may know me, some may not. Those that do will know I offer cloaky camping services over new eden. I do camping contracts / extort renters and focus my time hunting botters when the contracts are quiet. I offer PvP entities access to my cyno network to get dank kills and big escalations. From super carriers to Rattlesnakes.
The thing that got me into camping was hunting bots back in the dronelands a few years ago. I realised the most effective way to hurt them was to camp them 23/7, follow them around using locator agents. Eventually they had to rat with me in system. When they did I setup bubble traps etc and dropped blops and cleaned them up.
The 2nd thing I love about cloaky camping is the ability to counter Alliances (i feel its overpowered) intel channels / networks. Think about it. They have multiple intel toons dotted around the entrances to their pipes reporting hunters coming into the pipe allowing the PvE players to warp off and safe up. They even use external programs to collect this intel and give audible alerts. Cloaky camping is just the polar opposite. Dotting toons in their ratting pocket and giving me intel on whats going on in their system. As long as local chat exists so will cloaky camping. I'm pretty confident CCP share the same thought.
People probably think cloaky camping is easy. You are wrong. The prep work and behind the scenes work that goes into it is pretty immense. You are about to find out.
The hardware i'm currently running the 60 clients on is as follows:
How do you pay for 60 toons I started with 10 campers and made ISK by other means. When I made new campers I invested ISK and started to Skill extract and plexing the toons. I also make a decent amount from people who pay me to camp others.
The Setup I manage the clients window positions and CPU allocation with ISBOXER. Its legal to use as long as you don't use input broadcasting. I boot up the clients with ISBOXER EVE Launcher. I copy the window positions / chat channels etc over using garpaui. I use remote desktop to manage the clients light cynos etc. Example here
On both motherboards I had to under clock the processors as they were drawing too much power from the motherboard and causing the chipset to overheat. I think these motherboards are not beefy enough to support these 8 core processors. It caused the CPU to throttle reducing the clock speeds to 1.3Ghz and causing lag issues. I solved this problem by reducing the clock speed from 4Ghz to 3.6Ghz and reducing the CPU voltage. This reduced the heat by a really good amount and stopped the problems.
However, Me being me I wanted to expand and the camping pcs were running at full chat. So I needed a better piece of hardware to host these 60+ clients. So, while at Fanfest, I bidded on this R820 Server on ebay and won!
Dell R820 Server
Processor: 4 x E7-4870 2.40Ghz 10-CORE 40 Cores and 80 Threads
RAM: 64 GB ECC DDR3 Ram
Raid Controller: PERCH700
PSU: 2 x 1100W
The hardware should be able to support multiple clients. However i'm not too sure how eve is going to behave when I try and open 60 instances all in one OS. I have set myself up for a hell of a challenge! However, I feel like I got a pretty good deal on the server and DELL hold their value. I'm sure I can re sell it if the project fails.
Things to work out:
Install a Consumer GPU into the server somehow / buy an overpriced Quaddro / GRID gpu / modify a Geforce to appear like a Quaddro (some use the same hardware)
How to host the clients? Hypervisor or native all on one OS
Where to put it (noisy)
Things I will teach you guys
Modifying the PSU to give the GPU power (soldering perhaps)
How to setup ISboxer
How to setup IS boxer eve launcher
How to copy one Toon's UI , window positions, chat channels to 60 clients.
Update 23/04/18 I have made some decent progress on this crazy project. I will give some breif updates here. I will get a blog up and running to post full details with how to's etc. Its probably way to long for reddit.
I have successfully installed some GPU's into the R810 AMD R9 280x and Nvidia GTX 970. I soldered some PCI-E cables to the PDB and it worked fine. The GTX sits nicely in the chassis however, the R9 280X is external atm using a PCIE x1 to x16 riser (from my bitcoin mining). Also I have managed to enable and use them both with passthrough in ESXI 6.5. Yes the GPU works with a x1 adaptor. WTF!
Freezing Problem with a single os install If I try and run more than 40 clients in a single OS I the system freezes when loading up client 41. I have tried the following:
Windows 10 / Windows server 2016 OS's
Virtual windows 10 OS
Using multiple instances of the Shared Cache
Installing EvE to a RAM drive
Removing / enlarging page file
I cannot see why it is freezing. Is there any way to gather logs for the client? It doesn't appear to be a resource problem. Plenty of RAM / CPU and HDD isn't going crazy.
Here are some pics of the current progress:
Soldered the PCI-E power cables to the Power Board 1234
Need some troubleshooting help! Riser 008s and R3c
This project isn't for gpu mining but I know these risers are mainly used for this purpose so I thought I might get some good feedback here. My project is that I have an itx board with a single x16 pcie slot. It also has 3 m.2 pcie gen3 x4 slots. I have one free m.2 slot and wanted to convert that to x16 via riser. I wanted a 2nd low power silent gpu added to the rig. I went with the fanless msi 1030. It has a max draw of ~30w so I figured sata power would be safe. I purchased this and this to test with. Neither work!! So it must be something on my end?? The first part is fairly standard, the difference being I'm going to a m.2 slot where most of you are coming from x1 or x4. "In theory" this should just work! I'll start with the 2nd part since it's very simple: m.2 connector -> x16 socket + sata power. I hooked this up, seated the gpu and booted up. Nothing. Not even bios. I pulled the gpu and booted. Bios worked and booted up (running a 1080ti direct on the board). Installed the gpu back and nothing. I bought the 1030 used so I pulled the 1080ti and installed the 1030 direct to the mb. Works! So then I thought maybe the riser is bad or that sata power is insufficient seeing that most gpus would also have 6+8pin direct whereas mine has no external power. So I swapped risers out. This time the 008s with additional power connectors. Exact same thing. First I powered via pci only. Then sata+pci. And finally sata+pci+molex. In all situations the red led lit up. In all situations if I do not have the gpu plugged in it boots up fine. The strange thing is I never get into bios. No speaker or post lcd on this board so my troubleshooting is limited. And to note I test both gpu hdmi ports just to make sure one vs the other was set to primary. I got lazy and just looked at my mouse to light up to see if it booted. The mouse stayed dark, implying it never posted. Any help would be greatly appreciated! solved I have two m.2. ports which are pcie only. I have 1 port that is pcie/sata. the suggestion by u/sqrtlurface was to use the pcie/sata port and now the 1030 is being recognized in both linux and windows.
A heads up to those wanting to use PCIe splitters/switches.
Well, after 129 miner restarts in SMOS I've finally gotten my 8 GPU rig mining stable for 16 hours straight. I'm using Supermicro boards in my operation to have IPMI and limit having to move rigs or monitors around to troubleshoot. Once the kinks are worked out its great! Anyways my board only has 7 PCIe slots so I've been experimenting with splitters to get me to 8 cards. Its been a long road. I started with a couple of those x1 into 4 USB cards which kinda worked if I was running less than 6 total GPUs and no more than 2 cards on each splitter. They are funky. I could run 4 on the board and 2 on the splitter for days but if I added 2 more to the board I had constant crashes. I spent an immense amount of time messing with the PCI gen, MCFG setting (base address for PCI devices) with mixed results. Finally as I gave up yesterday and put 2 cards back in another rig my x16 to 8 USB splitter finally arrived! I threw it in and hooked up 6 GPUs to it and I'll be damned it ran for 30 minutes no problem. I said screw it and grabbed 2 more cards again and had some rejected shares. Switched the slot back to PCI Gen2 and what do you know. Haven't had to reboot yet. Obviously its known your mileage will vary using splitters like this. It won't magically make a 20 year old motherboard support more cards. But if you have a modern-ish board that doesn't have enough slots it may be the ticket. I know people have had luck with those 4 GPU splitters I'm still not sure why they were so unstable for me but hey this works. Only needing one x16 slot to run cards I may just opt for a dual CPU board and do some CPU mining as well if a new CPU only algorithm triumphs over Cryptonight. x1 switch - https://www.amazon.com/LinkStyle-Extender-BitcoinLitecoin-Adapter-Ethereum/dp/B078YQMF7F/ref=sr_1_15?s=electronics&ie=UTF8&qid=1521395139&sr=1-15&keywords=x1+to+4+mining+riser x16 switch - https://www.amazon.com/Motherboard-Express-Graphics-Adapter-Machine/dp/B07571T721
I finally made my way over to egpu and egpu.io. Read the DIY 101 and some of the initial tutorials over on io. I sort of risk a cross post because I also posted similar questions over on virtualization and gpumining. I started over on mining because they deal with lots of risers but in particular x1/x4 to x16. Virtualization because this is what I'm trying to accomplish and those of us who have itx boards all need a 2nd/3rd gpu. Thus far my testing hasn't gotten me anywhere so I'm reaching out for additional feedback. Summary I have an itx case/board running skylake-x (no igp). I need to install a 2nd gpu (4k 60fps/hz in 2d and fanless/silent were my reqs - I picked up a msi 1030). I have (3) m.2 pcie gen 3 x4 slots, one of which is dual sata/pcie. I picked up this and this to test with. Neither work. It appears that it's not even passing POST - no bios screen. After reading egpu.io and the diy 101 here my hunch is that I'm running into a bios whitelist issue. What do you think? Steps taken: 1. tried both parts, the one part only takes power via sata (the card tops off at 34w and sata is capable of 54w) and the other i powered via 6pin pcie. with a card inserted it does not even hit bios. with the card unplugged i boot fine. 2. verified that the 1030 operates fine by plugging into the single x16 slot direct on the board. verified that it is not conflicting with my 1080ti (direct on mb) by unplugging the ti and only running 1030 via riser. 3. verified that its not some weird sata/pcie incompatibility by disabling sata in the chipset section of bios. next steps 1. per a suggestion in the other post, I will try the dual use sata/pcie m.2 slot. I don't think the m.2 key would be sata, but worth a shot. 2. per egpu.io i will try to hot plug via the usb cable after boot. and see if the gpu will auto detect. personally i think this is what will do the trick. however long term this will not work because for my project the gpu is inside the case. for this reddit this is fine because most/all of you are running external and a disconnect is easy. 3. ironically one of the parts was on the recommended parts list over on io, so you would think i'm good to go. which really makes me think about the bios whitelisting issue. other than trying an amd card out (which won't meet my reqs longterm) i'm not sure how to fix/test the bios issue. I guess #2 will test it. Ideas??solved I have two m.2. ports which are pcie only. I have 1 port that is pcie/sata. the suggestion by u/sqrtlurface was to use the pcie/sata port and now the 1030 is being recognized in both linux and windows.
Hello, I have a question about whether anyone here has experience using "mining rig" style designs for building deep learning boxes. Currently, we are building machines similar to the design guide NVIDIA put out a few years ago (aka the "devbox"), and invariably they end up being hot, loud, or both. Quietest and coolest version so far involves a blower fan from home depot. Not exactly ideal. Recently I saw a bitcoin-type mining rig (I have no idea what coin specifically it was mining) which looked very good. It was open air, quiet, and had cards packed well. I've done a bit of research, and apparently the miners are only using x1 PCIe connections to their motherboards (which makes sense given the low data rates), but does something similar exist which could be used for deep learning? I don't want to keep buying basement blower fans to cool computers if all that is needed is a better chassis.
I'm trying to build a bitcoin/altcoin mining rig (same concept as building a pc) but with 6 GPUs. With risers, I will end up converting each of the gpu's PCIE 16x to PCIE 1x so I will have six individual PCIE 1x representing the six gpus. The motherboard that supposedly supports 6 GPUs has the specs: 1 x PCIe 2.0 x16 (blue) 1 x PCIe 2.0 x16 (x4 mode, black) 2 x PCIe 2.0 x1 2 x PCI So now my question is, how can I fit the six PCIe 1x into those slots above? Can the PCIE x16 fit 16 PCIE x1? How does it work? Thanks
[US-WA][H] 11-GPUs, My 2-in-1 Mobile Mining Rig [W] BTC/BCC/USD/PayPal
I have this posted on Craigslist at the moment, though I would be willing to ship as long as you're willing to piece it all back together once it all arrives, and pay for shipping lol. I'll add the link so anybody can see photos, but I'll just copy/paste the entire listing below as well. https://seattle.craigslist.org/see/sys/d/selling-11-gpu-mining-rig/6370381005.html I'm selling my pride and joy of the last 4-6 months of my life, sadly I can't keep it in my apartment another day and have to hear my girlfriend nag about how much time I'm spending mining any longer. This is really two separate rigs that I have combined into a single entity (see pictures for details).
Motherboard: Gigabyte GA-X99-Phoenix SLI CPU: 6th Gen. Intel Core i7-6800K (6-Core/12-Thread) (15M L3 Cache | 3.60 GHz) RAM: Corsair Vengeance 8GB DDR4 2400 MHz (x2 for a total of 16GB) Heatsink: Cooler Master Hyper 212 EVO (w/2 Fans) PSU: Corsair HX1000 1000W 80 Plus Platinum Grade Fully Modular GPU #1: MSI GTX 1060 Armor 6gb GDDR5 GPU #2: MSI GTX 1060 Armor 6gb GDDR5 GPU #3: MSI GTX 1060 Gaming X 6gb GDDR5 GPU #4: MSI GTX 1060 Gaming X 6gb GDDR5 GPU #5: EVGA GTX 1060 6gb FTW (Tri-Fan) Risers: Explomos Multi-Powered USB 3.0 (VER 008S) <----Newest Model
HDD: 2.5" Laptop SATA 7200rpm 1.0 TB HDD w/Windows 10 Pro
Motherboard: Asrock H110 Pro BTC+ (x13 PCIe Slots) CPU: 7th Gen. Intel Celeron Dual Core @ 2.60 GHz RAM: Corsair Vengeance 8GB DDR4 2400 MHz (x1 for a total of 8GB) PSU: Corsair HX1000 1000W 80 Plus Platinum Grade Fully Modular GPU #1: MSI GTX 1060 OCV1 Mining Optimized 6GB GDDR5 GPU #2: MSI GTX 1060 OCV1 Mining Optimized 6GB GDDR5 GPU #3: MSI GTX 1060 OCV1 Mining Optimized 6GB GDDR5 GPU #4: EVGA GTX 1060 SC Gaming 6GB GDDR5 GPU #5: XFX RX 480 8GB RS Hard Swap Edition (Custom BIOS Mod for 29-31 MH/s + Undervolted for Lower Power Draw) GPU #6: Red Devil RX 480 8GB (Tri-Fan) (Custom BIOS Mod for 29-31 MH/s + Undervolted for Lower Power Draw) Risers: Explomos Multi-Powered USB 3.0 (VER 008S) <----Newest Model
HDD: Western Digital 7200rpm 500gb 2.5" Laptop SATA HDD w/Windows 10 Pro
The features that set this rig apart from most others is the fact that it is 100% portable and easy to move. Its compact design makes for an easy-to-manage mining experience, doubly so with the fact that the entire rig is on wheels! From RIG #1 to RIG #2 I have connected an Ethernet cable; doing this I am able to create a Bridged Network Adapter and effectively enable a constant internet connection to RIG #2 from RIG #1 without ever having to do anything more than simply power each device on. Of course, you'll have to have some way to give internet access to RIG #1 for this to work properly, though this should come as no problem considering RIG #1 has built-in Wi-Fi access, as well as a second Ethernet port on the motherboard. If you're wondering how much effort you'll have to put in from the time you buy it and get home, I'll say that this rig takes absolutely ZERO effort to install. The entire rig is ran headless, with Teamviewer installed onto both rigs, so you don't have to have anything plug into it except for the x2 power cords from each PSU, and an Ethernet cord from your router into RIG #1. That's literally it. 3 plugs, then connect to each rig with Teamviewer from a separate device (there's an app for that). This rig can literally mine anything you want, I have a multitude of mining software already available on the device, and custom made batch files in each folder so literally all it takes is for you to decide which coin you want to mine, then double click a single file and start raking in the coins! Here are a few hashrates that you can expect to get if you choose to utilize all 11 GPUs to a single coin: ETHEREUM (Ethash Algorithm) - 240 MH/s ZCASH (Equihash Algorithm) - 3300 sol/s NICEHASH (Auto Profit Switcher Software) - $20+/day in Bitcoin (which is over $7000 if you didn't know!) I'd be happy to help you get everything squared away, and would honestly just like to see this thing go to somebody that will appreciate its glory. I spent a LOT of time building this rig, and I'm sad to have to see it go, but my girlfriend is constantly bitching about it and I'm beginning to procrastinate homework these days because of it, so sadly it is time to see it go... I have about 90% of the original boxes that the hardware came in when I purchased it, and I've only had it up and running for about a month total, so there is massive life left to be enjoyed with this guy. With the way the crypto is going (or at least Bitcoin), it is a wise investment to get into it now while you still can ;) SERIOUS BUYERS ONLY!!!!! You may contact me either by email via this Craigslist listing, or by phone @ show contact info . I will accept cash, PayPal (in-person ONLY), or Bitcoin/Ethereum and other Cryptocurrencies as form of payment.
This is an all-purpose build that I put together slowly over the past year. It started out as just an HTPC, but ballooned into a gaming and bitcoin mining system. What's not listed in pcpartpicker is an additional HD 6850 connected by a PCIe x1 riser for bitcoin mining. The total hashrate of the system is 780 MH/s. Mining has been going full-on for about 4 months now and about a 1/3 of the cost of the current system has been paid for. It probably won't continue at this rate if difficulty goes way up with the asics coming out, but a 1/3 of the cost already is still a lot. The i5-3450 and 7950 are a great combination for gaming. FPS on ultra detail on BF3 is 40-60 on a 1080p HDTV with AA/MSAA at their lowest settings. Pictures PCPartPicker part list / Price breakdown by merchant / Benchmarks
Hi, I'm Cablesaurus. As Reddit has plugged into the Bitcoin world, many here may be wrestling with the complications of securely mounting accumulating graphics cards and mining rig gear; getting all cards to recognize; or how to utilize all possible motherboard slots for Bitcoin purposes to save hardware costs A few things new miners should be aware of:
* PCI Express extenders can be used to greatly increase airflow between your cards * Mounting solutions are available for those strugging to securely mount cards * You can use x1 PCIe slots to power any mining card just as fast as when plugged directly into an x16 slot. Adapters are available for the curious. * PCI to PCI express slot adapters are available for those running out of slots. A PCI slot can be converted to run a mining card at full speed from an extender.
Some of these solutions can save the miner a large wad of cash in startup hardware costs. To find more basic information, check out the Bitcoin forums or visit our site @ www.Cablesaurus.com I'll be glad to help answer any questions Reddit has about the use of such solutions, or just general questions for me! - Feel free to post! Warm regards, Cablesaurus
About to drop around $2500. Would love some opinions on this rig.
Ive been reading and reading and studying for days on end now. I want to understand as much as i can before i drop thousands on a rig and start mining. My plan is to ride this out as long as possible. I have faith LTC will go substantially higher...not as high as bitcoin..but i feel it has huge potential. With that said...i will cash out when i get enough LTC to match my initial investment to pay myself back. This makes everything i mine after the fact nothing but profit (minus the electricity of course). Ill use that profit to build a second rig based on how this is going but that comes later. Also...im a PC builder and have been for 10 years now. I will be using six R9 280x's. Preferably MSI but ASUS if i have to. I only want one motherboard so i will be buying six PCIe x1 to x16 POWERED risers. I am under the impression that x1 or x16 doesnt impact hashrate. Only gaming (which im obviously not doing). I have 4GB of DDR3 1333 laying around in my room so i dont need to buy that. I will be using Windows 8 since i hear the drivers for Windows net better hashrates. I am correct to assume i can use 6 cards with Windows right? Now... i will be buying a 32GB SSD since they draw very low wattage and an Intel Celeron Dual Core Ivy Bridge processor that draws 55 watts. Here is where i am really unsure. Can this be possible if all else above checks out...with two 1000watt PSU's? I plan to try and undervolt the gpu's a bit to save on power and heat. Is that enough or too much wattage? I figure id buy an Add2PSU and hook them both up for stability. The cards will draw anywhere from 1500-1800 watts with the rest of the system hopefully not drawing anymore than 150. Can this be done with a single PSU? DO i even really need the Add2PSU? Can i get away without using it? Or should i buy a 1250watt and a 1000 watt and have the 1000w power 3 cards with the 1250w powering the other 3 plus the rest of the system? These are the parts:
A friend is buying me the risers from a US based supplier with Bitcoin since all they accept is bitcoin.
(I understand the GPUs are out of stock. I am waiting a couple days otherwise i will buy from Tigerdirect. Bit more expensive but available.) So what do you all think? Opinions? Suggestions? Am i crazy?lol
How is it possible that an x16 GPU can work in an x1 slot?
I read earlier that some people have modded their x16 GPUs to fit in an x1 slot on the motherboard. How does this even work? Wouldn't this bottleneck the GPU somehow? I read about it in a bitcoin mining rig website if that means anything. Here would be an example http://www.invisiblerobot.com/pcie_x1/
# Join a Bitcoin Mining Pool - Bitcoin mining pools are teams of Bitcoin miners collaborating in order to resolve a block and share in its awards. Without having a Bitcoin mining pool, one could mine bitcoins for more than a year and never ever gain any bitcoins. It’s much more practical to share the effort and divided the reward along with a much bigger group of people. # Set up a Bitcoin ... Die PCIe x1 Slots übermitteln Daten von den Grafikkarten, die sich unter dieser Vorrichtung befinden und über die PCIe Riser über USB miteinander verbunden sind. Das blaue Kabel übermittelt dabei die Daten über USB 3.0, was allerdings nicht notwendig ist. Der 24pin-Connector versorgt das Mainboard mit Strom, wohingegen der 8pin-Connector die CPU mit Strom versorgt. Beide Anschlüsse ... Produktinformationen - PCI-E x1 auf x16 powered Riser Card Mining/Rendering-Kit Pro - 1m Diese PCI-Express x1 auf x16 powered Riser-Karte (von engl. "to rise" - aufsteigen) mit zusätzlichem 6-Pin-PCIe-Stromanschluss ist das ideale Zubehörteil für Bitcoin-Mining-Systeme und kann natürlich - unter Beachtung der hier zur Verfügung stehenden Bandbreite - auch wie jede andere Riserkarte für ... Bitcoin Stack Exchange is a question and answer site for Bitcoin crypto-currency enthusiasts. It only takes a minute to sign up. Sign up to join this community. Anybody can ask a question Anybody can answer The best answers are voted up and rise to the top Bitcoin . Home ; Questions ; Tags ; Users ; Jobs; Unanswered ; How do I fit a normal PCI-E x16 video card into a PCI-E x1 slot? Ask ... [Bitcoin Mining Dedicated Card ] PCI-E PCIe Riser Mining Card PCI-E 16x to 1x Powered Riser Adapter Card w/ 60cm USB 3.0 Extension Cable & 6 Pin PCI-E to SATA Cable - GPU Riser Adapter 006c (6 Pack) Brand: Diagtree. 6 answered questions Price: $17.89 & FREE Shipping: Color: 6 pack $17.89 . $5.69 . This fits your . Make sure this fits by entering your model number. Strong Stability: Newest ...
PCI-E 1x to 16x Extender Rise Card for BTC Bitcoin Mining - BLUE
Today i show you shortly how to install your PCIe Risers properly, many requests asked me about how to do it and what is safe. So here is the answer that a f... Cách lắp Card PCI vào Mainboard PCIe 1X, 16X không có PCI thường - Duration: 6:56. Phukienpc-vn Phụ kiện máy tính-Macbook 5,631 views Best choice for mining! Buy: https://goo.gl/Rygu92 Price: 5.99$ · Brand new and high quality. · PCI-E 1x to 16x Mining Machine Enhanced Extender Riser Adapter With Power Cable · With power ... Gpu PCI Riser For Bitcoin Mining 2017 - (3.99 USD) PCI - E 1X to 16X Extender Riser Card Adapter You can Buy Here gpu riser for 3.99 USD Flash Sale : https:/... Riser card PCI-E x16 to x1 for mining cryptocurrency SBTech. Loading... Unsubscribe from SBTech? ... USB Powered Risers GPU mining Litecoin Bitcoin - Duration: 2:15. d 82,631 views. 2:15 . Yaesu ...