Before we begin, make sure that you have a monitor hooked up to the second GPU. In some situations, the video card will fail to properly initialize if one isnt attached. Also it helps with debugging issues that will most assuredly arise.
Ensure that IOMMU is enabled in the BIOS. For me using an Intel system from Dell, it was under Virtualization -> Direct I/O. It should be something along those lines for AMD as well. That was the easy part :).
Before we proceed we're going to need to gather some information. Run the command, lspci -nn|grep NVIDIA
(or AMD if your using that). The output for me was: