Platinum-selling rapper Ja Rule left an upstate New York prison Thursday morning after serving most of his two-year sentence for illegal gun possession and headed straight into federal custody in a tax case.