Other Investments - Servicing Advance Investments (Details) - USD ($) $ in Thousands	Mar. 31, 2020	Dec. 31, 2019
Schedule of Investments [Line Items]
Total Servicer Advance Receivables	$ 282,743	$ 151,582
Residential Loans
Schedule of Investments [Line Items]
Principal and interest advances	113,612	15,081
Escrow advances (taxes and insurance advances)	117,876	96,732
Corporate advances	$ 51,255	$ 39,769

Fair value of an asset representing net future revenue from contractually specified servicing fees, late charges, and other ancillary revenues, in excess of future costs related to servicing arrangements.

Reference 1: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 860
-SubTopic 50
-Section 45
-Paragraph 2
-URI http://asc.fasb.org/extlink&oid=6469459&loc=d3e122501-111745

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 860
-SubTopic 50
-Section 50
-Paragraph 3
-Subparagraph (a)(1)
-URI http://asc.fasb.org/extlink&oid=116651436&loc=d3e122625-111746

Name:	us-gaap_ServicingAssetAtFairValueAmount
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant