Borrowings - Maturities (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013	Dec. 31, 2012
Debt Instrument [Line Items]
2014	$ 2,853,743
2015	27,219
2016	11,690
2017	11,690
2018	1,238,141
Thereafter	0
Total Balance	4,142,483
Fair Value	4,127,690
Long-term Debt, Gross	1,284,229	306,308
Match Funded Liabilties [Member]
Debt Instrument [Line Items]
2014	2,364,814
2015	0
2016	0
2017	0
2018	0
Thereafter	0
Total Balance	2,364,814
Fair Value	2,364,814
Other Secured Borrowings [Member]
Debt Instrument [Line Items]
2014	488,929
2015	27,219
2016	11,690
2017	11,690
2018	1,238,141
Thereafter	0
Total Balance	1,777,669	790,371
Fair Value	1,762,876
Other Secured Borrowings [Member] \| Servicing [Member]
Debt Instrument [Line Items]
Long-term Debt, Gross	1,323,286	407,695
Other Secured Borrowings [Member] \| Lending [Member]
Debt Instrument [Line Items]
Long-term Debt, Gross	455,020	388,075
Financing Liabilities [Member]
Debt Instrument [Line Items]
Long-term Debt, Gross	1,284,229	306,308
Financing Liabilities [Member] \| Servicing [Member]
Debt Instrument [Line Items]
Long-term Debt, Gross	651,060	306,308
Financing Liabilities [Member] \| Lending [Member]
Debt Instrument [Line Items]
Long-term Debt, Gross	633,169	0
Financing Liabilities [Member] \| Lending [Member] \| HMBS - Related Borrowings [Member]
Debt Instrument [Line Items]
Long-term Debt, Gross	$ 615,576	$ 0

Amount of long-term debt before deduction of unamortized discount or premium. Includes, but is not limited to, notes payable, bonds payable, commercial loans, mortgage loans, convertible debt, subordinated debt and other types of debt, with initial maturities beyond one year or the normal operating cycle, if longer.

Reference 1: http://www.xbrl.org/2003/role/presentationRef

-Publisher SEC

-Name Regulation S-X (SX)

-Number 210

-Section 02

-Paragraph 20

-Article 5

Reference 2: http://www.xbrl.org/2003/role/presentationRef

-Publisher SEC

-Name Regulation S-X (SX)

-Number 210

-Section 02

-Paragraph 22

-Article 5

Reference 3: http://www.xbrl.org/2003/role/presentationRef

-Publisher FASB

-Name Accounting Standards Codification

-Topic 210

-SubTopic 10

-Section S99

-Paragraph 1

-Subparagraph (SX 210.5-02.22)

-URI http://asc.fasb.org/extlink&oid=6877327&loc=d3e13212-122682

Reference 4: http://www.xbrl.org/2003/role/presentationRef

-Publisher SEC

-Name Regulation S-X (SX)

-Number 210

-Section 03

-Paragraph 16

-Article 9

+ Details

Name:	us-gaap_DebtInstrumentCarryingAmount
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Details

Name:	us-gaap_DebtInstrumentLineItems
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Definition

Carrying amount of long-term debt, net of unamortized discount or premium, including current and noncurrent amounts. Includes, but not limited to, notes payable, bonds payable, debentures, mortgage loans and commercial paper. Excludes capital lease obligations.

+ References

Reference 1: http://www.xbrl.org/2003/role/presentationRef

-Publisher SEC

-Name Regulation S-X (SX)

-Number 210

-Section 03

-Paragraph 16

-Article 7

Reference 2: http://www.xbrl.org/2003/role/presentationRef

-Publisher FASB

-Name Accounting Standards Codification

-Topic 210

-SubTopic 10

-Section S99

-Paragraph 1

-Subparagraph (SX 210.5-02.22)

-URI http://asc.fasb.org/extlink&oid=6877327&loc=d3e13212-122682

Reference 3: http://www.xbrl.org/2003/role/presentationRef

-Publisher FASB

-Name Accounting Standards Codification

-Topic 942

-SubTopic 210

-Section S99

-Paragraph 1

-Subparagraph (SX 210.9-03.16)

-URI http://asc.fasb.org/extlink&oid=6876686&loc=d3e534808-122878

Reference 4: http://www.xbrl.org/2003/role/presentationRef

-Publisher SEC

-Name Regulation S-X (SX)

-Number 210

-Section 03

-Paragraph 16

-Article 9

Reference 5: http://www.xbrl.org/2003/role/presentationRef

-Publisher SEC

-Name Regulation S-X (SX)

-Number 210

-Section 02

-Paragraph 20, 22

-Article 5

Reference 6: http://www.xbrl.org/2003/role/presentationRef

-Publisher FASB

-Name Accounting Standards Codification

-Topic 944

-SubTopic 210

-Section S99

-Paragraph 1

-Subparagraph (SX 210.7-03.16)

-URI http://asc.fasb.org/extlink&oid=6879938&loc=d3e572229-122910

+ Details

Name:	us-gaap_LongTermDebt
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

The fair value amount of long-term debt whether such amount is presented as a separate caption or as a parenthetical disclosure. Additionally, this element may be used in connection with the fair value disclosures required in the footnote disclosures to the financial statements. The element may be used in both the balance sheet and disclosure in the same submission.

+ References

No definition available.

+ Details

Name:	us-gaap_LongTermDebtFairValue
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amount of long-term debt, sinking fund requirements, and other securities redeemable at fixed or determinable prices and dates maturing after the fifth fiscal year following the latest fiscal year.

+ References

Reference 1: http://www.xbrl.org/2003/role/presentationRef

-Publisher FASB

-Name Accounting Standards Codification

-Topic 470

-SubTopic 10

-Section 50

-Paragraph 1

-URI http://asc.fasb.org/extlink&oid=6802200&loc=d3e1835-112601

+ Details

Name:	us-gaap_LongTermDebtMaturitiesRepaymentsOfPrincipalAfterYearFive
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amount of long-term debt, sinking fund requirements, and other securities redeemable at fixed or determinable prices and dates maturing in the next fiscal year following the latest fiscal year.

+ References

+ Details

Name:	us-gaap_LongTermDebtMaturitiesRepaymentsOfPrincipalInNextTwelveMonths
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amount of long-term debt, sinking fund requirements, and other securities redeemable at fixed or determinable prices and dates maturing in the fifth fiscal year following the latest fiscal year.

+ References

+ Details

Name:	us-gaap_LongTermDebtMaturitiesRepaymentsOfPrincipalInYearFive
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amount of long-term debt, sinking fund requirements, and other securities redeemable at fixed or determinable prices and dates maturing in the fourth fiscal year following the latest fiscal year.

+ References

+ Details

Name:	us-gaap_LongTermDebtMaturitiesRepaymentsOfPrincipalInYearFour
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amount of long-term debt, sinking fund requirements, and other securities redeemable at fixed or determinable prices and dates maturing in the third fiscal year following the latest fiscal year.

+ References

+ Details

Name:	us-gaap_LongTermDebtMaturitiesRepaymentsOfPrincipalInYearThree
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amount of long-term debt, sinking fund requirements, and other securities redeemable at fixed or determinable prices and dates maturing in the second fiscal year following the latest fiscal year.

+ References

+ Details

Name:	us-gaap_LongTermDebtMaturitiesRepaymentsOfPrincipalInYearTwo
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant