Fair Value of Financial Instruments - Quantitative Information about Significant Unobservable Inputs Used in Valuation of Level 3 Assets and Liabilities Measured at Fair Value (Details)
$ in Thousands

Fair Value of Financial Instruments - Quantitative Information about Significant Unobservable Inputs Used in Valuation of Level 3 Assets and Liabilities Measured at Fair Value (Details) $ in Thousands	6 Months Ended
	Jun. 30, 2022 USD ($) $ / loan	Dec. 31, 2021 USD ($)
Assets
ABS issued, net, At fair value \| $	$ 7,993,953	$ 8,843,147
Variable Interest Entity, Primary Beneficiary \| Collateralized Financing Entities \| HEI
Liabilities
Fair value of securities owned \| $	$ 15,000
Residential loan purchase commitments, net
Assets
Loans receivable, measurement input	0.68
Loan purchase commitments, net \| $	$ 1,500
Residential loan purchase commitments, net \| Maximum
Assets
Loans receivable, measurement input	1
Residential loan purchase commitments, net \| Prepayment rate (annual CPR)
Assets
Loans receivable, measurement input	0.0224
Residential loan purchase commitments, net \| Prepayment rate (annual CPR) \| Minimum
Assets
Loans receivable, measurement input	0.0217
Residential loan purchase commitments, net \| Prepayment rate (annual CPR) \| Maximum
Assets
Loans receivable, measurement input	0.0240
Residential loan purchase commitments, net \| Pull-through rate \| Minimum
Assets
Loans receivable, measurement input	0.18
Residential loan purchase commitments, net \| Committed sales price
Assets
Loans receivable, measurement input	97
Residential loan purchase commitments, net \| Committed sales price \| Minimum
Assets
Loans receivable, measurement input	97
Residential loan purchase commitments, net \| Committed sales price \| Maximum
Assets
Loans receivable, measurement input	102
ABS Issued
Liabilities
ABS issued \| $	$ 3,496,329
ABS Issued \| Prepayment rate (annual CPR) \| Minimum
Liabilities
ABS issued, measurement input	0.05
ABS Issued \| Prepayment rate (annual CPR) \| Maximum
Liabilities
ABS issued, measurement input	0.27
ABS Issued \| Prepayment rate (annual CPR) \| Weighted Average
Liabilities
ABS issued, measurement input	0.14
ABS Issued \| Whole loan discount rate \| Minimum
Liabilities
ABS issued, measurement input	0.04
ABS Issued \| Whole loan discount rate \| Maximum
Liabilities
ABS issued, measurement input	0.18
ABS Issued \| Whole loan discount rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.06
ABS Issued \| Default rate \| Minimum
Liabilities
ABS issued, measurement input	0
ABS Issued \| Default rate \| Maximum
Liabilities
ABS issued, measurement input	0.22
ABS Issued \| Default rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.01
ABS Issued \| Loss severity \| Minimum
Liabilities
ABS issued, measurement input	0.25
ABS Issued \| Loss severity \| Maximum
Liabilities
ABS issued, measurement input	0.50
ABS Issued \| Loss severity \| Weighted Average
Liabilities
ABS issued, measurement input	0.32
CAFL
Liabilities
ABS issued \| $	$ 2,732,964
CAFL \| Prepayment rate (annual CPR) \| Minimum
Liabilities
ABS issued, measurement input	0
CAFL \| Prepayment rate (annual CPR) \| Maximum
Liabilities
ABS issued, measurement input	0.03
CAFL \| Prepayment rate (annual CPR) \| Weighted Average
Liabilities
ABS issued, measurement input	0.03
CAFL \| Whole loan discount rate \| Minimum
Liabilities
ABS issued, measurement input	0.02
CAFL \| Whole loan discount rate \| Maximum
Liabilities
ABS issued, measurement input	0.15
CAFL \| Whole loan discount rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.05
CAFL \| Default rate \| Minimum
Liabilities
ABS issued, measurement input	0.05
CAFL \| Default rate \| Maximum
Liabilities
ABS issued, measurement input	0.28
CAFL \| Default rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.07
CAFL \| Loss severity \| Minimum
Liabilities
ABS issued, measurement input	0.30
CAFL \| Loss severity \| Maximum
Liabilities
ABS issued, measurement input	0.30
CAFL \| Loss severity \| Weighted Average
Liabilities
ABS issued, measurement input	0.30
Freddie Mac SLST
Liabilities
ABS issued \| $	$ 1,243,167
Freddie Mac SLST \| Prepayment rate (annual CPR) \| Minimum
Liabilities
ABS issued, measurement input	0.06
Freddie Mac SLST \| Prepayment rate (annual CPR) \| Maximum
Liabilities
ABS issued, measurement input	0.08
Freddie Mac SLST \| Prepayment rate (annual CPR) \| Weighted Average
Liabilities
ABS issued, measurement input	0.06
Freddie Mac SLST \| Whole loan discount rate \| Minimum
Liabilities
ABS issued, measurement input	0.04
Freddie Mac SLST \| Whole loan discount rate \| Maximum
Liabilities
ABS issued, measurement input	0.07
Freddie Mac SLST \| Whole loan discount rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.05
Freddie Mac SLST \| Default rate \| Minimum
Liabilities
ABS issued, measurement input	0.07
Freddie Mac SLST \| Default rate \| Maximum
Liabilities
ABS issued, measurement input	0.09
Freddie Mac SLST \| Default rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.08
Freddie Mac SLST \| Loss severity \| Minimum
Liabilities
ABS issued, measurement input	0.35
Freddie Mac SLST \| Loss severity \| Maximum
Liabilities
ABS issued, measurement input	0.35
Freddie Mac SLST \| Loss severity \| Weighted Average
Liabilities
ABS issued, measurement input	0.35
Freddie Mac K-Series
Liabilities
ABS issued \| $	$ 411,380
Freddie Mac K-Series \| Whole loan discount rate \| Minimum
Liabilities
ABS issued, measurement input	0.03
Freddie Mac K-Series \| Whole loan discount rate \| Maximum
Liabilities
ABS issued, measurement input	0.09
Freddie Mac K-Series \| Whole loan discount rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.04
Consolidated Point Entities
Liabilities
ABS issued \| $	$ 110,111
Consolidated Point Entities \| Prepayment rate (annual CPR) \| Minimum
Liabilities
ABS issued, measurement input	0.20
Consolidated Point Entities \| Prepayment rate (annual CPR) \| Maximum
Liabilities
ABS issued, measurement input	0.20
Consolidated Point Entities \| Prepayment rate (annual CPR) \| Weighted Average
Liabilities
ABS issued, measurement input	0.20
Consolidated Point Entities \| Whole loan discount rate \| Minimum
Liabilities
ABS issued, measurement input	0.08
Consolidated Point Entities \| Whole loan discount rate \| Maximum
Liabilities
ABS issued, measurement input	0.13
Consolidated Point Entities \| Whole loan discount rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.09
Consolidated Point Entities \| Default rate \| Minimum
Liabilities
ABS issued, measurement input	0.12
Consolidated Point Entities \| Default rate \| Maximum
Liabilities
ABS issued, measurement input	0.12
Consolidated Point Entities \| Default rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.12
Consolidated Point Entities \| Loss severity \| Minimum
Liabilities
ABS issued, measurement input	0.30
Consolidated Point Entities \| Loss severity \| Maximum
Liabilities
ABS issued, measurement input	0.30
Consolidated Point Entities \| Loss severity \| Weighted Average
Liabilities
ABS issued, measurement input	0.30
Consolidated Point Entities \| Home price appreciation \| Minimum
Liabilities
ABS issued, measurement input	0.03
Consolidated Point Entities \| Home price appreciation \| Maximum
Liabilities
ABS issued, measurement input	0.04
Consolidated Point Entities \| Home price appreciation \| Weighted Average
Liabilities
ABS issued, measurement input	0.03
Jumbo fixed-rate loans
Assets
ABS issued, net, At fair value \| $	$ 714,777
Jumbo fixed-rate loans \| Whole loan spread to swap rate
Assets
Loans held-for-sale, measurement input	0.0221
Jumbo fixed-rate loans \| Whole loan spread to swap rate \| Minimum
Assets
Loans held-for-sale, measurement input	0.0217
Jumbo fixed-rate loans \| Whole loan spread to swap rate \| Maximum
Assets
Loans held-for-sale, measurement input	0.0240
Jumbo fixed-rate loans \| CRT dollar price
Assets
Loans held-for-sale, measurement input	96
Jumbo fixed-rate loans \| CRT dollar price \| Minimum
Assets
Loans held-for-sale, measurement input	96
Jumbo fixed-rate loans \| CRT dollar price \| Maximum
Assets
Loans held-for-sale, measurement input	96
Jumbo loans committed to sell
Assets
Loans receivable, fair value \| $	$ 498,258
Jumbo loans committed to sell \| Whole loan committed sales price \| Minimum
Assets
Loans held-for-sale, measurement input	97
Jumbo loans committed to sell \| Whole loan committed sales price \| Maximum
Assets
Loans held-for-sale, measurement input	99
Jumbo loans committed to sell \| Whole loan committed sales price \| Weighted Average
Assets
Loans held-for-sale, measurement input	98
Legacy Sequoia
Assets
Loans receivable, fair value \| $	$ 208,788
Sequoia
Assets
Loans receivable, fair value \| $	3,525,459
Liabilities
Fair value of securities owned \| $	238,000
Freddie Mac SLST
Assets
Loans receivable, fair value \| $	1,631,285
Liabilities
Fair value of securities owned \| $	390,000	445,000
Single-family rental loans
Assets
Loans receivable, fair value \| $	$ 505,171
Single-family rental loans \| Senior credit spread \| Minimum
Assets
Loans receivable, measurement input	0.0215
Single-family rental loans \| Senior credit spread \| Maximum
Assets
Loans receivable, measurement input	0.0235
Single-family rental loans \| Senior credit spread \| Weighted Average
Assets
Loans receivable, measurement input	0.0220
Single-family rental loans \| Subordinate credit spread \| Minimum
Assets
Loans receivable, measurement input	0.0260
Single-family rental loans \| Subordinate credit spread \| Maximum
Assets
Loans receivable, measurement input	0.1099
Single-family rental loans \| Subordinate credit spread \| Weighted Average
Assets
Loans receivable, measurement input	0.0504
Single-family rental loans \| Senior credit support \| Minimum
Assets
Loans receivable, measurement input	0.39
Single-family rental loans \| Senior credit support \| Maximum
Assets
Loans receivable, measurement input	0.40
Single-family rental loans \| Senior credit support \| Weighted Average
Assets
Loans receivable, measurement input	0.39
Single-family rental loans \| IO discount rate \| Minimum
Assets
Loans receivable, measurement input	0.08
Single-family rental loans \| IO discount rate \| Maximum
Assets
Loans receivable, measurement input	0.13
Single-family rental loans \| IO discount rate \| Weighted Average
Assets
Loans receivable, measurement input	0.09
Single-family rental loans \| Prepayment rate (annual CPR) \| Minimum
Assets
Loans receivable, measurement input	0.03
Single-family rental loans \| Prepayment rate (annual CPR) \| Maximum
Assets
Loans receivable, measurement input	0.25
Single-family rental loans \| Prepayment rate (annual CPR) \| Weighted Average
Assets
Loans receivable, measurement input	0.06
Single-family rental loans \| Non-securitizable loan dollar price \| Minimum
Assets
Loans receivable, measurement input	80
Single-family rental loans \| Non-securitizable loan dollar price \| Maximum
Assets
Loans receivable, measurement input	100
Single-family rental loans \| Non-securitizable loan dollar price \| Weighted Average
Assets
Loans receivable, measurement input	93
CAFL
Assets
Loans receivable, fair value \| $	$ 3,046,277
Liabilities
Fair value of securities owned \| $	307,000	$ 302,000
Bridge loans
Assets
Loans receivable, fair value \| $	$ 1,651,489
Bridge loans \| Senior credit spread \| Minimum
Assets
Loans held-for-investment, measurement input	0.0325
Bridge loans \| Senior credit spread \| Maximum
Assets
Loans held-for-investment, measurement input	0.0325
Bridge loans \| Senior credit spread \| Weighted Average
Assets
Loans held-for-investment, measurement input	0.0325
Bridge loans \| Subordinate credit spread \| Minimum
Assets
Loans held-for-investment, measurement input	0.15
Bridge loans \| Subordinate credit spread \| Maximum
Assets
Loans held-for-investment, measurement input	0.15
Bridge loans \| Subordinate credit spread \| Weighted Average
Assets
Loans held-for-investment, measurement input	0.15
Bridge loans \| Senior credit support \| Minimum
Assets
Loans held-for-investment, measurement input	0.15
Bridge loans \| Senior credit support \| Maximum
Assets
Loans held-for-investment, measurement input	0.15
Bridge loans \| Senior credit support \| Weighted Average
Assets
Loans held-for-investment, measurement input	0.15
Bridge loans \| Whole loan discount rate \| Minimum
Assets
Loans held-for-investment, measurement input	0.05
Bridge loans \| Whole loan discount rate \| Maximum
Assets
Loans held-for-investment, measurement input	0.15
Bridge loans \| Whole loan discount rate \| Weighted Average
Assets
Loans held-for-investment, measurement input	0.08
Freddie Mac K-Series
Assets
Loans receivable, fair value \| $	$ 443,114
Liabilities
Fair value of securities owned \| $	32,000
Trading and AFS securities
Assets
Trading and AFS securities \| $	$ 284,278
Trading and AFS securities \| CRT dollar price \| Minimum
Assets
Trading and AFS securities	74
Trading and AFS securities \| CRT dollar price \| Maximum
Assets
Trading and AFS securities	88
Trading and AFS securities \| CRT dollar price \| Weighted Average
Assets
Trading and AFS securities	83
Trading and AFS securities \| Prepayment rate (annual CPR) \| Minimum
Assets
Trading and AFS securities	0.06
Trading and AFS securities \| Prepayment rate (annual CPR) \| Maximum
Assets
Trading and AFS securities	0.65
Trading and AFS securities \| Prepayment rate (annual CPR) \| Weighted Average
Assets
Trading and AFS securities	0.13
Trading and AFS securities \| Whole loan discount rate \| Minimum
Assets
Trading and AFS securities	0.04
Trading and AFS securities \| Whole loan discount rate \| Maximum
Assets
Trading and AFS securities	0.18
Trading and AFS securities \| Whole loan discount rate \| Weighted Average
Assets
Trading and AFS securities	0.09
Trading and AFS securities \| Default rate \| Minimum
Assets
Trading and AFS securities	0
Trading and AFS securities \| Default rate \| Maximum
Assets
Trading and AFS securities	0.11
Trading and AFS securities \| Default rate \| Weighted Average
Assets
Trading and AFS securities	0.01
Trading and AFS securities \| Loss severity \| Minimum
Assets
Trading and AFS securities	0
Trading and AFS securities \| Loss severity \| Maximum
Assets
Trading and AFS securities	0.50
Trading and AFS securities \| Loss severity \| Weighted Average
Assets
Trading and AFS securities	0.25
Servicer Advance Investments
Assets
Servicing asset \| $	$ 273,210
Servicer Advance Investments \| Minimum
Assets
Expected remaining life	5 years
Servicer Advance Investments \| Maximum
Assets
Expected remaining life	5 years
Servicer Advance Investments \| Weighted Average
Assets
Expected remaining life	5 years
Servicer Advance Investments \| Prepayment rate (annual CPR) \| Minimum
Assets
Servicing asset, measurement input	0.16
Servicer Advance Investments \| Prepayment rate (annual CPR) \| Maximum
Assets
Servicing asset, measurement input	0.30
Servicer Advance Investments \| Prepayment rate (annual CPR) \| Weighted Average
Assets
Servicing asset, measurement input	0.16
Servicer Advance Investments \| Whole loan discount rate \| Minimum
Assets
Servicing asset, measurement input	0.02
Servicer Advance Investments \| Whole loan discount rate \| Maximum
Assets
Servicing asset, measurement input	0.04
Servicer Advance Investments \| Whole loan discount rate \| Weighted Average
Assets
Servicing asset, measurement input	0.03
Servicer Advance Investments \| Mortgage servicing income \| Minimum
Assets
Servicing asset, measurement input	0
Servicer Advance Investments \| Mortgage servicing income \| Maximum
Assets
Servicing asset, measurement input	0.0018
Servicer Advance Investments \| Mortgage servicing income \| Weighted Average
Assets
Servicing asset, measurement input	0.0009
MSRs
Assets
Servicing asset \| $	$ 23,560
MSRs \| Prepayment rate (annual CPR) \| Minimum
Assets
Servicing asset, measurement input	0.05
MSRs \| Prepayment rate (annual CPR) \| Maximum
Assets
Servicing asset, measurement input	0.31
MSRs \| Prepayment rate (annual CPR) \| Weighted Average
Assets
Servicing asset, measurement input	0.09
MSRs \| Whole loan discount rate \| Minimum
Assets
Servicing asset, measurement input	0.11
MSRs \| Whole loan discount rate \| Maximum
Assets
Servicing asset, measurement input	1.15
MSRs \| Whole loan discount rate \| Weighted Average
Assets
Servicing asset, measurement input	0.11
MSRs \| Per loan annual cost to service \| Minimum
Assets
Servicing asset, measurement input	93
MSRs \| Per loan annual cost to service \| Maximum
Assets
Servicing asset, measurement input	93
MSRs \| Per loan annual cost to service \| Weighted Average
Assets
Servicing asset, measurement input	93
Excess MSRs
Assets
Servicing asset \| $	$ 40,803
Excess MSRs \| Prepayment rate (annual CPR) \| Minimum
Assets
Servicing asset, measurement input	0.16
Excess MSRs \| Prepayment rate (annual CPR) \| Maximum
Assets
Servicing asset, measurement input	0.35
Excess MSRs \| Prepayment rate (annual CPR) \| Weighted Average
Assets
Servicing asset, measurement input	0.20
Excess MSRs \| Whole loan discount rate \| Minimum
Assets
Servicing asset, measurement input	0.13
Excess MSRs \| Whole loan discount rate \| Maximum
Assets
Servicing asset, measurement input	0.19
Excess MSRs \| Whole loan discount rate \| Weighted Average
Assets
Servicing asset, measurement input	0.18
Excess MSRs \| Excess mortgage servicing income \| Minimum
Assets
Servicing asset, measurement input	0.0008
Excess MSRs \| Excess mortgage servicing income \| Maximum
Assets
Servicing asset, measurement input	0.0018
Excess MSRs \| Excess mortgage servicing income \| Weighted Average
Assets
Servicing asset, measurement input	0.0011
Home Appreciation Option
Assets
HEIs \| $	$ 130,151
Home Appreciation Option \| Prepayment rate (annual CPR) \| Minimum
Assets
HEIs, Measurement input	0.01
Home Appreciation Option \| Prepayment rate (annual CPR) \| Maximum
Assets
HEIs, Measurement input	0.24
Home Appreciation Option \| Prepayment rate (annual CPR) \| Weighted Average
Assets
HEIs, Measurement input	0.17
Home Appreciation Option \| Whole loan discount rate \| Minimum
Assets
HEIs, Measurement input	0.10
Home Appreciation Option \| Whole loan discount rate \| Maximum
Assets
HEIs, Measurement input	0.10
Home Appreciation Option \| Whole loan discount rate \| Weighted Average
Assets
HEIs, Measurement input	0.10
Home Appreciation Option \| Home price appreciation \| Minimum
Assets
HEIs, Measurement input	0.03
Home Appreciation Option \| Home price appreciation \| Maximum
Assets
HEIs, Measurement input	0.04
Home Appreciation Option \| Home price appreciation \| Weighted Average
Assets
HEIs, Measurement input	0.03
HEIs held by Point HEI entity
Assets
HEIs \| $	$ 146,215
REO
Assets
REO \| $	$ 1,380
REO \| Loss severity \| Minimum
Assets
REO, measurement input	0.12
REO \| Loss severity \| Maximum
Assets
REO, measurement input	0.25
REO \| Loss severity \| Weighted Average
Assets
REO, measurement input	0.20