Fair Value of Financial Instruments - Quantitative Information about Significant Unobservable Inputs Used in Valuation of Level 3 Assets and Liabilities Measured at Fair Value (Details)
$ in Thousands

Fair Value of Financial Instruments - Quantitative Information about Significant Unobservable Inputs Used in Valuation of Level 3 Assets and Liabilities Measured at Fair Value (Details) $ in Thousands	9 Months Ended
	Sep. 30, 2023 USD ($) $ / loan	Dec. 31, 2022 USD ($)
Assets
ABS issued, net, At fair value \| $	$ 7,910,345	$ 7,424,132
Variable Interest Entity, Primary Beneficiary \| Collateralized Financing Entities \| HEI
Liabilities
Fair value of securities owned \| $	15,000
ABS Issued
Liabilities
ABS issued \| $	$ 3,717,707
ABS Issued \| Prepayment rate (annual CPR) \| Minimum
Liabilities
ABS issued, measurement input	0.03
ABS Issued \| Prepayment rate (annual CPR) \| Maximum
Liabilities
ABS issued, measurement input	0.25
ABS Issued \| Prepayment rate (annual CPR) \| Weighted Average
Liabilities
ABS issued, measurement input	0.08
ABS Issued \| Whole loan discount rate \| Minimum
Liabilities
ABS issued, measurement input	0.04
ABS Issued \| Whole loan discount rate \| Maximum
Liabilities
ABS issued, measurement input	0.19
ABS Issued \| Whole loan discount rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.08
ABS Issued \| Default rate \| Minimum
Liabilities
ABS issued, measurement input	0
ABS Issued \| Default rate \| Maximum
Liabilities
ABS issued, measurement input	0.16
ABS Issued \| Default rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.01
ABS Issued \| Loss severity \| Minimum
Liabilities
ABS issued, measurement input	0.25
ABS Issued \| Loss severity \| Maximum
Liabilities
ABS issued, measurement input	0.50
ABS Issued \| Loss severity \| Weighted Average
Liabilities
ABS issued, measurement input	0.31
CAFL
Liabilities
ABS issued \| $	$ 2,653,224
CAFL \| Prepayment rate (annual CPR) \| Minimum
Liabilities
ABS issued, measurement input	0
CAFL \| Prepayment rate (annual CPR) \| Maximum
Liabilities
ABS issued, measurement input	0.03
CAFL \| Prepayment rate (annual CPR) \| Weighted Average
Liabilities
ABS issued, measurement input	0.001
CAFL \| Whole loan discount rate \| Minimum
Liabilities
ABS issued, measurement input	0.06
CAFL \| Whole loan discount rate \| Maximum
Liabilities
ABS issued, measurement input	0.12
CAFL \| Whole loan discount rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.07
CAFL \| Default rate \| Minimum
Liabilities
ABS issued, measurement input	0.05
CAFL \| Default rate \| Maximum
Liabilities
ABS issued, measurement input	0.14
CAFL \| Default rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.07
CAFL \| Loss severity \| Minimum
Liabilities
ABS issued, measurement input	0.30
CAFL \| Loss severity \| Maximum
Liabilities
ABS issued, measurement input	0.40
CAFL \| Loss severity \| Weighted Average
Liabilities
ABS issued, measurement input	0.30
Freddie Mac SLST
Liabilities
ABS issued \| $	$ 1,058,991
Freddie Mac SLST \| Prepayment rate (annual CPR) \| Minimum
Liabilities
ABS issued, measurement input	0.06
Freddie Mac SLST \| Prepayment rate (annual CPR) \| Maximum
Liabilities
ABS issued, measurement input	0.06
Freddie Mac SLST \| Prepayment rate (annual CPR) \| Weighted Average
Liabilities
ABS issued, measurement input	0.06
Freddie Mac SLST \| Whole loan discount rate \| Minimum
Liabilities
ABS issued, measurement input	0.06
Freddie Mac SLST \| Whole loan discount rate \| Maximum
Liabilities
ABS issued, measurement input	0.16
Freddie Mac SLST \| Whole loan discount rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.07
Freddie Mac SLST \| Default rate \| Minimum
Liabilities
ABS issued, measurement input	0.12
Freddie Mac SLST \| Default rate \| Maximum
Liabilities
ABS issued, measurement input	0.14
Freddie Mac SLST \| Default rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.13
Freddie Mac SLST \| Loss severity \| Minimum
Liabilities
ABS issued, measurement input	0.25
Freddie Mac SLST \| Loss severity \| Maximum
Liabilities
ABS issued, measurement input	0.25
Freddie Mac SLST \| Loss severity \| Weighted Average
Liabilities
ABS issued, measurement input	0.25
Freddie Mac K-Series
Liabilities
ABS issued \| $	$ 387,650
Freddie Mac K-Series \| Whole loan discount rate \| Minimum
Liabilities
ABS issued, measurement input	0.03
Freddie Mac K-Series \| Whole loan discount rate \| Maximum
Liabilities
ABS issued, measurement input	0.10
Freddie Mac K-Series \| Whole loan discount rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.06
Consolidated Point Entities
Liabilities
ABS issued \| $	$ 92,773
Consolidated Point Entities \| Prepayment rate (annual CPR) \| Minimum
Liabilities
ABS issued, measurement input	0.20
Consolidated Point Entities \| Prepayment rate (annual CPR) \| Maximum
Liabilities
ABS issued, measurement input	0.20
Consolidated Point Entities \| Prepayment rate (annual CPR) \| Weighted Average
Liabilities
ABS issued, measurement input	0.20
Consolidated Point Entities \| Whole loan discount rate \| Minimum
Liabilities
ABS issued, measurement input	0.10
Consolidated Point Entities \| Whole loan discount rate \| Maximum
Liabilities
ABS issued, measurement input	0.16
Consolidated Point Entities \| Whole loan discount rate \| Weighted Average
Liabilities
ABS issued, measurement input	0.11
Consolidated Point Entities \| Home price appreciation (depreciation) \| Minimum
Liabilities
ABS issued, measurement input	(0.01)
Consolidated Point Entities \| Home price appreciation (depreciation) \| Maximum
Liabilities
ABS issued, measurement input	0.03
Consolidated Point Entities \| Home price appreciation (depreciation) \| Weighted Average
Liabilities
ABS issued, measurement input	0.03
Jumbo loans
Assets
ABS issued, net, At fair value \| $	$ 540,782
Jumbo loans \| Senior credit spread to TBA price(2) \| Minimum
Assets
Loans held-for-sale, measurement input	1.63
Jumbo loans \| Senior credit spread to TBA price(2) \| Maximum
Assets
Loans held-for-sale, measurement input	2.63
Jumbo loans \| Senior credit spread to TBA price(2) \| Weighted Average
Assets
Loans held-for-sale, measurement input	1.71
Jumbo loans \| Subordinate credit spread \| Minimum
Assets
Loans receivable, measurement input	0.0275
Jumbo loans \| Subordinate credit spread \| Maximum
Assets
Loans receivable, measurement input	0.1020
Jumbo loans \| Subordinate credit spread \| Weighted Average
Assets
Loans receivable, measurement input	0.0438
Jumbo loans \| Senior credit support \| Minimum
Assets
Loans receivable, measurement input	0.07
Jumbo loans \| Senior credit support \| Maximum
Assets
Loans receivable, measurement input	0.07
Jumbo loans \| Senior credit support \| Weighted Average
Assets
Loans receivable, measurement input	0.07
Jumbo loans \| IO discount rate \| Minimum
Assets
Loans receivable, measurement input	0.10
Jumbo loans \| IO discount rate \| Maximum
Assets
Loans receivable, measurement input	0.10
Jumbo loans \| IO discount rate \| Weighted Average
Assets
Loans receivable, measurement input	0.10
Jumbo loans \| Prepayment rate (annual CPR) \| Minimum
Assets
Loans held-for-sale, measurement input	0.15
Jumbo loans \| Prepayment rate (annual CPR) \| Maximum
Assets
Loans held-for-sale, measurement input	0.15
Jumbo loans \| Prepayment rate (annual CPR) \| Weighted Average
Assets
Loans held-for-sale, measurement input	0.15
Jumbo loans committed to sell
Assets
ABS issued, net, At fair value \| $	$ 70,136
Jumbo loans committed to sell \| Whole loan committed sales price \| Minimum
Assets
Residential loans, measurement input	98
Jumbo loans committed to sell \| Whole loan committed sales price \| Maximum
Assets
Residential loans, measurement input	101
Jumbo loans committed to sell \| Whole loan committed sales price \| Weighted Average
Assets
Residential loans, measurement input	98
Legacy Sequoia
Assets
Loans receivable, fair value \| $	$ 150,152
Sequoia
Assets
Loans receivable, fair value \| $	3,774,090
Liabilities
Fair value of securities owned \| $	206,000
Freddie Mac SLST
Assets
Loans receivable, fair value \| $	1,312,149
Liabilities
Fair value of securities owned \| $	256,000	323,000
BPL term loans
Assets
Loans receivable, fair value \| $	$ 72,149
BPL term loans \| Senior credit spread \| Minimum
Assets
Loans receivable, measurement input	0.0185
BPL term loans \| Senior credit spread \| Maximum
Assets
Loans receivable, measurement input	0.0185
BPL term loans \| Senior credit spread \| Weighted Average
Assets
Loans receivable, measurement input	0.0185
BPL term loans \| Subordinate credit spread \| Minimum
Assets
Loans receivable, measurement input	0.0325
BPL term loans \| Subordinate credit spread \| Maximum
Assets
Loans receivable, measurement input	0.0818
BPL term loans \| Subordinate credit spread \| Weighted Average
Assets
Loans receivable, measurement input	0.0468
BPL term loans \| Senior credit support \| Minimum
Assets
Loans receivable, measurement input	0.35
BPL term loans \| Senior credit support \| Maximum
Assets
Loans receivable, measurement input	0.35
BPL term loans \| Senior credit support \| Weighted Average
Assets
Loans receivable, measurement input	0.35
BPL term loans \| IO discount rate \| Minimum
Assets
Loans receivable, measurement input	0.08
BPL term loans \| IO discount rate \| Maximum
Assets
Loans receivable, measurement input	0.09
BPL term loans \| IO discount rate \| Weighted Average
Assets
Loans receivable, measurement input	0.08
BPL term loans \| Prepayment rate (annual CPR) \| Minimum
Assets
Loans receivable, measurement input	0
BPL term loans \| Prepayment rate (annual CPR) \| Maximum
Assets
Loans receivable, measurement input	0.03
BPL term loans \| Prepayment rate (annual CPR) \| Weighted Average
Assets
Loans receivable, measurement input	0.03
BPL term loans \| Dollar price of non-performing loans \| Minimum
Assets
Loans receivable, measurement input	60
BPL term loans \| Dollar price of non-performing loans \| Maximum
Assets
Loans receivable, measurement input	100
BPL term loans \| Dollar price of non-performing loans \| Weighted Average
Assets
Loans receivable, measurement input	61
CAFL
Assets
Loans receivable, fair value \| $	$ 2,969,217
Liabilities
Fair value of securities owned \| $	316,000	$ 304,000
BPL bridge loans
Assets
Loans receivable, fair value \| $	$ 2,207,964
BPL bridge loans \| Dollar price of non-performing loans \| Minimum
Assets
Loans held-for-investment, measurement input	48
BPL bridge loans \| Dollar price of non-performing loans \| Maximum
Assets
Loans held-for-investment, measurement input	100
BPL bridge loans \| Dollar price of non-performing loans \| Weighted Average
Assets
Loans held-for-investment, measurement input	91
BPL bridge loans \| Whole loan discount rate \| Minimum
Assets
Loans held-for-investment, measurement input	0.06
BPL bridge loans \| Whole loan discount rate \| Maximum
Assets
Loans held-for-investment, measurement input	0.12
BPL bridge loans \| Whole loan discount rate \| Weighted Average
Assets
Loans held-for-investment, measurement input	0.09
BPL bridge loans \| Dollar price of non-performing loans \| Minimum
Assets
Loans held-for-investment, measurement input	0.0520
BPL bridge loans \| Dollar price of non-performing loans \| Maximum
Assets
Loans held-for-investment, measurement input	0.0520
BPL bridge loans \| Dollar price of non-performing loans \| Weighted Average
Assets
Loans held-for-investment, measurement input	0.0520
Freddie Mac K-Series
Assets
Loans receivable, fair value \| $	$ 420,554
Liabilities
Fair value of securities owned \| $	33,000
Trading and AFS securities
Assets
Trading and AFS securities \| $	$ 129,445
Trading and AFS securities \| Prepayment rate (annual CPR) \| Minimum
Assets
Trading and AFS securities	0.04
Trading and AFS securities \| Prepayment rate (annual CPR) \| Maximum
Assets
Trading and AFS securities	0.65
Trading and AFS securities \| Prepayment rate (annual CPR) \| Weighted Average
Assets
Trading and AFS securities	0.10
Trading and AFS securities \| Whole loan discount rate \| Minimum
Assets
Trading and AFS securities	0.06
Trading and AFS securities \| Whole loan discount rate \| Maximum
Assets
Trading and AFS securities	0.18
Trading and AFS securities \| Whole loan discount rate \| Weighted Average
Assets
Trading and AFS securities	0.11
Trading and AFS securities \| Default rate \| Minimum
Assets
Trading and AFS securities	0
Trading and AFS securities \| Default rate \| Maximum
Assets
Trading and AFS securities	0.14
Trading and AFS securities \| Default rate \| Weighted Average
Assets
Trading and AFS securities	0.001
Trading and AFS securities \| Loss severity \| Minimum
Assets
Trading and AFS securities	0
Trading and AFS securities \| Loss severity \| Maximum
Assets
Trading and AFS securities	0.50
Trading and AFS securities \| Loss severity \| Weighted Average
Assets
Trading and AFS securities	0.22
HEI
Assets
HEI \| $	$ 302,122
HEI \| Prepayment rate (annual CPR) \| Minimum
Assets
HEI, Measurement input	0.01
HEI \| Prepayment rate (annual CPR) \| Maximum
Assets
HEI, Measurement input	0.20
HEI \| Prepayment rate (annual CPR) \| Weighted Average
Assets
HEI, Measurement input	0.15
HEI \| Whole loan discount rate \| Minimum
Assets
HEI, Measurement input	0.10
HEI \| Whole loan discount rate \| Maximum
Assets
HEI, Measurement input	0.11
HEI \| Whole loan discount rate \| Weighted Average
Assets
HEI, Measurement input	0.10
HEI \| Home price appreciation (depreciation) \| Minimum
Assets
HEI, Measurement input	(0.01)
HEI \| Home price appreciation (depreciation) \| Maximum
Assets
HEI, Measurement input	0.03
HEI \| Home price appreciation (depreciation) \| Weighted Average
Assets
HEI, Measurement input	0.03
HEIs held by Point HEI entity
Assets
HEI \| $	$ 129,150
Servicer Advance Investments
Assets
Servicing asset \| $	$ 219,813
Servicer Advance Investments \| Minimum
Assets
Expected remaining life	6 years
Servicer Advance Investments \| Maximum
Assets
Expected remaining life	6 years
Servicer Advance Investments \| Weighted Average
Assets
Expected remaining life	6 years
Servicer Advance Investments \| Prepayment rate (annual CPR) \| Minimum
Assets
Servicing asset, measurement input	0.11
Servicer Advance Investments \| Prepayment rate (annual CPR) \| Maximum
Assets
Servicing asset, measurement input	0.30
Servicer Advance Investments \| Prepayment rate (annual CPR) \| Weighted Average
Assets
Servicing asset, measurement input	0.14
Servicer Advance Investments \| Whole loan discount rate \| Minimum
Assets
Servicing asset, measurement input	0.03
Servicer Advance Investments \| Whole loan discount rate \| Maximum
Assets
Servicing asset, measurement input	0.05
Servicer Advance Investments \| Whole loan discount rate \| Weighted Average
Assets
Servicing asset, measurement input	0.04
Servicer Advance Investments \| Mortgage servicing income \| Minimum
Assets
Servicing asset, measurement input	0
Servicer Advance Investments \| Mortgage servicing income \| Maximum
Assets
Servicing asset, measurement input	0.0018
Servicer Advance Investments \| Mortgage servicing income \| Weighted Average
Assets
Servicing asset, measurement input	0.0004
MSRs
Assets
Servicing asset \| $	$ 26,033
MSRs \| Prepayment rate (annual CPR) \| Minimum
Assets
Servicing asset, measurement input	0.03
MSRs \| Prepayment rate (annual CPR) \| Maximum
Assets
Servicing asset, measurement input	0.21
MSRs \| Prepayment rate (annual CPR) \| Weighted Average
Assets
Servicing asset, measurement input	0.06
MSRs \| Whole loan discount rate \| Minimum
Assets
Servicing asset, measurement input	0.12
MSRs \| Whole loan discount rate \| Maximum
Assets
Servicing asset, measurement input	0.73
MSRs \| Whole loan discount rate \| Weighted Average
Assets
Servicing asset, measurement input	0.13
MSRs \| Per loan annual cost to service \| Minimum
Assets
Servicing asset, measurement input	93
MSRs \| Per loan annual cost to service \| Maximum
Assets
Servicing asset, measurement input	93
MSRs \| Per loan annual cost to service \| Weighted Average
Assets
Servicing asset, measurement input	93
Excess MSRs
Assets
Servicing asset \| $	$ 38,427
Excess MSRs \| Prepayment rate (annual CPR) \| Minimum
Assets
Servicing asset, measurement input	0.10
Excess MSRs \| Prepayment rate (annual CPR) \| Maximum
Assets
Servicing asset, measurement input	1
Excess MSRs \| Prepayment rate (annual CPR) \| Weighted Average
Assets
Servicing asset, measurement input	0.17
Excess MSRs \| Whole loan discount rate \| Minimum
Assets
Servicing asset, measurement input	0.13
Excess MSRs \| Whole loan discount rate \| Maximum
Assets
Servicing asset, measurement input	0.19
Excess MSRs \| Whole loan discount rate \| Weighted Average
Assets
Servicing asset, measurement input	0.18
Excess MSRs \| Excess mortgage servicing amount \| Minimum
Assets
Servicing asset, measurement input	0.0008
Excess MSRs \| Excess mortgage servicing amount \| Maximum
Assets
Servicing asset, measurement input	0.0020
Excess MSRs \| Excess mortgage servicing amount \| Weighted Average
Assets
Servicing asset, measurement input	0.0011
Residential loan purchase commitments
Assets
Loan purchase commitments, net \| $	$ 1,980
Residential loan purchase commitments \| Pull-through rate \| Minimum
Assets
Loans receivable, measurement input	0.22
Residential loan purchase commitments \| Pull-through rate \| Maximum
Assets
Loans receivable, measurement input	1
Residential loan purchase commitments \| Pull-through rate \| Weighted Average
Assets
Loans receivable, measurement input	0.68
Residential loan purchase commitments \| Committed sales price \| Minimum
Assets
Loans receivable, measurement input	102
Residential loan purchase commitments \| Committed sales price \| Maximum
Assets
Loans receivable, measurement input	103
Residential loan purchase commitments \| Committed sales price \| Weighted Average
Assets
Loans receivable, measurement input	102