Schedule IV - Mortgage Loans on Real Estate (Details) $ in Thousands	12 Months Ended
	Dec. 31, 2023 USD ($) loan	Dec. 31, 2022 USD ($)	Dec. 31, 2021 USD ($)
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Fair Value	$ 3,084,303	$ 3,525,080	$ 3,575,601
Principal Amount of Loans Subject to Delinquent Principal or Interest	305,227
Reconciliation of Balance Sheet Reported Amounts of Mortgage Loans on Real Estate
Beginning balance	3,525,080	3,575,601	3,049,166
Additions during period:
Purchases	620,277	1,733,265	1,581,979
Accretion of purchase discount	6,689	5,292	4,154
Change in realized and unrealized gains	65,485	(404,524)	44,564
Deductions during period:
Repayments of principal	(1,062,930)	(1,362,294)	(1,018,176)
Collection of interest	0	0	0
Transfer to REO	(42,485)	(18,858)	(4,133)
Cost of loans sold	(25,144)	0	(77,127)
Provision for loan loss	0	0	0
Amortization of premium	(2,669)	(3,402)	(4,826)
Balance at end of period	$ 3,084,303	3,525,080	3,575,601
Constructive Loans, LLC
Deductions during period:
Option to purchase issued and outstanding interests, percentage	50.00%
Purchase of residential loans	$ 80,800	$ 260,600	$ 94,000
Consolidated Mortgage Loans
Deductions during period:
Cost of consolidated real estate for federal income tax purposes	2,500,000
Amount acquired from controlled and other affiliates	$ 7,400
First lien loans \| Consolidated SLST
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	5,813
Fair Value	$ 754,860
Principal Amount of Loans Subject to Delinquent Principal or Interest	84,650
Deductions during period:
Balance at end of period	$ 754,860
First lien loans \| Consolidated SLST \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	1.38%
First lien loans \| Consolidated SLST \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	10.50%
Mortgage Loans Under $100,000 \| First lien loans \| Residential loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	302
Fair Value	$ 8,348
Principal Amount of Loans Subject to Delinquent Principal or Interest	387
Deductions during period:
Balance at end of period	$ 8,348
Mortgage Loans Under $100,000 \| First lien loans \| Residential loans \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	2.00%
Mortgage Loans Under $100,000 \| First lien loans \| Residential loans \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	14.99%
Mortgage Loans Under $100,000 \| First lien loans \| Residential loans held in securitization trusts
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	1,637
Fair Value	$ 81,538
Principal Amount of Loans Subject to Delinquent Principal or Interest	7,390
Deductions during period:
Balance at end of period	$ 81,538
Mortgage Loans Under $100,000 \| First lien loans \| Residential loans held in securitization trusts \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	0.00%
Mortgage Loans Under $100,000 \| First lien loans \| Residential loans held in securitization trusts \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	14.29%
Mortgage Loans Under $100,000 \| Second lien loans \| Residential loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	168
Fair Value	$ 5,546
Principal Amount of Loans Subject to Delinquent Principal or Interest	474
Deductions during period:
Balance at end of period	$ 5,546
Mortgage Loans Under $100,000 \| Second lien loans \| Residential loans \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	0.00%
Mortgage Loans Under $100,000 \| Second lien loans \| Residential loans \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	8.88%
Mortgage Loans Under $100,000 \| Business purpose loans \| Residential loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	218
Fair Value	$ 27,199
Principal Amount of Loans Subject to Delinquent Principal or Interest	3,829
Deductions during period:
Balance at end of period	$ 27,199
Mortgage Loans Under $100,000 \| Business purpose loans \| Residential loans \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	5.50%
Mortgage Loans Under $100,000 \| Business purpose loans \| Residential loans \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	13.65%
Mortgage Loans Under $100,000 \| Business purpose loans \| Residential loans held in securitization trusts
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	340
Fair Value	$ 38,721
Principal Amount of Loans Subject to Delinquent Principal or Interest	1,676
Deductions during period:
Balance at end of period	$ 38,721
Mortgage Loans Under $100,000 \| Business purpose loans \| Residential loans held in securitization trusts \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	4.00%
Mortgage Loans Under $100,000 \| Business purpose loans \| Residential loans held in securitization trusts \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	13.49%
Mortgage Loans Between $100,000 - $199,999 \| First lien loans \| Residential loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	309
Fair Value	$ 34,929
Principal Amount of Loans Subject to Delinquent Principal or Interest	347
Deductions during period:
Balance at end of period	$ 34,929
Mortgage Loans Between $100,000 - $199,999 \| First lien loans \| Residential loans \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	2.13%
Mortgage Loans Between $100,000 - $199,999 \| First lien loans \| Residential loans \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	11.72%
Mortgage Loans Between $100,000 - $199,999 \| First lien loans \| Residential loans held in securitization trusts
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	2,116
Fair Value	$ 222,407
Principal Amount of Loans Subject to Delinquent Principal or Interest	13,813
Deductions during period:
Balance at end of period	$ 222,407
Mortgage Loans Between $100,000 - $199,999 \| First lien loans \| Residential loans held in securitization trusts \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	0.00%
Mortgage Loans Between $100,000 - $199,999 \| First lien loans \| Residential loans held in securitization trusts \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	12.75%
Mortgage Loans Between $100,000 - $199,999 \| Second lien loans \| Residential loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	9
Fair Value	$ 947
Principal Amount of Loans Subject to Delinquent Principal or Interest	0
Deductions during period:
Balance at end of period	$ 947
Mortgage Loans Between $100,000 - $199,999 \| Second lien loans \| Residential loans \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	6.25%
Mortgage Loans Between $100,000 - $199,999 \| Second lien loans \| Residential loans \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	8.63%
Mortgage Loans Between $100,000 - $199,999 \| Business purpose loans \| Residential loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	238
Fair Value	$ 41,772
Principal Amount of Loans Subject to Delinquent Principal or Interest	11,278
Deductions during period:
Balance at end of period	$ 41,772
Mortgage Loans Between $100,000 - $199,999 \| Business purpose loans \| Residential loans \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	4.25%
Mortgage Loans Between $100,000 - $199,999 \| Business purpose loans \| Residential loans \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	14.29%
Mortgage Loans Between $100,000 - $199,999 \| Business purpose loans \| Residential loans held in securitization trusts
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	520
Fair Value	$ 78,371
Principal Amount of Loans Subject to Delinquent Principal or Interest	2,001
Deductions during period:
Balance at end of period	$ 78,371
Mortgage Loans Between $100,000 - $199,999 \| Business purpose loans \| Residential loans held in securitization trusts \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	3.75%
Mortgage Loans Between $100,000 - $199,999 \| Business purpose loans \| Residential loans held in securitization trusts \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	14.75%
Mortgage Loans Between $200,000 - $299,999 \| First lien loans \| Residential loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	281
Fair Value	$ 53,418
Principal Amount of Loans Subject to Delinquent Principal or Interest	1,276
Deductions during period:
Balance at end of period	$ 53,418
Mortgage Loans Between $200,000 - $299,999 \| First lien loans \| Residential loans \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	1.88%
Mortgage Loans Between $200,000 - $299,999 \| First lien loans \| Residential loans \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	7.63%
Mortgage Loans Between $200,000 - $299,999 \| First lien loans \| Residential loans held in securitization trusts
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	1,041
Fair Value	$ 186,574
Principal Amount of Loans Subject to Delinquent Principal or Interest	12,114
Deductions during period:
Balance at end of period	$ 186,574
Mortgage Loans Between $200,000 - $299,999 \| First lien loans \| Residential loans held in securitization trusts \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	0.00%
Mortgage Loans Between $200,000 - $299,999 \| First lien loans \| Residential loans held in securitization trusts \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	13.25%
Mortgage Loans Between $200,000 - $299,999 \| Second lien loans \| Residential loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	4
Fair Value	$ 712
Principal Amount of Loans Subject to Delinquent Principal or Interest	0
Deductions during period:
Balance at end of period	$ 712
Mortgage Loans Between $200,000 - $299,999 \| Second lien loans \| Residential loans \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	6.75%
Mortgage Loans Between $200,000 - $299,999 \| Second lien loans \| Residential loans \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	7.75%
Mortgage Loans Between $200,000 - $299,999 \| Business purpose loans \| Residential loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	196
Fair Value	$ 51,703
Principal Amount of Loans Subject to Delinquent Principal or Interest	9,943
Deductions during period:
Balance at end of period	$ 51,703
Mortgage Loans Between $200,000 - $299,999 \| Business purpose loans \| Residential loans \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	5.63%
Mortgage Loans Between $200,000 - $299,999 \| Business purpose loans \| Residential loans \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	15.19%
Mortgage Loans Between $200,000 - $299,999 \| Business purpose loans \| Residential loans held in securitization trusts
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	304
Fair Value	$ 73,003
Principal Amount of Loans Subject to Delinquent Principal or Interest	1,219
Deductions during period:
Balance at end of period	$ 73,003
Mortgage Loans Between $200,000 - $299,999 \| Business purpose loans \| Residential loans held in securitization trusts \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	3.50%
Mortgage Loans Between $200,000 - $299,999 \| Business purpose loans \| Residential loans held in securitization trusts \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	12.99%
Mortgage Loans Over $299,999 \| First lien loans \| Residential loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	402
Fair Value	$ 148,642
Principal Amount of Loans Subject to Delinquent Principal or Interest	1,367
Deductions during period:
Balance at end of period	$ 148,642
Mortgage Loans Over $299,999 \| First lien loans \| Residential loans \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	1.99%
Mortgage Loans Over $299,999 \| First lien loans \| Residential loans \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	9.38%
Mortgage Loans Over $299,999 \| First lien loans \| Residential loans held in securitization trusts
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	1,221
Fair Value	$ 406,914
Principal Amount of Loans Subject to Delinquent Principal or Interest	27,348
Deductions during period:
Balance at end of period	$ 406,914
Mortgage Loans Over $299,999 \| First lien loans \| Residential loans held in securitization trusts \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	1.88%
Mortgage Loans Over $299,999 \| First lien loans \| Residential loans held in securitization trusts \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	9.75%
Mortgage Loans Over $299,999 \| Business purpose loans \| Residential loans
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	488
Fair Value	$ 454,158
Principal Amount of Loans Subject to Delinquent Principal or Interest	104,816
Deductions during period:
Balance at end of period	$ 454,158
Mortgage Loans Over $299,999 \| Business purpose loans \| Residential loans \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	5.50%
Mortgage Loans Over $299,999 \| Business purpose loans \| Residential loans \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	15.39%
Mortgage Loans Over $299,999 \| Business purpose loans \| Residential loans held in securitization trusts
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Number of Loans \| loan	527
Fair Value	$ 414,541
Principal Amount of Loans Subject to Delinquent Principal or Interest	21,299
Deductions during period:
Balance at end of period	$ 414,541
Mortgage Loans Over $299,999 \| Business purpose loans \| Residential loans held in securitization trusts \| Minimum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	3.49%
Mortgage Loans Over $299,999 \| Business purpose loans \| Residential loans held in securitization trusts \| Maximum
SEC Schedule, 12-29, Real Estate Companies, Investment in Mortgage Loans on Real Estate [Line Items]
Interest Rate	12.99%