Segment Information - Key Servicing Metrics (Details) - Agency Business - MSRs - USD ($) $ in Thousands	12 Months Ended
Dec. 31, 2023	Dec. 31, 2022
Segment Reporting Information [Line Items]
Servicing Portfolio UPB	$ 30,983,455	$ 27,998,029
Wtd. Avg. Servicing Fee Rate (basis points)	0.391%	0.411%
Wtd. Avg. Life of Portfolio (years)	8 years	8 years 7 months 6 days
SFR - Fixed Rate
Segment Reporting Information [Line Items]
Servicing Portfolio UPB	$ 287,446	$ 274,764
Wtd. Avg. Servicing Fee Rate (basis points)	0.201%	0.198%
Wtd. Avg. Life of Portfolio (years)	5 years 1 month 6 days	6 years
Fannie Mae
Segment Reporting Information [Line Items]
Servicing Portfolio UPB	$ 21,264,578	$ 19,038,124
Wtd. Avg. Servicing Fee Rate (basis points)	0.474%	0.502%
Wtd. Avg. Life of Portfolio (years)	7 years 4 months 24 days	8 years
Freddie Mac
Segment Reporting Information [Line Items]
Servicing Portfolio UPB	$ 5,181,933	$ 5,153,207
Wtd. Avg. Servicing Fee Rate (basis points)	0.24%	0.25%
Wtd. Avg. Life of Portfolio (years)	8 years 6 months	9 years
Private Label
Segment Reporting Information [Line Items]
Servicing Portfolio UPB	$ 2,510,449	$ 2,074,859
Wtd. Avg. Servicing Fee Rate (basis points)	0.195%	0.185%
Wtd. Avg. Life of Portfolio (years)	6 years 8 months 12 days	7 years 7 months 6 days
FHA
Segment Reporting Information [Line Items]
Servicing Portfolio UPB	$ 1,359,624	$ 1,155,893
Wtd. Avg. Servicing Fee Rate (basis points)	0.144%	0.149%
Wtd. Avg. Life of Portfolio (years)	19 years 2 months 12 days	19 years 6 months
Bridge
Segment Reporting Information [Line Items]
Servicing Portfolio UPB	$ 379,425	$ 301,182
Wtd. Avg. Servicing Fee Rate (basis points)	0.109%	0.125%
Wtd. Avg. Life of Portfolio (years)	3 years 2 months 12 days	1 year 8 months 12 days