Subordinated Debentures and Convertible Notes - Summary of Trust Preferred Securities and Debentures (Details) - USD ($)	Mar. 31, 2021	Dec. 31, 2020
Subordinated Borrowing [Line Items]
Trust Preferred Security Amount	$ 126,000,000.0
Carrying Value of Debentures	104,469,000	$ 104,178,000
Trust Preferred Security Amount
Subordinated Borrowing [Line Items]
Trust Preferred Security Amount	126,000,000
Carrying Value of Debentures
Subordinated Borrowing [Line Items]
Carrying Value of Debentures	$ 104,469,000	$ 104,200,000
Nara Capital Trust III
Subordinated Borrowing [Line Items]
Current Rate	3.334%
Nara Capital Trust III \| Trust Preferred Security Amount
Subordinated Borrowing [Line Items]
Trust Preferred Security Amount	$ 5,000,000
Nara Capital Trust III \| Carrying Value of Debentures
Subordinated Borrowing [Line Items]
Carrying Value of Debentures	$ 5,155,000
Nara Statutory Trust IV
Subordinated Borrowing [Line Items]
Current Rate	3.091%
Nara Statutory Trust IV \| Trust Preferred Security Amount
Subordinated Borrowing [Line Items]
Trust Preferred Security Amount	$ 5,000,000
Nara Statutory Trust IV \| Carrying Value of Debentures
Subordinated Borrowing [Line Items]
Carrying Value of Debentures	$ 5,155,000
Nara Statutory Trust V
Subordinated Borrowing [Line Items]
Current Rate	3.132%
Nara Statutory Trust V \| Trust Preferred Security Amount
Subordinated Borrowing [Line Items]
Trust Preferred Security Amount	$ 10,000,000
Nara Statutory Trust V \| Carrying Value of Debentures
Subordinated Borrowing [Line Items]
Carrying Value of Debentures	$ 10,310,000
Nara Statutory Trust VI
Subordinated Borrowing [Line Items]
Current Rate	1.834%
Nara Statutory Trust VI \| Trust Preferred Security Amount
Subordinated Borrowing [Line Items]
Trust Preferred Security Amount	$ 8,000,000
Nara Statutory Trust VI \| Carrying Value of Debentures
Subordinated Borrowing [Line Items]
Carrying Value of Debentures	$ 8,248,000
Center Capital Trust I
Subordinated Borrowing [Line Items]
Current Rate	3.091%
Center Capital Trust I \| Trust Preferred Security Amount
Subordinated Borrowing [Line Items]
Trust Preferred Security Amount	$ 18,000,000
Center Capital Trust I \| Carrying Value of Debentures
Subordinated Borrowing [Line Items]
Carrying Value of Debentures	$ 14,514,000
Wilshire Trust II
Subordinated Borrowing [Line Items]
Current Rate	1.972%
Wilshire Trust II \| Trust Preferred Security Amount
Subordinated Borrowing [Line Items]
Trust Preferred Security Amount	$ 20,000,000
Wilshire Trust II \| Carrying Value of Debentures
Subordinated Borrowing [Line Items]
Carrying Value of Debentures	$ 16,025,000
Wilshire Trust III
Subordinated Borrowing [Line Items]
Current Rate	1.584%
Wilshire Trust III \| Trust Preferred Security Amount
Subordinated Borrowing [Line Items]
Trust Preferred Security Amount	$ 15,000,000
Wilshire Trust III \| Carrying Value of Debentures
Subordinated Borrowing [Line Items]
Carrying Value of Debentures	$ 11,374,000
Wilshire Trust IV
Subordinated Borrowing [Line Items]
Current Rate	1.564%
Wilshire Trust IV \| Trust Preferred Security Amount
Subordinated Borrowing [Line Items]
Trust Preferred Security Amount	$ 25,000,000
Wilshire Trust IV \| Carrying Value of Debentures
Subordinated Borrowing [Line Items]
Carrying Value of Debentures	$ 18,406,000
Saehan Capital Trust I
Subordinated Borrowing [Line Items]
Current Rate	1.819%
Saehan Capital Trust I \| Trust Preferred Security Amount
Subordinated Borrowing [Line Items]
Trust Preferred Security Amount	$ 20,000,000
Saehan Capital Trust I \| Carrying Value of Debentures
Subordinated Borrowing [Line Items]
Carrying Value of Debentures	$ 15,282,000