Loans Receivable and Allowance for Loan Losses - Troubled Debt Restructurings on Financing Receivables (Details) (USD $)	12 Months Ended
	Dec. 31, 2013 loan	Dec. 31, 2012 loan	Dec. 31, 2011 loan
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	$ 58,904,000	$ 51,451,000
Troubled Debt Restructuring, By Loan Class
Number of Loans	41	42
Pre-Modification	30,749,000	34,669,000
Post-Modification	22,566,000	30,355,000
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	12	9	15
Balance	6,279,000	7,089,000	2,448,000
Specific reserves	2,000,000	2,500,000
Specific reserves for the TDRs	661,000	89,000
Specific reserves allocated to TDRs	6,600,000	6,300,000
Payment concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	20,029,000	20,450,000
Maturity/ Amortization concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	13,174,000	8,193,000
Rate concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	25,652,000	22,746,000
Principal forgiveness
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	49,000	62,000
TDR on accrual
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	33,904,000	29,849,000
TDR on accrual \| Payment concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	8,494,000	10,295,000
TDR on accrual \| Maturity/ Amortization concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	7,865,000	4,731,000
TDR on accrual \| Rate concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	17,545,000	14,823,000
TDR on accrual \| Principal forgiveness
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	0	0
TDR on non-accrual
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	25,000,000	21,602,000
TDR on non-accrual \| Payment concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	11,535,000	10,155,000
TDR on non-accrual \| Maturity/ Amortization concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	5,309,000	3,462,000
TDR on non-accrual \| Rate concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	8,107,000	7,923,000
TDR on non-accrual \| Principal forgiveness
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	49,000	62,000
Real estate-Commercial \| TDR on accrual
Financing Receivable, Modifications [Line Items]
Number of TDRs on accrual status	15	12
Commercial business \| TDR on accrual
Financing Receivable, Modifications [Line Items]
Number of TDRs on accrual status	28	20
Consumer \| TDR on accrual
Financing Receivable, Modifications [Line Items]
Number of TDRs on accrual status	2
Real Estate \| Real estate-Commercial \| TDR on accrual
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	21,257,000	23,550,000
Real Estate \| Real estate-Commercial \| TDR on accrual \| Payment concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	7,437,000	9,608,000
Real Estate \| Real estate-Commercial \| TDR on accrual \| Maturity/ Amortization concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	765,000	348,000
Real Estate \| Real estate-Commercial \| TDR on accrual \| Rate concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	13,055,000	13,594,000
Real Estate \| Real estate-Commercial \| TDR on accrual \| Principal forgiveness
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	0	0
Real Estate \| Real estate-Commercial \| TDR on non-accrual
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	19,249,000	13,310,000
Real Estate \| Real estate-Commercial \| TDR on non-accrual \| Payment concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	9,489,000	4,735,000
Real Estate \| Real estate-Commercial \| TDR on non-accrual \| Maturity/ Amortization concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	1,653,000	652,000
Real Estate \| Real estate-Commercial \| TDR on non-accrual \| Rate concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	8,107,000	7,923,000
Real Estate \| Real estate-Commercial \| TDR on non-accrual \| Principal forgiveness
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	0	0
Commercial Business \| TDR on accrual
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	12,112,000	5,763,000
Commercial Business \| TDR on accrual \| Payment concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	1,057,000	687,000
Commercial Business \| TDR on accrual \| Maturity/ Amortization concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	6,565,000	3,847,000
Commercial Business \| TDR on accrual \| Rate concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	4,490,000	1,229,000
Commercial Business \| TDR on accrual \| Principal forgiveness
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	0	0
Commercial Business \| TDR on non-accrual
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	4,984,000	6,621,000
Commercial Business \| TDR on non-accrual \| Payment concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	1,279,000	4,618,000
Commercial Business \| TDR on non-accrual \| Maturity/ Amortization concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	3,656,000	1,941,000
Commercial Business \| TDR on non-accrual \| Rate concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	0	0
Commercial Business \| TDR on non-accrual \| Principal forgiveness
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	49,000	62,000
Commercial Business \| Commercial business \| TDR on accrual
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	12,100,000
Trade Finance and Other \| TDR on accrual
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	535,000	536,000
Trade Finance and Other \| TDR on accrual \| Payment concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	0	0
Trade Finance and Other \| TDR on accrual \| Maturity/ Amortization concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	535,000	536,000
Trade Finance and Other \| TDR on accrual \| Rate concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	0	0
Trade Finance and Other \| TDR on accrual \| Principal forgiveness
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	0	0
Trade Finance and Other \| TDR on non-accrual
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	767,000	1,671,000
Trade Finance and Other \| TDR on non-accrual \| Payment concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	767,000	802,000
Trade Finance and Other \| TDR on non-accrual \| Maturity/ Amortization concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	0	869,000
Trade Finance and Other \| TDR on non-accrual \| Rate concession
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	0	0
Trade Finance and Other \| TDR on non-accrual \| Principal forgiveness
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	0	0
Consumer and Other \| Consumer \| TDR on accrual
Financing Receivable, Modifications [Line Items]
Troubled debt restructured	535,000
Legacy
Troubled Debt Restructuring, By Loan Class
Number of Loans	25	28
Pre-Modification	17,593,000	23,092,000
Post-Modification	15,474,000	19,262,000
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	6	6	15
Balance	1,048,000	956,000	2,448,000
Charge offs	7,018,000	158,000
Legacy \| Real Estate \| Real estate-Residential
Troubled Debt Restructuring, By Loan Class
Number of Loans	0	0
Pre-Modification	0	0
Post-Modification	0	0
Legacy \| Real Estate \| Real estate-Commercial \| Retail
Troubled Debt Restructuring, By Loan Class
Number of Loans	6	5
Pre-Modification	6,195,000	2,456,000
Post-Modification	6,214,000	2,321,000
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	1	1	1
Legacy \| Real Estate \| Real estate-Commercial \| Hotel & Motel
Troubled Debt Restructuring, By Loan Class
Number of Loans	0	1
Pre-Modification	0	1,479,000
Post-Modification	0	1,444,000
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	0	0	2
Balance		0	0
Legacy \| Real Estate \| Real estate-Commercial \| Gas Station & Car Wash
Troubled Debt Restructuring, By Loan Class
Number of Loans	1	1
Pre-Modification	1,371,000	216,000
Post-Modification	880,000	50,000
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	0	1	0
Balance		50,000	0
Legacy \| Real Estate \| Real estate-Commercial \| Mixed Use
Troubled Debt Restructuring, By Loan Class
Number of Loans	0	0
Pre-Modification	0	0
Post-Modification	0	0
Legacy \| Real Estate \| Real estate-Commercial \| Industrial & Warehouse
Troubled Debt Restructuring, By Loan Class
Number of Loans	1	1
Pre-Modification	370,000	502,000
Post-Modification	338,000	494,000
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	0	0	3
Balance	0
Legacy \| Real Estate \| Real estate-Commercial \| Other
Troubled Debt Restructuring, By Loan Class
Number of Loans	0	4
Pre-Modification	0	12,391,000
Post-Modification	0	9,234,000
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	0	1	1
Legacy \| Real Estate \| Real estate-Commercial \| Payment concession \| Hotel & Motel
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Balance	0
Legacy \| Real Estate \| Real estate-Commercial \| Payment concession \| Gas Station & Car Wash
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Balance	0
Legacy \| Real Estate \| Real estate-Commercial \| Payment concession \| Industrial & Warehouse
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Balance		0	961,000
Legacy \| Real Estate \| Real estate-Commercial \| Payment concession \| Other
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Balance		562,000	294,000
Legacy \| Real Estate \| Real estate-Commercial \| Maturity/ Amortization concession \| Retail
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Balance	508,000	268,000	771,000
Legacy \| Real Estate \| Real estate-Commercial \| Rate concession \| Other
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	1
Balance	0
Legacy \| Real Estate \| Real estate-Construction
Troubled Debt Restructuring, By Loan Class
Number of Loans	0	0
Pre-Modification	0	0
Post-Modification	0	0
Legacy \| Commercial Business
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	5	3	8
Balance		76,000	422,000
Legacy \| Commercial Business \| Payment concession
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans		1	5
Balance			397,000
Legacy \| Commercial Business \| Maturity/ Amortization concession
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans		2	3
Balance	540,000		25,000
Legacy \| Commercial Business \| Payment Concession And Rate Concession
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Balance	540,000
Legacy \| Commercial Business \| Commercial business
Troubled Debt Restructuring, By Loan Class
Number of Loans	15	14
Pre-Modification	8,687,000	4,075,000
Post-Modification	7,552,000	4,838,000
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	1
Legacy \| Commercial Business \| Commercial business \| Payment concession
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	2
Legacy \| Trade Finance and Other \| Trade Finance
Troubled Debt Restructuring, By Loan Class
Number of Loans	0	1
Pre-Modification	0	1,493,000
Post-Modification	0	401,000
Legacy \| Consumer and Other \| Trade Finance
Troubled Debt Restructuring, By Loan Class
Number of Loans	2	1
Pre-Modification	970,000	480,000
Post-Modification	490,000	480,000
Acquired
Troubled Debt Restructuring, By Loan Class
Number of Loans	16	14
Pre-Modification	13,156,000	11,577,000
Post-Modification	7,092,000	11,093,000
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	6	3	0
Balance	5,231,000	6,133,000	0
Charge offs	2,600,000	158,000
Acquired \| Real Estate \| Real estate-Residential
Troubled Debt Restructuring, By Loan Class
Number of Loans	0	0
Pre-Modification	0	0
Post-Modification	0	0
Acquired \| Real Estate \| Real estate-Commercial \| Retail
Troubled Debt Restructuring, By Loan Class
Number of Loans	3	2
Pre-Modification	336,000	1,458,000
Post-Modification	321,000	1,286,000
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	1	0	0
Balance	56,000	0	0
Acquired \| Real Estate \| Real estate-Commercial \| Hotel & Motel
Troubled Debt Restructuring, By Loan Class
Number of Loans	0	1
Pre-Modification	0	6,165,000
Post-Modification	0	5,990,000
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	0	1	0
Acquired \| Real Estate \| Real estate-Commercial \| Gas Station & Car Wash
Troubled Debt Restructuring, By Loan Class
Number of Loans	1	0
Pre-Modification	165,000	0
Post-Modification	0	0
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	1	0	0
Acquired \| Real Estate \| Real estate-Commercial \| Mixed Use
Troubled Debt Restructuring, By Loan Class
Number of Loans	0	0
Pre-Modification	0	0
Post-Modification	0	0
Acquired \| Real Estate \| Real estate-Commercial \| Industrial & Warehouse
Troubled Debt Restructuring, By Loan Class
Number of Loans	2	0
Pre-Modification	10,336,000	0
Post-Modification	5,208,000	0
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	1	0	0
Balance	5,128,000	0	0
Acquired \| Real Estate \| Real estate-Commercial \| Other
Troubled Debt Restructuring, By Loan Class
Number of Loans	2	1
Pre-Modification	1,137,000	670,000
Post-Modification	1,122,000	631,000
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	0	0	0
Balance	0	0	0
Acquired \| Real Estate \| Real estate-Commercial \| Rate concession \| Hotel & Motel
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Balance	0	5,990,000	0
Acquired \| Real Estate \| Real estate-Commercial \| Rate concession \| Gas Station & Car Wash
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Balance	0	0	0
Acquired \| Real Estate \| Real estate-Construction
Troubled Debt Restructuring, By Loan Class
Number of Loans	0	0
Pre-Modification	0	0
Post-Modification	0	0
Acquired \| Commercial Business
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	3	2	0
Acquired \| Commercial Business \| Payment Concession And Rate Concession
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Balance	47,000	143,000	0
Acquired \| Commercial Business \| Commercial business
Troubled Debt Restructuring, By Loan Class
Number of Loans	8	6
Pre-Modification	1,182,000	2,476,000
Post-Modification	441,000	2,384,000
Acquired \| Commercial Business \| Commercial business \| Maturity/ Amortization concession
Troubled Debt Restructuring, By Loan Class, Modified And Subsequent Payment Default
Number of Loans	2
Acquired \| Trade Finance and Other
Troubled Debt Restructuring, By Loan Class
Number of Loans	0	0
Pre-Modification	0	0
Post-Modification	0	0
Acquired \| Consumer and Other \| Trade Finance
Troubled Debt Restructuring, By Loan Class
Number of Loans	0	4
Pre-Modification	0	808,000
Post-Modification	$ 0	$ 802,000