Investment Securities (Investment securities by contractual maturity) (Details) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2014	Dec. 31, 2013
Schedule of Investments [Line Items]
Available for sale Amortized Cost	$ 1,385,438	$ 1,575,043
Available-for-sale Securities	1,418,958	1,588,425
Held-to-maturity, Amortized cost	26,706
Held to maturity Fair Value	26,844	0
Collateralized Mortgage Backed Securities [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	1,275,705	1,419,117
Available-for-sale Securities	1,314,677	1,439,539
Held-to-maturity, Amortized cost	26,706
Held to maturity Fair Value	26,844
Collateralized Mortgage Backed Securities [Member] \| FNMA and FHLMC [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	1,070,034	1,190,910
Available-for-sale Securities	1,112,118	1,217,330
Held-to-maturity, Amortized cost	26,706
Held to maturity Fair Value	26,844
Collateralized Mortgage Backed Securities [Member] \| GNMA [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	5,560	7,406
Available-for-sale Securities	5,928	7,815
Collateralized Mortgage Backed Securities [Member] \| CMO's [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	200,111	220,801
Available-for-sale Securities	196,631	214,394
Collateralized Mortgage Backed Securities [Member] \| Maturities Due From Five To Ten Years [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	24,631
Available-for-sale Securities	25,109
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Collateralized Mortgage Backed Securities [Member] \| Maturities Due From Five To Ten Years [Member] \| FNMA and FHLMC [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	24,631
Available-for-sale Securities	25,109
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Collateralized Mortgage Backed Securities [Member] \| Maturities Due After Ten Years [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	1,251,074
Available-for-sale Securities	1,289,568
Held-to-maturity, Amortized cost	26,706
Held to maturity Fair Value	26,844
Collateralized Mortgage Backed Securities [Member] \| Maturities Due After Ten Years [Member] \| FNMA and FHLMC [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	1,045,403
Available-for-sale Securities	1,087,009
Held-to-maturity, Amortized cost	26,706
Held to maturity Fair Value	26,844
Collateralized Mortgage Backed Securities [Member] \| Maturities Due After Ten Years [Member] \| GNMA [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	5,560
Available-for-sale Securities	5,928
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Collateralized Mortgage Backed Securities [Member] \| Maturities Due After Ten Years [Member] \| CMO's [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	200,111
Available-for-sale Securities	196,631
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities
Schedule of Investments [Line Items]
Available for sale Amortized Cost	109,733	155,926
Available-for-sale Securities	104,281	148,886
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| US Treasury Securities [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	9,000
Available-for-sale Securities	9,000
Investment Securities \| Obligation of US Government sponsored agencies at loss [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	74,613	10,691
Available-for-sale Securities	74,575	10,649
Investment Securities \| Obligation of Puerto Rico Government and political subdivisions [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	22,391	121,035
Available-for-sale Securities	16,800	114,190
Investment Securities \| Other Debt Securities [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	3,729	24,200
Available-for-sale Securities	3,906	24,047
Investment Securities \| Maturities Due In Less Than One Year [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	75,000
Available-for-sale Securities	75,000
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| Maturities Due In Less Than One Year [Member] \| US Treasury Securities [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	9,000
Available-for-sale Securities	9,000
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| Maturities Due In Less Than One Year [Member] \| Obligation of US Government sponsored agencies at loss [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	66,000
Available-for-sale Securities	66,000
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| Maturities Due From One To Five Years [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	11,927
Available-for-sale Securities	9,543
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| Maturities Due From One To Five Years [Member] \| Obligation of Puerto Rico Government and political subdivisions [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	11,927
Available-for-sale Securities	9,543
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| Maturities Due From Five To Ten Years [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	8,613
Available-for-sale Securities	8,575
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| Maturities Due From Five To Ten Years [Member] \| Obligation of US Government sponsored agencies at loss [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	8,613
Available-for-sale Securities	8,575
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| Maturities Due After Ten Years [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	14,193
Available-for-sale Securities	11,163
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| Maturities Due After Ten Years [Member] \| Obligation of Puerto Rico Government and political subdivisions [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	10,464
Available-for-sale Securities	7,257
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| Maturities Due After Ten Years [Member] \| Other Debt Securities [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	3,729
Available-for-sale Securities	3,906
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	$ 0