Investment Securities (Investment securities by contractual maturity) (Details) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2014	Dec. 31, 2013
Schedule of Investments [Line Items]
Available for sale Amortized Cost	$ 1,249,769	$ 1,575,043
Available-for-sale Securities	1,273,879	1,588,425
Held-to-maturity, Amortized cost	144,305
Held to maturity Fair Value	144,217	0
Collateralized Mortgage Backed Securities [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	1,217,686	1,419,117
Available-for-sale Securities	1,247,161	1,439,539
Held-to-maturity, Amortized cost	144,305
Held to maturity Fair Value	144,217
Collateralized Mortgage Backed Securities [Member] \| FNMA and FHLMC [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	1,023,303	1,190,910
Available-for-sale Securities	1,056,635	1,217,330
Held-to-maturity, Amortized cost	144,305
Held to maturity Fair Value	144,217
Collateralized Mortgage Backed Securities [Member] \| GNMA [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	5,241	7,406
Available-for-sale Securities	5,568	7,815
Collateralized Mortgage Backed Securities [Member] \| CMO's [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	189,142	220,801
Available-for-sale Securities	184,958	214,394
Collateralized Mortgage Backed Securities [Member] \| Maturities Due From Five To Ten Years [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	22,896
Available-for-sale Securities	23,243
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Collateralized Mortgage Backed Securities [Member] \| Maturities Due From Five To Ten Years [Member] \| FNMA and FHLMC [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	22,896
Available-for-sale Securities	23,243
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Collateralized Mortgage Backed Securities [Member] \| Maturities Due After Ten Years [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	1,194,790
Available-for-sale Securities	1,223,918
Held-to-maturity, Amortized cost	144,305
Held to maturity Fair Value	144,217
Collateralized Mortgage Backed Securities [Member] \| Maturities Due After Ten Years [Member] \| FNMA and FHLMC [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	1,000,407
Available-for-sale Securities	1,033,392
Held-to-maturity, Amortized cost	144,305
Held to maturity Fair Value	144,217
Collateralized Mortgage Backed Securities [Member] \| Maturities Due After Ten Years [Member] \| GNMA [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	5,241
Available-for-sale Securities	5,568
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Collateralized Mortgage Backed Securities [Member] \| Maturities Due After Ten Years [Member] \| CMO's [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	189,142
Available-for-sale Securities	184,958
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities
Schedule of Investments [Line Items]
Available for sale Amortized Cost	32,083	155,926
Available-for-sale Securities	26,718	148,886
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| US Treasury Securities [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	0
Available-for-sale Securities	0
Investment Securities \| Obligation of US Government sponsored agencies at loss [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	7,795	10,691
Available-for-sale Securities	7,761	10,649
Investment Securities \| Obligation of Puerto Rico Government and political subdivisions [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	20,915	121,035
Available-for-sale Securities	15,446	114,190
Investment Securities \| Other Debt Securities [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	3,373	24,200
Available-for-sale Securities	3,511	24,047
Investment Securities \| Maturities Due From One To Five Years [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	10,450
Available-for-sale Securities	8,628
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| Maturities Due From One To Five Years [Member] \| Obligation of Puerto Rico Government and political subdivisions [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	10,450
Available-for-sale Securities	8,628
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| Maturities Due From Five To Ten Years [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	7,795
Available-for-sale Securities	7,761
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| Maturities Due From Five To Ten Years [Member] \| Obligation of US Government sponsored agencies at loss [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	7,795
Available-for-sale Securities	7,761
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| Maturities Due After Ten Years [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	13,838
Available-for-sale Securities	10,329
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| Maturities Due After Ten Years [Member] \| Obligation of Puerto Rico Government and political subdivisions [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	10,465
Available-for-sale Securities	6,818
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	0
Investment Securities \| Maturities Due After Ten Years [Member] \| Other Debt Securities [Member]
Schedule of Investments [Line Items]
Available for sale Amortized Cost	3,373
Available-for-sale Securities	3,511
Held-to-maturity, Amortized cost	0
Held to maturity Fair Value	$ 0