Non-performing Loans and Impaired Loans (Details 5) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2013	Dec. 31, 2012
Loans by credit grades
Total	$ 1,087,945	$ 1,188,466
Commercial [Member]
Loans by credit grades
Total	472,248	459,558
Commercial [Member] \| Owner occupied real estate [Member]
Loans by credit grades
Total	157,076	162,694
Commercial [Member] \| Non owner occupied real estate [Member]
Loans by credit grades
Total	217,220	201,763
Commercial [Member] \| Residential development [Member]
Loans by credit grades
Total	248	1,056
Commercial [Member] \| Development & Spec Land Loans [Member]
Loans by credit grades
Total	10,975	6,963
Commercial [Member] \| Commercial and industrial [Member]
Loans by credit grades
Total	86,729	87,082
Real estate [Member]
Loans by credit grades
Total	334,450	440,579
Real estate [Member] \| Residential mortgage [Member]
Loans by credit grades
Total	184,589	181,450
Real estate [Member] \| Residential construction [Member]
Loans by credit grades
Total	6,252	7,681
Real estate [Member] \| Mortgage warehouse [Member]
Loans by credit grades
Total	143,609	251,448
Consumer [Member]
Loans by credit grades
Total	281,247	288,329
Consumer [Member] \| Direct Installment [Member]
Loans by credit grades
Total	27,396	27,831
Consumer [Member] \| Direct Installment Purchased [Member]
Loans by credit grades
Total	382	429
Consumer [Member] \| Indirect Installment [Member]
Loans by credit grades
Total	131,293	133,481
Consumer [Member] \| Home Equity [Member]
Loans by credit grades
Total	122,176	126,588
Pass [Member]
Loans by credit grades
Total	1,017,782	1,107,191
Percentage of total loans	93.55%	93.16%
Pass [Member] \| Commercial [Member]
Loans by credit grades
Total	415,745	391,369
Pass [Member] \| Commercial [Member] \| Owner occupied real estate [Member]
Loans by credit grades
Total	139,631	137,664
Pass [Member] \| Commercial [Member] \| Non owner occupied real estate [Member]
Loans by credit grades
Total	189,876	171,319
Pass [Member] \| Commercial [Member] \| Residential development [Member]
Loans by credit grades
Total	248	405
Pass [Member] \| Commercial [Member] \| Development & Spec Land Loans [Member]
Loans by credit grades
Total	7,108	3,171
Pass [Member] \| Commercial [Member] \| Commercial and industrial [Member]
Loans by credit grades
Total	78,882	78,810
Pass [Member] \| Real estate [Member]
Loans by credit grades
Total	325,504	431,424
Pass [Member] \| Real estate [Member] \| Residential mortgage [Member]
Loans by credit grades
Total	175,933	172,586
Pass [Member] \| Real estate [Member] \| Residential construction [Member]
Loans by credit grades
Total	5,962	7,390
Pass [Member] \| Real estate [Member] \| Mortgage warehouse [Member]
Loans by credit grades
Total	143,609	251,448
Pass [Member] \| Consumer [Member]
Loans by credit grades
Total	276,533	284,398
Pass [Member] \| Consumer [Member] \| Direct Installment [Member]
Loans by credit grades
Total	27,123	27,667
Pass [Member] \| Consumer [Member] \| Direct Installment Purchased [Member]
Loans by credit grades
Total	382	429
Pass [Member] \| Consumer [Member] \| Indirect Installment [Member]
Loans by credit grades
Total	130,363	132,589
Pass [Member] \| Consumer [Member] \| Home Equity [Member]
Loans by credit grades
Total	118,665	123,713
Special Mention [Member]
Loans by credit grades
Total	16,960	29,161
Percentage of total loans	1.56%	2.45%
Special Mention [Member] \| Commercial [Member]
Loans by credit grades
Total	16,960	29,161
Special Mention [Member] \| Commercial [Member] \| Owner occupied real estate [Member]
Loans by credit grades
Total	4,062	6,407
Special Mention [Member] \| Commercial [Member] \| Non owner occupied real estate [Member]
Loans by credit grades
Total	10,806	19,440
Special Mention [Member] \| Commercial [Member] \| Development & Spec Land Loans [Member]
Loans by credit grades
Total	99	178
Special Mention [Member] \| Commercial [Member] \| Commercial and industrial [Member]
Loans by credit grades
Total	1,993	3,136
Substandard [Member]
Loans by credit grades
Total	53,203	50,233
Percentage of total loans	4.89%	4.23%
Substandard [Member] \| Commercial [Member]
Loans by credit grades
Total	39,543	37,147
Substandard [Member] \| Commercial [Member] \| Owner occupied real estate [Member]
Loans by credit grades
Total	13,383	17,029
Substandard [Member] \| Commercial [Member] \| Non owner occupied real estate [Member]
Loans by credit grades
Total	16,538	10,717
Substandard [Member] \| Commercial [Member] \| Residential development [Member]
Loans by credit grades
Total		651
Substandard [Member] \| Commercial [Member] \| Development & Spec Land Loans [Member]
Loans by credit grades
Total	3,768	3,614
Substandard [Member] \| Commercial [Member] \| Commercial and industrial [Member]
Loans by credit grades
Total	5,854	5,136
Substandard [Member] \| Real estate [Member]
Loans by credit grades
Total	8,946	9,155
Substandard [Member] \| Real estate [Member] \| Residential mortgage [Member]
Loans by credit grades
Total	8,656	8,864
Substandard [Member] \| Real estate [Member] \| Residential construction [Member]
Loans by credit grades
Total	290	291
Substandard [Member] \| Consumer [Member]
Loans by credit grades
Total	4,714	3,931
Substandard [Member] \| Consumer [Member] \| Direct Installment [Member]
Loans by credit grades
Total	273	164
Substandard [Member] \| Consumer [Member] \| Direct Installment Purchased [Member]
Loans by credit grades
Total
Substandard [Member] \| Consumer [Member] \| Indirect Installment [Member]
Loans by credit grades
Total	930	892
Substandard [Member] \| Consumer [Member] \| Home Equity [Member]
Loans by credit grades
Total	3,511	2,875
Doubtful [Member]
Loans by credit grades
Total		1,881
Percentage of total loans	0.00%	0.16%
Doubtful [Member] \| Commercial [Member]
Loans by credit grades
Total		1,881
Doubtful [Member] \| Commercial [Member] \| Owner occupied real estate [Member]
Loans by credit grades
Total		1,594
Doubtful [Member] \| Commercial [Member] \| Non owner occupied real estate [Member]
Loans by credit grades
Total		287
Doubtful [Member] \| Commercial [Member] \| Residential development [Member]
Loans by credit grades
Total
Doubtful [Member] \| Commercial [Member] \| Development & Spec Land Loans [Member]
Loans by credit grades
Total
Doubtful [Member] \| Commercial [Member] \| Commercial and industrial [Member]
Loans by credit grades
Total
Doubtful [Member] \| Real estate [Member]
Loans by credit grades
Total
Doubtful [Member] \| Real estate [Member] \| Residential mortgage [Member]
Loans by credit grades
Total
Doubtful [Member] \| Real estate [Member] \| Residential construction [Member]
Loans by credit grades
Total
Doubtful [Member] \| Real estate [Member] \| Mortgage warehouse [Member]
Loans by credit grades
Total
Doubtful [Member] \| Consumer [Member]
Loans by credit grades
Total
Doubtful [Member] \| Consumer [Member] \| Direct Installment [Member]
Loans by credit grades
Total
Doubtful [Member] \| Consumer [Member] \| Direct Installment Purchased [Member]
Loans by credit grades
Total
Doubtful [Member] \| Consumer [Member] \| Indirect Installment [Member]
Loans by credit grades
Total
Doubtful [Member] \| Consumer [Member] \| Home Equity [Member]
Loans by credit grades
Total