Loans and Asset Quality Information (Details 11) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2014	Dec. 31, 2013	Sep. 30, 2013
Recorded investment in loans by credit quality indicators:
Non-covered loans	$ 2,292,841	$ 2,252,885
Unamortized net deferred loan costs	730	928	1,024
Covered loans	133,249	210,309	226,909
Total loans	2,426,090	2,463,194	2,442,082
Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	2,292,111	2,251,957
Commercial Unsecured [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	33,723	37,015
Commercial Secured [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	115,404	122,280
Secured by Inventory and Accounts Receivable [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	21,521	21,176
Real estate construction, land development other land loans [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	266,419	244,670
Real estate residential, farmland and mutli-family [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	860,218	869,387
Real estate home equity lines of credit [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	198,977	198,127
Real estate commercial [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	752,108	709,606
Consumer [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	43,741	49,696
Pass (Grades 1, 2 and 3) [Member]
Recorded investment in loans by credit quality indicators:
Covered loans	14,615	25,078
Total loans	711,834	588,744
Pass (Grades 1, 2 and 3) [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	697,219	563,666
Pass (Grades 1, 2 and 3) [Member] \| Commercial Unsecured [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	12,240	8,495
Pass (Grades 1, 2 and 3) [Member] \| Commercial Secured [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	34,385	31,494
Pass (Grades 1, 2 and 3) [Member] \| Secured by Inventory and Accounts Receivable [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	7,585	4,098
Pass (Grades 1, 2 and 3) [Member] \| Real estate construction, land development other land loans [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	84,414	31,221
Pass (Grades 1, 2 and 3) [Member] \| Real estate residential, farmland and mutli-family [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	221,422	227,053
Pass (Grades 1, 2 and 3) [Member] \| Real estate home equity lines of credit [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	123,649	120,205
Pass (Grades 1, 2 and 3) [Member] \| Real estate commercial [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	188,845	115,397
Pass (Grades 1, 2 and 3) [Member] \| Consumer [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	24,679	25,703
Weak Pass (Grade 4) [Member]
Recorded investment in loans by credit quality indicators:
Covered loans	75,618	92,147
Total loans	1,418,904	1,547,072
Weak Pass (Grade 4) [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	1,343,286	1,454,925
Weak Pass (Grade 4) [Member] \| Commercial Unsecured [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	17,394	24,415
Weak Pass (Grade 4) [Member] \| Commercial Secured [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	68,397	77,441
Weak Pass (Grade 4) [Member] \| Secured by Inventory and Accounts Receivable [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	11,510	12,800
Weak Pass (Grade 4) [Member] \| Real estate construction, land development other land loans [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	144,702	181,050
Weak Pass (Grade 4) [Member] \| Real estate residential, farmland and mutli-family [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	529,203	540,349
Weak Pass (Grade 4) [Member] \| Real estate home equity lines of credit [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	62,223	63,400
Weak Pass (Grade 4) [Member] \| Real estate commercial [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	492,862	533,680
Weak Pass (Grade 4) [Member] \| Consumer [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	16,995	21,790
Watch or Standard Loans (Grade 9) [Member]
Recorded investment in loans by credit quality indicators:
Covered loans	34
Total loans	15,022	19,101
Watch or Standard Loans (Grade 9) [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	14,988	19,101
Watch or Standard Loans (Grade 9) [Member] \| Commercial Unsecured [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	5	7
Watch or Standard Loans (Grade 9) [Member] \| Commercial Secured [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	63	100
Watch or Standard Loans (Grade 9) [Member] \| Secured by Inventory and Accounts Receivable [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans
Watch or Standard Loans (Grade 9) [Member] \| Real estate construction, land development other land loans [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	1,571	2,365
Watch or Standard Loans (Grade 9) [Member] \| Real estate residential, farmland and mutli-family [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	4,470	5,062
Watch or Standard Loans (Grade 9) [Member] \| Real estate home equity lines of credit [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	1,258	1,499
Watch or Standard Loans (Grade 9) [Member] \| Real estate commercial [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	7,568	10,014
Watch or Standard Loans (Grade 9) [Member] \| Consumer [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	53	54
Special Mention Loans (Grade 5) [Member]
Recorded investment in loans by credit quality indicators:
Covered loans	10,050	8,857
Total loans	110,607	102,299
Special Mention Loans (Grade 5) [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	100,557	93,442
Special Mention Loans (Grade 5) [Member] \| Commercial Unsecured [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	1,415	1,509
Special Mention Loans (Grade 5) [Member] \| Commercial Secured [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	4,602	5,597
Special Mention Loans (Grade 5) [Member] \| Secured by Inventory and Accounts Receivable [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	1,186	2,022
Special Mention Loans (Grade 5) [Member] \| Real estate construction, land development other land loans [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	12,989	11,646
Special Mention Loans (Grade 5) [Member] \| Real estate residential, farmland and mutli-family [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	44,584	41,583
Special Mention Loans (Grade 5) [Member] \| Real estate home equity lines of credit [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	4,320	5,699
Special Mention Loans (Grade 5) [Member] \| Real estate commercial [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	30,705	24,557
Special Mention Loans (Grade 5) [Member] \| Consumer [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	756	829
Classified Loans (Grades 6,7 and 8) [Member]
Recorded investment in loans by credit quality indicators:
Covered loans	22,454	47,010
Total loans	104,895	125,895
Classified Loans (Grades 6,7 and 8) [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	82,441	78,885
Classified Loans (Grades 6,7 and 8) [Member] \| Commercial Unsecured [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	2,420	2,367
Classified Loans (Grades 6,7 and 8) [Member] \| Commercial Secured [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	4,459	4,986
Classified Loans (Grades 6,7 and 8) [Member] \| Secured by Inventory and Accounts Receivable [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	849	1,711
Classified Loans (Grades 6,7 and 8) [Member] \| Real estate construction, land development other land loans [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	12,379	10,333
Classified Loans (Grades 6,7 and 8) [Member] \| Real estate residential, farmland and mutli-family [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	35,421	37,526
Classified Loans (Grades 6,7 and 8) [Member] \| Real estate home equity lines of credit [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	5,210	5,124
Classified Loans (Grades 6,7 and 8) [Member] \| Real estate commercial [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	20,996	15,843
Classified Loans (Grades 6,7 and 8) [Member] \| Consumer [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	707	995
Nonaccrual Loans [Member]
Recorded investment in loans by credit quality indicators:
Covered loans	10,478	37,217
Total loans	64,098	79,155
Nonaccrual Loans [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	53,620	41,938
Nonaccrual Loans [Member] \| Commercial Unsecured [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	249	222
Nonaccrual Loans [Member] \| Commercial Secured [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	3,498	2,662
Nonaccrual Loans [Member] \| Secured by Inventory and Accounts Receivable [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	391	545
Nonaccrual Loans [Member] \| Real estate construction, land development other land loans [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	10,364	8,055
Nonaccrual Loans [Member] \| Real estate residential, farmland and mutli-family [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	25,118	17,814
Nonaccrual Loans [Member] \| Real estate home equity lines of credit [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	2,317	2,200
Nonaccrual Loans [Member] \| Real estate commercial [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	11,132	10,115
Nonaccrual Loans [Member] \| Consumer [Member] \| Non-covered [Member]
Recorded investment in loans by credit quality indicators:
Non-covered loans	$ 551	$ 325