Fair Value of Financial Instruments - Fair Value Hierarchy (Details) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2014	Dec. 31, 2013
Total available for sale securities	$ 204,869	$ 181,409
Loans held-for-sale (mandatory pricing agreements)	14,621	24,254
Interest rate lock commitments
Derivative financial instrument	170	79
Forward contracts
Derivative financial instrument	32	227
Loans held-for-sale (mandatory pricing agreements)
Loans held-for-sale (mandatory pricing agreements)	14,621	24,254
Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available for sale securities	1,969	1,963
Loans held-for-sale (mandatory pricing agreements)	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) \| Interest rate lock commitments
Derivative financial instrument	0	0
Quoted Prices in Active Markets for Identical Assets (Level 1) \| Forward contracts
Derivative financial instrument	32	227
Quoted Prices in Active Markets for Identical Assets (Level 1) \| Loans held-for-sale (mandatory pricing agreements)
Loans held-for-sale (mandatory pricing agreements)	0	0
Significant Other Observable Inputs (Level 2)
Total available for sale securities	201,089	177,773
Loans held-for-sale (mandatory pricing agreements)	2,652	4,356
Significant Other Observable Inputs (Level 2) \| Interest rate lock commitments
Derivative financial instrument	0	0
Significant Other Observable Inputs (Level 2) \| Forward contracts
Derivative financial instrument	0	0
Significant Other Observable Inputs (Level 2) \| Loans held-for-sale (mandatory pricing agreements)
Loans held-for-sale (mandatory pricing agreements)	14,621	24,254
Significant Unobservable Inputs (Level 3)
Total available for sale securities	1,811	1,673
Loans held-for-sale (mandatory pricing agreements)	0	0
Significant Unobservable Inputs (Level 3) \| Interest rate lock commitments
Derivative financial instrument	170	79
Significant Unobservable Inputs (Level 3) \| Forward contracts
Derivative financial instrument	0	0
Significant Unobservable Inputs (Level 3) \| Loans held-for-sale (mandatory pricing agreements)
Loans held-for-sale (mandatory pricing agreements)	0	0
U.S. Government-sponsored enterprises
Total available for sale securities	55,874	56,277
U.S. Government-sponsored enterprises \| Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available for sale securities	0	0
U.S. Government-sponsored enterprises \| Significant Other Observable Inputs (Level 2)
Total available for sale securities	55,874	56,277
U.S. Government-sponsored enterprises \| Significant Unobservable Inputs (Level 3)
Total available for sale securities	0	0
Municipals
Total available for sale securities		46,323
Municipals \| Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available for sale securities		0
Municipals \| Significant Other Observable Inputs (Level 2)
Total available for sale securities		46,323
Municipals \| Significant Unobservable Inputs (Level 3)
Total available for sale securities		0
Mortgage-backed and asset-backed securities – government-sponsored enterprises
Total available for sale securities	144,048	73,941
Mortgage-backed and asset-backed securities – government-sponsored enterprises \| Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available for sale securities	0	0
Mortgage-backed and asset-backed securities – government-sponsored enterprises \| Significant Other Observable Inputs (Level 2)
Total available for sale securities	144,048	73,941
Mortgage-backed and asset-backed securities – government-sponsored enterprises \| Significant Unobservable Inputs (Level 3)
Total available for sale securities	0	0
Mortgage-backed and asset-backed securities – private labeled
Total available for sale securities	1,167	1,232
Mortgage-backed and asset-backed securities – private labeled \| Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available for sale securities	0	0
Mortgage-backed and asset-backed securities – private labeled \| Significant Other Observable Inputs (Level 2)
Total available for sale securities	1,167	1,232
Mortgage-backed and asset-backed securities – private labeled \| Significant Unobservable Inputs (Level 3)
Total available for sale securities	0	0
Other securities
Total available for sale securities	3,780	3,636
Other securities \| Quoted Prices in Active Markets for Identical Assets (Level 1)
Total available for sale securities	1,969	1,963
Other securities \| Significant Other Observable Inputs (Level 2)
Total available for sale securities	0	0
Other securities \| Significant Unobservable Inputs (Level 3)
Total available for sale securities	$ 1,811	$ 1,673