Exhibit 23.1

Consent of Independent Registered Public Accounting Firm

We have issued our report dated March 18, 2016, with respect to the consolidated financial statements and schedule included in the Annual Report of Famous Dave’s of America, Inc. on Form 10-K for the year ended January 3, 2016. We consent to the incorporation by reference of said report in the Registration Statements of Famous Dave’s of America, Inc. on Forms S-3 (File No. 333-86358, File No. 333-73504, File No. 333-65428, File No. 333-54562, File No. 333-48492, and File No. 333-95311) and on Forms S-8 (File No. 333-208261, File No. 333-204015, File No. 333-176278, File No. 333-124985, and File No. 333-88930).

/s/ Grant Thornton LLP

Minneapolis, Minnesota

March 18, 2016