Allowance for Loan Losses - Schedule of Allowance for Loan Losses on Basis of Calculation Methodology (Details) - USD ($) $ in Thousands	Mar. 31, 2020	Dec. 31, 2019	Mar. 31, 2019	Dec. 31, 2018
Allowance For Loan Losses On Basis Of Calculation Methodology Abstract
Specifically reserved	$ 777		$ 906
Historical loss rate	1,054		422
Qualitative factors	7,577		5,956
Other	198
Total	9,606	$ 8,669	7,284	$ 7,306
Unallocated [Member]
Allowance For Loan Losses On Basis Of Calculation Methodology Abstract
Specifically reserved	0		0
Historical loss rate	0		0
Qualitative factors	0		0
Other	198
Total	198	272	0	152
Residential Mortgage Loans [Member] \| 1-4 Family First Lien Residential Mortgages [Member]
Allowance For Loan Losses On Basis Of Calculation Methodology Abstract
Specifically reserved	95		104
Historical loss rate	66		65
Qualitative factors	570		553
Total	731	580	722	766
Residential Mortgage Loans [Member] \| Residential Construction Mortgage [Member]
Allowance For Loan Losses On Basis Of Calculation Methodology Abstract
Specifically reserved	0		0
Historical loss rate	0		0
Qualitative factors	0		0
Total	0	0	0	0
Commercial Loans [Member] \| Real Estate [Member]
Allowance For Loan Losses On Basis Of Calculation Methodology Abstract
Specifically reserved	76		98
Historical loss rate	101		151
Qualitative factors	4,066		3,121
Total	4,243	4,010	3,370	3,578
Commercial Loans [Member] \| Lines of Credit [Member]
Allowance For Loan Losses On Basis Of Calculation Methodology Abstract
Specifically reserved	98		92
Historical loss rate	100		18
Qualitative factors	1,020		692
Total	1,218	1,195	802	730
Commercial Loans [Member] \| Other Commercial and Industrial [Member]
Allowance For Loan Losses On Basis Of Calculation Methodology Abstract
Specifically reserved	379		464
Historical loss rate	57		26
Qualitative factors	1,322		1,070
Total	1,758	1,645	1,560	1,285
Commercial Loans [Member] \| Tax Exempt Loans [Member]
Allowance For Loan Losses On Basis Of Calculation Methodology Abstract
Specifically reserved	0		0
Historical loss rate	0		0
Qualitative factors	1		1
Other	0
Total	1	1	1	1
Consumer Loans [Member] \| Home Equity and Junior Liens [Member]
Allowance For Loan Losses On Basis Of Calculation Methodology Abstract
Specifically reserved	128		139
Historical loss rate	146		13
Qualitative factors	337		278
Other	0
Total	611	553	430	409
Consumer Loans [Member] \| Other Consumer [Member]
Allowance For Loan Losses On Basis Of Calculation Methodology Abstract
Specifically reserved	1		9
Historical loss rate	584		149
Qualitative factors	261		241
Other	0
Total	$ 846	$ 413	$ 399	$ 385

Allowance for Loan Losses on Basis of Calculation Methodology [Abstract]

No definition available.

Name:	pbhc_AllowanceForLoanLossesOnBasisOfCalculationMethodologyAbstract
Namespace Prefix:	pbhc_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Definition

Amount of financing receivables in allowance to historical loss rate.

+ References

No definition available.

+ Details

Name:	pbhc_FinancingReceivableAllowanceForCreditLossesHistoricalLossRate
Namespace Prefix:	pbhc_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Financing receivable allowance for credit losses other.

+ References

No definition available.

+ Details

Name:	pbhc_FinancingReceivableAllowanceForCreditLossesOther
Namespace Prefix:	pbhc_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amount of financing receivables in allowance to qualitative factors.

+ References

No definition available.

+ Details

Name:	pbhc_FinancingReceivableAllowanceForCreditLossesQualitativeFactors
Namespace Prefix:	pbhc_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amount of financing receivables in allowance to specifically reserved.

+ References

No definition available.

+ Details

Name:	pbhc_FinancingReceivableAllowanceForCreditLossesSpecificallyReserved
Namespace Prefix:	pbhc_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amount of allowance for credit loss on financing receivable. Excludes allowance for financing receivable covered under loss sharing agreement.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 10
-Section 50
-Paragraph 11B
-Subparagraph (c)(1)
-URI http://asc.fasb.org/extlink&oid=118936363&loc=SL6953423-111524

Reference 2: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 20
-Section 45
-Paragraph 1
-URI http://asc.fasb.org/extlink&oid=118955202&loc=SL82895884-210446

Reference 3: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 20
-Section 50
-Paragraph 13
-Subparagraph (a)
-URI http://asc.fasb.org/extlink&oid=119407570&loc=SL82919249-210447

Reference 4: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 942
-SubTopic 210
-Section S99
-Paragraph 1
-Subparagraph (SX 210.9-03(7)(d))
-URI http://asc.fasb.org/extlink&oid=6876686&loc=d3e534808-122878

Reference 5: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 20
-Section 50
-Paragraph 13
-Subparagraph (f)
-URI http://asc.fasb.org/extlink&oid=119407570&loc=SL82919249-210447

+ Details

Name:	us-gaap_FinancingReceivableAllowanceForCreditLosses
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Details

Name:	us-gaap_FinancingReceivableRecordedInvestmentByClassOfFinancingReceivableAxis=pbhc_UnallocatedMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancingReceivablePortfolioSegmentAxis=us-gaap_ResidentialPortfolioSegmentMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancingReceivableRecordedInvestmentByClassOfFinancingReceivableAxis=pbhc_FamilyFirstLienResidentialMortgages1To4Member
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancingReceivableRecordedInvestmentByClassOfFinancingReceivableAxis=pbhc_ResidentialMortgageConstructionMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancingReceivablePortfolioSegmentAxis=us-gaap_CommercialPortfolioSegmentMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancingReceivableRecordedInvestmentByClassOfFinancingReceivableAxis=us-gaap_RealEstateLoanMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancingReceivableRecordedInvestmentByClassOfFinancingReceivableAxis=pbhc_LinesOfCreditMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancingReceivableRecordedInvestmentByClassOfFinancingReceivableAxis=pbhc_OtherCommercialAndIndustrialMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancingReceivableRecordedInvestmentByClassOfFinancingReceivableAxis=pbhc_TaxExemptLoansMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancingReceivablePortfolioSegmentAxis=us-gaap_ConsumerPortfolioSegmentMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancingReceivableRecordedInvestmentByClassOfFinancingReceivableAxis=pbhc_HomeEquityAndJuniorLiensMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancingReceivableRecordedInvestmentByClassOfFinancingReceivableAxis=pbhc_OtherConsumerFinancingReceivableMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type: