Loans Held for Investment - Schedule of Past Due Status of Loans Held for Investment, Gross (Details) - USD ($) $ in Thousands	9 Months Ended	12 Months Ended
Mar. 31, 2022	Jun. 30, 2021	Mar. 31, 2021
Financing Receivable, Recorded Investment, Past Due [Line Items]
Loans deemed uncollectible, period of delinquency	90 days	90 days
Current	$ 890,222	$ 842,668
30-89 Days Past Due	2	7
Non-Accrual	2,227	9,407
Total Loans Held for Investment, Gross	892,451	852,082	$ 841,993
Mortgage loans, Single-family
Financing Receivable, Recorded Investment, Past Due [Line Items]
Current	325,872	259,984
30-89 Days Past Due	0	0
Non-Accrual	1,789	8,288
Total Loans Held for Investment, Gross	327,661	268,272	254,393
Mortgage Loans, Multi Family
Financing Receivable, Recorded Investment, Past Due [Line Items]
Current	468,218	483,289
30-89 Days Past Due	0	0
Non-Accrual	438	1,119
Total Loans Held for Investment, Gross	468,656	484,408	483,283
Mortgage loans, Commercial real estate
Financing Receivable, Recorded Investment, Past Due [Line Items]
Current	91,344	95,279
30-89 Days Past Due	0	0
Non-Accrual	0	0
Total Loans Held for Investment, Gross	91,344	95,279	99,722
Construction
Financing Receivable, Recorded Investment, Past Due [Line Items]
Current	4,127	3,040
30-89 Days Past Due	0	0
Non-Accrual	0	0
Total Loans Held for Investment, Gross	4,127	3,040	3,508
Mortgage Loans Other
Financing Receivable, Recorded Investment, Past Due [Line Items]
Current	131	139
30-89 Days Past Due	0	0
Non-Accrual	0	0
Total Loans Held for Investment, Gross	131	139	140
Commercial business loans
Financing Receivable, Recorded Investment, Past Due [Line Items]
Current	459	849
30-89 Days Past Due	0	0
Non-Accrual	0	0
Total Loans Held for Investment, Gross	459	849	851
Consumer loans
Financing Receivable, Recorded Investment, Past Due [Line Items]
Current	71	88
30-89 Days Past Due	2	7
Non-Accrual	0	0
Total Loans Held for Investment, Gross	$ 73	$ 95	$ 96
Bankruptcy [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Loans deemed uncollectible, period of delinquency	60 days
Troubled Debt Restructurings [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Loans deemed uncollectible, period of delinquency	90 days
Commercial Real Estate Or Second Mortgage [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Loans deemed uncollectible, period of delinquency	120 days