Any reduction in property taxes on leased property used exclusively for religious worship and granted the church exemption shall inure to the benefit of the organization entitled to the exemption. If the lease or rental agreement does not specifically provide that the church exemption is taken into account in fixing the terms of the agreement, the tenant shall receive a reduction in rental payments, or a refund of such payments, if paid, for each month of occupancy, or portion thereof, during the fiscal year equal to one-twelfth of the property taxes not paid during such fiscal year by reason of the church exemption.