Each foreign (other nation) credit union that maintains an office shall make, keep, and preserve at that office, or at any other place that the commissioner may by regulation or order approve, the books, accounts, and other records relating to the business of the office, in the form, in the manner, and for the time that the commissioner may, by regulation or order, require.