“(4) In the case of an infant whose father and mother have not married each other, the right to make an application under this section regarding the custody of the infant and the right of access thereto of his father or mother shall extend to the father who is not a guardian of the infant, and for this purpose references in this section to the father or parent of an infant shall be construed as including him.”.