Sec. of State says senators should concentrate on their races instead of calling for his resignation