hi... 104 is not a bad score at all, but considering the universities you are applying to, it is NOT going to affect your admission decision. However, it is definitely going to affect your chances of getting an assistantship or a scholarship. So, in case, you were aiming for either of the two, you should go ahead and take it again.
Do a lot of reading excercises, watch english movies, think of any random topic and speak out to yourself, record yourself and see how you could have sounded better. With a score of 40 on verbal, you should be just fine