I'm assuming the following:
1 is not repeated other than in the last 3 digits and that repeats of other numbers are allowed. Given that:
We have a number that is xxxx111 where the 4 xs are unknown and can be any of the numbers 2-9. Listing them we have:
Primes - 2,3,5,7
Non-primes - 4,6,8,9
Total number of different numbers = 8^4 since each x can be filled by any of the 8 numbers 2 thru 9
# of times we have >=2 primes = Total - (# of times we have no primes) - (# of times we have 1 prime)
# of times we have no primes = 4^4
# of times we have 1 prime = (Select the prime) * (Select the spot) * (Fill the other 3 spots with any of 4,6,8,9) = C(4,1) * C(4,1) * 4^3 = 4^5
So the required probability = 1 - (4^4 + 4^5)/(8^4) = 1 - 5/16 = 11/16