The former allows you to change to:
Map<Integer, String> mymap = new TreeMap<Integer, String>();
for example, without breaking all the rest of your code.
A much more minor advantage is that your IDE can show you the methods for the interface, rather than the (potentially much larger number of) methods for the implementation.