I am sure I have done it in the past but now I cannot find an option that allows for it. No menu button on downloaded maps list and a long-press does not get me an option either?
If you skort tap a map (not long press), you get a popup menu. One of the commands there is Delete.