Currently, there is a way to set the alt attribute of images, but not the title attribute, which means that IE shows tooltips (against the HTML spec, I know) and Firefox doesn't. Is it possible to make it so the title attribute is set to the same value as the alt attribute?
An alternative would be to create a special "image template", as an addition to the current picture template, but without things like captions and frames. Something that allows a more flexible approach to generating <img> tags (eg: allow borders, allow to be used inside square brackets as links: [{{image|url}}|link])
I've added the template.
If you do not see a border around the image when using a caption, then force a reload.