Hi Sarah,
According to your description, my understanding is that you want to show Title of the image under the image in Picture Library Slideshow Web Part.
I recommend to edit the Picture Library Slideshow Web Part and select Title only below image under Display with and make sure that the picture in the picture library has value in Title field.

Best regards.
Thanks
Victoria Xia
TechNet Community Support
