I can help you to change the background from the caption. Use this:
border: none !important;
background-color: white !important;
The issue with the paragraph that it’s not Search Engine friendly and the margin would affect all other paragraphs. If you can use a custom class for the caption when you write them, it would be good to target that.