Site Safety working as designed?

(If anyone can point me to an exisiting thread, that would be great!)

 

Quick question: if I go to a site, and Site Safety in the toolbar marks it green (Safe), but it references an image or something thats hosted on a site marked unsafe (Yellow or Red), should the original site be marked unsafe as well?