Uninvited Skype access

I hate to wake up this old issue again but I am reminded about it every time I connect to someone through Skype and I get the Norton message that someone is trying to access my computer through Skype and so the firewall automatically cuts off the conversation. From reading other threads, I understand that Norton can't do much about it because 1) the Norton firewall is just doing its job 2) Norton can't distinguish between Skype and any other unauthorised access 3) there are some (limited) filtering options available 4) Its okay to allow all Skype connections 5) Symantec is not Skype. What I still can't understand is WHY uninvited access is attempted in the first place. Is it possible these gate-crashers are piggy-backing the Skype service somehow? It is as if they lie in wait for someone to make a connection and then try to hitch a ride. It is my uneducated guess that they are not trying to access my computer so much as trying to access the SERVICE. Could this be the case? Could they just be trying to ride the train without paying the fare? Surely some professional in your good organisation could hazard a guess as to what is going on.