If you want to give a relative path,
use something like that:
(if you are using it in a Module)
/Module1/SLProject.xap
if you write:
Module1/SLProject.xap
It wont recognize it and you will see an error on Silverlight Web Part that the .xap file cant be found.
I hope this little trick solves the problem.