Collectivism rears its ugly head again.
"There's only one fundamental right: the right to do as you **** well please. With it comes the only fundamental responsibility: the responsibility to take the consequences." There are no other responsibilities to which you did not knowingly and willingly agree.
So in short, no, it isn't.
It is your right to waive your rights, and that is indeed what you are doing. Have at it, if it makes you feel better, and as long as it doesn't create any responsibility, real or implied, on the part of others to do the same.
I, myself, am against illegal Mexicans stealing our oxygen, so I have always answered those questions at the border, too, but don't pretend that I or others have the responsibility to do so when we plainly don't. The Bill of Rights doesn't guarantee the right to remain silent "unless we decide otherwise," or, "unless you're within 50 miles of the border." There is no "unless."