That can't be used against you because the right to remain silent is a given by the Constitution. It would be a fallacious charge, and any lawyer worth his salt would actually be able to put together a nice and fat counterclaim against whoever made that charge. If a cop WOULD actually do something like that, then they're retarded and would probably lose their lose job - IF you were to press charges on that alone filed as misconduct and misappropriation of police resources.
A cop has zero authority to arrest you on wholly exercising your amendment rights. Hopefully most of them know that, but if one or two dumbasses don't, you could at least even make some money out of the whole headache. Something like that actually happened to a friend's friend (not mine, cause I hate the ****) - a cop got him on absolutely bullshit charges, so he just filed a lawsuit on half a dozen nitpicky things, "emotional abuse" among them. Got $35,000 awarded to him by the state court, $12,000 of which went to the lawyer. Not too bad.