Will they care if you're card counting...?

...at a $5 blackjack table? Sometimes I have a hunch that the pit bosses have their eyes on me more and more, but I usually make out with $100~$300 each session. Will they eventually bar me because of my abilities or will they brush off a couple hundred dollar loss? (In other words, will they still be cautious even at a low limit table?)