Both smokers and non smokers have rights to go anywhere, say a bar.  The problem arises when the actions of one causes harm to an other.  In this case the person causing the harm needs to be excluded.