If you want to follow a question without appearing in the list of followers on the question, you can choose to privately follow a question.
You can do this by checking the “Follow Privately” option in the “...” of any question. For more information, see What does it mean to be “privately following” a question?.