The problem of other minds is the core issue to be solved in the realization of human-robot interaction. Through a detailed analysis of Wittgenstein's claim on other minds, empirical realism is appropriate to describe Wittgenstein's therapy. Through the using of Wittgenstein's explanation of the problem of other minds, the solution to the problem of other minds is explored in the process of human-robot interaction. It is believed that human-robot interaction research should move from behaviorism to phenomenology, and thus to Wittgenstein's empirical realism, which pays more attention to atmosphere, life form and life experience in the process of access to other minds. The realization of human-robot interaction depends on the way of perceptional, direct and experiential generation to understand other minds.