Research in cognitive neuroscience and social psychology suggests that the perception of a gaze contact may automatically trigger a set of specific processes, including a neurovegetative arousal response, even when it is incidental to a main cognitive task. We aimed at investigating this issue using a visual word spelling task where participants were simultaneously presented with faces under different gaze directions and head orientations. We recorded skin conductance response (SCR) as an indicator of the participants'arousal state and electromyographic (EMG) corrugator activity as an indicator of the task difficulty. Experiments 1 and 2 showed that the mere perception of a direct gaze increased the arousal state of the perceiver, although it was non informative for the task, while averted gaze was associated with enhanced corrugator activity. These results suggest that gaze contact is automatically categorised as a special gaze direction, which triggers specific autonomous response. Moreover, Experiment 3 indicated that such effects were nonetheless context-dependent, as they were not observed under the lower constraint of an easy letter detection task. These data provide the first direct evidence for the view that direct and averted gaze constitute distinct categories of social objects that trigger dissociated autonomic responses.