The 4 handshape moves from the face to the side to show that attention is being diverted; that someone is not paying attention to something.