Error concealment is an effective approach to reduce the influence of errors that occur at the decoders. When error occurs, it may degrade the reconstructed pictures and lead to undesirable visual distortion. In this paper, we propose a novel temporal error concealment method for H.264 video streaming. A block-matching algorithm based on multi-side boundary matching (MSBM) principle, is presented to refine the concealed video. The proposed algorithm divides a corrupted macroblock (MB) into four 8×8 sub-blocks, and uses the information of the nearest rows and columns to reconstruct the MB. Experimental results show that the proposed algorithm yields more satisfying image quality than the relative algorithms presented in previous studies.