Copying VLOOKUP function to multiple cells?

when you click on the cell with the formula you see that the cell now has the little square ox in the bottom right. have you tried to click and hold that and drag to the cells you want? or copy and paste?