Manual -> Report Generator -> Engineering in the Editor -> Formatting -> Format cells -> Frame
With the frame formatting, the relevant border (top, bottom, left, right), the type of border and the colour of border are defined.