Go to: Admin > Themes and Styles > OLAP Modify .CellData and .CellData2 style classes. Click on CSS tab and change border CSS attribute.
You can modify these classes for the all Themes or just some of the Style themes. Themes can be selected for the site, user or a report using the dropdown toolbar menu.