This image from the JScrollPane API documentation provides the key. Placing the identifying information in the row header looks like a promising solution. We already know that the column header area holds the table header, which identifies the columns. We want a similar effect for the rows.
Also take note of the corner components, we'll need those too.