Yes. JTextArea supports only a single foreground color, background color and font. To Have more than this you can work with a StyledDocument in a JTextPane.
For discussion and example code see
How to Use Editor Panes and Text Panes, especially the section
An Example of Using a Text Pane.