For DSP, there is HW architecture design for DSP - this is IC design related. And you can purely port your algorithm to DSP CPU - this is FW/SW related.
Both directions are good. But you must be in the level of "outstanding" to grow fast in any domain. Even in a hot area, if you do not work well, you can not have good return.