The Cherries will have to make the trek north to London for the midweek game.
“In any cup competition, you always hope for a home draw, especially for the supporters,” Howe told the Daily Echo.
“Although we are away to Chelsea, it is not too far to travel for a midweek game and I know our fans will turn out in their numbers.
“Stamford Bridge holds special memories for them and us after the win there in our first season in the Premier League.
“It is one of the toughest draws possible but a game we will really look forward to.
“We have a lot of games in the Premier League to concentrate on before then so will be giving them our full focus.”