But the Ewood Park boss might change his mind with reflection, for this weekend's action has proved that minnows can give giants a run for their money.
Manchester United were held by Burton Albion, Tottenham Hotspur crashed out away to Leicester City and Everton's blushes were spared by an 79th minute goal by Leon Osman away to Millwall.
Leyton Orient masterminded a 2-1 win away to Fulham, so a Premiership clash could be a positive way of looking at the draw.
"It's probably not the draw that we or West Ham wanted, but it has the makings of a good cup tie," said former FA Cup winner Hughes.
Two goals from Welsh wizard Craig Bellamy and a goal from Andy Todd saw Rovers safely navigate their way past a tricky test against Queens Park Rangers in the third round.
But Hughes knows only too well, the FA Cup is a tough competition to win and, no matter of opposition, you have to play well to progress.