The Supreme Court on Thursday refused to order an interim stay on the alleged detention of Bengali-speaking migrant workers over suspicion of being Bangladeshi nationals, saying such a directive may have consequences, especially with respect to people, who genuinely came from across the borders.