Congress president Mallikarjun Kharge told the Rajya Sabha that Rahul Gandhi was not being allowed to speak, accusing the government of stifling Opposition voices in Parliament.