Alleged BJP workers carried black flags and raised slogans Swami Agnivesh said he offered dialogue, but got abuses in return Chief Minister Raghubar Das asked police to investigate incident