Video stops for few minutes after sometime and then again comes

Have been trying to build a video conferencing solution.Now what happens
after sometime is video of different participants stops
after sometime of playing and again then comes.Not sure why is this
happening.Can anyone throw some light on the topic.Its urgent.