Implementations generally relate to providing smart tags. In some implementations, a method includes receiving, at a server, a video stream from a video camera. The method further includes receiving, at the server, a plurality of tags from a plurality of client devices, where each tag of the plurality of tags tags a portion of the video stream. The method further includes tagging the video stream based on the plurality of tags. The method further includes grouping the plurality of tags into a plurality of tag groups, where each tag group includes one or more tags received from a particular client device.