This article discusses the challenges of detecting and tracking moving objects in video surveillance and proposes an improved YOLOv3-based multi-object detection and tracking algorithm. Experimental validation shows high success rates and superior performance compared to other algorithms. This algorithm has robust filtering and detection capabilities, making it suitable for various detection tasks in practical applications.