This Paper Proposes A Detailed Framework Of Storing Privacy Information In Surveillance Video As A Watermark. Authorized Personnel Is Not Only Removed From The Surveillance Video As In But Also Embedded Into The Video Itself, Which Can Only Be Retrieved With A Secrete Key. A Perceptual-model-based Compressed Domain Video Watermarking Scheme Is Proposed To Deal With The Huge Payload Problem In The Proposed Surveillance System. A Signature Is Also Embedded Into The Header Of The Video As In For Authentication. Simulation Results Have Shown That The Proposed Algorithm Can Embed All The Privacy Information Into The Video Without Affecting Its Visual Quality. As A Result, The Proposed Video Surveillance System Can Monitor The Unauthorized Persons In A Restricted Environment, Protect The Privacy Of The Authorized Persons But, At The Same Time, Allow The Privacy Information To Be Revealed In A Secure And Reliable Way.