If using weaver scope mounts can you remove a scope from a rifle and still hold zero?

I have an AR-15 with a flat-top upper, full of picatinny mounts. Normally i just use my holographic sight, but occasionally i want to be more accurate and use a scope. If i use picatinny/weaver scope bases, and put the scope in the same position on the rifle, can I take the scope(in the rings) off the rifle and have it still hold a zero?