No, I only have new files on my local machine, and as I collect new stuff I move them to my server with rsync and just remove it onthe local machine.
Rsync is more than smart enough to, if you keep same folder structure to easilly move the files to the server without you having to manually copy other each file.