Request: Programing videoedit guide/book

I don't know of such a book, but since loading and saving audio/video filese can be a pain (and can easily become unpracticable if you plan to support more formats) you could try to build the editor over an existing library to handle the low level codec details.
There is for example FFmpeg that is able to load, store and converts many different formats.
The open source Video editing system Jahshaka uses the Openlibraries libraries, so you might want to give them a look.
Hope this helps.

Thanks for the advice, the links looks quite useful, especially FFmpeg. I'm not to write this video part until later, but this might be the good start I'll need to get the rest of the code prepared to what's to come, so it'll be very useful!

I'm no expert at it, but lately I've been playing with OpenCV, and it has a fairly robust set of facilities for processing video files. I highly recommend taking a look at it, as it is really easy compared to the other image/video libraries out there. The only drawback over libavfile/FFmpeg is that it doesn't the enormous number of formats.

However, if you just want to jump into coding the interesting stuff, OpenCV is probably the fastest way to get started.