Graphic Engines

Google is your friend.
DevMaster has a list of graphics engines: http://www.devmaster.net/engines/
Microsoft have a free game development system called Game Studio Express: http://msdn.microsoft.com/directx/XNA/default.aspx
Learn some vector and matrix maths. Then some rendering theory (I used the OpenGL red book: http://fly.cc.fer.hr/~unreal/theredbook/).

CorelDRAW X3? ZBrush? Ogre? POVRay? Acrylic canvas and paint?

"Messing around with graphics" covers a wide range of topics. Are you interested in creating graphics (digitally, I assume), in displaying graphics (2D or 3D? Realtime or static?), or in writing graphics tools to help other people do the above?

Please be more specific.

Thanks for the replies! I'll check those sites out! And to be more specific I want to create graphics if that helps.

What language are you using?
I assume that you want to do some simple startup stuff like displaying a 2D image or something?

I'm using C++ but im new to programming so I only know a little bit of it.

The jump from text based console applications to graphics is always a steep one.
You will typically have to install a graphics API since C++ itself dont have any support for graphics, sound, networking etc.
Windows GDI does have what you need, but its a realy old API and it does not use accelerated graphics.
SDL and Allegro is both 2D API's that are known to be beginner friendly.
SDL would be my best tip. Google should give you some good tutorials.
Unfortunately their main site seems to be down for the moment :/

Thanks for the info! I'll try it out!