Jerel Unruh put together a video all about this:
http://www.youtube.com/watch?v=Te61OzHK400
Really you just enter your Amazon credentials into the settings area, then hook a folder up with the bucket. All images will be sent to S3 and cached locally, and work identically to local files.