Try using the document's directory. You can access it like this:
NSArray *directoryPath = NSSearchPathForDirectoriesInDomains(NSDocumentDirectory, NSUserDomainMask, YES);
NSString *directory = [directoryPath objectAtIndex:0];
You should be free to add/remove files/directories to your hearts content here.