Have you tried exporting your custom UTI type in the .plist file? Take a look at UTExportedTypeDeclarations in Apple's docs. Should be something like this:
<key>UTExportedTypeDeclarations</key>
<array>
<dict>
<key>UTTypeDescription</key>
<string>My file type</string>
<key>UTTypeConformsTo</key>
<array>
<string>public.data</string> // ... or whatever you want it to conform to
</array>
<key>UTTypeIdentifier</key>
<string>com.mycompany.myapp</string>
<key>UTTypeTagSpecification</key>
<dict>
<key>public.filename-extension</key>
<array>
<string>dotpaint</string>
</array>
</dict>
</dict>
</array>