If you're using Eclipse, create a project for each library and add it to your app:
Create a new Library Project for the License Verification Library and Downloader Library. For each library: Begin a new Android project. Select Create project from existing source and choose the library from the /extras/google/ directory (market_licensing/ for the License Verification Library or market_apk_expansion/downloader_library/ for the Downloader Library). Specify a Project Name such as "Google Play License Library" and "Google Play Downloader Library" Click Finish. Note: The Downloader Library depends on the License Verification Library. Be sure to add the License Verification Library to the Downloader Library's project properties (same process as steps 2 and 3 below). Right-click the Android project in which you want to use APK expansion files and select Properties. In the Library panel, click Add to select and add each of the libraries to your application.
http://developer.android.com/google/play/expansion-files.html#AboutLibraries
And actually I just ignored the bit about "Specify a Prject Name such as ..." I just used the default names the gui came up with.