Вопрос

I'm trying to play with Hadoop on Azure using HDInsight, but am a bit confused on how to run a Hadoop job on my newly created cluster. So far I've created an HDInsight cluster and attached a Storage Account to it. I also have the azure-cli installed on my local OS X box.

There's an Azure tutorial on launching Hadoop jobs, but it uses PowerShell, which I don't think is available via the Azure cross-platform CLI.

Aside form starting up a Windows VirtualBox, can a job get created via the Azure Web UI (e.g. like Amazon EMR provides) or via some other command line arguments that would be compatible with OS X?

Thanks

Это было полезно?

Решение

  1. Login using Remote Desktop Protocol into the head node of the cluster and use CLI tools there.
  2. Or submit jobs using WebHCatalog REST APIs (e.g. using curl).

HDInsight currently has XPlat CLI tools for cluster provisioning. Job submission XPlat CLI tools will be available later.

Лицензировано под: CC-BY-SA с атрибуция
Не связан с StackOverflow
scroll top