Pergunta

I'm trying to play with Hadoop on Azure using HDInsight, but am a bit confused on how to run a Hadoop job on my newly created cluster. So far I've created an HDInsight cluster and attached a Storage Account to it. I also have the azure-cli installed on my local OS X box.

There's an Azure tutorial on launching Hadoop jobs, but it uses PowerShell, which I don't think is available via the Azure cross-platform CLI.

Aside form starting up a Windows VirtualBox, can a job get created via the Azure Web UI (e.g. like Amazon EMR provides) or via some other command line arguments that would be compatible with OS X?

Thanks

Foi útil?

Solução

  1. Login using Remote Desktop Protocol into the head node of the cluster and use CLI tools there.
  2. Or submit jobs using WebHCatalog REST APIs (e.g. using curl).

HDInsight currently has XPlat CLI tools for cluster provisioning. Job submission XPlat CLI tools will be available later.

Licenciado em: CC-BY-SA com atribuição
Não afiliado a StackOverflow
scroll top