Sadly, it seems external latex packages like algorithmicx aren't supported (https://github.com/ipython/ipython/issues/6524).
One way you can extend your ability to hack latex together in that environment is IPython.display.Latex. With it you can dynamically create a string and display it as Latex. Not as convenient as what you're looking for, but might suffice for some use cases.