Ok, what I did was the following:
edit /usr/local/zend/etc/conf.d/json.ini and comment out the line that loads the json.so file
PHP doesn't throw errors at that point.
JSON support still seems enabled as far as I can see.
php -i | grep "json support"
json support => enabled