Read manual for your RDBMS (you have not specified it). Typically circular cascade forbidden - you will get an error on create.
UPDATED: try http://sqlfiddle.com/#!1/24df4/2/0 It seems it is not forbidden - remove recursively.
Someone very kind minused me, because i have fixed the tags and it makes my post incorrect)