Here's how I solved it using CoffeeScript:
$('#date-range').submit ->
$(this).find('input[id*="display"]').each ->
$(this).remove()
But an even better solution posed by @StuR is to set an empty value for the name
attribute:
<%= form_tag stats_path, :method => 'get', :id => "date-range" do %>
<%= hidden_field_tag :start_date %>
<%= text_field_tag :start_date_display, '', :name => nil %>
<%= hidden_field_tag :end_date %>
<%= text_field_tag :end_date_display, '', :name => nil %>
<%= submit_tag "Run it!" %>
<% end %>