I figured it out:
First, add this relationship to the Project model:
has_many :task_assignments, through: :tasks
Then use this query:
Project.includes(:task_assignments).where("task_assignments.user_id = #{user_id}").references(:task_assignments)