The "rows" column in the EXPLAIN output is an estimate of the number of rows that need to be examined.
Whether or not the query will actually need to examine every row in the table really depends on the access plan (shown in other columns in the EXPLAIN output. For example, an index range scan operation doesn't have to look at EVERY row, only the rows in particular index range. But a full scan operation will look at EVERY row in the table.
Your question cannot be answered based on the value returned in the "rows" column; we'd really need to see the output from EXPLAIN to determine whether MySQL is using an index range scan or not.