The JSTL SQL tag library makes use of JDBC to connect to a database (also note that JSTL SQL is designed for quick prototyping, not real applications).
JDBC is an abstraction layer over any database. The actual details of the underlying database are handled by a specific driver.
To use SQLite you could give this driver a try.