PostgreSQL is powerful and widely compatible, supporting the complete SQL standard, including transactions, foreign keys, ...

Here's a quick JDBC with HSQLDB tutorial to get you up and running with Java database connectivity and the popular HyperSQL database.