All data is kept in the database.  The database consists of a set of files on your hard disk.  You can set up more than one database, but most users won't need to.