From the documentation (System Tables and Limits):
For 32-bit TimesTen: Maximum number of rows in a table = 268,435,256
For 64-bit Timesten: Maximum number of rows in a table = 2,147,483,647
There is no specific limit on the 'size' of a table in terms of data stored but there are related limits. Please consult the documentation for full details.