We added a primary key to the table and that seemed to fix it.
Apparently IBObjects requires that you have a primary key.