TsavoriteKV AccessViolationException When Loading Larger Data Sets

[orcohennn]

Hi,
We are using TsavoriteKV in our service with basic session functions and a simple implementation, where data is written using local device (writing to temporary directory). The key type is Guid, and the value is a struct containing two strings.

During service startup, we load data into the store using the Upsert operation. When loading a small amount of data, everything works as expected, and the data appears correctly when read from the store.

However, when loading a larger dataset, the service throws the following error when trying to access the value we get from the read operation:
Fatal error. System.AccessViolationException: Attempted to read or write protected memory. This is often an indication that other memory is corrupt. Additionally, a NullReferenceException sometimes occurs when attempting to retrieve the value's content.
In this case, we are utilizing disk storage, and the data volume is not excessively large (~150K records, totaling no more than 50MB).

Do you have any insights or suggestions on how to resolve this issue?
Thanks!

[badrishc]

TsavoriteKV is mostly meant to be used from Garnet, as it is usually really hard for users to configure TsavoriteKV directly. Could you try to ingest the same data via the Garnet remote API (RESP SET is the API version of Upsert) and see if you can hit the problem.