megenginelite.global_setting

class LiteGlobal

Some global config in lite

static clear_memory_pair(vir_ptr, phy_ptr, device, backend=LiteBackend.LITE_DEFAULT)

Clear the physical and virtual address pair in MegEngine.

Parameters:

• vir_ptr – the virtual ptr to set to MegEngine.

• phy_ptr – the physical ptr to set to MegEngine.

• device – the the device to set the pair memory.

• backend – the backend to set the pair memory.

Returns:

Whether the clear is operation successful.

static dump_persistent_cache(path)

Dump the PersistentCache policy cache to the specific file. If the network is set to profile when forward, though this the algo policy will dump to file.

Parameters:

path – the cache file path to be dumped.

static dump_tensorrt_cache()

Dump the TensorRT cache to the file set in set_tensorrt_cache.

static get_device_count(device_type)

Get the number of device of the given device type in current context.

Parameters:

device_type – the device type to be counted.

Returns:

the number of device.

static lookup_physic_ptr(vir_ptr, device, backend=LiteBackend.LITE_DEFAULT)

Get the physic address by the virtual address in MegEngine.

Parameters:

• vir_ptr – the virtual ptr to set to MegEngine.

• device – the the device to set the pair memory.

• backend – the backend to set the pair memory.

Returns:

The physic address to lookup.

static register_decryption_and_key(decryption_name, decryption_func, key)

Register a custom decryption method and key to lite

Parameters:

• decryption_name – the name of the decryption, which will act as the hash key to find the decryption method.

• decryption_func – the decryption function, which will decrypt the model with the registered key, then return the decrypted model. See decryption_func for more details.

• key – the decryption key of the method.

static register_memory_pair(vir_ptr, phy_ptr, length, device, backend=LiteBackend.LITE_DEFAULT)

Register the physical and virtual address pair to the MegEngine, some device need the map from physical to virtual.

Parameters:

• vir_ptr – the virtual ptr to set to MegEngine.

• phy_ptr – the physical ptr to set to MegEngine.

• length – the length of bytes to set pair memory.

• device – the the device to set the pair memory.

• backend – the backend to set the pair memory

Returns:

Whether the register operation is successful.

static set_loader_lib_path(path)

Set the loader path to be used in lite.

Parameters:

path – the file path which store the loader library.

static set_persistent_cache(path, always_sync=False)

Set the algo policy cache file for CPU/CUDA, the algo policy cache is produced by MegEngine fast-run.

Parameters:

• path – the file path which store the cache.

• always_sync – always update the cache file when model runs.

static set_tensorrt_cache(path)

Set the TensorRT engine cache path for serialized prebuilt ICudaEngine.

Parameters:

path – the cache file path to set

static try_coalesce_all_free_memory()

Try to coalesce all free memory in MegEngine. When call it MegEnine Lite will try to free all the unused memory thus decrease the runtime memory usage.

static update_decryption_key(decryption_name, key)

Update decryption key of a custom decryption method.

Parameters:

• decrypt_name – the name of the decryption, which will act as the hash key to find the decryption method.

• key – the decryption key of the method, if the length of key is zero, the key will not be updated.